2025-05-08 13:39:56,559 [INFO ] [logger.py:dumpArgs:73]	 Starting with arguments
{"name": "celeba", "dataset": {"path": "../../datasets/CelebAMask/256/img", "lists_root": "datasets/celeba", "targets": ["Smiling"], "attributes_path": "../../datasets/CelebAMask/1024/CelebAMask-HQ-attribute-anno.txt"}, "output": "./models/celeba/Smiling/", "seed": 1337, "verbose": 1, "cuda_index": 1, "learning_rate": 0.0001, "training_iterations": 1000, "batch_size": 250, "validate_every": 10, "patience": 5, "classification": false, "evaluate_training": false, "loss": "BCELogits", "input": null, "architecture": {"name": "resnet", "momentum": 0.01, "track_running_stats": false, "activation": "identity"}, "layers": []}
2025-05-08 13:39:56,560 [INFO ] [learn_neural_network.py:<module>:60]	 Starting to train celeba
2025-05-08 13:39:56,560 [INFO ] [loader.py:getDatasetSplits:23]	 Loading CelebA dataset from ../../datasets/CelebAMask/256/img
2025-05-08 13:40:00,953 [INFO ] [celeba.py:createCelebADataset:139]	 Found 1 CelebA attributes for 30000 images: ['Smiling']
2025-05-08 13:40:01,003 [INFO ] [celeba.py:createCelebADataset:149]	 Loading 26000 training images, 2000 validation images, and 2000 testing images
2025-05-08 13:40:01,004 [INFO ] [learn_neural_network.py:<module>:71]	 Constructing neural network
2025-05-08 13:40:01,004 [INFO ] [loader.py:_ensureNumClassesSet:22]	 Constructing ResNet with 1 targets
2025-05-08 13:40:01,164 [INFO ] [learn_neural_network.py:<module>:84]	 Network has 11177025 parameters
2025-05-08 13:40:01,192 [INFO ] [util.py:selectDevice:85]	 Using cuda:1 for tensor calculations
2025-05-08 13:40:18,708 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 17.28410 seconds
2025-05-08 13:40:18,729 [INFO ] [learn_neural_network.py:<module>:108]	 Initial validation error 8.020645e-01
2025-05-08 13:40:18,729 [INFO ] [learn_neural_network.py:<module>:111]	 Starting network learning
2025-05-08 13:44:18,818 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 1/1000 in 240.07319 seconds - error: 1.966364e-01
2025-05-08 13:44:18,818 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 13:44:18,818 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 1 to ./models/celeba/Smiling/celeba-20250508-133956-1.pklz
2025-05-08 13:44:25,061 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 4.61017 seconds
2025-05-08 13:44:25,061 [INFO ] [learn_neural_network.py:<module>:159]	 Worsening on valid 1.301374e+00 > prev best 8.020645e-01
2025-05-08 13:45:20,901 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 2/1000 in 55.83955 seconds - error: 9.777791e-02
2025-05-08 13:46:16,541 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 3/1000 in 55.64017 seconds - error: 4.993504e-02
2025-05-08 13:47:12,413 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 4/1000 in 55.87227 seconds - error: 1.519648e-02
2025-05-08 13:48:09,044 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 5/1000 in 56.63066 seconds - error: 1.309001e-02
2025-05-08 13:49:05,045 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 6/1000 in 56.00114 seconds - error: 2.710108e-03
2025-05-08 13:50:02,294 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 7/1000 in 57.24826 seconds - error: 1.191763e-03
2025-05-08 13:50:58,837 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 8/1000 in 56.54339 seconds - error: 4.832968e-04
2025-05-08 13:51:55,052 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 9/1000 in 56.21414 seconds - error: 3.255744e-04
2025-05-08 13:52:51,047 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 10/1000 in 55.99565 seconds - error: 2.407716e-04
2025-05-08 13:53:47,815 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 11/1000 in 56.76745 seconds - error: 2.089309e-04
2025-05-08 13:53:47,815 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 13:53:47,816 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 11 to ./models/celeba/Smiling/celeba-20250508-133956-11.pklz
2025-05-08 13:53:52,306 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 2.89783 seconds
2025-05-08 13:53:52,306 [INFO ] [learn_neural_network.py:<module>:166]	 Found new best model with error 4.192154e-01 < prev best 8.020645e-01
2025-05-08 13:54:49,051 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 12/1000 in 56.73839 seconds - error: 1.678171e-04
2025-05-08 13:55:45,836 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 13/1000 in 56.78456 seconds - error: 1.611921e-04
2025-05-08 13:56:41,990 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 14/1000 in 56.15323 seconds - error: 1.350363e-04
2025-05-08 13:57:37,811 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 15/1000 in 55.82164 seconds - error: 1.188936e-04
2025-05-08 13:58:35,194 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 16/1000 in 57.38223 seconds - error: 1.078102e-04
2025-05-08 13:59:31,641 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 17/1000 in 56.44715 seconds - error: 9.169107e-05
2025-05-08 14:00:27,401 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 18/1000 in 55.76006 seconds - error: 8.032969e-05
2025-05-08 14:01:24,322 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 19/1000 in 56.92048 seconds - error: 7.916567e-05
2025-05-08 14:02:21,411 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 20/1000 in 57.08878 seconds - error: 8.325481e-05
2025-05-08 14:03:17,470 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 21/1000 in 56.05931 seconds - error: 7.064018e-05
2025-05-08 14:03:17,470 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 14:03:17,471 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 21 to ./models/celeba/Smiling/celeba-20250508-133956-21.pklz
2025-05-08 14:03:22,192 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 3.12386 seconds
2025-05-08 14:03:22,192 [INFO ] [learn_neural_network.py:<module>:166]	 Found new best model with error 3.825388e-01 < prev best 4.192154e-01
2025-05-08 14:04:18,453 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 22/1000 in 56.25448 seconds - error: 5.798058e-05
2025-05-08 14:05:14,514 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 23/1000 in 56.06176 seconds - error: 6.763326e-05
2025-05-08 14:06:11,816 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 24/1000 in 57.30114 seconds - error: 5.422556e-05
2025-05-08 14:07:09,120 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 25/1000 in 57.30453 seconds - error: 5.110844e-05
2025-05-08 14:08:06,143 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 26/1000 in 57.02268 seconds - error: 4.506037e-05
2025-05-08 14:09:03,598 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 27/1000 in 57.45475 seconds - error: 4.487768e-05
2025-05-08 14:10:00,243 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 28/1000 in 56.64512 seconds - error: 4.073901e-05
2025-05-08 14:10:55,643 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 29/1000 in 55.39966 seconds - error: 3.487515e-05
2025-05-08 14:11:52,966 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 30/1000 in 57.32276 seconds - error: 3.106806e-05
2025-05-08 14:12:49,602 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 31/1000 in 56.63546 seconds - error: 3.143889e-05
2025-05-08 14:12:49,602 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 14:12:49,602 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 31 to ./models/celeba/Smiling/celeba-20250508-133956-31.pklz
2025-05-08 14:12:54,056 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 2.86943 seconds
2025-05-08 14:12:54,056 [INFO ] [learn_neural_network.py:<module>:166]	 Found new best model with error 3.562064e-01 < prev best 3.825388e-01
2025-05-08 14:13:50,732 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 32/1000 in 56.67072 seconds - error: 2.814491e-05
2025-05-08 14:14:47,931 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 33/1000 in 57.19913 seconds - error: 2.721644e-05
2025-05-08 14:15:43,833 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 34/1000 in 55.90166 seconds - error: 2.608772e-05
2025-05-08 14:16:41,333 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 35/1000 in 57.50031 seconds - error: 2.865691e-05
2025-05-08 14:17:38,553 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 36/1000 in 57.21942 seconds - error: 2.122018e-05
2025-05-08 14:18:35,675 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 37/1000 in 57.12191 seconds - error: 2.414055e-05
2025-05-08 14:19:32,489 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 38/1000 in 56.81430 seconds - error: 2.170931e-05
2025-05-08 14:20:29,803 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 39/1000 in 57.31291 seconds - error: 1.921680e-05
2025-05-08 14:21:26,157 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 40/1000 in 56.35459 seconds - error: 2.432617e-05
2025-05-08 14:22:22,968 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 41/1000 in 56.81091 seconds - error: 1.749667e-05
2025-05-08 14:22:22,969 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 14:22:22,969 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 41 to ./models/celeba/Smiling/celeba-20250508-133956-41.pklz
2025-05-08 14:22:27,611 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 3.00002 seconds
2025-05-08 14:22:27,611 [INFO ] [learn_neural_network.py:<module>:166]	 Found new best model with error 3.143295e-01 < prev best 3.562064e-01
2025-05-08 14:23:23,544 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 42/1000 in 55.92718 seconds - error: 1.575837e-05
2025-05-08 14:24:19,145 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 43/1000 in 55.60068 seconds - error: 1.345275e-05
2025-05-08 14:25:15,280 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 44/1000 in 56.13533 seconds - error: 1.401814e-05
2025-05-08 14:26:11,572 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 45/1000 in 56.29117 seconds - error: 1.393583e-05
2025-05-08 14:27:07,383 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 46/1000 in 55.81119 seconds - error: 1.285268e-05
2025-05-08 14:28:03,588 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 47/1000 in 56.20468 seconds - error: 1.278722e-05
2025-05-08 14:29:00,077 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 48/1000 in 56.48966 seconds - error: 1.020750e-05
2025-05-08 14:29:56,191 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 49/1000 in 56.11303 seconds - error: 1.008467e-05
2025-05-08 14:30:52,392 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 50/1000 in 56.20101 seconds - error: 1.171878e-05
2025-05-08 14:31:49,102 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 51/1000 in 56.71022 seconds - error: 1.099740e-05
2025-05-08 14:31:49,102 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 14:31:49,103 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 51 to ./models/celeba/Smiling/celeba-20250508-133956-51.pklz
2025-05-08 14:31:53,628 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 2.93934 seconds
2025-05-08 14:31:53,628 [INFO ] [learn_neural_network.py:<module>:166]	 Found new best model with error 2.950924e-01 < prev best 3.143295e-01
2025-05-08 14:32:51,543 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 52/1000 in 57.90968 seconds - error: 9.445158e-06
2025-05-08 14:33:48,269 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 53/1000 in 56.72549 seconds - error: 8.753067e-06
2025-05-08 14:34:45,509 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 54/1000 in 57.23969 seconds - error: 7.713839e-06
2025-05-08 14:35:41,633 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 55/1000 in 56.12443 seconds - error: 7.668836e-06
2025-05-08 14:36:38,207 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 56/1000 in 56.57351 seconds - error: 7.821862e-06
2025-05-08 14:37:35,987 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 57/1000 in 57.78024 seconds - error: 6.416845e-06
2025-05-08 14:38:32,408 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 58/1000 in 56.42029 seconds - error: 6.260816e-06
2025-05-08 14:39:28,680 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 59/1000 in 56.27232 seconds - error: 5.650174e-06
2025-05-08 14:40:24,519 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 60/1000 in 55.83822 seconds - error: 5.929547e-06
2025-05-08 14:41:20,960 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 61/1000 in 56.44125 seconds - error: 5.876209e-06
2025-05-08 14:41:20,960 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 14:41:20,961 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 61 to ./models/celeba/Smiling/celeba-20250508-133956-61.pklz
2025-05-08 14:41:25,540 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 2.87976 seconds
2025-05-08 14:41:25,540 [INFO ] [learn_neural_network.py:<module>:159]	 Worsening on valid 3.007540e-01 > prev best 2.950924e-01
2025-05-08 14:42:22,484 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 62/1000 in 56.94392 seconds - error: 5.081122e-06
2025-05-08 14:43:22,262 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 63/1000 in 59.77769 seconds - error: 4.873683e-06
2025-05-08 14:44:18,843 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 64/1000 in 56.58129 seconds - error: 4.646357e-06
2025-05-08 14:45:15,906 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 65/1000 in 57.06259 seconds - error: 4.257675e-06
2025-05-08 14:46:12,785 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 66/1000 in 56.87895 seconds - error: 4.578232e-06
2025-05-08 14:47:09,945 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 67/1000 in 57.15987 seconds - error: 4.015437e-06
2025-05-08 14:48:07,704 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 68/1000 in 57.75835 seconds - error: 3.776412e-06
2025-05-08 14:49:04,542 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 69/1000 in 56.83778 seconds - error: 3.814741e-06
2025-05-08 14:50:00,791 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 70/1000 in 56.24895 seconds - error: 3.427596e-06
2025-05-08 14:50:57,556 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 71/1000 in 56.76522 seconds - error: 3.596885e-06
2025-05-08 14:50:57,556 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 14:50:57,557 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 71 to ./models/celeba/Smiling/celeba-20250508-133956-71.pklz
2025-05-08 14:51:02,119 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 2.92642 seconds
2025-05-08 14:51:02,119 [INFO ] [learn_neural_network.py:<module>:159]	 Worsening on valid 3.224513e-01 > prev best 2.950924e-01
2025-05-08 14:51:59,596 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 72/1000 in 57.47700 seconds - error: 3.168351e-06
2025-05-08 14:52:56,263 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 73/1000 in 56.66666 seconds - error: 2.828137e-06
2025-05-08 14:53:52,455 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 74/1000 in 56.19200 seconds - error: 2.922222e-06
2025-05-08 14:54:49,279 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 75/1000 in 56.82385 seconds - error: 2.531692e-06
2025-05-08 14:55:46,128 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 76/1000 in 56.84908 seconds - error: 2.628584e-06
2025-05-08 14:56:42,140 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 77/1000 in 56.01208 seconds - error: 2.443219e-06
2025-05-08 14:57:38,374 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 78/1000 in 56.23387 seconds - error: 2.393665e-06
2025-05-08 14:58:34,773 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 79/1000 in 56.39818 seconds - error: 2.116609e-06
2025-05-08 14:59:32,695 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 80/1000 in 57.92173 seconds - error: 2.056289e-06
2025-05-08 15:00:29,666 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 81/1000 in 56.97077 seconds - error: 1.950555e-06
2025-05-08 15:00:29,666 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 15:00:29,666 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 81 to ./models/celeba/Smiling/celeba-20250508-133956-81.pklz
2025-05-08 15:00:34,309 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 3.00213 seconds
2025-05-08 15:00:34,309 [INFO ] [learn_neural_network.py:<module>:159]	 Worsening on valid 3.088084e-01 > prev best 2.950924e-01
2025-05-08 15:01:31,244 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 82/1000 in 56.93432 seconds - error: 1.918278e-06
2025-05-08 15:02:28,821 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 83/1000 in 57.57782 seconds - error: 1.649493e-06
2025-05-08 15:03:26,426 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 84/1000 in 57.60391 seconds - error: 1.741794e-06
2025-05-08 15:04:23,184 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 85/1000 in 56.75816 seconds - error: 1.695485e-06
2025-05-08 15:05:20,289 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 86/1000 in 57.10465 seconds - error: 1.528861e-06
2025-05-08 15:06:17,756 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 87/1000 in 57.46746 seconds - error: 1.444997e-06
2025-05-08 15:07:13,706 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 88/1000 in 55.94968 seconds - error: 1.413190e-06
2025-05-08 15:08:10,485 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 89/1000 in 56.77875 seconds - error: 1.153554e-06
2025-05-08 15:09:07,291 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 90/1000 in 56.80621 seconds - error: 3.115882e-02
2025-05-08 15:10:03,748 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 91/1000 in 56.45647 seconds - error: 8.200374e-02
2025-05-08 15:10:03,748 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 15:10:03,748 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 91 to ./models/celeba/Smiling/celeba-20250508-133956-91.pklz
2025-05-08 15:10:08,278 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 2.95777 seconds
2025-05-08 15:10:08,278 [INFO ] [learn_neural_network.py:<module>:159]	 Worsening on valid 1.186227e+00 > prev best 2.950924e-01
2025-05-08 15:11:05,878 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 92/1000 in 57.59980 seconds - error: 1.357563e-02
2025-05-08 15:12:03,078 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 93/1000 in 57.19960 seconds - error: 6.676386e-03
2025-05-08 15:12:59,505 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 94/1000 in 56.42706 seconds - error: 8.644352e-03
2025-05-08 15:13:56,707 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 95/1000 in 57.20201 seconds - error: 2.566198e-03
2025-05-08 15:14:52,726 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 96/1000 in 56.01915 seconds - error: 8.669363e-04
2025-05-08 15:15:49,503 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 97/1000 in 56.77610 seconds - error: 5.832871e-04
2025-05-08 15:16:46,186 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 98/1000 in 56.68310 seconds - error: 6.828002e-04
2025-05-08 15:17:43,268 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 99/1000 in 57.08170 seconds - error: 1.363302e-04
2025-05-08 15:18:40,094 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 100/1000 in 56.82584 seconds - error: 7.570183e-05
2025-05-08 15:19:38,951 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 101/1000 in 58.85736 seconds - error: 5.581107e-05
2025-05-08 15:19:38,951 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 15:19:38,952 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 101 to ./models/celeba/Smiling/celeba-20250508-133956-101.pklz
2025-05-08 15:19:50,125 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 9.58008 seconds
2025-05-08 15:19:50,125 [INFO ] [learn_neural_network.py:<module>:159]	 Worsening on valid 8.904406e-01 > prev best 2.950924e-01
2025-05-08 15:20:48,810 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 102/1000 in 58.68488 seconds - error: 6.360617e-05
2025-05-08 15:21:44,260 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 103/1000 in 55.44987 seconds - error: 4.220880e-05
2025-05-08 15:22:38,463 [INFO ] [learn_neural_network.py:<module>:138]	 celeba iteration 104/1000 in 54.20264 seconds - error: 3.465346e-05
2025-05-08 15:22:38,463 [INFO ] [learn_neural_network.py:<module>:143]	 Evaluating the model via validation data
2025-05-08 15:22:38,464 [INFO ] [learn_neural_network.py:<module>:148]	 Saving model at iteration 104 to ./models/celeba/Smiling/celeba-20250508-133956-104.pklz
2025-05-08 15:22:45,606 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 5.63186 seconds
2025-05-08 15:22:45,606 [INFO ] [learn_neural_network.py:<module>:159]	 Worsening on valid 8.531859e-01 > prev best 2.950924e-01
2025-05-08 15:22:45,606 [INFO ] [learn_neural_network.py:<module>:161]	 Exceeding patience 5, stopping training
2025-05-08 15:22:45,606 [INFO ] [learn_neural_network.py:<module>:173]	 Network learning done in 6146.87683 secs
2025-05-08 15:22:45,622 [INFO ] [learn_neural_network.py:<module>:197]	 Saving model to ./models/celeba/Smiling/celeba-20250508-133956.pklz
2025-05-08 15:23:22,167 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 35.07369 seconds
2025-05-08 15:23:22,167 [INFO ] [regressor.py:evaluateDataLoaders:119]	 MSE for train is 0.10378368943929672:
tensor([0.1038])
2025-05-08 15:23:24,831 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 2.66326 seconds
2025-05-08 15:23:24,831 [INFO ] [regressor.py:evaluateDataLoaders:119]	 MSE for validate is 0.2950924038887024:
tensor([0.2951])
2025-05-08 15:23:27,958 [INFO ] [regressor.py:evaluateData:67]	 Evaluated regressor with data loader in 3.12632 seconds
2025-05-08 15:23:27,965 [INFO ] [regressor.py:evaluateDataLoaders:119]	 MSE for test is 0.4054335355758667:
tensor([0.4054])
