Requirement already satisfied: group-lasso in /home/users/yhung7/.local/lib/python3.13/site-packages (1.5.0)
Requirement already satisfied: xgboost in /home/users/yhung7/.local/lib/python3.13/site-packages (3.0.5)
Requirement already satisfied: numpy in /sysapps/ubuntu-applications/pytorch/2.7.0/venv/lib/python3.13/site-packages (from group-lasso) (2.1.2)
Requirement already satisfied: scikit-learn in /home/users/yhung7/.local/lib/python3.13/site-packages (from group-lasso) (1.6.1)
Requirement already satisfied: nvidia-nccl-cu12 in /sysapps/ubuntu-applications/pytorch/2.7.0/venv/lib/python3.13/site-packages (from xgboost) (2.26.2)
Requirement already satisfied: scipy in /home/users/yhung7/.local/lib/python3.13/site-packages (from xgboost) (1.15.3)
Requirement already satisfied: joblib>=1.2.0 in /home/users/yhung7/.local/lib/python3.13/site-packages (from scikit-learn->group-lasso) (1.5.0)
Requirement already satisfied: threadpoolctl>=3.1.0 in /home/users/yhung7/.local/lib/python3.13/site-packages (from scikit-learn->group-lasso) (3.6.0)
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 1 Active set:  [[0], [1], [2], [3]]
Repetition  1
Training DNN...
Early Stop at Epoch 59
Training ADNN...
Early Stop at Epoch 633
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 2 Active set:  [[0], [1], [2], [3]]
Repetition  2
Training DNN...
Early Stop at Epoch 269
Training ADNN...
Epoch 1000, MSE: 0.23700906336307526
Early Stop at Epoch 1273
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 3 Active set:  [[0], [1], [2], [3]]
Repetition  3
Training DNN...
Early Stop at Epoch 69
Training ADNN...
Early Stop at Epoch 191
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 4 Active set:  [[0], [1], [2], [3]]
Repetition  4
Training DNN...
Early Stop at Epoch 242
Training ADNN...
Early Stop at Epoch 505
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 5 Active set:  [[0], [1], [2], [3]]
Repetition  5
Training DNN...
Early Stop at Epoch 166
Training ADNN...
Early Stop at Epoch 941
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 6 Active set:  [[0], [1], [2], [3]]
Repetition  6
Training DNN...
Early Stop at Epoch 221
Training ADNN...
Early Stop at Epoch 487
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 7 Active set:  [[0], [1], [2], [3]]
Repetition  7
Training DNN...
Early Stop at Epoch 102
Training ADNN...
Early Stop at Epoch 966
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 8 Active set:  [[0], [1], [2], [3]]
Repetition  8
Training DNN...
Early Stop at Epoch 68
Training ADNN...
Early Stop at Epoch 518
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 9 Active set:  [[0], [1], [2], [3]]
Repetition  9
Training DNN...
Early Stop at Epoch 126
Training ADNN...
Early Stop at Epoch 709
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 10 Active set:  [[0], [1], [2], [3]]
Repetition  10
Training DNN...
Early Stop at Epoch 127
Training ADNN...
Epoch 1000, MSE: 0.7635917067527771
Early Stop at Epoch 1349
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 11 Active set:  [[0], [1], [2], [3]]
Repetition  11
Training DNN...
Early Stop at Epoch 70
Training ADNN...
Early Stop at Epoch 574
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 12 Active set:  [[0], [1], [2], [3]]
Repetition  12
Training DNN...
Early Stop at Epoch 132
Training ADNN...
Early Stop at Epoch 51
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Ain't Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 13 Active set:  [[0], [1], [2], [3], [1, 2]]
Repetition  13
Training DNN...
Early Stop at Epoch 299
Training ADNN...
Epoch 1000, MSE: 0.9143117666244507
Early Stop at Epoch 1218
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 14 Active set:  [[0], [1], [2], [3]]
Repetition  14
Training DNN...
Early Stop at Epoch 290
Training ADNN...
Early Stop at Epoch 891
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 15 Active set:  [[0], [1], [2], [3]]
Repetition  15
Training DNN...
Early Stop at Epoch 559
Training ADNN...
Early Stop at Epoch 902
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 16 Active set:  [[0], [1], [2], [3]]
Repetition  16
Training DNN...
Early Stop at Epoch 83
Training ADNN...
Early Stop at Epoch 389
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 17 Active set:  [[0], [1], [2], [3], [2, 3]]
Repetition  17
Training DNN...
Early Stop at Epoch 140
Training ADNN...
Early Stop at Epoch 751
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 18 Active set:  [[0], [1], [2], [3]]
Repetition  18
Training DNN...
Early Stop at Epoch 160
Training ADNN...
Epoch 1000, MSE: 0.8510231375694275
Early Stop at Epoch 1392
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 19 Active set:  [[0], [1], [2], [3], [1, 3]]
Repetition  19
Training DNN...
Early Stop at Epoch 58
Training ADNN...
Epoch 1000, MSE: 3.0382165908813477
Early Stop at Epoch 1059
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Ain't Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 20 Active set:  [[0], [1], [2], [3], [2, 3]]
Repetition  20
Training DNN...
Early Stop at Epoch 113
Training ADNN...
Early Stop at Epoch 641
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Ain't Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 21 Active set:  [[0], [1], [2], [3], [1, 3]]
Repetition  21
Training DNN...
Early Stop at Epoch 156
Training ADNN...
Early Stop at Epoch 426
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Ain't Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 22 Active set:  [[0], [1], [2], [3]]
Repetition  22
Training DNN...
Early Stop at Epoch 126
Training ADNN...
Early Stop at Epoch 704
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 23 Active set:  [[0], [1], [2], [3]]
Repetition  23
Training DNN...
Early Stop at Epoch 124
Training ADNN...
Early Stop at Epoch 533
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 24 Active set:  [[0], [1], [2], [3]]
Repetition  24
Training DNN...
Early Stop at Epoch 72
Training ADNN...
Early Stop at Epoch 961
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 25 Active set:  [[0], [1], [2], [3]]
Repetition  25
Training DNN...
Early Stop at Epoch 168
Training ADNN...
Epoch 1000, MSE: 0.3820432722568512
Early Stop at Epoch 1580
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 26 Active set:  [[0], [1], [2], [3]]
Repetition  26
Training DNN...
Early Stop at Epoch 129
Training ADNN...
Epoch 1000, MSE: 1.465385913848877
Early Stop at Epoch 1060
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 27 Active set:  [[0], [1], [2], [3]]
Repetition  27
Training DNN...
Early Stop at Epoch 188
Training ADNN...
Epoch 1000, MSE: 0.333194762468338
Early Stop at Epoch 1229
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 28 Active set:  [[0], [1], [2], [3]]
Repetition  28
Training DNN...
Early Stop at Epoch 268
Training ADNN...
Early Stop at Epoch 808
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Ain't Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 29 Active set:  [[0], [1], [2], [3]]
Repetition  29
Training DNN...
Early Stop at Epoch 67
Training ADNN...
Early Stop at Epoch 901
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 30 Active set:  [[0], [1], [2], [3]]
Repetition  30
Training DNN...
Early Stop at Epoch 83
Training ADNN...
Early Stop at Epoch 283
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 31 Active set:  [[0], [1], [2], [3]]
Repetition  31
Training DNN...
Early Stop at Epoch 988
Training ADNN...
Early Stop at Epoch 544
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 32 Active set:  [[0], [1], [2], [3], [0, 1], [0, 3], [1, 3]]
Repetition  32
Training DNN...
Early Stop at Epoch 196
Training ADNN...
Early Stop at Epoch 657
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 33 Active set:  [[0], [1], [2], [3]]
Repetition  33
Training DNN...
Early Stop at Epoch 162
Training ADNN...
Early Stop at Epoch 633
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 34 Active set:  [[0], [1], [2], [3]]
Repetition  34
Training DNN...
Early Stop at Epoch 212
Training ADNN...
Early Stop at Epoch 563
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 35 Active set:  [[0], [1], [2], [3]]
Repetition  35
Training DNN...
Early Stop at Epoch 301
Training ADNN...
Epoch 1000, MSE: 0.4013967514038086
Early Stop at Epoch 1063
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 36 Active set:  [[0], [1], [2], [3]]
Repetition  36
Training DNN...
Early Stop at Epoch 271
Training ADNN...
Early Stop at Epoch 397
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 37 Active set:  [[0], [1], [2], [3]]
Repetition  37
Training DNN...
Early Stop at Epoch 769
Training ADNN...
Early Stop at Epoch 634
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 38 Active set:  [[0], [1], [2], [3]]
Repetition  38
Training DNN...
Early Stop at Epoch 136
Training ADNN...
Early Stop at Epoch 848
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Ain't Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 39 Active set:  [[0], [1], [2], [3]]
Repetition  39
Training DNN...
Early Stop at Epoch 135
Training ADNN...
Early Stop at Epoch 500
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 40 Active set:  [[0], [1], [2], [3]]
Repetition  40
Training DNN...
Early Stop at Epoch 165
Training ADNN...
Early Stop at Epoch 215
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 41 Active set:  [[0], [1], [2], [3]]
Repetition  41
Training DNN...
Early Stop at Epoch 164
Training ADNN...
Early Stop at Epoch 283
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 42 Active set:  [[0], [1], [2], [3]]
Repetition  42
Training DNN...
Early Stop at Epoch 94
Training ADNN...
Epoch 1000, MSE: 0.24643823504447937
Early Stop at Epoch 1134
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 43 Active set:  [[0], [1], [2], [3], [0, 2]]
Repetition  43
Training DNN...
Early Stop at Epoch 87
Training ADNN...
Early Stop at Epoch 389
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 44 Active set:  [[0], [1], [2], [3]]
Repetition  44
Training DNN...
Early Stop at Epoch 95
Training ADNN...
Early Stop at Epoch 533
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 45 Active set:  [[0], [1], [2], [3]]
Repetition  45
Training DNN...
Early Stop at Epoch 61
Training ADNN...
Early Stop at Epoch 204
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 46 Active set:  [[0], [1], [2], [3]]
Repetition  46
Training DNN...
Early Stop at Epoch 118
Training ADNN...
Early Stop at Epoch 202
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 47 Active set:  [[0], [1], [2], [3]]
Repetition  47
Training DNN...
Early Stop at Epoch 152
Training ADNN...
Early Stop at Epoch 591
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 48 Active set:  [[0], [1], [2], [3]]
Repetition  48
Training DNN...
Early Stop at Epoch 149
Training ADNN...
Early Stop at Epoch 818
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Ain't Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 49 Active set:  [[0], [1], [2], [3]]
Repetition  49
Training DNN...
Early Stop at Epoch 64
Training ADNN...
Early Stop at Epoch 392
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 50 Active set:  [[0], [1], [2], [3]]
Repetition  50
Training DNN...
Early Stop at Epoch 108
Training ADNN...
Early Stop at Epoch 744
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 51 Active set:  [[0], [1], [2], [3]]
Repetition  51
Training DNN...
Early Stop at Epoch 210
Training ADNN...
Epoch 1000, MSE: 0.1574259102344513
Early Stop at Epoch 1010
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 52 Active set:  [[0], [1], [2], [3]]
Repetition  52
Training DNN...
Early Stop at Epoch 472
Training ADNN...
Early Stop at Epoch 770
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 53 Active set:  [[0], [1], [2], [3]]
Repetition  53
Training DNN...
Early Stop at Epoch 64
Training ADNN...
Early Stop at Epoch 703
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 54 Active set:  [[0], [1], [2], [3]]
Repetition  54
Training DNN...
Early Stop at Epoch 70
Training ADNN...
Early Stop at Epoch 889
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 55 Active set:  [[0], [1], [2], [3]]
Repetition  55
Training DNN...
Early Stop at Epoch 98
Training ADNN...
Early Stop at Epoch 531
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 56 Active set:  [[0], [1], [2], [3]]
Repetition  56
Training DNN...
Early Stop at Epoch 50
Training ADNN...
Early Stop at Epoch 699
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 57 Active set:  [[0], [1], [2], [3]]
Repetition  57
Training DNN...
Early Stop at Epoch 247
Training ADNN...
Early Stop at Epoch 783
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 58 Active set:  [[0], [1], [2], [3]]
Repetition  58
Training DNN...
Early Stop at Epoch 84
Training ADNN...
Epoch 1000, MSE: 0.21421483159065247
Early Stop at Epoch 1314
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 59 Active set:  [[0], [1], [2], [3], [1, 3]]
Repetition  59
Training DNN...
Early Stop at Epoch 208
Training ADNN...
Early Stop at Epoch 859
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 60 Active set:  [[0], [1], [2], [3]]
Repetition  60
Training DNN...
Early Stop at Epoch 165
Training ADNN...
Epoch 1000, MSE: 0.2491767704486847
Early Stop at Epoch 1089
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 61 Active set:  [[0], [1], [2], [3]]
Repetition  61
Training DNN...
Early Stop at Epoch 165
Training ADNN...
Early Stop at Epoch 633
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 62 Active set:  [[0], [1], [2], [3]]
Repetition  62
Training DNN...
Early Stop at Epoch 94
Training ADNN...
Early Stop at Epoch 938
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 63 Active set:  [[0], [1], [2], [3]]
Repetition  63
Training DNN...
Early Stop at Epoch 291
Training ADNN...
Early Stop at Epoch 273
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 64 Active set:  [[0], [1], [2], [3]]
Repetition  64
Training DNN...
Early Stop at Epoch 107
Training ADNN...
Early Stop at Epoch 533
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 65 Active set:  [[0], [1], [2], [3]]
Repetition  65
Training DNN...
Early Stop at Epoch 65
Training ADNN...
Early Stop at Epoch 891
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 66 Active set:  [[0], [1], [2], [3]]
Repetition  66
Training DNN...
Early Stop at Epoch 147
Training ADNN...
Early Stop at Epoch 530
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 67 Active set:  [[0], [1], [2], [3]]
Repetition  67
Training DNN...
Early Stop at Epoch 99
Training ADNN...
Early Stop at Epoch 304
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 68 Active set:  [[0], [1], [2], [3]]
Repetition  68
Training DNN...
Early Stop at Epoch 131
Training ADNN...
Early Stop at Epoch 911
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 69 Active set:  [[0], [1], [2], [3]]
Repetition  69
Training DNN...
Early Stop at Epoch 136
Training ADNN...
Early Stop at Epoch 239
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 70 Active set:  [[0], [1], [2], [3]]
Repetition  70
Training DNN...
Early Stop at Epoch 180
Training ADNN...
Early Stop at Epoch 876
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 71 Active set:  [[0], [1], [2], [3]]
Repetition  71
Training DNN...
Early Stop at Epoch 187
Training ADNN...
Epoch 1000, MSE: 0.5723795294761658
Early Stop at Epoch 1413
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 72 Active set:  [[0], [1], [2], [3]]
Repetition  72
Training DNN...
Early Stop at Epoch 98
Training ADNN...
Epoch 1000, MSE: 2.1237399578094482
Early Stop at Epoch 1548
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 73 Active set:  [[0], [1], [2], [3]]
Repetition  73
Training DNN...
Early Stop at Epoch 75
Training ADNN...
Early Stop at Epoch 940
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 74 Active set:  [[0], [1], [2], [3]]
Repetition  74
Training DNN...
Early Stop at Epoch 198
Training ADNN...
Early Stop at Epoch 806
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 75 Active set:  [[0], [1], [2], [3]]
Repetition  75
Training DNN...
Epoch 1000, MSE: 12.260865211486816
Epoch 2000, MSE: 12.19454574584961
Epoch 3000, MSE: 12.19454574584961
Epoch 4000, MSE: 12.19454574584961
Epoch 5000, MSE: 12.19454574584961
Epoch 6000, MSE: 12.19454574584961
Epoch 7000, MSE: 12.19454574584961
Epoch 8000, MSE: 12.19454574584961
Epoch 9000, MSE: 12.19454574584961
Epoch 10000, MSE: 12.19454574584961
Training ADNN...
Early Stop at Epoch 500
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 76 Active set:  [[0], [1], [2], [3]]
Repetition  76
Training DNN...
Early Stop at Epoch 165
Training ADNN...
Early Stop at Epoch 459
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 77 Active set:  [[0], [1], [2], [3]]
Repetition  77
Training DNN...
Early Stop at Epoch 238
Training ADNN...
Early Stop at Epoch 630
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 78 Active set:  [[0], [1], [2], [3], [2, 3]]
Repetition  78
Training DNN...
Early Stop at Epoch 74
Training ADNN...
Early Stop at Epoch 796
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 79 Active set:  [[0], [1], [2], [3]]
Repetition  79
Training DNN...
Early Stop at Epoch 61
Training ADNN...
Early Stop at Epoch 626
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 80 Active set:  [[0], [1], [2], [3]]
Repetition  80
Training DNN...
Early Stop at Epoch 149
Training ADNN...
Early Stop at Epoch 613
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 81 Active set:  [[0], [1], [2], [3]]
Repetition  81
Training DNN...
Early Stop at Epoch 187
Training ADNN...
Early Stop at Epoch 479
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 82 Active set:  [[0], [1], [2], [3]]
Repetition  82
Training DNN...
Early Stop at Epoch 242
Training ADNN...
Early Stop at Epoch 794
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 83 Active set:  [[0], [1], [2], [3]]
Repetition  83
Training DNN...
Early Stop at Epoch 108
Training ADNN...
Early Stop at Epoch 917
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 84 Active set:  [[0], [1], [2], [3]]
Repetition  84
Training DNN...
Early Stop at Epoch 153
Training ADNN...
Epoch 1000, MSE: 1.3708627223968506
Early Stop at Epoch 1191
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 85 Active set:  [[0], [1], [2], [3]]
Repetition  85
Training DNN...
Early Stop at Epoch 188
Training ADNN...
Early Stop at Epoch 563
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 86 Active set:  [[0], [1], [2], [3]]
Repetition  86
Training DNN...
Early Stop at Epoch 56
Training ADNN...
Early Stop at Epoch 942
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 87 Active set:  [[0], [1], [2], [3]]
Repetition  87
Training DNN...
Early Stop at Epoch 55
Training ADNN...
Epoch 1000, MSE: 0.2757188677787781
Early Stop at Epoch 1121
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 88 Active set:  [[0], [1], [2], [3]]
Repetition  88
Training DNN...
Early Stop at Epoch 50
Training ADNN...
Early Stop at Epoch 565
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 89 Active set:  [[0], [1], [2], [3]]
Repetition  89
Training DNN...
Epoch 1000, MSE: 13.64387035369873
Epoch 2000, MSE: 13.643792152404785
Epoch 3000, MSE: 13.643725395202637
Epoch 4000, MSE: 13.643596649169922
Epoch 5000, MSE: 13.643436431884766
Epoch 6000, MSE: 13.643278121948242
Epoch 7000, MSE: 13.643098831176758
Epoch 8000, MSE: 13.642924308776855
Epoch 9000, MSE: 13.642762184143066
Epoch 10000, MSE: 13.64260196685791
Training ADNN...
Early Stop at Epoch 658
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 90 Active set:  [[0], [1], [2], [3], [2, 3]]
Repetition  90
Training DNN...
Early Stop at Epoch 72
Training ADNN...
Early Stop at Epoch 255
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 91 Active set:  [[0], [1], [2], [3], [0, 3]]
Repetition  91
Training DNN...
Early Stop at Epoch 93
Training ADNN...
Early Stop at Epoch 652
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 92 Active set:  [[0], [1], [2], [3]]
Repetition  92
Training DNN...
Early Stop at Epoch 121
Training ADNN...
Early Stop at Epoch 703
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 93 Active set:  [[0], [1], [2], [3]]
Repetition  93
Training DNN...
Early Stop at Epoch 74
Training ADNN...
Early Stop at Epoch 815
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 94 Active set:  [[0], [1], [2], [3]]
Repetition  94
Training DNN...
Early Stop at Epoch 84
Training ADNN...
Epoch 1000, MSE: 0.1494939923286438
Early Stop at Epoch 1293
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 95 Active set:  [[0], [1], [2], [3]]
Repetition  95
Training DNN...
Early Stop at Epoch 92
Training ADNN...
Early Stop at Epoch 865
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 96 Active set:  [[0], [1], [2], [3]]
Repetition  96
Training DNN...
Early Stop at Epoch 160
Training ADNN...
Early Stop at Epoch 907
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 97 Active set:  [[0], [1], [2], [3]]
Repetition  97
Training DNN...
Early Stop at Epoch 116
Training ADNN...
Epoch 1000, MSE: 0.668878972530365
Early Stop at Epoch 1083
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 98 Active set:  [[0], [1], [2], [3]]
Repetition  98
Training DNN...
Early Stop at Epoch 150
Training ADNN...
Early Stop at Epoch 731
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 99 Active set:  [[0], [1], [2], [3]]
Repetition  99
Training DNN...
Early Stop at Epoch 130
Training ADNN...
Epoch 1000, MSE: 0.8655798435211182
Early Stop at Epoch 1005
Generating only_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 100 Active set:  [[0], [1], [2], [3]]
Repetition  100
Training DNN...
Early Stop at Epoch 141
Training ADNN...
Early Stop at Epoch 661
