Requirement already satisfied: group-lasso in /home/users/yhung7/.local/lib/python3.13/site-packages (1.5.0)
Requirement already satisfied: xgboost in /home/users/yhung7/.local/lib/python3.13/site-packages (3.0.5)
Requirement already satisfied: numpy in /sysapps/ubuntu-applications/pytorch/2.7.0/venv/lib/python3.13/site-packages (from group-lasso) (2.1.2)
Requirement already satisfied: scikit-learn in /home/users/yhung7/.local/lib/python3.13/site-packages (from group-lasso) (1.6.1)
Requirement already satisfied: nvidia-nccl-cu12 in /sysapps/ubuntu-applications/pytorch/2.7.0/venv/lib/python3.13/site-packages (from xgboost) (2.26.2)
Requirement already satisfied: scipy in /home/users/yhung7/.local/lib/python3.13/site-packages (from xgboost) (1.15.3)
Requirement already satisfied: joblib>=1.2.0 in /home/users/yhung7/.local/lib/python3.13/site-packages (from scikit-learn->group-lasso) (1.5.0)
Requirement already satisfied: threadpoolctl>=3.1.0 in /home/users/yhung7/.local/lib/python3.13/site-packages (from scikit-learn->group-lasso) (3.6.0)
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 1 Active set:  [[0], [1], [2]]
Repetition  1
Training DNN...
Early Stop at Epoch 81
Training ADNN...
Early Stop at Epoch 600
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 2 Active set:  [[0], [1], [2]]
Repetition  2
Training DNN...
Early Stop at Epoch 214
Training ADNN...
Early Stop at Epoch 772
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 3 Active set:  [[0], [1], [2]]
Repetition  3
Training DNN...
Early Stop at Epoch 100
Training ADNN...
Early Stop at Epoch 578
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 4 Active set:  [[0], [1], [2]]
Repetition  4
Training DNN...
Early Stop at Epoch 139
Training ADNN...
Early Stop at Epoch 727
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 5 Active set:  [[0], [1], [2], [0, 1], [1, 2]]
Repetition  5
Training DNN...
Early Stop at Epoch 159
Training ADNN...
Early Stop at Epoch 226
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 6 Active set:  [[0], [1], [2]]
Repetition  6
Training DNN...
Early Stop at Epoch 100
Training ADNN...
Epoch 1000, MSE: 2.564720392227173
Early Stop at Epoch 1572
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 7 Active set:  [[0], [1], [2]]
Repetition  7
Training DNN...
Early Stop at Epoch 103
Training ADNN...
Early Stop at Epoch 894
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 8 Active set:  [[0], [1], [2]]
Repetition  8
Training DNN...
Early Stop at Epoch 78
Training ADNN...
Early Stop at Epoch 322
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 9 Active set:  [[0], [1], [2]]
Repetition  9
Training DNN...
Early Stop at Epoch 75
Training ADNN...
Early Stop at Epoch 355
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 10 Active set:  [[0], [1], [2]]
Repetition  10
Training DNN...
Early Stop at Epoch 92
Training ADNN...
Epoch 1000, MSE: 0.19297467172145844
Early Stop at Epoch 1073
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 11 Active set:  [[0], [1], [2]]
Repetition  11
Training DNN...
Early Stop at Epoch 243
Training ADNN...
Early Stop at Epoch 483
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 12 Active set:  [[0], [1], [2]]
Repetition  12
Training DNN...
Early Stop at Epoch 63
Training ADNN...
Early Stop at Epoch 703
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 13 Active set:  [[0], [1], [2], [0, 1], [1, 2]]
Repetition  13
Training DNN...
Early Stop at Epoch 139
Training ADNN...
Early Stop at Epoch 457
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 14 Active set:  [[0], [1], [2]]
Repetition  14
Training DNN...
Early Stop at Epoch 97
Training ADNN...
Early Stop at Epoch 461
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 15 Active set:  [[0], [1], [2]]
Repetition  15
Training DNN...
Epoch 1000, MSE: 5.697561740875244
Epoch 2000, MSE: 5.697561740875244
Epoch 3000, MSE: 5.697561740875244
Epoch 4000, MSE: 5.697561740875244
Epoch 5000, MSE: 5.697561740875244
Epoch 6000, MSE: 5.697561740875244
Epoch 7000, MSE: 5.697561740875244
Epoch 8000, MSE: 5.697561740875244
Epoch 9000, MSE: 5.697561740875244
Epoch 10000, MSE: 5.697561740875244
Training ADNN...
Early Stop at Epoch 915
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 16 Active set:  [[0], [1], [2]]
Repetition  16
Training DNN...
Early Stop at Epoch 106
Training ADNN...
Early Stop at Epoch 667
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 17 Active set:  [[0], [1], [2]]
Repetition  17
Training DNN...
Early Stop at Epoch 137
Training ADNN...
Early Stop at Epoch 715
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 18 Active set:  [[0], [1], [2]]
Repetition  18
Training DNN...
Early Stop at Epoch 161
Training ADNN...
Early Stop at Epoch 670
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 19 Active set:  [[0], [1], [2]]
Repetition  19
Training DNN...
Early Stop at Epoch 50
Training ADNN...
Epoch 1000, MSE: 2.424612283706665
Early Stop at Epoch 1152
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 20 Active set:  [[0], [1], [2]]
Repetition  20
Training DNN...
Early Stop at Epoch 113
Training ADNN...
Epoch 1000, MSE: 1.8833966255187988
Epoch 2000, MSE: 1.4486526250839233
Epoch 3000, MSE: 0.8909600377082825
Epoch 4000, MSE: 0.41927745938301086
Early Stop at Epoch 4581
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 21 Active set:  [[0], [1], [2]]
Repetition  21
Training DNN...
Early Stop at Epoch 121
Training ADNN...
Early Stop at Epoch 467
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 22 Active set:  [[0], [1], [2]]
Repetition  22
Training DNN...
Early Stop at Epoch 87
Training ADNN...
Early Stop at Epoch 373
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 23 Active set:  [[0], [1], [2]]
Repetition  23
Training DNN...
Early Stop at Epoch 74
Training ADNN...
Early Stop at Epoch 285
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 24 Active set:  [[0], [1], [2]]
Repetition  24
Training DNN...
Early Stop at Epoch 89
Training ADNN...
Early Stop at Epoch 655
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 25 Active set:  [[0], [1], [2]]
Repetition  25
Training DNN...
Early Stop at Epoch 76
Training ADNN...
Epoch 1000, MSE: 0.1373092383146286
Early Stop at Epoch 1112
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 26 Active set:  [[0], [1], [2]]
Repetition  26
Training DNN...
Early Stop at Epoch 122
Training ADNN...
Early Stop at Epoch 706
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 27 Active set:  [[0], [1], [2], [1, 2]]
Repetition  27
Training DNN...
Early Stop at Epoch 151
Training ADNN...
Epoch 1000, MSE: 0.14386197924613953
Early Stop at Epoch 1077
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 28 Active set:  [[0], [1], [2]]
Repetition  28
Training DNN...
Early Stop at Epoch 125
Training ADNN...
Early Stop at Epoch 594
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 29 Active set:  [[0], [1], [2]]
Repetition  29
Training DNN...
Early Stop at Epoch 77
Training ADNN...
Early Stop at Epoch 324
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 30 Active set:  [[0], [1], [2]]
Repetition  30
Training DNN...
Early Stop at Epoch 82
Training ADNN...
Early Stop at Epoch 468
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 31 Active set:  [[0], [1], [2]]
Repetition  31
Training DNN...
Epoch 1000, MSE: 4.0956597328186035
Epoch 2000, MSE: 4.08031702041626
Epoch 3000, MSE: 4.08031702041626
Epoch 4000, MSE: 4.08031702041626
Epoch 5000, MSE: 4.08031702041626
Epoch 6000, MSE: 4.08031702041626
Epoch 7000, MSE: 4.08031702041626
Epoch 8000, MSE: 4.08031702041626
Epoch 9000, MSE: 4.08031702041626
Epoch 10000, MSE: 4.08031702041626
Training ADNN...
Early Stop at Epoch 291
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 32 Active set:  [[0], [1], [2]]
Repetition  32
Training DNN...
Early Stop at Epoch 161
Training ADNN...
Early Stop at Epoch 735
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 33 Active set:  [[0], [1], [2], [0, 2], [1, 2]]
Repetition  33
Training DNN...
Early Stop at Epoch 161
Training ADNN...
Early Stop at Epoch 276
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 34 Active set:  [[0], [1], [2]]
Repetition  34
Training DNN...
Early Stop at Epoch 93
Training ADNN...
Early Stop at Epoch 390
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 35 Active set:  [[0], [1], [2]]
Repetition  35
Training DNN...
Early Stop at Epoch 153
Training ADNN...
Epoch 1000, MSE: 0.15299038589000702
Early Stop at Epoch 1007
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 36 Active set:  [[0], [1], [2]]
Repetition  36
Training DNN...
Early Stop at Epoch 254
Training ADNN...
Early Stop at Epoch 487
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 37 Active set:  [[0], [1], [2]]
Repetition  37
Training DNN...
Early Stop at Epoch 94
Training ADNN...
Early Stop at Epoch 556
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 38 Active set:  [[0], [1], [2]]
Repetition  38
Training DNN...
Early Stop at Epoch 134
Training ADNN...
Early Stop at Epoch 735
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 39 Active set:  [[0], [1], [2]]
Repetition  39
Training DNN...
Early Stop at Epoch 154
Training ADNN...
Early Stop at Epoch 567
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 40 Active set:  [[0], [1], [2]]
Repetition  40
Training DNN...
Early Stop at Epoch 62
Training ADNN...
Early Stop at Epoch 926
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 41 Active set:  [[0], [1], [2]]
Repetition  41
Training DNN...
Early Stop at Epoch 154
Training ADNN...
Early Stop at Epoch 469
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 42 Active set:  [[0], [1], [2], [0, 1], [1, 2]]
Repetition  42
Training DNN...
Early Stop at Epoch 99
Training ADNN...
Early Stop at Epoch 216
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 43 Active set:  [[0], [1], [2], [0, 2]]
Repetition  43
Training DNN...
Early Stop at Epoch 84
Training ADNN...
Epoch 1000, MSE: 0.16986902058124542
Early Stop at Epoch 1210
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 44 Active set:  [[0], [1], [2]]
Repetition  44
Training DNN...
Early Stop at Epoch 115
Training ADNN...
Early Stop at Epoch 213
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 45 Active set:  [[0], [1], [2]]
Repetition  45
Training DNN...
Early Stop at Epoch 100
Training ADNN...
Early Stop at Epoch 556
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 46 Active set:  [[0], [1], [2], [0, 2], [1, 2]]
Repetition  46
Training DNN...
Early Stop at Epoch 112
Training ADNN...
Early Stop at Epoch 180
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 47 Active set:  [[0], [1], [2]]
Repetition  47
Training DNN...
Early Stop at Epoch 83
Training ADNN...
Early Stop at Epoch 618
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 48 Active set:  [[0], [1], [2]]
Repetition  48
Training DNN...
Early Stop at Epoch 224
Training ADNN...
Early Stop at Epoch 565
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 49 Active set:  [[0], [1], [2]]
Repetition  49
Training DNN...
Early Stop at Epoch 290
Training ADNN...
Early Stop at Epoch 783
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 50 Active set:  [[0], [1], [2]]
Repetition  50
Training DNN...
Early Stop at Epoch 129
Training ADNN...
Early Stop at Epoch 580
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 51 Active set:  [[0], [1], [2]]
Repetition  51
Training DNN...
Early Stop at Epoch 107
Training ADNN...
Early Stop at Epoch 308
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 52 Active set:  [[0], [1], [2]]
Repetition  52
Training DNN...
Early Stop at Epoch 198
Training ADNN...
Early Stop at Epoch 671
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 53 Active set:  [[0], [1], [2], [0, 2], [1, 2]]
Repetition  53
Training DNN...
Early Stop at Epoch 77
Training ADNN...
Epoch 1000, MSE: 0.2027980387210846
Early Stop at Epoch 1020
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 54 Active set:  [[0], [1], [2]]
Repetition  54
Training DNN...
Early Stop at Epoch 69
Training ADNN...
Early Stop at Epoch 704
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 55 Active set:  [[0], [1], [2], [0, 2]]
Repetition  55
Training DNN...
Early Stop at Epoch 139
Training ADNN...
Early Stop at Epoch 243
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 56 Active set:  [[0], [1], [2]]
Repetition  56
Training DNN...
Early Stop at Epoch 50
Training ADNN...
Early Stop at Epoch 551
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 57 Active set:  [[0], [1], [2]]
Repetition  57
Training DNN...
Early Stop at Epoch 127
Training ADNN...
Early Stop at Epoch 900
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 58 Active set:  [[0], [1], [2], [0, 1]]
Repetition  58
Training DNN...
Early Stop at Epoch 164
Training ADNN...
Early Stop at Epoch 408
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 59 Active set:  [[0], [1], [2]]
Repetition  59
Training DNN...
Early Stop at Epoch 270
Training ADNN...
Early Stop at Epoch 549
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 60 Active set:  [[0], [1], [2]]
Repetition  60
Training DNN...
Early Stop at Epoch 196
Training ADNN...
Epoch 1000, MSE: 0.12262574583292007
Early Stop at Epoch 1165
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 61 Active set:  [[0], [1], [2]]
Repetition  61
Training DNN...
Early Stop at Epoch 124
Training ADNN...
Early Stop at Epoch 467
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 62 Active set:  [[0], [1], [2], [0, 1]]
Repetition  62
Training DNN...
Early Stop at Epoch 99
Training ADNN...
Early Stop at Epoch 558
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 63 Active set:  [[0], [1], [2]]
Repetition  63
Training DNN...
Early Stop at Epoch 240
Training ADNN...
Early Stop at Epoch 905
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 64 Active set:  [[0], [1], [2]]
Repetition  64
Training DNN...
Early Stop at Epoch 78
Training ADNN...
Early Stop at Epoch 325
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 65 Active set:  [[0], [1], [2]]
Repetition  65
Training DNN...
Early Stop at Epoch 141
Training ADNN...
Early Stop at Epoch 643
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 66 Active set:  [[0], [1], [2]]
Repetition  66
Training DNN...
Early Stop at Epoch 131
Training ADNN...
Early Stop at Epoch 648
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 67 Active set:  [[0], [1], [2]]
Repetition  67
Training DNN...
Early Stop at Epoch 162
Training ADNN...
Early Stop at Epoch 940
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 68 Active set:  [[0], [1], [2]]
Repetition  68
Training DNN...
Early Stop at Epoch 159
Training ADNN...
Early Stop at Epoch 459
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 69 Active set:  [[0], [1], [2]]
Repetition  69
Training DNN...
Early Stop at Epoch 147
Training ADNN...
Early Stop at Epoch 502
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 70 Active set:  [[0], [1], [2]]
Repetition  70
Training DNN...
Early Stop at Epoch 196
Training ADNN...
Early Stop at Epoch 593
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 71 Active set:  [[0], [1], [2]]
Repetition  71
Training DNN...
Early Stop at Epoch 184
Training ADNN...
Epoch 1000, MSE: 0.9993448257446289
Early Stop at Epoch 1149
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 72 Active set:  [[0], [1], [2]]
Repetition  72
Training DNN...
Early Stop at Epoch 63
Training ADNN...
Early Stop at Epoch 620
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 73 Active set:  [[0], [1], [2], [0, 1], [1, 2]]
Repetition  73
Training DNN...
Early Stop at Epoch 66
Training ADNN...
Early Stop at Epoch 469
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 74 Active set:  [[0], [1], [2]]
Repetition  74
Training DNN...
Early Stop at Epoch 108
Training ADNN...
Early Stop at Epoch 478
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 75 Active set:  [[0], [1], [2]]
Repetition  75
Training DNN...
Epoch 1000, MSE: 4.477902889251709
Early Stop at Epoch 1748
Training ADNN...
Early Stop at Epoch 451
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 76 Active set:  [[0], [1], [2], [0, 2]]
Repetition  76
Training DNN...
Early Stop at Epoch 50
Training ADNN...
Early Stop at Epoch 206
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 77 Active set:  [[0], [1], [2]]
Repetition  77
Training DNN...
Early Stop at Epoch 265
Training ADNN...
Early Stop at Epoch 296
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 78 Active set:  [[0], [1], [2]]
Repetition  78
Training DNN...
Early Stop at Epoch 53
Training ADNN...
Early Stop at Epoch 827
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 79 Active set:  [[0], [1], [2]]
Repetition  79
Training DNN...
Early Stop at Epoch 296
Training ADNN...
Early Stop at Epoch 606
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 80 Active set:  [[0], [1], [2]]
Repetition  80
Training DNN...
Early Stop at Epoch 193
Training ADNN...
Early Stop at Epoch 754
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 81 Active set:  [[0], [1], [2]]
Repetition  81
Training DNN...
Early Stop at Epoch 143
Training ADNN...
Early Stop at Epoch 157
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 82 Active set:  [[0], [1], [2]]
Repetition  82
Training DNN...
Early Stop at Epoch 92
Training ADNN...
Early Stop at Epoch 560
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 83 Active set:  [[0], [1], [2]]
Repetition  83
Training DNN...
Early Stop at Epoch 67
Training ADNN...
Early Stop at Epoch 711
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 84 Active set:  [[0], [1], [2]]
Repetition  84
Training DNN...
Early Stop at Epoch 146
Training ADNN...
Early Stop at Epoch 430
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 85 Active set:  [[0], [1], [2]]
Repetition  85
Training DNN...
Early Stop at Epoch 179
Training ADNN...
Early Stop at Epoch 665
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 86 Active set:  [[0], [1], [2]]
Repetition  86
Training DNN...
Early Stop at Epoch 197
Training ADNN...
Early Stop at Epoch 759
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 87 Active set:  [[0], [1], [2]]
Repetition  87
Training DNN...
Early Stop at Epoch 100
Training ADNN...
Early Stop at Epoch 617
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 88 Active set:  [[0], [1], [2]]
Repetition  88
Training DNN...
Early Stop at Epoch 118
Training ADNN...
Early Stop at Epoch 499
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 89 Active set:  [[0], [1], [2]]
Repetition  89
Training DNN...
Early Stop at Epoch 506
Training ADNN...
Early Stop at Epoch 391
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 90 Active set:  [[0], [1], [2]]
Repetition  90
Training DNN...
Early Stop at Epoch 75
Training ADNN...
Early Stop at Epoch 702
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 91 Active set:  [[0], [1], [2]]
Repetition  91
Training DNN...
Early Stop at Epoch 66
Training ADNN...
Early Stop at Epoch 513
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 92 Active set:  [[0], [1], [2]]
Repetition  92
Training DNN...
Early Stop at Epoch 122
Training ADNN...
Early Stop at Epoch 184
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 93 Active set:  [[0], [1], [2]]
Repetition  93
Training DNN...
Early Stop at Epoch 118
Training ADNN...
Early Stop at Epoch 508
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 94 Active set:  [[0], [1], [2]]
Repetition  94
Training DNN...
Early Stop at Epoch 164
Training ADNN...
Early Stop at Epoch 797
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 95 Active set:  [[0], [1], [2]]
Repetition  95
Training DNN...
Early Stop at Epoch 100
Training ADNN...
Early Stop at Epoch 839
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 96 Active set:  [[0], [1], [2]]
Repetition  96
Training DNN...
Early Stop at Epoch 93
Training ADNN...
Epoch 1000, MSE: 0.7330726385116577
Early Stop at Epoch 1245
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 97 Active set:  [[0], [1], [2], [0, 1]]
Repetition  97
Training DNN...
Early Stop at Epoch 270
Training ADNN...
Early Stop at Epoch 511
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 98 Active set:  [[0], [1], [2]]
Repetition  98
Training DNN...
Early Stop at Epoch 152
Training ADNN...
Early Stop at Epoch 709
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 99 Active set:  [[0], [1], [2]]
Repetition  99
Training DNN...
Early Stop at Epoch 116
Training ADNN...
Early Stop at Epoch 571
Generating weak_main dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Ain't Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 100 Active set:  [[0], [1], [2], [0, 2], [1, 2]]
Repetition  100
Training DNN...
Early Stop at Epoch 87
Training ADNN...
Early Stop at Epoch 433
