Requirement already satisfied: group-lasso in /home/users/yhung7/.local/lib/python3.13/site-packages (1.5.0)
Requirement already satisfied: xgboost in /home/users/yhung7/.local/lib/python3.13/site-packages (3.0.5)
Requirement already satisfied: numpy in /sysapps/ubuntu-applications/pytorch/2.7.0/venv/lib/python3.13/site-packages (from group-lasso) (2.1.2)
Requirement already satisfied: scikit-learn in /home/users/yhung7/.local/lib/python3.13/site-packages (from group-lasso) (1.6.1)
Requirement already satisfied: nvidia-nccl-cu12 in /sysapps/ubuntu-applications/pytorch/2.7.0/venv/lib/python3.13/site-packages (from xgboost) (2.26.2)
Requirement already satisfied: scipy in /home/users/yhung7/.local/lib/python3.13/site-packages (from xgboost) (1.15.3)
Requirement already satisfied: joblib>=1.2.0 in /home/users/yhung7/.local/lib/python3.13/site-packages (from scikit-learn->group-lasso) (1.5.0)
Requirement already satisfied: threadpoolctl>=3.1.0 in /home/users/yhung7/.local/lib/python3.13/site-packages (from scikit-learn->group-lasso) (3.6.0)
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 1 Active set:  [[0], [0, 1], [2, 3]]
Repetition  1
Training DNN...
Early Stop at Epoch 103
Training ADNN...
Early Stop at Epoch 196
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 2 Active set:  [[0], [2], [0, 1], [2, 3]]
Repetition  2
Training DNN...
Early Stop at Epoch 182
Training ADNN...
Early Stop at Epoch 233
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 3 Active set:  [[3], [0, 1], [2, 3]]
Repetition  3
Training DNN...
Early Stop at Epoch 78
Training ADNN...
Early Stop at Epoch 374
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 4 Active set:  [[2], [0, 1], [2, 3]]
Repetition  4
Training DNN...
Early Stop at Epoch 187
Training ADNN...
Early Stop at Epoch 635
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 5 Active set:  [[0, 1], [2, 3]]
Repetition  5
Training DNN...
Early Stop at Epoch 218
Training ADNN...
Early Stop at Epoch 383
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 6 Active set:  [[1], [0, 1], [2, 3]]
Repetition  6
Training DNN...
Early Stop at Epoch 499
Training ADNN...
Early Stop at Epoch 461
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 7 Active set:  [[0, 1], [2, 3]]
Repetition  7
Training DNN...
Early Stop at Epoch 102
Training ADNN...
Early Stop at Epoch 659
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 8 Active set:  [[1], [2], [3], [0, 1], [2, 3]]
Repetition  8
Training DNN...
Early Stop at Epoch 264
Training ADNN...
Early Stop at Epoch 424
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 9 Active set:  [[0], [1], [2], [0, 1], [2, 3]]
Repetition  9
Training DNN...
Early Stop at Epoch 127
Training ADNN...
Early Stop at Epoch 260
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 10 Active set:  [[0], [1], [2], [0, 1], [2, 3]]
Repetition  10
Training DNN...
Early Stop at Epoch 163
Training ADNN...
Early Stop at Epoch 384
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 11 Active set:  [[0, 1], [2, 3]]
Repetition  11
Training DNN...
Early Stop at Epoch 206
Training ADNN...
Epoch 1000, MSE: 0.1894599050283432
Early Stop at Epoch 1098
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 12 Active set:  [[0], [0, 1], [2, 3]]
Repetition  12
Training DNN...
Early Stop at Epoch 60
Training ADNN...
Early Stop at Epoch 960
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 13 Active set:  [[0, 1], [2, 3]]
Repetition  13
Training DNN...
Early Stop at Epoch 270
Training ADNN...
Early Stop at Epoch 679
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 14 Active set:  [[2], [3], [0, 1], [2, 3]]
Repetition  14
Training DNN...
Early Stop at Epoch 136
Training ADNN...
Early Stop at Epoch 416
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 15 Active set:  [[2], [0, 1], [2, 3]]
Repetition  15
Training DNN...
Early Stop at Epoch 130
Training ADNN...
Early Stop at Epoch 631
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 16 Active set:  [[2], [0, 1], [2, 3]]
Repetition  16
Training DNN...
Early Stop at Epoch 118
Training ADNN...
Early Stop at Epoch 594
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 17 Active set:  [[0], [1], [2], [0, 1], [2, 3]]
Repetition  17
Training DNN...
Early Stop at Epoch 126
Training ADNN...
Early Stop at Epoch 899
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 18 Active set:  [[0, 1], [2, 3]]
Repetition  18
Training DNN...
Early Stop at Epoch 126
Training ADNN...
Early Stop at Epoch 350
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 19 Active set:  [[0], [3], [0, 1], [2, 3]]
Repetition  19
Training DNN...
Early Stop at Epoch 62
Training ADNN...
Early Stop at Epoch 476
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 20 Active set:  [[0, 1], [2, 3]]
Repetition  20
Training DNN...
Early Stop at Epoch 97
Training ADNN...
Early Stop at Epoch 589
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 21 Active set:  [[0], [0, 1], [2, 3]]
Repetition  21
Training DNN...
Early Stop at Epoch 137
Training ADNN...
Early Stop at Epoch 634
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 22 Active set:  [[2], [0, 1], [2, 3]]
Repetition  22
Training DNN...
Epoch 1000, MSE: 1.1603032350540161
Epoch 2000, MSE: 1.1603032350540161
Epoch 3000, MSE: 1.1603032350540161
Epoch 4000, MSE: 1.1603032350540161
Epoch 5000, MSE: 1.1603032350540161
Epoch 6000, MSE: 1.1603032350540161
Epoch 7000, MSE: 1.1603032350540161
Epoch 8000, MSE: 1.1603032350540161
Epoch 9000, MSE: 1.1603032350540161
Epoch 10000, MSE: 1.1603032350540161
Training ADNN...
Early Stop at Epoch 473
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 23 Active set:  [[0], [1], [0, 1], [2, 3]]
Repetition  23
Training DNN...
Early Stop at Epoch 98
Training ADNN...
Early Stop at Epoch 386
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 24 Active set:  [[2], [3], [0, 1], [2, 3]]
Repetition  24
Training DNN...
Early Stop at Epoch 125
Training ADNN...
Early Stop at Epoch 644
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 25 Active set:  [[0, 1], [2, 3]]
Repetition  25
Training DNN...
Early Stop at Epoch 96
Training ADNN...
Early Stop at Epoch 653
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 26 Active set:  [[0], [2], [3], [0, 1], [2, 3]]
Repetition  26
Training DNN...
Early Stop at Epoch 825
Training ADNN...
Early Stop at Epoch 184
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 27 Active set:  [[0], [1], [2], [3], [0, 1], [2, 3]]
Repetition  27
Training DNN...
Early Stop at Epoch 183
Training ADNN...
Early Stop at Epoch 191
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 28 Active set:  [[1], [0, 1], [2, 3]]
Repetition  28
Training DNN...
Early Stop at Epoch 154
Training ADNN...
Early Stop at Epoch 417
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 29 Active set:  [[0], [1], [0, 1], [2, 3]]
Repetition  29
Training DNN...
Early Stop at Epoch 205
Training ADNN...
Early Stop at Epoch 413
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 30 Active set:  [[0], [1], [0, 1], [2, 3]]
Repetition  30
Training DNN...
Early Stop at Epoch 156
Training ADNN...
Early Stop at Epoch 531
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 31 Active set:  [[0], [2], [0, 1], [2, 3]]
Repetition  31
Training DNN...
Epoch 1000, MSE: 0.6182276606559753
Early Stop at Epoch 1744
Training ADNN...
Early Stop at Epoch 304
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 32 Active set:  [[0, 1], [2, 3]]
Repetition  32
Training DNN...
Early Stop at Epoch 120
Training ADNN...
Early Stop at Epoch 884
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 33 Active set:  [[0, 1], [2, 3]]
Repetition  33
Training DNN...
Early Stop at Epoch 160
Training ADNN...
Early Stop at Epoch 491
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 34 Active set:  [[0, 1], [2, 3]]
Repetition  34
Training DNN...
Early Stop at Epoch 932
Training ADNN...
Early Stop at Epoch 859
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 35 Active set:  [[0], [1], [2], [3], [0, 1], [2, 3]]
Repetition  35
Training DNN...
Early Stop at Epoch 152
Training ADNN...
Early Stop at Epoch 693
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 36 Active set:  [[0], [1], [3], [0, 1], [2, 3]]
Repetition  36
Training DNN...
Early Stop at Epoch 182
Training ADNN...
Early Stop at Epoch 991
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 37 Active set:  [[0], [0, 1], [2, 3]]
Repetition  37
Training DNN...
Early Stop at Epoch 135
Training ADNN...
Early Stop at Epoch 475
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 38 Active set:  [[0, 1], [2, 3]]
Repetition  38
Training DNN...
Early Stop at Epoch 168
Training ADNN...
Early Stop at Epoch 627
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 39 Active set:  [[0, 1], [2, 3]]
Repetition  39
Training DNN...
Early Stop at Epoch 185
Training ADNN...
Early Stop at Epoch 375
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 40 Active set:  [[0], [1], [2, 3]]
Repetition  40
Training DNN...
Early Stop at Epoch 85
Training ADNN...
Early Stop at Epoch 842
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 41 Active set:  [[0], [3], [0, 1], [2, 3]]
Repetition  41
Training DNN...
Early Stop at Epoch 50
Training ADNN...
Early Stop at Epoch 168
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 42 Active set:  [[0, 1], [2, 3]]
Repetition  42
Training DNN...
Early Stop at Epoch 172
Training ADNN...
Early Stop at Epoch 691
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 43 Active set:  [[0, 1], [2, 3]]
Repetition  43
Training DNN...
Early Stop at Epoch 780
Training ADNN...
Early Stop at Epoch 724
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 44 Active set:  [[0, 1], [2, 3]]
Repetition  44
Training DNN...
Early Stop at Epoch 250
Training ADNN...
Early Stop at Epoch 672
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 45 Active set:  [[0, 1], [2, 3]]
Repetition  45
Training DNN...
Early Stop at Epoch 113
Training ADNN...
Early Stop at Epoch 438
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 46 Active set:  [[0, 1], [2, 3]]
Repetition  46
Training DNN...
Early Stop at Epoch 264
Training ADNN...
Early Stop at Epoch 288
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 47 Active set:  [[2], [3], [0, 1], [2, 3]]
Repetition  47
Training DNN...
Early Stop at Epoch 92
Training ADNN...
Early Stop at Epoch 481
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 48 Active set:  [[2], [3], [0, 1]]
Repetition  48
Training DNN...
Early Stop at Epoch 50
Training ADNN...
Early Stop at Epoch 481
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 49 Active set:  [[0], [1], [0, 1], [2, 3]]
Repetition  49
Training DNN...
Early Stop at Epoch 131
Training ADNN...
Early Stop at Epoch 745
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 50 Active set:  [[0], [0, 1], [2, 3]]
Repetition  50
Training DNN...
Early Stop at Epoch 170
Training ADNN...
Early Stop at Epoch 854
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 51 Active set:  [[1], [2], [3], [0, 1], [2, 3]]
Repetition  51
Training DNN...
Early Stop at Epoch 143
Training ADNN...
Early Stop at Epoch 744
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 52 Active set:  [[0], [0, 1], [2, 3]]
Repetition  52
Training DNN...
Early Stop at Epoch 246
Training ADNN...
Early Stop at Epoch 530
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 53 Active set:  [[1], [2], [0, 1], [2, 3]]
Repetition  53
Training DNN...
Early Stop at Epoch 222
Training ADNN...
Early Stop at Epoch 393
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 54 Active set:  [[0], [2], [3], [0, 1], [2, 3]]
Repetition  54
Training DNN...
Early Stop at Epoch 352
Training ADNN...
Early Stop at Epoch 149
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 55 Active set:  [[2], [0, 1], [2, 3]]
Repetition  55
Training DNN...
Early Stop at Epoch 126
Training ADNN...
Early Stop at Epoch 201
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 56 Active set:  [[0], [1], [2], [3], [0, 1]]
Repetition  56
Training DNN...
Early Stop at Epoch 50
Training ADNN...
Early Stop at Epoch 304
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 57 Active set:  [[0, 1], [2, 3]]
Repetition  57
Training DNN...
Early Stop at Epoch 197
Training ADNN...
Early Stop at Epoch 708
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 58 Active set:  [[0, 1], [2, 3]]
Repetition  58
Training DNN...
Early Stop at Epoch 152
Training ADNN...
Early Stop at Epoch 269
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 59 Active set:  [[1], [3], [0, 1], [2, 3]]
Repetition  59
Training DNN...
Early Stop at Epoch 69
Training ADNN...
Early Stop at Epoch 754
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 60 Active set:  [[0], [1], [2], [3], [0, 1], [2, 3]]
Repetition  60
Training DNN...
Early Stop at Epoch 156
Training ADNN...
Early Stop at Epoch 291
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 61 Active set:  [[0, 1], [2, 3]]
Repetition  61
Training DNN...
Early Stop at Epoch 187
Training ADNN...
Early Stop at Epoch 590
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 62 Active set:  [[1], [2], [3], [0, 1], [2, 3]]
Repetition  62
Training DNN...
Early Stop at Epoch 148
Training ADNN...
Early Stop at Epoch 237
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 63 Active set:  [[1], [0, 1], [2, 3]]
Repetition  63
Training DNN...
Early Stop at Epoch 166
Training ADNN...
Early Stop at Epoch 608
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 64 Active set:  [[0], [1], [0, 1], [2, 3]]
Repetition  64
Training DNN...
Early Stop at Epoch 153
Training ADNN...
Early Stop at Epoch 905
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 65 Active set:  [[2], [0, 1], [2, 3]]
Repetition  65
Training DNN...
Early Stop at Epoch 201
Training ADNN...
Early Stop at Epoch 401
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 66 Active set:  [[0], [0, 1], [2, 3]]
Repetition  66
Training DNN...
Early Stop at Epoch 101
Training ADNN...
Early Stop at Epoch 468
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 67 Active set:  [[0, 1], [2, 3]]
Repetition  67
Training DNN...
Early Stop at Epoch 149
Training ADNN...
Early Stop at Epoch 815
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 68 Active set:  [[2], [3], [0, 1], [2, 3]]
Repetition  68
Training DNN...
Early Stop at Epoch 393
Training ADNN...
Early Stop at Epoch 721
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 69 Active set:  [[0], [0, 1], [2, 3]]
Repetition  69
Training DNN...
Early Stop at Epoch 192
Training ADNN...
Early Stop at Epoch 630
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 70 Active set:  [[0], [0, 1], [2, 3]]
Repetition  70
Training DNN...
Early Stop at Epoch 313
Training ADNN...
Early Stop at Epoch 724
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 71 Active set:  [[2], [3], [0, 1], [2, 3]]
Repetition  71
Training DNN...
Early Stop at Epoch 121
Training ADNN...
Early Stop at Epoch 486
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 72 Active set:  [[0], [0, 1], [2, 3]]
Repetition  72
Training DNN...
Early Stop at Epoch 175
Training ADNN...
Early Stop at Epoch 711
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 73 Active set:  [[0], [1], [3], [0, 1], [2, 3]]
Repetition  73
Training DNN...
Early Stop at Epoch 152
Training ADNN...
Early Stop at Epoch 258
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 74 Active set:  [[0], [1], [2, 3]]
Repetition  74
Training DNN...
Early Stop at Epoch 97
Training ADNN...
Early Stop at Epoch 534
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 75 Active set:  [[2], [3], [0, 1], [2, 3]]
Repetition  75
Training DNN...
Early Stop at Epoch 246
Training ADNN...
Early Stop at Epoch 448
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 76 Active set:  [[1], [2], [0, 1], [2, 3]]
Repetition  76
Training DNN...
Early Stop at Epoch 156
Training ADNN...
Early Stop at Epoch 584
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 77 Active set:  [[1], [0, 1], [2, 3]]
Repetition  77
Training DNN...
Early Stop at Epoch 150
Training ADNN...
Early Stop at Epoch 213
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 78 Active set:  [[0], [1], [2], [3], [0, 1], [2, 3]]
Repetition  78
Training DNN...
Early Stop at Epoch 50
Training ADNN...
Early Stop at Epoch 409
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 79 Active set:  [[2], [3], [0, 1], [2, 3]]
Repetition  79
Training DNN...
Early Stop at Epoch 51
Training ADNN...
Early Stop at Epoch 380
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 80 Active set:  [[0, 1], [2, 3]]
Repetition  80
Training DNN...
Early Stop at Epoch 168
Training ADNN...
Early Stop at Epoch 603
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 81 Active set:  [[0], [0, 1], [2, 3]]
Repetition  81
Training DNN...
Early Stop at Epoch 165
Training ADNN...
Early Stop at Epoch 281
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 82 Active set:  [[2], [3], [0, 1], [2, 3]]
Repetition  82
Training DNN...
Early Stop at Epoch 189
Training ADNN...
Early Stop at Epoch 988
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 83 Active set:  [[0, 1], [2, 3]]
Repetition  83
Training DNN...
Early Stop at Epoch 77
Training ADNN...
Epoch 1000, MSE: 0.06148732453584671
Early Stop at Epoch 1081
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 84 Active set:  [[1], [2], [0, 1], [2, 3]]
Repetition  84
Training DNN...
Early Stop at Epoch 112
Training ADNN...
Early Stop at Epoch 752
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 85 Active set:  [[0], [1], [2], [0, 1], [2, 3]]
Repetition  85
Training DNN...
Early Stop at Epoch 160
Training ADNN...
Early Stop at Epoch 710
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 86 Active set:  [[0, 1], [2, 3]]
Repetition  86
Training DNN...
Early Stop at Epoch 154
Training ADNN...
Early Stop at Epoch 292
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 87 Active set:  [[0], [2], [3], [0, 1], [2, 3]]
Repetition  87
Training DNN...
Early Stop at Epoch 89
Training ADNN...
Early Stop at Epoch 432
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 88 Active set:  [[0, 1], [2, 3]]
Repetition  88
Training DNN...
Early Stop at Epoch 111
Training ADNN...
Early Stop at Epoch 587
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 89 Active set:  [[2], [0, 1], [2, 3]]
Repetition  89
Training DNN...
Early Stop at Epoch 234
Training ADNN...
Early Stop at Epoch 538
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 90 Active set:  [[0], [2], [3], [0, 1], [2, 3]]
Repetition  90
Training DNN...
Early Stop at Epoch 152
Training ADNN...
Early Stop at Epoch 275
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 91 Active set:  [[0, 1], [2, 3]]
Repetition  91
Training DNN...
Early Stop at Epoch 80
Training ADNN...
Early Stop at Epoch 779
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 92 Active set:  [[0], [1], [2], [0, 1], [2, 3]]
Repetition  92
Training DNN...
Early Stop at Epoch 97
Training ADNN...
Early Stop at Epoch 809
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 93 Active set:  [[0, 1], [2, 3]]
Repetition  93
Training DNN...
Early Stop at Epoch 132
Training ADNN...
Early Stop at Epoch 440
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 94 Active set:  [[2], [0, 1], [2, 3]]
Repetition  94
Training DNN...
Early Stop at Epoch 995
Training ADNN...
Early Stop at Epoch 389
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 95 Active set:  [[0], [2, 3]]
Repetition  95
Training DNN...
Early Stop at Epoch 125
Training ADNN...
Early Stop at Epoch 797
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 96 Active set:  [[0, 1], [0, 2], [2, 3]]
Repetition  96
Training DNN...
Early Stop at Epoch 153
Training ADNN...
Early Stop at Epoch 371
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 97 Active set:  [[0], [1], [2], [0, 1], [2, 3]]
Repetition  97
Training DNN...
Early Stop at Epoch 191
Training ADNN...
Early Stop at Epoch 510
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 98 Active set:  [[0], [1], [0, 1], [2, 3]]
Repetition  98
Training DNN...
Early Stop at Epoch 121
Training ADNN...
Epoch 1000, MSE: 0.1727162003517151
Early Stop at Epoch 1127
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 99 Active set:  [[0], [0, 1], [2, 3]]
Repetition  99
Training DNN...
Early Stop at Epoch 119
Training ADNN...
Early Stop at Epoch 775
Generating only_inter dataset
Running SAM for different alpha values
Alpha: 0.00 | Ain't Convergence.
Alpha: 0.10 | Convergence.
Alpha: 0.20 | Convergence.
Alpha: 0.30 | Convergence.
Alpha: 0.40 | Convergence.
Alpha: 0.50 | Convergence.
Alpha: 0.60 | Convergence.
Alpha: 0.70 | Convergence.
Alpha: 0.80 | Convergence.
Alpha: 0.90 | Convergence.
Alpha: 1.00 | Convergence.
Alpha: 1.50 | Convergence.
Alpha: 2.00 | Convergence.
Alpha: 3.00 | Convergence.
Alpha: 5.00 | Convergence.
Rep 100 Active set:  [[0, 1], [2, 3]]
Repetition  100
Training DNN...
Early Stop at Epoch 129
Training ADNN...
Early Stop at Epoch 519
