------------------------------------------------------------------------------------------------------------------------
Vector testing report
Params:
    conf: "conf/embeddings_validation_short_1601448124.hocon"

Collected 45 files with 0 errors

------------------------------------------------------------------------------------------------------------------------
Metric: "auroc"
                                      scores_valid                                                                                                                                                                                             
                                              mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                                        
lgbm       emb_mles__hidden_size_0032        0.783 0.015   0.768   0.798 0.012  [0.793 0.769 0.797 0.784 0.773]    1.225     0.576   -4.835     0.001  -0.040      0.019    -0.058    -0.021     -4.806         2.292       -7.098       -2.514
           emb_mles__hidden_size_0064        0.799 0.008   0.791   0.807 0.006  [0.803 0.793 0.805 0.803 0.791]    4.545     0.914   -3.540     0.004  -0.024      0.015    -0.039    -0.008     -2.884         1.878       -4.762       -1.005
           emb_mles__hidden_size_0128        0.814 0.012   0.803   0.826 0.009  [0.815 0.798 0.823 0.817 0.818]    2.054     0.749   -1.095     0.153  -0.008      0.017    -0.025     0.009     -0.984         2.074       -3.058        1.089
           emb_mles__hidden_size_0256        0.821 0.015   0.807   0.836 0.012  [0.836 0.805 0.826 0.824 0.814]    1.336     0.607   -0.174     0.433  -0.001      0.018    -0.020     0.017     -0.170         2.249       -2.419        2.079
           emb_mles__hidden_size_0512        0.818 0.009   0.808   0.827 0.007  [0.820 0.807 0.827 0.817 0.817]    3.426     0.870   -0.725     0.244  -0.005      0.016    -0.021     0.011     -0.608         1.933       -2.541        1.325
           emb_mles__hidden_size_1024        0.823 0.017   0.806   0.839 0.014  [0.837 0.803 0.831 0.815 0.827]    1.000     0.500    0.000     0.500   0.000      0.020    -0.020     0.020      0.000         2.405       -2.405        2.405
           emb_mles__hidden_size_2048        0.824 0.014   0.811   0.838 0.011  [0.837 0.810 0.829 0.816 0.831]    1.530     0.655    0.246     0.594   0.002      0.018    -0.016     0.020      0.234         2.187       -1.953        2.420
           emb_mles__hidden_size_3072        0.814 0.012   0.801   0.826 0.010  [0.828 0.801 0.813 0.813 0.813]    1.905     0.726   -1.202     0.132  -0.009      0.017    -0.026     0.008     -1.094         2.100       -3.194        1.006
           mles_embeddings                   0.823 0.017   0.806   0.839 0.014  [0.837 0.803 0.831 0.815 0.827]    1.000     0.500    0.000     0.500   0.000      0.020    -0.020     0.020      0.000         2.405       -2.405        2.405
                                      scores_test                                                                                                                                                                                             
                                             mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                                       
lgbm       emb_mles__hidden_size_0032       0.798 0.011   0.787   0.809 0.009  [0.807 0.807 0.791 0.788 0.796]    0.097     0.022  -11.226     0.000  -0.046      0.009    -0.055    -0.036     -5.403         1.110       -6.513       -4.293
           emb_mles__hidden_size_0064       0.827 0.004   0.823   0.830 0.003  [0.821 0.827 0.828 0.827 0.829]    0.780     0.408   -9.214     0.000  -0.017      0.004    -0.021    -0.013     -1.995         0.499       -2.494       -1.496
           emb_mles__hidden_size_0128       0.836 0.006   0.830   0.842 0.005  [0.836 0.843 0.835 0.835 0.830]    0.333     0.156   -3.090     0.007  -0.007      0.006    -0.013    -0.002     -0.886         0.661       -1.547       -0.225
           emb_mles__hidden_size_0256       0.851 0.004   0.847   0.855 0.003  [0.846 0.853 0.850 0.854 0.851]    0.680     0.359    3.819     0.997   0.007      0.004     0.003     0.012      0.860         0.519        0.341        1.379
           emb_mles__hidden_size_0512       0.845 0.003   0.842   0.848 0.002  [0.842 0.848 0.843 0.845 0.845]    1.269     0.589    0.759     0.765   0.001      0.004    -0.003     0.005      0.145         0.442       -0.296        0.587
           emb_mles__hidden_size_1024       0.843 0.003   0.840   0.847 0.003  [0.839 0.844 0.844 0.843 0.847]    1.000     0.500    0.000     0.500   0.000      0.004    -0.004     0.004      0.000         0.467       -0.467        0.467
           emb_mles__hidden_size_2048       0.836 0.005   0.831   0.841 0.004  [0.836 0.842 0.831 0.836 0.836]    0.511     0.266   -3.580     0.004  -0.007      0.005    -0.012    -0.003     -0.882         0.568       -1.450       -0.314
           emb_mles__hidden_size_3072       0.838 0.003   0.835   0.841 0.002  [0.840 0.835 0.837 0.840 0.840]    1.386     0.620   -3.333     0.005  -0.005      0.004    -0.009    -0.002     -0.627         0.434       -1.060       -0.193
           mles_embeddings                  0.843 0.003   0.840   0.847 0.003  [0.839 0.844 0.844 0.843 0.847]    1.000     0.500    0.000     0.500   0.000      0.004    -0.004     0.004      0.000         0.467       -0.467        0.467

------------------------------------------------------------------------------------------------------------------------
Metric: "accuracy"
                                      scores_valid                                                                                                                                                                                             
                                              mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                                        
lgbm       emb_mles__hidden_size_0032        0.712 0.012   0.700   0.724 0.010  [0.716 0.706 0.724 0.716 0.699]    3.253     0.860   -3.619     0.003  -0.033      0.021    -0.054    -0.012     -4.444         2.831       -7.275       -1.612
           emb_mles__hidden_size_0064        0.722 0.010   0.712   0.731 0.008  [0.714 0.724 0.731 0.726 0.712]    5.055     0.927   -2.690     0.014  -0.024      0.020    -0.044    -0.003     -3.161         2.710       -5.872       -0.451
           emb_mles__hidden_size_0128        0.740 0.008   0.731   0.748 0.007  [0.740 0.729 0.740 0.747 0.743]    7.163     0.959   -0.624     0.275  -0.005      0.020    -0.025     0.014     -0.716         2.644       -3.359        1.928
           emb_mles__hidden_size_0256        0.744 0.011   0.733   0.755 0.009  [0.753 0.732 0.740 0.752 0.742]    4.096     0.900   -0.124     0.452  -0.001      0.021    -0.022     0.019     -0.149         2.762       -2.911        2.613
           emb_mles__hidden_size_0512        0.745 0.011   0.734   0.756 0.009  [0.750 0.730 0.749 0.744 0.751]    4.230     0.904   -0.025     0.490  -0.000      0.021    -0.021     0.020     -0.030         2.754       -2.783        2.724
           emb_mles__hidden_size_1024        0.745 0.022   0.723   0.767 0.018  [0.764 0.723 0.749 0.730 0.759]    1.000     0.500    0.000     0.500   0.000      0.026    -0.026     0.026      0.000         3.502       -3.502        3.502
           emb_mles__hidden_size_2048        0.748 0.010   0.738   0.758 0.008  [0.760 0.740 0.742 0.749 0.750]    5.207     0.930    0.356     0.635   0.003      0.020    -0.017     0.023      0.418         2.704       -2.286        3.121
           emb_mles__hidden_size_3072        0.735 0.009   0.726   0.745 0.008  [0.747 0.726 0.737 0.733 0.733]    5.482     0.936   -1.149     0.142  -0.010      0.020    -0.030     0.010     -1.342         2.693       -4.035        1.351
           mles_embeddings                   0.745 0.022   0.723   0.767 0.018  [0.764 0.723 0.749 0.730 0.759]    1.000     0.500    0.000     0.500   0.000      0.026    -0.026     0.026      0.000         3.502       -3.502        3.502
                                      scores_test                                                                                                                                                                                             
                                             mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                                       
lgbm       emb_mles__hidden_size_0032       0.730 0.016   0.714   0.746 0.013  [0.744 0.728 0.732 0.710 0.736]    0.708     0.373   -4.437     0.001  -0.033      0.017    -0.050    -0.016     -4.300         2.235       -6.535       -2.065
           emb_mles__hidden_size_0064       0.751 0.007   0.744   0.758 0.006  [0.748 0.754 0.760 0.748 0.746]    3.410     0.869   -2.144     0.032  -0.012      0.012    -0.024     0.001     -1.521         1.636       -3.157        0.115
           emb_mles__hidden_size_0128       0.763 0.010   0.753   0.773 0.008  [0.772 0.770 0.760 0.760 0.752]    1.685     0.687    0.000     0.500   0.000      0.014    -0.014     0.014      0.000         1.816       -1.816        1.816
           emb_mles__hidden_size_0256       0.776 0.014   0.762   0.791 0.012  [0.764 0.766 0.780 0.792 0.780]    0.852     0.440    1.939     0.956   0.014      0.016    -0.003     0.030      1.783         2.120       -0.338        3.903
           emb_mles__hidden_size_0512       0.766 0.008   0.758   0.775 0.007  [0.760 0.770 0.762 0.764 0.776]    2.645     0.815    0.645     0.731   0.004      0.013    -0.009     0.016      0.472         1.689       -1.217        2.161
           emb_mles__hidden_size_1024       0.763 0.013   0.750   0.776 0.011  [0.768 0.754 0.752 0.778 0.762]    1.000     0.500    0.000     0.500   0.000      0.016    -0.016     0.016      0.000         2.034       -2.034        2.034
           emb_mles__hidden_size_2048       0.757 0.008   0.749   0.765 0.007  [0.758 0.758 0.748 0.766 0.754]    2.620     0.813   -1.073     0.157  -0.006      0.013    -0.019     0.007     -0.787         1.691       -2.477        0.904
           emb_mles__hidden_size_3072       0.765 0.009   0.756   0.774 0.007  [0.768 0.768 0.760 0.774 0.756]    2.211     0.769    0.419     0.657   0.002      0.013    -0.011     0.016      0.315         1.733       -1.419        2.048
           mles_embeddings                  0.763 0.013   0.750   0.776 0.011  [0.768 0.754 0.752 0.778 0.762]    1.000     0.500    0.000     0.500   0.000      0.016    -0.016     0.016      0.000         2.034       -2.034        2.034

------------------------------------------------------------------------------------------------------------------------
End of report.     Current time: 2020-09-30 06:42:12
------------------------------------------------------------------------------------------------------------------------
