------------------------------------------------------------------------------------------------------------------------
Vector testing report
Params:
    conf: "conf/embeddings_validation_baselines_unsupervised.hocon"

Collected 30 files with 0 errors

------------------------------------------------------------------------------------------------------------------------
Metric: "auroc"
                           scores_valid                                                                                                                                                                                             
                                   mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                             
lgbm       baseline               0.806 0.013   0.793   0.818 0.010  [0.818 0.795 0.813 0.807 0.796]    1.000     0.500    0.000     0.500   0.000      0.015    -0.015     0.015      0.000         1.855       -1.855        1.855
           cpc_embeddings         0.800 0.020   0.780   0.819 0.016  [0.813 0.777 0.816 0.795 0.797]    0.422     0.212   -0.739     0.240  -0.006      0.019    -0.026     0.013     -0.772         2.409       -3.181        1.637
           mles_embeddings        0.823 0.017   0.806   0.839 0.014  [0.837 0.803 0.831 0.815 0.827]    0.571     0.300    2.211     0.971   0.017      0.018    -0.001     0.034      2.086         2.176       -0.089        4.262
           nsp_embeddings         0.817 0.016   0.801   0.833 0.013  [0.833 0.799 0.824 0.816 0.812]    0.639     0.337    1.488     0.912   0.011      0.017    -0.006     0.028      1.356         2.101       -0.746        3.457
           rtd_embeddings         0.796 0.014   0.783   0.810 0.011  [0.805 0.781 0.809 0.790 0.796]    0.849     0.439   -1.390     0.101  -0.009      0.016    -0.025     0.006     -1.167         1.936       -3.103        0.769
           sop_embeddings         0.788 0.011   0.778   0.799 0.009  [0.794 0.774 0.788 0.793 0.794]    1.437     0.633   -2.894     0.010  -0.017      0.014    -0.031    -0.004     -2.144         1.708       -3.852       -0.436
                           scores_test                                                                                                                                                                                             
                                  mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                            
lgbm       baseline              0.825 0.005   0.820   0.831 0.004  [0.820 0.830 0.825 0.822 0.830]    1.000     0.500    0.000     0.500   0.000      0.006    -0.006     0.006      0.000         0.768       -0.768        0.768
           cpc_embeddings        0.802 0.003   0.798   0.805 0.003  [0.805 0.803 0.800 0.802 0.798]    2.594     0.811  -10.381     0.000  -0.024      0.005    -0.029    -0.018     -2.877         0.639       -3.517       -2.238
           mles_embeddings       0.843 0.003   0.840   0.847 0.003  [0.839 0.844 0.844 0.843 0.847]    2.586     0.810    7.839     1.000   0.018      0.005     0.013     0.023      2.173         0.639        1.534        2.813
           nsp_embeddings        0.830 0.005   0.826   0.835 0.004  [0.836 0.832 0.827 0.830 0.827]    1.307     0.599    1.930     0.955   0.005      0.006    -0.001     0.011      0.604         0.721       -0.118        1.325
           rtd_embeddings        0.801 0.005   0.796   0.806 0.004  [0.804 0.800 0.806 0.800 0.795]    1.092     0.533   -9.043     0.000  -0.024      0.006    -0.031    -0.018     -2.947         0.752       -3.699       -2.196
           sop_embeddings        0.782 0.006   0.776   0.788 0.005  [0.782 0.776 0.779 0.784 0.788]    0.824     0.428  -15.011     0.000  -0.043      0.007    -0.050    -0.037     -5.259         0.808       -6.066       -4.451

------------------------------------------------------------------------------------------------------------------------
Metric: "accuracy"
                           scores_valid                                                                                                                                                                                             
                                   mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                             
lgbm       baseline               0.730 0.018   0.712   0.749 0.015  [0.747 0.710 0.740 0.733 0.722]    1.000     0.500    0.000     0.500   0.000      0.021    -0.021     0.021      0.000         2.908       -2.908        2.908
           cpc_embeddings         0.729 0.018   0.712   0.747 0.014  [0.743 0.708 0.740 0.724 0.731]    1.059     0.521   -0.122     0.453  -0.001      0.021    -0.022     0.020     -0.152         2.867       -3.019        2.715
           mles_embeddings        0.745 0.022   0.723   0.767 0.018  [0.764 0.723 0.749 0.730 0.759]    0.663     0.350    1.422     0.904   0.015      0.024    -0.009     0.038      2.008         3.257       -1.249        5.265
           nsp_embeddings         0.739 0.017   0.722   0.756 0.013  [0.759 0.723 0.744 0.734 0.733]    1.173     0.559    0.953     0.816   0.008      0.020    -0.012     0.029      1.156         2.799       -1.643        3.955
           rtd_embeddings         0.725 0.012   0.713   0.737 0.010  [0.733 0.713 0.737 0.719 0.722]    2.194     0.767   -0.707     0.250  -0.006      0.018    -0.024     0.013     -0.761         2.481       -3.241        1.720
           sop_embeddings         0.710 0.018   0.693   0.728 0.014  [0.726 0.691 0.701 0.721 0.713]    1.046     0.517   -2.195     0.030  -0.020      0.021    -0.041     0.001     -2.738         2.876       -5.614        0.138
                           scores_test                                                                                                                                                                                             
                                  mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                            
lgbm       baseline              0.750 0.006   0.744   0.756 0.005  [0.746 0.758 0.748 0.748 0.752]    1.000     0.500    0.000     0.500   0.000      0.007    -0.007     0.007      0.000         0.928       -0.928        0.928
           cpc_embeddings        0.734 0.013   0.721   0.747 0.010  [0.730 0.728 0.732 0.752 0.728]    0.219     0.085   -3.257     0.006  -0.016      0.012    -0.028    -0.005     -2.186         1.548       -3.733       -0.638
           mles_embeddings       0.763 0.013   0.750   0.776 0.011  [0.768 0.754 0.752 0.778 0.762]    0.201     0.075    2.378     0.978   0.012      0.012     0.000     0.024      1.652         1.603        0.050        3.255
           nsp_embeddings        0.757 0.010   0.747   0.768 0.008  [0.756 0.744 0.758 0.762 0.766]    0.329     0.154    1.585     0.924   0.007      0.010    -0.003     0.017      0.906         1.318       -0.412        2.224
           rtd_embeddings        0.741 0.023   0.719   0.764 0.018  [0.758 0.714 0.736 0.758 0.740]    0.068     0.012   -1.090     0.154  -0.009      0.019    -0.029     0.010     -1.226         2.593       -3.819        1.367
           sop_embeddings        0.713 0.013   0.700   0.726 0.010  [0.724 0.722 0.700 0.714 0.706]    0.217     0.084   -7.352     0.000  -0.037      0.012    -0.049    -0.026     -4.957         1.555       -6.512       -3.403

------------------------------------------------------------------------------------------------------------------------
End of report.     Current time: 2020-10-02 07:24:50
------------------------------------------------------------------------------------------------------------------------
