------------------------------------------------------------------------------------------------------------------------
Vector testing report
Params:
    conf: "conf/embeddings_validation_baselines_unsupervised.hocon"

Collected 30 files with 0 errors

------------------------------------------------------------------------------------------------------------------------
Metric: "accuracy"
                           scores_valid                                                                                                                                                                                             
                                   mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                             
lgbm       baseline               0.548 0.003   0.545   0.550 0.002  [0.545 0.546 0.549 0.550 0.549]    1.000     0.500    0.000     0.500   0.000      0.003    -0.003     0.003      0.000         0.544       -0.544        0.544
           cpc_embeddings         0.524 0.003   0.521   0.526 0.002  [0.522 0.522 0.527 0.522 0.525]    0.892     0.457  -18.310     0.000  -0.024      0.003    -0.027    -0.021     -4.450         0.560       -5.010       -3.889
           mles_embeddings        0.541 0.002   0.540   0.543 0.001  [0.541 0.539 0.543 0.541 0.542]    2.583     0.810   -6.269     0.000  -0.007      0.002    -0.009    -0.004     -1.232         0.453       -1.685       -0.779
           nsp_embeddings         0.424 0.001   0.423   0.426 0.001  [0.426 0.424 0.424 0.423 0.425]    3.294     0.863 -118.449     0.000  -0.124      0.002    -0.126    -0.121    -22.564         0.439      -23.003      -22.124
           rtd_embeddings         0.520 0.002   0.518   0.522 0.002  [0.520 0.517 0.521 0.521 0.520]    1.323     0.604  -23.190     0.000  -0.028      0.003    -0.031    -0.025     -5.127         0.510       -5.636       -4.617
           sop_embeddings         0.429 0.002   0.428   0.431 0.001  [0.427 0.429 0.430 0.431 0.429]    2.226     0.771 -107.760     0.000  -0.119      0.003    -0.121    -0.116    -21.644         0.463      -22.107      -21.180
                           scores_test                                                                                                                                                                                             
                                  mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                            
lgbm       baseline              0.547 0.001   0.546   0.548 0.001  [0.546 0.548 0.547 0.548 0.546]    1.000     0.500    0.000     0.500   0.000      0.001    -0.001     0.001      0.000         0.199       -0.199        0.199
           cpc_embeddings        0.525 0.001   0.523   0.526 0.001  [0.523 0.526 0.526 0.524 0.525]    0.418     0.209  -35.921     0.000  -0.022      0.001    -0.024    -0.021     -4.039         0.259       -4.298       -3.779
           mles_embeddings       0.539 0.001   0.538   0.540 0.001  [0.538 0.540 0.539 0.538 0.539]    0.896     0.459  -16.236     0.000  -0.008      0.001    -0.009    -0.007     -1.442         0.205       -1.646       -1.237
           nsp_embeddings        0.425 0.003   0.422   0.427 0.002  [0.424 0.428 0.423 0.423 0.426]    0.124     0.034 -121.552     0.000  -0.122      0.002    -0.124    -0.120    -22.333         0.424      -22.757      -21.909
           rtd_embeddings        0.520 0.002   0.518   0.521 0.001  [0.521 0.520 0.520 0.520 0.518]    0.335     0.157  -40.675     0.000  -0.027      0.002    -0.029    -0.026     -4.956         0.281       -5.237       -4.675
           sop_embeddings        0.428 0.001   0.427   0.429 0.001  [0.429 0.427 0.428 0.427 0.429]    0.703     0.370 -229.060     0.000  -0.119      0.001    -0.120    -0.118    -21.765         0.219      -21.984      -21.545

------------------------------------------------------------------------------------------------------------------------
End of report.     Current time: 2020-10-02 07:26:57
------------------------------------------------------------------------------------------------------------------------
