------------------------------------------------------------------------------------------------------------------------
Vector testing report
Params:
    conf: "conf/embeddings_validation_baselines_unsupervised.hocon"

Collected 30 files with 0 errors

------------------------------------------------------------------------------------------------------------------------
Metric: "accuracy"
                           scores_valid                                                                                                                                                                                             
                                   mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                             
lgbm       baseline               0.633 0.003   0.631   0.636 0.002  [0.632 0.635 0.636 0.632 0.632]    1.000     0.500    0.000     0.500   0.000      0.003    -0.003     0.003      0.000         0.470       -0.470        0.470
           cpc_embeddings         0.600 0.006   0.594   0.606 0.005  [0.600 0.602 0.603 0.592 0.602]    0.186     0.066  -14.506     0.000  -0.033      0.005    -0.039    -0.028     -5.275         0.839       -6.113       -4.436
           mles_embeddings        0.638 0.006   0.633   0.644 0.005  [0.640 0.637 0.646 0.636 0.634]    0.198     0.073    2.259     0.973   0.005      0.005    -0.000     0.010      0.801         0.818       -0.017        1.619
           nsp_embeddings         0.619 0.003   0.616   0.622 0.002  [0.617 0.620 0.621 0.621 0.616]    0.815     0.424  -10.333     0.000  -0.014      0.003    -0.017    -0.011     -2.222         0.496       -2.718       -1.726
           rtd_embeddings         0.636 0.008   0.627   0.644 0.007  [0.631 0.639 0.646 0.629 0.634]    0.091     0.020    0.807     0.778   0.003      0.007    -0.005     0.010      0.404         1.153       -0.750        1.557
           sop_embeddings         0.499 0.008   0.490   0.507 0.007  [0.495 0.508 0.490 0.501 0.498]    0.091     0.020  -42.757     0.000  -0.135      0.007    -0.142    -0.128    -21.287         1.148      -22.435      -20.139
                           scores_test                                                                                                                                                                                             
                                  mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                            
lgbm       baseline              0.631 0.004   0.627   0.635 0.003  [0.630 0.632 0.635 0.633 0.626]    1.000     0.500    0.000     0.500   0.000      0.005    -0.005     0.005      0.000         0.787       -0.787        0.787
           cpc_embeddings        0.594 0.002   0.591   0.596 0.002  [0.596 0.595 0.595 0.592 0.592]    3.132     0.853  -21.312     0.000  -0.037      0.004    -0.041    -0.033     -5.905         0.639       -6.544       -5.266
           mles_embeddings       0.638 0.008   0.630   0.647 0.007  [0.643 0.644 0.641 0.634 0.628]    0.257     0.109    2.100     0.966   0.007      0.008    -0.001     0.015      1.120         1.230       -0.110        2.349
           nsp_embeddings        0.622 0.005   0.617   0.627 0.004  [0.619 0.620 0.619 0.629 0.622]    0.622     0.328   -3.742     0.003  -0.009      0.006    -0.015    -0.004     -1.458         0.898       -2.356       -0.559
           rtd_embeddings        0.632 0.002   0.629   0.634 0.002  [0.629 0.631 0.630 0.633 0.634]    3.386     0.868    0.231     0.588   0.000      0.004    -0.004     0.004      0.063         0.633       -0.570        0.696
           sop_embeddings        0.493 0.002   0.491   0.496 0.002  [0.491 0.496 0.494 0.493 0.492]    3.332     0.865  -79.459     0.000  -0.138      0.004    -0.142    -0.134    -21.855         0.634      -22.489      -21.221

------------------------------------------------------------------------------------------------------------------------
End of report.     Current time: 2020-10-02 07:10:39
------------------------------------------------------------------------------------------------------------------------
