------------------------------------------------------------------------------------------------------------------------
Vector testing report
Params:
    conf: "conf/embeddings_validation_baselines_unsupervised.hocon"

Collected 30 files with 0 errors

------------------------------------------------------------------------------------------------------------------------
Metric: "accuracy"
                           scores_valid                                                                                                                                                                                             
                                   mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                             
lgbm       baseline               0.616 0.003   0.613   0.620 0.003  [0.618 0.613 0.616 0.615 0.620]    1.000     0.500    0.000     0.500   0.000      0.004    -0.004     0.004      0.000         0.667       -0.667        0.667
           cpc_embeddings         0.604 0.004   0.600   0.608 0.003  [0.604 0.607 0.607 0.603 0.598]    0.678     0.358   -6.350     0.000  -0.013      0.005    -0.017    -0.008     -2.043         0.742       -2.784       -1.301
           mles_embeddings        0.617 0.008   0.610   0.625 0.006  [0.617 0.615 0.628 0.612 0.614]    0.198     0.073    0.345     0.630   0.001      0.007    -0.006     0.008      0.174         1.161       -0.987        1.335
           nsp_embeddings         0.593 0.006   0.587   0.598 0.004  [0.589 0.590 0.598 0.597 0.589]    0.399     0.197  -10.079     0.000  -0.024      0.005    -0.029    -0.018     -3.860         0.883       -4.743       -2.977
           rtd_embeddings         0.587 0.005   0.582   0.592 0.004  [0.584 0.589 0.588 0.591 0.581]    0.483     0.249  -13.426     0.000  -0.030      0.005    -0.035    -0.025     -4.810         0.826       -5.636       -3.984
           sop_embeddings         0.588 0.006   0.582   0.594 0.005  [0.584 0.588 0.595 0.590 0.582]    0.331     0.155  -11.256     0.000  -0.028      0.006    -0.034    -0.023     -4.616         0.946       -5.562       -3.670
                           scores_test                                                                                                                                                                                             
                                  mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                            
lgbm       baseline              0.602 0.006   0.596   0.608 0.005  [0.605 0.605 0.607 0.598 0.595]    1.000     0.500    0.000     0.500   0.000      0.007    -0.007     0.007      0.000         1.244       -1.244        1.244
           cpc_embeddings        0.588 0.002   0.586   0.590 0.002  [0.587 0.586 0.590 0.590 0.587]    8.009     0.966   -5.694     0.000  -0.014      0.006    -0.019    -0.008     -2.304         0.933       -3.237       -1.371
           mles_embeddings       0.601 0.002   0.599   0.604 0.002  [0.601 0.599 0.602 0.604 0.600]    7.025     0.957   -0.226     0.413  -0.001      0.006    -0.006     0.005     -0.092         0.940       -1.032        0.848
           nsp_embeddings        0.581 0.004   0.577   0.585 0.003  [0.580 0.586 0.582 0.578 0.578]    2.153     0.762   -7.545     0.000  -0.021      0.006    -0.027    -0.015     -3.483         1.065       -4.548       -2.419
           rtd_embeddings        0.580 0.004   0.576   0.585 0.003  [0.577 0.584 0.582 0.576 0.582]    2.159     0.763   -7.788     0.000  -0.022      0.006    -0.028    -0.015     -3.594         1.064       -4.658       -2.530
           sop_embeddings        0.577 0.003   0.574   0.580 0.002  [0.578 0.579 0.573 0.578 0.576]    4.350     0.908   -9.801     0.000  -0.025      0.006    -0.031    -0.019     -4.147         0.976       -5.122       -3.171

------------------------------------------------------------------------------------------------------------------------
End of report.     Current time: 2020-10-02 07:23:28
------------------------------------------------------------------------------------------------------------------------
