------------------------------------------------------------------------------------------------------------------------
Vector testing report
Params:
    conf: "conf/embeddings_validation_baselines_supervised.hocon"

Collected 5 files with 0 errors

------------------------------------------------------------------------------------------------------------------------
Metric: "auroc"
                           scores_valid                                                                                                                                                                                             
                                   mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                             
nn         cpc_finetuning         0.791 0.020   0.771   0.811 0.016  [0.777 0.811 0.771 0.797 0.799]    1.219     0.574   -1.983     0.041  -0.021      0.025    -0.046     0.003     -2.642         3.072       -5.714        0.431
           mles_finetuning        0.814 0.026   0.788   0.840 0.021  [0.805 0.824 0.781 0.832 0.827]    0.732     0.385    0.094     0.536   0.001      0.028    -0.027     0.030      0.143         3.502       -3.359        3.646
           nsp_finetuning         0.802 0.018   0.784   0.820 0.014  [0.797 0.809 0.780 0.808 0.818]    1.533     0.655   -1.019     0.169  -0.011      0.024    -0.034     0.013     -1.293         2.927       -4.220        1.634
           rtd_finetuning         0.804 0.023   0.781   0.827 0.019  [0.791 0.818 0.793 0.829 0.788]    0.939     0.476   -0.790     0.226  -0.009      0.027    -0.036     0.017     -1.120         3.272       -4.393        2.152
           target_scores          0.813 0.022   0.790   0.835 0.018  [0.804 0.826 0.785 0.822 0.827]    1.000     0.500    0.000     0.500   0.000      0.026    -0.026     0.026      0.000         3.220       -3.220        3.220
                           scores_test                                                                                                                                                                                             
                                  mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                            
nn         cpc_finetuning        0.810 0.008   0.802   0.818 0.006  [0.811 0.811 0.815 0.799 0.814]    2.220     0.771   -1.463     0.091  -0.007      0.012    -0.019     0.004     -0.899         1.416       -2.315        0.518
           mles_finetuning       0.827 0.004   0.822   0.831 0.004  [0.824 0.833 0.825 0.827 0.825]    6.930     0.956    2.070     0.964   0.009      0.010    -0.001     0.020      1.129         1.258       -0.129        2.387
           nsp_finetuning        0.818 0.008   0.810   0.826 0.006  [0.820 0.814 0.822 0.808 0.824]    2.121     0.758    0.064     0.525   0.000      0.012    -0.011     0.012      0.040         1.427       -1.387        1.466
           rtd_finetuning        0.819 0.006   0.813   0.826 0.005  [0.824 0.826 0.818 0.815 0.816]    3.594     0.878    0.442     0.665   0.002      0.011    -0.009     0.013      0.255         1.330       -1.075        1.585
           target_scores         0.817 0.012   0.806   0.829 0.009  [0.806 0.814 0.826 0.813 0.828]    1.000     0.500    0.000     0.500   0.000      0.014    -0.014     0.014      0.000         1.663       -1.663        1.663

------------------------------------------------------------------------------------------------------------------------
End of report.     Current time: 2020-10-02 07:26:24
------------------------------------------------------------------------------------------------------------------------
