------------------------------------------------------------------------------------------------------------------------
Vector testing report
Params:
    conf: "conf/embeddings_validation_short_1601447982.hocon"

Collected 45 files with 0 errors

------------------------------------------------------------------------------------------------------------------------
Metric: "auroc"
                                                 scores_valid                                                                                                                                                                                             
                                                         mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                                                   
lgbm       emb_mles__loss_binomialdeviance              0.769 0.018   0.751   0.788 0.015  [0.781 0.749 0.782 0.775 0.758]    0.841     0.435   -5.947     0.000  -0.053      0.021    -0.074    -0.033     -6.489         2.516       -9.005       -3.973
           emb_mles__loss_contrastive_margin_0.3        0.820 0.014   0.807   0.834 0.011  [0.833 0.804 0.822 0.816 0.826]    1.509     0.650   -0.297     0.387  -0.002      0.018    -0.020     0.016     -0.283         2.193       -2.475        1.910
           emb_mles__loss_contrastive_margin_0.5        0.823 0.017   0.806   0.839 0.014  [0.837 0.803 0.831 0.815 0.827]    1.000     0.500    0.000     0.500   0.000      0.020    -0.020     0.020      0.000         2.405       -2.405        2.405
           emb_mles__loss_contrastive_margin_0.8        0.822 0.013   0.809   0.835 0.010  [0.833 0.806 0.822 0.821 0.829]    1.691     0.688   -0.057     0.478  -0.000      0.018    -0.018     0.017     -0.053         2.145       -2.198        2.093
           emb_mles__loss_histogramloss                 0.815 0.018   0.798   0.833 0.014  [0.831 0.801 0.821 0.825 0.800]    0.892     0.457   -0.798     0.224  -0.007      0.020    -0.027     0.013     -0.857         2.476       -3.333        1.620
           emb_mles__loss_margin_0.2_beta_0.4           0.823 0.012   0.811   0.835 0.010  [0.831 0.809 0.831 0.827 0.818]    1.988     0.739    0.075     0.529   0.001      0.017    -0.017     0.018      0.067         2.085       -2.018        2.152
           emb_mles__loss_margin_0.3_beta_0.6           0.815 0.006   0.809   0.821 0.005  [0.820 0.809 0.820 0.814 0.811]    7.200     0.959   -1.174     0.137  -0.008      0.015    -0.023     0.007     -0.924         1.815       -2.739        0.891
           emb_mles__loss_triplet                       0.781 0.021   0.760   0.802 0.017  [0.795 0.752 0.792 0.782 0.783]    0.641     0.338   -4.319     0.001  -0.042      0.022    -0.064    -0.020     -5.098         2.722       -7.819       -2.376
           mles_embeddings                              0.823 0.017   0.806   0.839 0.014  [0.837 0.803 0.831 0.815 0.827]    1.000     0.500    0.000     0.500   0.000      0.020    -0.020     0.020      0.000         2.405       -2.405        2.405
                                                 scores_test                                                                                                                                                                                             
                                                        mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                                                  
lgbm       emb_mles__loss_binomialdeviance             0.782 0.005   0.777   0.787 0.004  [0.780 0.780 0.784 0.779 0.788]    0.440     0.223  -28.010     0.000  -0.061      0.005    -0.066    -0.056     -7.261         0.598       -7.859       -6.663
           emb_mles__loss_contrastive_margin_0.3       0.844 0.003   0.841   0.847 0.003  [0.844 0.848 0.841 0.844 0.844]    1.124     0.544    0.458     0.671   0.001      0.004    -0.003     0.005      0.090         0.454       -0.364        0.545
           emb_mles__loss_contrastive_margin_0.5       0.843 0.003   0.840   0.847 0.003  [0.839 0.844 0.844 0.843 0.847]    1.000     0.500    0.000     0.500   0.000      0.004    -0.004     0.004      0.000         0.467       -0.467        0.467
           emb_mles__loss_contrastive_margin_0.8       0.840 0.003   0.838   0.843 0.002  [0.840 0.843 0.837 0.839 0.841]    1.587     0.667   -2.107     0.034  -0.003      0.004    -0.007     0.000     -0.385         0.422       -0.807        0.036
           emb_mles__loss_histogramloss                0.822 0.003   0.819   0.825 0.002  [0.824 0.820 0.821 0.825 0.821]    1.250     0.583  -13.045     0.000  -0.021      0.004    -0.025    -0.017     -2.508         0.443       -2.951       -2.065
           emb_mles__loss_margin_0.2_beta_0.4          0.830 0.003   0.827   0.834 0.003  [0.828 0.833 0.828 0.833 0.829]    1.028     0.510   -7.758     0.000  -0.013      0.004    -0.017    -0.009     -1.562         0.464       -2.026       -1.097
           emb_mles__loss_margin_0.3_beta_0.6          0.828 0.003   0.825   0.830 0.002  [0.826 0.828 0.825 0.829 0.831]    1.344     0.609   -9.929     0.000  -0.016      0.004    -0.020    -0.012     -1.879         0.436       -2.315       -1.443
           emb_mles__loss_triplet                      0.795 0.010   0.785   0.805 0.008  [0.787 0.789 0.806 0.793 0.800]    0.114     0.029  -12.824     0.000  -0.048      0.009    -0.057    -0.040     -5.743         1.033       -6.776       -4.711
           mles_embeddings                             0.843 0.003   0.840   0.847 0.003  [0.839 0.844 0.844 0.843 0.847]    1.000     0.500    0.000     0.500   0.000      0.004    -0.004     0.004      0.000         0.467       -0.467        0.467

------------------------------------------------------------------------------------------------------------------------
Metric: "accuracy"
                                                 scores_valid                                                                                                                                                                                             
                                                         mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                                                   
lgbm       emb_mles__loss_binomialdeviance              0.699 0.020   0.679   0.719 0.016  [0.711 0.678 0.716 0.702 0.687]    1.239     0.580   -4.318     0.001  -0.046      0.025    -0.071    -0.022     -6.233         3.329       -9.562       -2.905
           emb_mles__loss_contrastive_margin_0.3        0.740 0.013   0.727   0.752 0.010  [0.756 0.730 0.733 0.743 0.736]    3.076     0.849   -0.603     0.282  -0.006      0.021    -0.027     0.016     -0.746         2.851       -3.596        2.105
           emb_mles__loss_contrastive_margin_0.5        0.745 0.022   0.723   0.767 0.018  [0.764 0.723 0.749 0.730 0.759]    1.000     0.500    0.000     0.500   0.000      0.026    -0.026     0.026      0.000         3.502       -3.502        3.502
           emb_mles__loss_contrastive_margin_0.8        0.748 0.019   0.728   0.767 0.016  [0.761 0.724 0.741 0.749 0.762]    1.312     0.600    0.230     0.588   0.002      0.024    -0.022     0.027      0.328         3.288       -2.959        3.616
           emb_mles__loss_histogramloss                 0.741 0.015   0.726   0.756 0.012  [0.761 0.732 0.740 0.742 0.730]    2.117     0.757   -0.412     0.346  -0.004      0.022    -0.026     0.018     -0.537         3.005       -3.542        2.468
           emb_mles__loss_margin_0.2_beta_0.4           0.750 0.011   0.739   0.761 0.009  [0.758 0.741 0.742 0.760 0.748]    4.203     0.903    0.524     0.693   0.005      0.021    -0.016     0.025      0.626         2.755       -2.129        3.382
           emb_mles__loss_margin_0.3_beta_0.6           0.738 0.006   0.732   0.745 0.005  [0.741 0.733 0.743 0.741 0.732]   12.466     0.984   -0.828     0.216  -0.007      0.019    -0.026     0.012     -0.925         2.574       -3.498        1.649
           emb_mles__loss_triplet                       0.707 0.023   0.684   0.730 0.019  [0.717 0.678 0.724 0.699 0.717]    0.908     0.464   -3.295     0.005  -0.038      0.027    -0.065    -0.011     -5.130         3.590       -8.720       -1.540
           mles_embeddings                              0.745 0.022   0.723   0.767 0.018  [0.764 0.723 0.749 0.730 0.759]    1.000     0.500    0.000     0.500   0.000      0.026    -0.026     0.026      0.000         3.502       -3.502        3.502
                                                 scores_test                                                                                                                                                                                             
                                                        mean  t_pm t_int_l t_int_h   std                           values t_f_stat t_f_alpha t_t_stat t_t_alpha t_delta t_delta_pm t_delta_l t_delta_h t_delta_pp t_delta_pm_pp t_delta_l_pp t_delta_h_pp
model_name feature_name                                                                                                                                                                                                                                  
lgbm       emb_mles__loss_binomialdeviance             0.696 0.008   0.687   0.704 0.007  [0.698 0.686 0.704 0.692 0.698]    2.419     0.793  -11.879     0.000  -0.067      0.013    -0.080    -0.054     -8.810         1.710      -10.520       -7.100
           emb_mles__loss_contrastive_margin_0.3       0.771 0.009   0.761   0.780 0.008  [0.774 0.774 0.764 0.762 0.780]    1.979     0.738    1.370     0.896   0.008      0.013    -0.005     0.021      1.049         1.765       -0.716        2.814
           emb_mles__loss_contrastive_margin_0.5       0.763 0.013   0.750   0.776 0.011  [0.768 0.754 0.752 0.778 0.762]    1.000     0.500    0.000     0.500   0.000      0.016    -0.016     0.016      0.000         2.034       -2.034        2.034
           emb_mles__loss_contrastive_margin_0.8       0.765 0.014   0.751   0.779 0.011  [0.770 0.762 0.762 0.750 0.780]    0.919     0.468    0.291     0.611   0.002      0.016    -0.014     0.018      0.262         2.079       -1.816        2.341
           emb_mles__loss_histogramloss                0.742 0.013   0.729   0.755 0.011  [0.758 0.738 0.742 0.744 0.728]    0.959     0.484   -3.059     0.008  -0.021      0.016    -0.036    -0.005     -2.727         2.056       -4.782       -0.671
           emb_mles__loss_margin_0.2_beta_0.4          0.754 0.009   0.745   0.763 0.008  [0.750 0.746 0.760 0.764 0.750]    1.952     0.733   -1.504     0.086  -0.009      0.013    -0.022     0.005     -1.154         1.769       -2.923        0.615
           emb_mles__loss_margin_0.3_beta_0.6          0.755 0.017   0.738   0.772 0.014  [0.768 0.762 0.734 0.748 0.762]    0.598     0.315   -1.029     0.167  -0.008      0.018    -0.026     0.010     -1.049         2.351       -3.400        1.302
           emb_mles__loss_triplet                      0.726 0.014   0.711   0.740 0.011  [0.710 0.736 0.718 0.728 0.736]    0.865     0.446   -5.325     0.000  -0.037      0.016    -0.053    -0.021     -4.877         2.112       -6.989       -2.765
           mles_embeddings                             0.763 0.013   0.750   0.776 0.011  [0.768 0.754 0.752 0.778 0.762]    1.000     0.500    0.000     0.500   0.000      0.016    -0.016     0.016      0.000         2.034       -2.034        2.034

------------------------------------------------------------------------------------------------------------------------
End of report.     Current time: 2020-09-30 06:39:52
------------------------------------------------------------------------------------------------------------------------
