| Task | Dataset | Classes | Instances | Features | Majority Percentage | Two-sample classification1 | Residual diagnostics1 | Resampling uncertainty1 | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FE | Median | MAD | FE | Median | MAD | FE | Median | MAD | ||||||
| 3 | kr-vs-kp | 2 | 3196 | 37 | 52.22 | 0.27 | 0.74 | 1.09 | 6.71 | 9.97 | 0.00 | 6.34 | 7.33 | 3.91 |
| 6 | letter | 26 | 20000 | 17 | 4.06 | 0.13 | 0.58 | 0.87 | 0.95 | 1.98 | 1.94 | 0.45 | 1.00 | 1.28 |
| 11 | balan...cale | 3 | 625 | 5 | 46.08 | 0.10 | 0.54 | 0.79 | 0.16 | 0.74 | 1.09 | 0.29 | 1.05 | 1.17 |
| 12 | mfeat...tors | 10 | 2000 | 217 | 10.00 | 0.14 | 0.49 | 0.37 | 1.05 | 1.10 | 0.78 | 0.19 | 0.82 | 0.84 |
| 14 | mfeat...rier | 10 | 2000 | 77 | 10.00 | 0.26 | 0.81 | 0.67 | 0.43 | 0.58 | 0.48 | 0.09 | 0.49 | 0.72 |
| 15 | breast-w | 2 | 699 | 10 | 65.52 | 0.11 | 0.49 | 0.72 | 0.80 | 1.00 | 0.77 | 0.67 | 0.73 | 0.69 |
| 16 | mfeat...unen | 10 | 2000 | 65 | 10.00 | 0.05 | 0.26 | 0.39 | 0.47 | 0.73 | 0.69 | 0.35 | 0.89 | 0.93 |
| 18 | mfeat...ical | 10 | 2000 | 7 | 10.00 | 0.09 | 0.54 | 0.79 | 0.51 | 0.94 | 0.72 | 0.23 | 0.54 | 0.79 |
| 22 | mfeat...nike | 10 | 2000 | 48 | 10.00 | 0.30 | 0.87 | 1.09 | 0.48 | 1.05 | 0.72 | 0.26 | 0.49 | 0.37 |
| 23 | cmc | 3 | 1473 | 10 | 42.70 | 0.58 | 1.05 | 1.17 | 0.07 | 0.61 | 0.90 | 0.17 | 0.73 | 1.08 |
| 28 | optdigits | 10 | 5620 | 65 | 10.18 | 0.26 | 0.58 | 0.67 | 0.42 | 0.99 | 1.08 | 0.40 | 0.99 | 1.11 |
| 29 | credi...oval | 2 | 690 | 16 | 55.51 | 0.79 | 1.81 | 2.32 | 0.44 | 1.19 | 0.89 | 0.26 | 0.49 | 0.72 |
| 31 | credit-g | 2 | 1000 | 21 | 70.00 | 1.60 | 1.79 | 1.46 | 0.57 | 0.66 | 0.59 | 0.11 | 0.58 | 0.87 |
| 32 | pendigits | 10 | 10992 | 17 | 10.41 | 0.49 | 1.13 | 1.34 | 2.39 | 3.39 | 3.12 | 3.05 | 2.92 | 2.79 |
| 37 | diabetes | 2 | 768 | 9 | 65.10 | 0.18 | 0.66 | 0.98 | 0.16 | 0.49 | 0.72 | 0.46 | 0.74 | 0.70 |
| 43 | spambase | 2 | 4601 | 58 | 60.60 | 0.16 | 0.82 | 1.21 | 0.51 | 1.05 | 1.36 | 0.59 | 1.00 | 0.76 |
| 45 | splice | 3 | 3190 | 61 | 51.88 | 9.97 | 9.97 | 0.00 | 9.97 | 9.97 | 0.00 | 9.97 | 9.97 | 0.00 |
| 49 | tic-tac-toe | 2 | 958 | 10 | 65.34 | 0.13 | 0.68 | 1.01 | 0.39 | 0.81 | 1.00 | 0.21 | 0.79 | 1.17 |
| 53 | vehicle | 4 | 846 | 19 | 25.77 | 0.38 | 1.05 | 1.17 | 0.25 | 0.58 | 0.81 | 0.70 | 1.06 | 1.19 |
| 219 | electricity | 2 | 45312 | 9 | 57.55 | 0.17 | 1.15 | 1.35 | 0.94 | 1.22 | 1.09 | 0.27 | 0.49 | 0.47 |
| 2074 | satimage | 6 | 6430 | 37 | 23.81 | 0.18 | 0.37 | 0.55 | 0.70 | 1.08 | 1.05 | 0.40 | 0.88 | 1.31 |
| 2079 | eucalyptus | 5 | 736 | 20 | 29.08 | 1.60 | 3.04 | 3.41 | 0.43 | 0.88 | 1.17 | 0.24 | 0.54 | 0.74 |
| 3021 | sick | 2 | 3772 | 30 | 93.88 | 0.08 | 0.37 | 0.55 | 4.64 | 5.76 | 1.75 | 4.92 | 5.10 | 4.05 |
| 3022 | vowel | 11 | 990 | 13 | 9.09 | 0.55 | 1.36 | 1.69 | 0.40 | 1.00 | 0.60 | 0.13 | 0.49 | 0.72 |
| 3549 | analc...ship | 4 | 841 | 71 | 37.69 | 0.19 | 1.02 | 1.40 | 0.55 | 0.92 | 1.11 | 0.59 | 1.00 | 1.20 |
| 3560 | analc...dmft | 6 | 797 | 5 | 19.45 | 0.21 | 0.69 | 1.02 | 0.30 | 0.82 | 0.98 | 0.21 | 1.02 | 1.13 |
| 3902 | pc4 | 2 | 1458 | 38 | 87.79 | 0.08 | 0.26 | 0.39 | 0.51 | 1.19 | 1.19 | 1.03 | 1.39 | 1.39 |
| 3903 | pc3 | 2 | 1563 | 38 | 89.76 | 0.27 | 1.08 | 1.61 | 0.35 | 0.82 | 0.98 | 0.31 | 0.73 | 1.08 |
| 3904 | jm1 | 2 | 10885 | 22 | 80.65 | 0.51 | 1.17 | 1.19 | 0.47 | 0.81 | 0.80 | 0.18 | 0.74 | 0.92 |
| 3913 | kc2 | 2 | 522 | 22 | 79.50 | 0.12 | 0.81 | 1.19 | 0.49 | 0.88 | 0.59 | 0.27 | 0.87 | 0.91 |
| 3917 | kc1 | 2 | 2109 | 22 | 84.54 | 0.31 | 0.54 | 0.79 | 0.49 | 0.58 | 0.74 | 0.20 | 0.61 | 0.90 |
| 3918 | pc1 | 2 | 1109 | 22 | 93.06 | 0.12 | 0.54 | 0.79 | 0.52 | 1.04 | 1.35 | 0.28 | 0.88 | 1.17 |
| 7592 | adult | 2 | 48842 | 15 | 76.07 | 1.82 | 3.10 | 3.48 | 1.68 | 1.63 | 1.07 | 0.73 | 1.15 | 0.98 |
| 9946 | wdbc | 2 | 569 | 31 | 62.74 | 0.17 | 0.49 | 0.65 | 0.98 | 1.28 | 1.11 | 0.69 | 1.10 | 0.83 |
| 9952 | phoneme | 2 | 5404 | 6 | 70.65 | 0.21 | 0.49 | 0.72 | 0.59 | 0.89 | 0.77 | 0.15 | 0.54 | 0.79 |
| 9957 | qsar-biodeg | 2 | 1055 | 42 | 66.26 | 0.06 | 0.26 | 0.39 | 0.36 | 0.82 | 0.96 | 0.28 | 0.95 | 1.20 |
| 9960 | wall-...tion | 4 | 5456 | 25 | 40.41 | 0.12 | 0.54 | 0.79 | 9.22 | 9.97 | 0.00 | 8.72 | 9.97 | 0.00 |
| 9964 | semeion | 10 | 1593 | 257 | 10.17 | 0.45 | 1.00 | 1.20 | 0.42 | 0.87 | 1.09 | 0.18 | 0.49 | 0.45 |
| 9971 | ilpd | 2 | 583 | 11 | 71.36 | 0.11 | 0.37 | 0.55 | 0.31 | 0.49 | 0.72 | 0.32 | 0.66 | 0.62 |
| 9977 | nomao | 2 | 34465 | 119 | 71.44 | 0.51 | 1.46 | 1.77 | 8.68 | 9.97 | 0.00 | 7.77 | 9.97 | 0.00 |
| 9978 | ozone...-8hr | 2 | 2534 | 73 | 93.69 | 0.28 | 0.81 | 1.13 | 0.60 | 1.21 | 1.41 | 0.27 | 1.19 | 1.55 |
| 9985 | first...ving | 6 | 6118 | 52 | 41.75 | 0.17 | 0.54 | 0.79 | 0.37 | 0.81 | 0.52 | 0.04 | 0.26 | 0.39 |
| 10093 | bankn...tion | 2 | 1372 | 5 | 55.54 | 0.16 | 1.29 | 1.91 | 2.12 | 2.79 | 3.15 | 1.65 | 2.77 | 3.13 |
| 10101 | blood...nter | 2 | 748 | 5 | 76.20 | 0.43 | 0.66 | 0.88 | 0.24 | 0.54 | 0.79 | 0.31 | 0.49 | 0.65 |
| 14952 | Phish...ites | 2 | 11055 | 31 | 55.69 | 0.25 | 1.72 | 2.18 | 4.08 | 3.93 | 1.85 | 3.68 | 3.74 | 2.35 |
| 14954 | cylin...ands | 2 | 540 | 40 | 57.78 | 9.97 | 9.97 | 0.00 | 9.97 | 9.97 | 0.00 | 8.92 | 9.97 | 0.00 |
| 14965 | bank-...ting | 2 | 45211 | 17 | 88.30 | 0.13 | 0.49 | 0.72 | 3.68 | 3.74 | 2.32 | 1.37 | 2.90 | 2.13 |
| 14969 | Gestu...ssed | 5 | 9873 | 33 | 29.88 | 0.16 | 0.57 | 0.84 | 0.33 | 0.81 | 0.80 | 0.00 | 0.00 | 0.00 |
| 125920 | dress...ales | 2 | 500 | 13 | 58.00 | 9.62 | 9.97 | 0.00 | 2.55 | 2.66 | 2.03 | 0.74 | 1.25 | 1.12 |
| 125922 | texture | 11 | 5500 | 41 | 9.09 | 0.19 | 0.81 | 1.19 | 1.42 | 2.67 | 1.37 | 0.64 | 2.20 | 1.07 |
| 146195 | connect-4 | 3 | 67557 | 43 | 65.83 | 0.25 | 1.00 | 1.29 | 0.83 | 0.88 | 0.59 | 0.07 | 0.26 | 0.39 |
| 146800 | MiceProtein | 8 | 1080 | 82 | 13.89 | 9.97 | 9.97 | 0.00 | 9.97 | 9.97 | 0.00 | 9.97 | 9.97 | 0.00 |
| 146817 | steel...ault | 7 | 1941 | 28 | 34.67 | 0.56 | 1.32 | 1.57 | 0.34 | 0.99 | 0.89 | 0.31 | 0.74 | 0.46 |
| 146819 | clima...shes | 2 | 540 | 21 | 91.48 | 0.10 | 0.81 | 1.19 | 0.39 | 0.81 | 1.02 | 0.22 | 0.81 | 1.17 |
| 146820 | wilt | 2 | 4839 | 6 | 94.61 | 0.19 | 0.54 | 0.79 | 8.14 | 9.97 | 0.00 | 7.73 | 9.97 | 0.00 |
| 146821 | car | 4 | 1728 | 7 | 70.02 | 0.34 | 1.17 | 1.35 | 1.40 | 1.89 | 1.95 | 1.57 | 2.32 | 1.75 |
| 146822 | segment | 7 | 2310 | 20 | 14.29 | 0.25 | 1.18 | 1.49 | 1.99 | 2.12 | 1.43 | 2.21 | 2.29 | 1.36 |
| 146824 | mfeat-pixel | 10 | 2000 | 241 | 10.00 | 0.13 | 0.49 | 0.72 | 0.65 | 0.82 | 0.82 | 0.40 | 0.69 | 0.63 |
| 167119 | jungl...lete | 3 | 44819 | 7 | 51.46 | 0.33 | 1.11 | 1.09 | 0.69 | 1.10 | 1.08 | 0.41 | 1.19 | 1.38 |
| 167120 | numerai28.6 | 2 | 96320 | 22 | 50.52 | 0.51 | 0.61 | 0.52 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| 167140 | dna | 3 | 3186 | 181 | 51.91 | 0.44 | 1.17 | 1.19 | 0.37 | 1.33 | 1.46 | 0.16 | 0.54 | 0.79 |
| 167141 | churn | 2 | 5000 | 21 | 85.86 | 0.28 | 1.15 | 1.67 | 0.41 | 0.87 | 0.93 | 0.21 | 0.58 | 0.87 |
|
1
FE (fixed effect), median and MAD (median absolute deviation) estimates from cross-validation. Results are reported on the s-value scale.
|
||||||||||||||