[2021-03-15 02:08:03] Seeded: 5
[2021-03-15 02:08:03] Created experiment 0:
[2021-03-15 02:08:03]  - Model: mlp
[2021-03-15 02:08:03]  - Acquisition function: greedy-coreset
[2021-03-15 02:08:03] Created experiment 1:
[2021-03-15 02:08:03]  - Model: mlp
[2021-03-15 02:08:03]  - Acquisition function: random
[2021-03-15 02:08:03] Created experiment 2:
[2021-03-15 02:08:03]  - Model: mlp
[2021-03-15 02:08:03]  - Acquisition function: least-confidence
[2021-03-15 02:08:03] Created experiment 3:
[2021-03-15 02:08:03]  - Model: mlp
[2021-03-15 02:08:03]  - Acquisition function: max-entropy
[2021-03-15 02:08:03] Created experiment 4:
[2021-03-15 02:08:03]  - Model: mlp
[2021-03-15 02:08:03]  - Acquisition function: p-coreset
[2021-03-15 02:08:03] Loading blobsthin test set...
[2021-03-15 02:08:03] Generated 5000 blobs:
[2021-03-15 02:08:03] Class 0: 200
[2021-03-15 02:08:03] Class 1: 300
[2021-03-15 02:08:03] Class 2: 1000
[2021-03-15 02:08:03] Class 3: 100
[2021-03-15 02:08:03] Class 4: 50
[2021-03-15 02:08:03] Class 5: 200
[2021-03-15 02:08:03] Class 6: 400
[2021-03-15 02:08:03] Class 7: 1800
[2021-03-15 02:08:03] Class 8: 50
[2021-03-15 02:08:03] Class 9: 900
[2021-03-15 02:08:03] Saved figure to: ../data/blobsthin_data.png
[2021-03-15 02:08:03] Generated 5000 test points.
[2021-03-15 02:08:04] Saved figure to: ../data/blobsthin_test.png
[2021-03-15 02:08:04] Experiment repeat 1/10
[2021-03-15 02:08:04] Randomly labelled 50/5000
[2021-03-15 02:08:04] Showing labelled: True (50/5000 visible)
[2021-03-15 02:08:04] Running: experiment 0
[2021-03-15 02:08:04] Showing labelled: True (50/5000 visible)
[2021-03-15 02:08:04] mlp: initialized 1482 parameters.
[2021-03-15 02:08:04] Creating trainer with model on device: cuda
[2021-03-15 02:08:08] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:08:09] Training loss: 1.5627
[2021-03-15 02:08:09] Testing on 5000 data points...
[2021-03-15 02:08:09] Test accuracy: 0.5000
[2021-03-15 02:08:09] Score for 50 labels: 0.5000
[2021-03-15 02:08:09] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:08:09] Found 4950 unlabelled features.
[2021-03-15 02:08:09] Searching core-set greedily...
[2021-03-15 02:08:11] Showing labelled: True (70/5000 visible)
[2021-03-15 02:08:11] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:08:12] Training loss: 0.7168
[2021-03-15 02:08:12] Testing on 5000 data points...
[2021-03-15 02:08:12] Test accuracy: 0.8880
[2021-03-15 02:08:12] Score for 70 labels: 0.8880
[2021-03-15 02:08:12] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:08:12] Found 4930 unlabelled features.
[2021-03-15 02:08:12] Searching core-set greedily...
[2021-03-15 02:08:14] Showing labelled: True (90/5000 visible)
[2021-03-15 02:08:14] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:08:15] Training loss: 0.3844
[2021-03-15 02:08:15] Testing on 5000 data points...
[2021-03-15 02:08:15] Test accuracy: 0.8998
[2021-03-15 02:08:15] Score for 90 labels: 0.8998
[2021-03-15 02:08:15] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:08:15] Found 4910 unlabelled features.
[2021-03-15 02:08:15] Searching core-set greedily...
[2021-03-15 02:08:17] Showing labelled: True (110/5000 visible)
[2021-03-15 02:08:17] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:08:18] Training loss: 0.2483
[2021-03-15 02:08:18] Testing on 5000 data points...
[2021-03-15 02:08:18] Test accuracy: 0.9236
[2021-03-15 02:08:18] Score for 110 labels: 0.9236
[2021-03-15 02:08:18] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:08:18] Found 4890 unlabelled features.
[2021-03-15 02:08:18] Searching core-set greedily...
[2021-03-15 02:08:20] Showing labelled: True (130/5000 visible)
[2021-03-15 02:08:20] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:08:21] Training loss: 0.1590
[2021-03-15 02:08:21] Testing on 5000 data points...
[2021-03-15 02:08:21] Test accuracy: 0.9810
[2021-03-15 02:08:21] Score for 130 labels: 0.9810
[2021-03-15 02:08:21] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:08:21] Found 4870 unlabelled features.
[2021-03-15 02:08:21] Searching core-set greedily...
[2021-03-15 02:08:24] Showing labelled: True (150/5000 visible)
[2021-03-15 02:08:24] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:08:25] Training loss: 0.1088
[2021-03-15 02:08:25] Testing on 5000 data points...
[2021-03-15 02:08:25] Test accuracy: 0.9962
[2021-03-15 02:08:25] Score for 150 labels: 0.9962
[2021-03-15 02:08:25] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:08:25] Found 4850 unlabelled features.
[2021-03-15 02:08:25] Searching core-set greedily...
[2021-03-15 02:08:29] Showing labelled: True (170/5000 visible)
[2021-03-15 02:08:29] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:08:30] Training loss: 0.0814
[2021-03-15 02:08:30] Testing on 5000 data points...
[2021-03-15 02:08:30] Test accuracy: 0.9978
[2021-03-15 02:08:30] Score for 170 labels: 0.9978
[2021-03-15 02:08:30] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:08:30] Found 4830 unlabelled features.
[2021-03-15 02:08:30] Searching core-set greedily...
[2021-03-15 02:08:34] Showing labelled: True (190/5000 visible)
[2021-03-15 02:08:34] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:08:35] Training loss: 0.0579
[2021-03-15 02:08:35] Testing on 5000 data points...
[2021-03-15 02:08:35] Test accuracy: 0.9970
[2021-03-15 02:08:35] Score for 190 labels: 0.9970
[2021-03-15 02:08:35] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:08:35] Found 4810 unlabelled features.
[2021-03-15 02:08:35] Searching core-set greedily...
[2021-03-15 02:08:40] Showing labelled: True (210/5000 visible)
[2021-03-15 02:08:40] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:08:41] Training loss: 0.0438
[2021-03-15 02:08:41] Testing on 5000 data points...
[2021-03-15 02:08:41] Test accuracy: 0.9972
[2021-03-15 02:08:41] Score for 210 labels: 0.9972
[2021-03-15 02:08:41] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:08:41] Found 4790 unlabelled features.
[2021-03-15 02:08:41] Searching core-set greedily...
[2021-03-15 02:08:45] Showing labelled: True (230/5000 visible)
[2021-03-15 02:08:45] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:08:46] Training loss: 0.0340
[2021-03-15 02:08:46] Testing on 5000 data points...
[2021-03-15 02:08:46] Test accuracy: 0.9974
[2021-03-15 02:08:46] Score for 230 labels: 0.9974
[2021-03-15 02:08:46] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:08:46] Found 4770 unlabelled features.
[2021-03-15 02:08:46] Searching core-set greedily...
[2021-03-15 02:08:50] Showing labelled: True (250/5000 visible)
[2021-03-15 02:08:50] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:08:51] Training loss: 0.0269
[2021-03-15 02:08:51] Testing on 5000 data points...
[2021-03-15 02:08:51] Test accuracy: 0.9974
[2021-03-15 02:08:51] Score for 250 labels: 0.9974
[2021-03-15 02:08:51] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:08:51] Found 4750 unlabelled features.
[2021-03-15 02:08:52] Searching core-set greedily...
[2021-03-15 02:08:55] Showing labelled: True (270/5000 visible)
[2021-03-15 02:08:55] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:08:57] Training loss: 0.0239
[2021-03-15 02:08:57] Testing on 5000 data points...
[2021-03-15 02:08:57] Test accuracy: 0.9978
[2021-03-15 02:08:57] Score for 270 labels: 0.9978
[2021-03-15 02:08:57] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:08:57] Found 4730 unlabelled features.
[2021-03-15 02:08:57] Searching core-set greedily...
[2021-03-15 02:09:01] Showing labelled: True (290/5000 visible)
[2021-03-15 02:09:01] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:09:03] Training loss: 0.0199
[2021-03-15 02:09:03] Testing on 5000 data points...
[2021-03-15 02:09:03] Test accuracy: 0.9978
[2021-03-15 02:09:03] Score for 290 labels: 0.9978
[2021-03-15 02:09:03] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:09:03] Found 4710 unlabelled features.
[2021-03-15 02:09:03] Searching core-set greedily...
[2021-03-15 02:09:07] Showing labelled: True (310/5000 visible)
[2021-03-15 02:09:07] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:09:09] Training loss: 0.0177
[2021-03-15 02:09:09] Testing on 5000 data points...
[2021-03-15 02:09:09] Test accuracy: 0.9952
[2021-03-15 02:09:09] Score for 310 labels: 0.9952
[2021-03-15 02:09:09] Running: experiment 1
[2021-03-15 02:09:09] Showing labelled: True (50/5000 visible)
[2021-03-15 02:09:09] mlp: initialized 1482 parameters.
[2021-03-15 02:09:09] Creating trainer with model on device: cuda
[2021-03-15 02:09:09] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:09:09] Training loss: 1.4190
[2021-03-15 02:09:09] Testing on 5000 data points...
[2021-03-15 02:09:09] Test accuracy: 0.5000
[2021-03-15 02:09:09] Score for 50 labels: 0.5000
[2021-03-15 02:09:09] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:09:09] Found 4950 unlabelled features.
[2021-03-15 02:09:09] Showing labelled: True (70/5000 visible)
[2021-03-15 02:09:09] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:09:10] Training loss: 0.6406
[2021-03-15 02:09:10] Testing on 5000 data points...
[2021-03-15 02:09:10] Test accuracy: 0.6826
[2021-03-15 02:09:10] Score for 70 labels: 0.6826
[2021-03-15 02:09:10] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:09:10] Found 4930 unlabelled features.
[2021-03-15 02:09:10] Showing labelled: True (90/5000 visible)
[2021-03-15 02:09:10] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:09:11] Training loss: 0.3405
[2021-03-15 02:09:11] Testing on 5000 data points...
[2021-03-15 02:09:11] Test accuracy: 0.8726
[2021-03-15 02:09:11] Score for 90 labels: 0.8726
[2021-03-15 02:09:11] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:09:11] Found 4910 unlabelled features.
[2021-03-15 02:09:11] Showing labelled: True (110/5000 visible)
[2021-03-15 02:09:11] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:09:12] Training loss: 0.2084
[2021-03-15 02:09:12] Testing on 5000 data points...
[2021-03-15 02:09:12] Test accuracy: 0.8994
[2021-03-15 02:09:12] Score for 110 labels: 0.8994
[2021-03-15 02:09:12] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:09:12] Found 4890 unlabelled features.
[2021-03-15 02:09:12] Showing labelled: True (130/5000 visible)
[2021-03-15 02:09:12] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:09:13] Training loss: 0.1307
[2021-03-15 02:09:13] Testing on 5000 data points...
[2021-03-15 02:09:13] Test accuracy: 0.9760
[2021-03-15 02:09:13] Score for 130 labels: 0.9760
[2021-03-15 02:09:13] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:09:13] Found 4870 unlabelled features.
[2021-03-15 02:09:13] Showing labelled: True (150/5000 visible)
[2021-03-15 02:09:13] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:09:14] Training loss: 0.0855
[2021-03-15 02:09:14] Testing on 5000 data points...
[2021-03-15 02:09:14] Test accuracy: 0.9936
[2021-03-15 02:09:14] Score for 150 labels: 0.9936
[2021-03-15 02:09:14] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:09:14] Found 4850 unlabelled features.
[2021-03-15 02:09:14] Showing labelled: True (170/5000 visible)
[2021-03-15 02:09:14] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:09:15] Training loss: 0.0538
[2021-03-15 02:09:15] Testing on 5000 data points...
[2021-03-15 02:09:15] Test accuracy: 0.9952
[2021-03-15 02:09:15] Score for 170 labels: 0.9952
[2021-03-15 02:09:15] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:09:15] Found 4830 unlabelled features.
[2021-03-15 02:09:15] Showing labelled: True (190/5000 visible)
[2021-03-15 02:09:15] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:09:16] Training loss: 0.0348
[2021-03-15 02:09:16] Testing on 5000 data points...
[2021-03-15 02:09:17] Test accuracy: 0.9954
[2021-03-15 02:09:17] Score for 190 labels: 0.9954
[2021-03-15 02:09:17] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:09:17] Found 4810 unlabelled features.
[2021-03-15 02:09:17] Showing labelled: True (210/5000 visible)
[2021-03-15 02:09:17] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:09:18] Training loss: 0.0250
[2021-03-15 02:09:18] Testing on 5000 data points...
[2021-03-15 02:09:18] Test accuracy: 0.9956
[2021-03-15 02:09:18] Score for 210 labels: 0.9956
[2021-03-15 02:09:18] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:09:18] Found 4790 unlabelled features.
[2021-03-15 02:09:18] Showing labelled: True (230/5000 visible)
[2021-03-15 02:09:18] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:09:20] Training loss: 0.0169
[2021-03-15 02:09:20] Testing on 5000 data points...
[2021-03-15 02:09:20] Test accuracy: 0.9962
[2021-03-15 02:09:20] Score for 230 labels: 0.9962
[2021-03-15 02:09:20] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:09:20] Found 4770 unlabelled features.
[2021-03-15 02:09:20] Showing labelled: True (250/5000 visible)
[2021-03-15 02:09:20] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:09:21] Training loss: 0.0126
[2021-03-15 02:09:21] Testing on 5000 data points...
[2021-03-15 02:09:21] Test accuracy: 0.9960
[2021-03-15 02:09:21] Score for 250 labels: 0.9960
[2021-03-15 02:09:21] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:09:21] Found 4750 unlabelled features.
[2021-03-15 02:09:21] Showing labelled: True (270/5000 visible)
[2021-03-15 02:09:21] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:09:23] Training loss: 0.0097
[2021-03-15 02:09:23] Testing on 5000 data points...
[2021-03-15 02:09:23] Test accuracy: 0.9962
[2021-03-15 02:09:23] Score for 270 labels: 0.9962
[2021-03-15 02:09:23] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:09:23] Found 4730 unlabelled features.
[2021-03-15 02:09:23] Showing labelled: True (290/5000 visible)
[2021-03-15 02:09:23] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:09:25] Training loss: 0.0078
[2021-03-15 02:09:25] Testing on 5000 data points...
[2021-03-15 02:09:25] Test accuracy: 0.9958
[2021-03-15 02:09:25] Score for 290 labels: 0.9958
[2021-03-15 02:09:25] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:09:25] Found 4710 unlabelled features.
[2021-03-15 02:09:25] Showing labelled: True (310/5000 visible)
[2021-03-15 02:09:25] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:09:27] Training loss: 0.0062
[2021-03-15 02:09:27] Testing on 5000 data points...
[2021-03-15 02:09:27] Test accuracy: 0.9958
[2021-03-15 02:09:27] Score for 310 labels: 0.9958
[2021-03-15 02:09:27] Running: experiment 2
[2021-03-15 02:09:27] Showing labelled: True (50/5000 visible)
[2021-03-15 02:09:27] mlp: initialized 1482 parameters.
[2021-03-15 02:09:27] Creating trainer with model on device: cuda
[2021-03-15 02:09:27] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:09:27] Training loss: 1.3314
[2021-03-15 02:09:27] Testing on 5000 data points...
[2021-03-15 02:09:27] Test accuracy: 0.5000
[2021-03-15 02:09:27] Score for 50 labels: 0.5000
[2021-03-15 02:09:27] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:09:27] Found 4950 unlabelled features.
[2021-03-15 02:09:27] Showing labelled: True (70/5000 visible)
[2021-03-15 02:09:27] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:09:28] Training loss: 0.5315
[2021-03-15 02:09:28] Testing on 5000 data points...
[2021-03-15 02:09:28] Test accuracy: 0.6860
[2021-03-15 02:09:28] Score for 70 labels: 0.6860
[2021-03-15 02:09:28] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:09:28] Found 4930 unlabelled features.
[2021-03-15 02:09:28] Showing labelled: True (90/5000 visible)
[2021-03-15 02:09:28] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:09:29] Training loss: 0.1943
[2021-03-15 02:09:29] Testing on 5000 data points...
[2021-03-15 02:09:29] Test accuracy: 0.7956
[2021-03-15 02:09:29] Score for 90 labels: 0.7956
[2021-03-15 02:09:29] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:09:29] Found 4910 unlabelled features.
[2021-03-15 02:09:29] Showing labelled: True (110/5000 visible)
[2021-03-15 02:09:29] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:09:30] Training loss: 0.1205
[2021-03-15 02:09:30] Testing on 5000 data points...
[2021-03-15 02:09:30] Test accuracy: 0.8036
[2021-03-15 02:09:30] Score for 110 labels: 0.8036
[2021-03-15 02:09:30] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:09:30] Found 4890 unlabelled features.
[2021-03-15 02:09:30] Showing labelled: True (130/5000 visible)
[2021-03-15 02:09:30] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:09:31] Training loss: 0.0992
[2021-03-15 02:09:31] Testing on 5000 data points...
[2021-03-15 02:09:31] Test accuracy: 0.8944
[2021-03-15 02:09:31] Score for 130 labels: 0.8944
[2021-03-15 02:09:31] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:09:31] Found 4870 unlabelled features.
[2021-03-15 02:09:31] Showing labelled: True (150/5000 visible)
[2021-03-15 02:09:31] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:09:32] Training loss: 0.1027
[2021-03-15 02:09:32] Testing on 5000 data points...
[2021-03-15 02:09:32] Test accuracy: 0.8984
[2021-03-15 02:09:32] Score for 150 labels: 0.8984
[2021-03-15 02:09:32] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:09:32] Found 4850 unlabelled features.
[2021-03-15 02:09:32] Showing labelled: True (170/5000 visible)
[2021-03-15 02:09:32] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:09:33] Training loss: 0.1096
[2021-03-15 02:09:33] Testing on 5000 data points...
[2021-03-15 02:09:33] Test accuracy: 0.8972
[2021-03-15 02:09:33] Score for 170 labels: 0.8972
[2021-03-15 02:09:33] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:09:33] Found 4830 unlabelled features.
[2021-03-15 02:09:33] Showing labelled: True (190/5000 visible)
[2021-03-15 02:09:33] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:09:35] Training loss: 0.1037
[2021-03-15 02:09:35] Testing on 5000 data points...
[2021-03-15 02:09:35] Test accuracy: 0.8964
[2021-03-15 02:09:35] Score for 190 labels: 0.8964
[2021-03-15 02:09:35] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:09:35] Found 4810 unlabelled features.
[2021-03-15 02:09:35] Showing labelled: True (210/5000 visible)
[2021-03-15 02:09:35] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:09:36] Training loss: 0.0860
[2021-03-15 02:09:36] Testing on 5000 data points...
[2021-03-15 02:09:36] Test accuracy: 0.8988
[2021-03-15 02:09:36] Score for 210 labels: 0.8988
[2021-03-15 02:09:36] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:09:36] Found 4790 unlabelled features.
[2021-03-15 02:09:36] Showing labelled: True (230/5000 visible)
[2021-03-15 02:09:36] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:09:38] Training loss: 0.0629
[2021-03-15 02:09:38] Testing on 5000 data points...
[2021-03-15 02:09:38] Test accuracy: 0.8982
[2021-03-15 02:09:38] Score for 230 labels: 0.8982
[2021-03-15 02:09:38] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:09:38] Found 4770 unlabelled features.
[2021-03-15 02:09:38] Showing labelled: True (250/5000 visible)
[2021-03-15 02:09:38] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:09:40] Training loss: 0.0457
[2021-03-15 02:09:40] Testing on 5000 data points...
[2021-03-15 02:09:40] Test accuracy: 0.8986
[2021-03-15 02:09:40] Score for 250 labels: 0.8986
[2021-03-15 02:09:40] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:09:40] Found 4750 unlabelled features.
[2021-03-15 02:09:40] Showing labelled: True (270/5000 visible)
[2021-03-15 02:09:40] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:09:41] Training loss: 0.0358
[2021-03-15 02:09:41] Testing on 5000 data points...
[2021-03-15 02:09:41] Test accuracy: 0.8970
[2021-03-15 02:09:41] Score for 270 labels: 0.8970
[2021-03-15 02:09:41] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:09:41] Found 4730 unlabelled features.
[2021-03-15 02:09:42] Showing labelled: True (290/5000 visible)
[2021-03-15 02:09:42] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:09:43] Training loss: 0.0276
[2021-03-15 02:09:43] Testing on 5000 data points...
[2021-03-15 02:09:43] Test accuracy: 0.8986
[2021-03-15 02:09:43] Score for 290 labels: 0.8986
[2021-03-15 02:09:43] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:09:43] Found 4710 unlabelled features.
[2021-03-15 02:09:43] Showing labelled: True (310/5000 visible)
[2021-03-15 02:09:43] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:09:45] Training loss: 0.0228
[2021-03-15 02:09:45] Testing on 5000 data points...
[2021-03-15 02:09:45] Test accuracy: 0.8974
[2021-03-15 02:09:45] Score for 310 labels: 0.8974
[2021-03-15 02:09:45] Running: experiment 3
[2021-03-15 02:09:45] Showing labelled: True (50/5000 visible)
[2021-03-15 02:09:45] mlp: initialized 1482 parameters.
[2021-03-15 02:09:45] Creating trainer with model on device: cuda
[2021-03-15 02:09:45] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:09:46] Training loss: 1.2819
[2021-03-15 02:09:46] Testing on 5000 data points...
[2021-03-15 02:09:46] Test accuracy: 0.5000
[2021-03-15 02:09:46] Score for 50 labels: 0.5000
[2021-03-15 02:09:46] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:09:46] Found 4950 unlabelled features.
[2021-03-15 02:09:46] Showing labelled: True (70/5000 visible)
[2021-03-15 02:09:46] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:09:47] Training loss: 0.5223
[2021-03-15 02:09:47] Testing on 5000 data points...
[2021-03-15 02:09:47] Test accuracy: 0.6812
[2021-03-15 02:09:47] Score for 70 labels: 0.6812
[2021-03-15 02:09:47] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:09:47] Found 4930 unlabelled features.
[2021-03-15 02:09:47] Showing labelled: True (90/5000 visible)
[2021-03-15 02:09:47] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:09:47] Training loss: 0.2798
[2021-03-15 02:09:47] Testing on 5000 data points...
[2021-03-15 02:09:48] Test accuracy: 0.7918
[2021-03-15 02:09:48] Score for 90 labels: 0.7918
[2021-03-15 02:09:48] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:09:48] Found 4910 unlabelled features.
[2021-03-15 02:09:48] Showing labelled: True (110/5000 visible)
[2021-03-15 02:09:48] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:09:48] Training loss: 0.1890
[2021-03-15 02:09:48] Testing on 5000 data points...
[2021-03-15 02:09:49] Test accuracy: 0.8850
[2021-03-15 02:09:49] Score for 110 labels: 0.8850
[2021-03-15 02:09:49] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:09:49] Found 4890 unlabelled features.
[2021-03-15 02:09:49] Showing labelled: True (130/5000 visible)
[2021-03-15 02:09:49] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:09:50] Training loss: 0.1293
[2021-03-15 02:09:50] Testing on 5000 data points...
[2021-03-15 02:09:50] Test accuracy: 0.8954
[2021-03-15 02:09:50] Score for 130 labels: 0.8954
[2021-03-15 02:09:50] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:09:50] Found 4870 unlabelled features.
[2021-03-15 02:09:50] Showing labelled: True (150/5000 visible)
[2021-03-15 02:09:50] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:09:51] Training loss: 0.1142
[2021-03-15 02:09:51] Testing on 5000 data points...
[2021-03-15 02:09:51] Test accuracy: 0.8964
[2021-03-15 02:09:51] Score for 150 labels: 0.8964
[2021-03-15 02:09:51] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:09:51] Found 4850 unlabelled features.
[2021-03-15 02:09:51] Showing labelled: True (170/5000 visible)
[2021-03-15 02:09:51] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:09:52] Training loss: 0.1141
[2021-03-15 02:09:52] Testing on 5000 data points...
[2021-03-15 02:09:52] Test accuracy: 0.8976
[2021-03-15 02:09:52] Score for 170 labels: 0.8976
[2021-03-15 02:09:52] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:09:52] Found 4830 unlabelled features.
[2021-03-15 02:09:52] Showing labelled: True (190/5000 visible)
[2021-03-15 02:09:52] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:09:53] Training loss: 0.0968
[2021-03-15 02:09:53] Testing on 5000 data points...
[2021-03-15 02:09:53] Test accuracy: 0.8964
[2021-03-15 02:09:53] Score for 190 labels: 0.8964
[2021-03-15 02:09:53] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:09:53] Found 4810 unlabelled features.
[2021-03-15 02:09:53] Showing labelled: True (210/5000 visible)
[2021-03-15 02:09:53] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:09:55] Training loss: 0.0853
[2021-03-15 02:09:55] Testing on 5000 data points...
[2021-03-15 02:09:55] Test accuracy: 0.8976
[2021-03-15 02:09:55] Score for 210 labels: 0.8976
[2021-03-15 02:09:55] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:09:55] Found 4790 unlabelled features.
[2021-03-15 02:09:55] Showing labelled: True (230/5000 visible)
[2021-03-15 02:09:55] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:09:56] Training loss: 0.0602
[2021-03-15 02:09:56] Testing on 5000 data points...
[2021-03-15 02:09:56] Test accuracy: 0.8974
[2021-03-15 02:09:56] Score for 230 labels: 0.8974
[2021-03-15 02:09:56] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:09:56] Found 4770 unlabelled features.
[2021-03-15 02:09:57] Showing labelled: True (250/5000 visible)
[2021-03-15 02:09:57] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:09:58] Training loss: 0.0440
[2021-03-15 02:09:58] Testing on 5000 data points...
[2021-03-15 02:09:58] Test accuracy: 0.8978
[2021-03-15 02:09:58] Score for 250 labels: 0.8978
[2021-03-15 02:09:58] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:09:58] Found 4750 unlabelled features.
[2021-03-15 02:09:58] Showing labelled: True (270/5000 visible)
[2021-03-15 02:09:58] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:10:00] Training loss: 0.0343
[2021-03-15 02:10:00] Testing on 5000 data points...
[2021-03-15 02:10:00] Test accuracy: 0.8986
[2021-03-15 02:10:00] Score for 270 labels: 0.8986
[2021-03-15 02:10:00] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:10:00] Found 4730 unlabelled features.
[2021-03-15 02:10:00] Showing labelled: True (290/5000 visible)
[2021-03-15 02:10:00] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:10:02] Training loss: 0.0267
[2021-03-15 02:10:02] Testing on 5000 data points...
[2021-03-15 02:10:02] Test accuracy: 0.8980
[2021-03-15 02:10:02] Score for 290 labels: 0.8980
[2021-03-15 02:10:02] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:10:02] Found 4710 unlabelled features.
[2021-03-15 02:10:02] Showing labelled: True (310/5000 visible)
[2021-03-15 02:10:02] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:10:04] Training loss: 0.0213
[2021-03-15 02:10:04] Testing on 5000 data points...
[2021-03-15 02:10:04] Test accuracy: 0.8972
[2021-03-15 02:10:04] Score for 310 labels: 0.8972
[2021-03-15 02:10:04] Running: experiment 4
[2021-03-15 02:10:04] Showing labelled: True (50/5000 visible)
[2021-03-15 02:10:04] mlp: initialized 1482 parameters.
[2021-03-15 02:10:04] Creating trainer with model on device: cuda
[2021-03-15 02:10:04] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:10:04] Training loss: 1.5033
[2021-03-15 02:10:04] Testing on 5000 data points...
[2021-03-15 02:10:05] Test accuracy: 0.5000
[2021-03-15 02:10:05] Score for 50 labels: 0.5000
[2021-03-15 02:10:05] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:10:05] Found 4950 unlabelled features.
[2021-03-15 02:10:05] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:05] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:05] Scoring random batches...
[2021-03-15 02:10:05] Showing labelled: True (70/5000 visible)
[2021-03-15 02:10:05] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:10:06] Training loss: 0.5701
[2021-03-15 02:10:06] Testing on 5000 data points...
[2021-03-15 02:10:06] Test accuracy: 0.6676
[2021-03-15 02:10:06] Score for 70 labels: 0.6676
[2021-03-15 02:10:06] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:10:06] Found 4930 unlabelled features.
[2021-03-15 02:10:06] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:06] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:06] Scoring random batches...
[2021-03-15 02:10:06] Showing labelled: True (90/5000 visible)
[2021-03-15 02:10:06] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:10:07] Training loss: 0.3966
[2021-03-15 02:10:07] Testing on 5000 data points...
[2021-03-15 02:10:07] Test accuracy: 0.8670
[2021-03-15 02:10:07] Score for 90 labels: 0.8670
[2021-03-15 02:10:07] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:10:07] Found 4910 unlabelled features.
[2021-03-15 02:10:07] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:07] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:07] Scoring random batches...
[2021-03-15 02:10:07] Showing labelled: True (110/5000 visible)
[2021-03-15 02:10:07] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:10:08] Training loss: 0.1794
[2021-03-15 02:10:08] Testing on 5000 data points...
[2021-03-15 02:10:08] Test accuracy: 0.9024
[2021-03-15 02:10:08] Score for 110 labels: 0.9024
[2021-03-15 02:10:08] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:10:08] Found 4890 unlabelled features.
[2021-03-15 02:10:08] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:08] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:09] Scoring random batches...
[2021-03-15 02:10:09] Showing labelled: True (130/5000 visible)
[2021-03-15 02:10:09] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:10:10] Training loss: 0.0964
[2021-03-15 02:10:10] Testing on 5000 data points...
[2021-03-15 02:10:10] Test accuracy: 0.9586
[2021-03-15 02:10:10] Score for 130 labels: 0.9586
[2021-03-15 02:10:10] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:10:10] Found 4870 unlabelled features.
[2021-03-15 02:10:10] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:10] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:10] Scoring random batches...
[2021-03-15 02:10:10] Showing labelled: True (150/5000 visible)
[2021-03-15 02:10:10] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:10:11] Training loss: 0.0623
[2021-03-15 02:10:11] Testing on 5000 data points...
[2021-03-15 02:10:11] Test accuracy: 0.9808
[2021-03-15 02:10:11] Score for 150 labels: 0.9808
[2021-03-15 02:10:11] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:10:11] Found 4850 unlabelled features.
[2021-03-15 02:10:11] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:11] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:12] Scoring random batches...
[2021-03-15 02:10:12] Showing labelled: True (170/5000 visible)
[2021-03-15 02:10:12] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:10:13] Training loss: 0.0389
[2021-03-15 02:10:13] Testing on 5000 data points...
[2021-03-15 02:10:13] Test accuracy: 0.9812
[2021-03-15 02:10:13] Score for 170 labels: 0.9812
[2021-03-15 02:10:13] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:10:13] Found 4830 unlabelled features.
[2021-03-15 02:10:13] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:13] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:13] Scoring random batches...
[2021-03-15 02:10:13] Showing labelled: True (190/5000 visible)
[2021-03-15 02:10:13] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:10:15] Training loss: 0.0255
[2021-03-15 02:10:15] Testing on 5000 data points...
[2021-03-15 02:10:15] Test accuracy: 0.9868
[2021-03-15 02:10:15] Score for 190 labels: 0.9868
[2021-03-15 02:10:15] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:10:15] Found 4810 unlabelled features.
[2021-03-15 02:10:15] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:15] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:15] Scoring random batches...
[2021-03-15 02:10:15] Showing labelled: True (210/5000 visible)
[2021-03-15 02:10:15] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:10:17] Training loss: 0.0226
[2021-03-15 02:10:17] Testing on 5000 data points...
[2021-03-15 02:10:17] Test accuracy: 0.9940
[2021-03-15 02:10:17] Score for 210 labels: 0.9940
[2021-03-15 02:10:17] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:10:17] Found 4790 unlabelled features.
[2021-03-15 02:10:17] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:17] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:17] Scoring random batches...
[2021-03-15 02:10:17] Showing labelled: True (230/5000 visible)
[2021-03-15 02:10:17] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:10:19] Training loss: 0.0162
[2021-03-15 02:10:19] Testing on 5000 data points...
[2021-03-15 02:10:19] Test accuracy: 0.9948
[2021-03-15 02:10:19] Score for 230 labels: 0.9948
[2021-03-15 02:10:19] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:10:19] Found 4770 unlabelled features.
[2021-03-15 02:10:19] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:19] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:19] Scoring random batches...
[2021-03-15 02:10:19] Showing labelled: True (250/5000 visible)
[2021-03-15 02:10:19] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:10:21] Training loss: 0.0123
[2021-03-15 02:10:21] Testing on 5000 data points...
[2021-03-15 02:10:21] Test accuracy: 0.9948
[2021-03-15 02:10:21] Score for 250 labels: 0.9948
[2021-03-15 02:10:21] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:10:21] Found 4750 unlabelled features.
[2021-03-15 02:10:21] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:21] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:21] Scoring random batches...
[2021-03-15 02:10:21] Showing labelled: True (270/5000 visible)
[2021-03-15 02:10:21] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:10:23] Training loss: 0.0123
[2021-03-15 02:10:23] Testing on 5000 data points...
[2021-03-15 02:10:23] Test accuracy: 0.9954
[2021-03-15 02:10:23] Score for 270 labels: 0.9954
[2021-03-15 02:10:23] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:10:23] Found 4730 unlabelled features.
[2021-03-15 02:10:23] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:23] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:24] Scoring random batches...
[2021-03-15 02:10:24] Showing labelled: True (290/5000 visible)
[2021-03-15 02:10:24] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:10:25] Training loss: 0.0102
[2021-03-15 02:10:25] Testing on 5000 data points...
[2021-03-15 02:10:26] Test accuracy: 0.9960
[2021-03-15 02:10:26] Score for 290 labels: 0.9960
[2021-03-15 02:10:26] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:10:26] Found 4710 unlabelled features.
[2021-03-15 02:10:26] Training GMM (k=32) on labelled features...
[2021-03-15 02:10:26] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:10:26] Scoring random batches...
[2021-03-15 02:10:26] Showing labelled: True (310/5000 visible)
[2021-03-15 02:10:26] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:10:28] Training loss: 0.0083
[2021-03-15 02:10:28] Testing on 5000 data points...
[2021-03-15 02:10:28] Test accuracy: 0.9954
[2021-03-15 02:10:28] Score for 310 labels: 0.9954
[2021-03-15 02:10:28] Experiment repeat 2/10
[2021-03-15 02:10:28] Randomly labelled 50/5000
[2021-03-15 02:10:28] Showing labelled: True (50/5000 visible)
[2021-03-15 02:10:28] Running: experiment 0
[2021-03-15 02:10:28] Showing labelled: True (50/5000 visible)
[2021-03-15 02:10:28] mlp: initialized 1482 parameters.
[2021-03-15 02:10:28] Creating trainer with model on device: cuda
[2021-03-15 02:10:28] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:10:29] Training loss: 1.2618
[2021-03-15 02:10:29] Testing on 5000 data points...
[2021-03-15 02:10:29] Test accuracy: 0.4750
[2021-03-15 02:10:29] Score for 50 labels: 0.4750
[2021-03-15 02:10:29] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:10:29] Found 4950 unlabelled features.
[2021-03-15 02:10:29] Searching core-set greedily...
[2021-03-15 02:10:31] Showing labelled: True (70/5000 visible)
[2021-03-15 02:10:31] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:10:32] Training loss: 0.6856
[2021-03-15 02:10:32] Testing on 5000 data points...
[2021-03-15 02:10:32] Test accuracy: 0.7682
[2021-03-15 02:10:32] Score for 70 labels: 0.7682
[2021-03-15 02:10:32] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:10:32] Found 4930 unlabelled features.
[2021-03-15 02:10:32] Searching core-set greedily...
[2021-03-15 02:10:34] Showing labelled: True (90/5000 visible)
[2021-03-15 02:10:34] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:10:35] Training loss: 0.3857
[2021-03-15 02:10:35] Testing on 5000 data points...
[2021-03-15 02:10:35] Test accuracy: 0.9138
[2021-03-15 02:10:35] Score for 90 labels: 0.9138
[2021-03-15 02:10:35] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:10:35] Found 4910 unlabelled features.
[2021-03-15 02:10:35] Searching core-set greedily...
[2021-03-15 02:10:37] Showing labelled: True (110/5000 visible)
[2021-03-15 02:10:37] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:10:38] Training loss: 0.2373
[2021-03-15 02:10:38] Testing on 5000 data points...
[2021-03-15 02:10:38] Test accuracy: 0.9888
[2021-03-15 02:10:38] Score for 110 labels: 0.9888
[2021-03-15 02:10:38] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:10:38] Found 4890 unlabelled features.
[2021-03-15 02:10:38] Searching core-set greedily...
[2021-03-15 02:10:40] Showing labelled: True (130/5000 visible)
[2021-03-15 02:10:40] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:10:41] Training loss: 0.1504
[2021-03-15 02:10:41] Testing on 5000 data points...
[2021-03-15 02:10:41] Test accuracy: 0.9960
[2021-03-15 02:10:41] Score for 130 labels: 0.9960
[2021-03-15 02:10:41] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:10:41] Found 4870 unlabelled features.
[2021-03-15 02:10:41] Searching core-set greedily...
[2021-03-15 02:10:44] Showing labelled: True (150/5000 visible)
[2021-03-15 02:10:44] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:10:45] Training loss: 0.1096
[2021-03-15 02:10:45] Testing on 5000 data points...
[2021-03-15 02:10:45] Test accuracy: 0.9960
[2021-03-15 02:10:45] Score for 150 labels: 0.9960
[2021-03-15 02:10:45] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:10:45] Found 4850 unlabelled features.
[2021-03-15 02:10:45] Searching core-set greedily...
[2021-03-15 02:10:48] Showing labelled: True (170/5000 visible)
[2021-03-15 02:10:48] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:10:49] Training loss: 0.0816
[2021-03-15 02:10:49] Testing on 5000 data points...
[2021-03-15 02:10:49] Test accuracy: 0.9974
[2021-03-15 02:10:49] Score for 170 labels: 0.9974
[2021-03-15 02:10:49] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:10:49] Found 4830 unlabelled features.
[2021-03-15 02:10:50] Searching core-set greedily...
[2021-03-15 02:10:53] Showing labelled: True (190/5000 visible)
[2021-03-15 02:10:53] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:10:54] Training loss: 0.0599
[2021-03-15 02:10:54] Testing on 5000 data points...
[2021-03-15 02:10:54] Test accuracy: 0.9980
[2021-03-15 02:10:54] Score for 190 labels: 0.9980
[2021-03-15 02:10:54] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:10:54] Found 4810 unlabelled features.
[2021-03-15 02:10:54] Searching core-set greedily...
[2021-03-15 02:10:57] Showing labelled: True (210/5000 visible)
[2021-03-15 02:10:57] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:10:59] Training loss: 0.0478
[2021-03-15 02:10:59] Testing on 5000 data points...
[2021-03-15 02:10:59] Test accuracy: 0.9966
[2021-03-15 02:10:59] Score for 210 labels: 0.9966
[2021-03-15 02:10:59] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:10:59] Found 4790 unlabelled features.
[2021-03-15 02:10:59] Searching core-set greedily...
[2021-03-15 02:11:02] Showing labelled: True (230/5000 visible)
[2021-03-15 02:11:02] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:11:04] Training loss: 0.0363
[2021-03-15 02:11:04] Testing on 5000 data points...
[2021-03-15 02:11:04] Test accuracy: 0.9976
[2021-03-15 02:11:04] Score for 230 labels: 0.9976
[2021-03-15 02:11:04] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:11:04] Found 4770 unlabelled features.
[2021-03-15 02:11:04] Searching core-set greedily...
[2021-03-15 02:11:07] Showing labelled: True (250/5000 visible)
[2021-03-15 02:11:07] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:11:09] Training loss: 0.0289
[2021-03-15 02:11:09] Testing on 5000 data points...
[2021-03-15 02:11:09] Test accuracy: 0.9982
[2021-03-15 02:11:09] Score for 250 labels: 0.9982
[2021-03-15 02:11:09] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:11:09] Found 4750 unlabelled features.
[2021-03-15 02:11:09] Searching core-set greedily...
[2021-03-15 02:11:13] Showing labelled: True (270/5000 visible)
[2021-03-15 02:11:13] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:11:15] Training loss: 0.0246
[2021-03-15 02:11:15] Testing on 5000 data points...
[2021-03-15 02:11:15] Test accuracy: 0.9986
[2021-03-15 02:11:15] Score for 270 labels: 0.9986
[2021-03-15 02:11:15] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:11:15] Found 4730 unlabelled features.
[2021-03-15 02:11:15] Searching core-set greedily...
[2021-03-15 02:11:19] Showing labelled: True (290/5000 visible)
[2021-03-15 02:11:19] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:11:21] Training loss: 0.0204
[2021-03-15 02:11:21] Testing on 5000 data points...
[2021-03-15 02:11:21] Test accuracy: 0.9980
[2021-03-15 02:11:21] Score for 290 labels: 0.9980
[2021-03-15 02:11:21] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:11:21] Found 4710 unlabelled features.
[2021-03-15 02:11:21] Searching core-set greedily...
[2021-03-15 02:11:24] Showing labelled: True (310/5000 visible)
[2021-03-15 02:11:24] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:11:26] Training loss: 0.0170
[2021-03-15 02:11:26] Testing on 5000 data points...
[2021-03-15 02:11:26] Test accuracy: 0.9964
[2021-03-15 02:11:26] Score for 310 labels: 0.9964
[2021-03-15 02:11:26] Running: experiment 1
[2021-03-15 02:11:26] Showing labelled: True (50/5000 visible)
[2021-03-15 02:11:26] mlp: initialized 1482 parameters.
[2021-03-15 02:11:26] Creating trainer with model on device: cuda
[2021-03-15 02:11:26] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:11:27] Training loss: 1.1854
[2021-03-15 02:11:27] Testing on 5000 data points...
[2021-03-15 02:11:27] Test accuracy: 0.4598
[2021-03-15 02:11:27] Score for 50 labels: 0.4598
[2021-03-15 02:11:27] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:11:27] Found 4950 unlabelled features.
[2021-03-15 02:11:27] Showing labelled: True (70/5000 visible)
[2021-03-15 02:11:27] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:11:28] Training loss: 0.4810
[2021-03-15 02:11:28] Testing on 5000 data points...
[2021-03-15 02:11:28] Test accuracy: 0.6000
[2021-03-15 02:11:28] Score for 70 labels: 0.6000
[2021-03-15 02:11:28] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:11:28] Found 4930 unlabelled features.
[2021-03-15 02:11:28] Showing labelled: True (90/5000 visible)
[2021-03-15 02:11:28] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:11:28] Training loss: 0.3162
[2021-03-15 02:11:28] Testing on 5000 data points...
[2021-03-15 02:11:28] Test accuracy: 0.6856
[2021-03-15 02:11:28] Score for 90 labels: 0.6856
[2021-03-15 02:11:28] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:11:28] Found 4910 unlabelled features.
[2021-03-15 02:11:29] Showing labelled: True (110/5000 visible)
[2021-03-15 02:11:29] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:11:29] Training loss: 0.2315
[2021-03-15 02:11:29] Testing on 5000 data points...
[2021-03-15 02:11:29] Test accuracy: 0.7010
[2021-03-15 02:11:29] Score for 110 labels: 0.7010
[2021-03-15 02:11:29] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:11:29] Found 4890 unlabelled features.
[2021-03-15 02:11:30] Showing labelled: True (130/5000 visible)
[2021-03-15 02:11:30] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:11:30] Training loss: 0.1638
[2021-03-15 02:11:30] Testing on 5000 data points...
[2021-03-15 02:11:31] Test accuracy: 0.8052
[2021-03-15 02:11:31] Score for 130 labels: 0.8052
[2021-03-15 02:11:31] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:11:31] Found 4870 unlabelled features.
[2021-03-15 02:11:31] Showing labelled: True (150/5000 visible)
[2021-03-15 02:11:31] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:11:32] Training loss: 0.1187
[2021-03-15 02:11:32] Testing on 5000 data points...
[2021-03-15 02:11:32] Test accuracy: 0.8618
[2021-03-15 02:11:32] Score for 150 labels: 0.8618
[2021-03-15 02:11:32] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:11:32] Found 4850 unlabelled features.
[2021-03-15 02:11:32] Showing labelled: True (170/5000 visible)
[2021-03-15 02:11:32] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:11:33] Training loss: 0.0818
[2021-03-15 02:11:33] Testing on 5000 data points...
[2021-03-15 02:11:33] Test accuracy: 0.8780
[2021-03-15 02:11:33] Score for 170 labels: 0.8780
[2021-03-15 02:11:33] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:11:33] Found 4830 unlabelled features.
[2021-03-15 02:11:33] Showing labelled: True (190/5000 visible)
[2021-03-15 02:11:33] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:11:34] Training loss: 0.0735
[2021-03-15 02:11:34] Testing on 5000 data points...
[2021-03-15 02:11:34] Test accuracy: 0.9390
[2021-03-15 02:11:34] Score for 190 labels: 0.9390
[2021-03-15 02:11:34] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:11:34] Found 4810 unlabelled features.
[2021-03-15 02:11:34] Showing labelled: True (210/5000 visible)
[2021-03-15 02:11:34] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:11:36] Training loss: 0.0503
[2021-03-15 02:11:36] Testing on 5000 data points...
[2021-03-15 02:11:36] Test accuracy: 0.9860
[2021-03-15 02:11:36] Score for 210 labels: 0.9860
[2021-03-15 02:11:36] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:11:36] Found 4790 unlabelled features.
[2021-03-15 02:11:36] Showing labelled: True (230/5000 visible)
[2021-03-15 02:11:36] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:11:37] Training loss: 0.0375
[2021-03-15 02:11:37] Testing on 5000 data points...
[2021-03-15 02:11:37] Test accuracy: 0.9922
[2021-03-15 02:11:37] Score for 230 labels: 0.9922
[2021-03-15 02:11:37] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:11:37] Found 4770 unlabelled features.
[2021-03-15 02:11:37] Showing labelled: True (250/5000 visible)
[2021-03-15 02:11:37] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:11:39] Training loss: 0.0295
[2021-03-15 02:11:39] Testing on 5000 data points...
[2021-03-15 02:11:39] Test accuracy: 0.9934
[2021-03-15 02:11:39] Score for 250 labels: 0.9934
[2021-03-15 02:11:39] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:11:39] Found 4750 unlabelled features.
[2021-03-15 02:11:39] Showing labelled: True (270/5000 visible)
[2021-03-15 02:11:39] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:11:41] Training loss: 0.0228
[2021-03-15 02:11:41] Testing on 5000 data points...
[2021-03-15 02:11:41] Test accuracy: 0.9950
[2021-03-15 02:11:41] Score for 270 labels: 0.9950
[2021-03-15 02:11:41] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:11:41] Found 4730 unlabelled features.
[2021-03-15 02:11:41] Showing labelled: True (290/5000 visible)
[2021-03-15 02:11:41] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:11:43] Training loss: 0.0200
[2021-03-15 02:11:43] Testing on 5000 data points...
[2021-03-15 02:11:43] Test accuracy: 0.9952
[2021-03-15 02:11:43] Score for 290 labels: 0.9952
[2021-03-15 02:11:43] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:11:43] Found 4710 unlabelled features.
[2021-03-15 02:11:43] Showing labelled: True (310/5000 visible)
[2021-03-15 02:11:43] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:11:45] Training loss: 0.0160
[2021-03-15 02:11:45] Testing on 5000 data points...
[2021-03-15 02:11:45] Test accuracy: 0.9958
[2021-03-15 02:11:45] Score for 310 labels: 0.9958
[2021-03-15 02:11:45] Running: experiment 2
[2021-03-15 02:11:45] Showing labelled: True (50/5000 visible)
[2021-03-15 02:11:45] mlp: initialized 1482 parameters.
[2021-03-15 02:11:45] Creating trainer with model on device: cuda
[2021-03-15 02:11:45] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:11:45] Training loss: 1.2041
[2021-03-15 02:11:45] Testing on 5000 data points...
[2021-03-15 02:11:45] Test accuracy: 0.5374
[2021-03-15 02:11:45] Score for 50 labels: 0.5374
[2021-03-15 02:11:45] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:11:45] Found 4950 unlabelled features.
[2021-03-15 02:11:45] Showing labelled: True (70/5000 visible)
[2021-03-15 02:11:45] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:11:46] Training loss: 0.5045
[2021-03-15 02:11:46] Testing on 5000 data points...
[2021-03-15 02:11:46] Test accuracy: 0.6502
[2021-03-15 02:11:46] Score for 70 labels: 0.6502
[2021-03-15 02:11:46] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:11:46] Found 4930 unlabelled features.
[2021-03-15 02:11:46] Showing labelled: True (90/5000 visible)
[2021-03-15 02:11:46] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:11:47] Training loss: 0.1869
[2021-03-15 02:11:47] Testing on 5000 data points...
[2021-03-15 02:11:47] Test accuracy: 0.7000
[2021-03-15 02:11:47] Score for 90 labels: 0.7000
[2021-03-15 02:11:47] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:11:47] Found 4910 unlabelled features.
[2021-03-15 02:11:47] Showing labelled: True (110/5000 visible)
[2021-03-15 02:11:47] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:11:48] Training loss: 0.1133
[2021-03-15 02:11:48] Testing on 5000 data points...
[2021-03-15 02:11:48] Test accuracy: 0.7998
[2021-03-15 02:11:48] Score for 110 labels: 0.7998
[2021-03-15 02:11:48] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:11:48] Found 4890 unlabelled features.
[2021-03-15 02:11:48] Showing labelled: True (130/5000 visible)
[2021-03-15 02:11:48] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:11:49] Training loss: 0.1204
[2021-03-15 02:11:49] Testing on 5000 data points...
[2021-03-15 02:11:49] Test accuracy: 0.7998
[2021-03-15 02:11:49] Score for 130 labels: 0.7998
[2021-03-15 02:11:49] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:11:49] Found 4870 unlabelled features.
[2021-03-15 02:11:49] Showing labelled: True (150/5000 visible)
[2021-03-15 02:11:49] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:11:50] Training loss: 0.1318
[2021-03-15 02:11:50] Testing on 5000 data points...
[2021-03-15 02:11:50] Test accuracy: 0.8072
[2021-03-15 02:11:50] Score for 150 labels: 0.8072
[2021-03-15 02:11:50] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:11:50] Found 4850 unlabelled features.
[2021-03-15 02:11:50] Showing labelled: True (170/5000 visible)
[2021-03-15 02:11:50] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:11:51] Training loss: 0.0998
[2021-03-15 02:11:51] Testing on 5000 data points...
[2021-03-15 02:11:51] Test accuracy: 0.9974
[2021-03-15 02:11:51] Score for 170 labels: 0.9974
[2021-03-15 02:11:51] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:11:51] Found 4830 unlabelled features.
[2021-03-15 02:11:51] Showing labelled: True (190/5000 visible)
[2021-03-15 02:11:51] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:11:53] Training loss: 0.1047
[2021-03-15 02:11:53] Testing on 5000 data points...
[2021-03-15 02:11:53] Test accuracy: 0.9972
[2021-03-15 02:11:53] Score for 190 labels: 0.9972
[2021-03-15 02:11:53] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:11:53] Found 4810 unlabelled features.
[2021-03-15 02:11:53] Showing labelled: True (210/5000 visible)
[2021-03-15 02:11:53] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:11:54] Training loss: 0.1009
[2021-03-15 02:11:54] Testing on 5000 data points...
[2021-03-15 02:11:54] Test accuracy: 0.9984
[2021-03-15 02:11:54] Score for 210 labels: 0.9984
[2021-03-15 02:11:54] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:11:54] Found 4790 unlabelled features.
[2021-03-15 02:11:54] Showing labelled: True (230/5000 visible)
[2021-03-15 02:11:54] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:11:56] Training loss: 0.0859
[2021-03-15 02:11:56] Testing on 5000 data points...
[2021-03-15 02:11:56] Test accuracy: 0.9986
[2021-03-15 02:11:56] Score for 230 labels: 0.9986
[2021-03-15 02:11:56] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:11:56] Found 4770 unlabelled features.
[2021-03-15 02:11:56] Showing labelled: True (250/5000 visible)
[2021-03-15 02:11:56] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:11:57] Training loss: 0.0638
[2021-03-15 02:11:57] Testing on 5000 data points...
[2021-03-15 02:11:58] Test accuracy: 0.9976
[2021-03-15 02:11:58] Score for 250 labels: 0.9976
[2021-03-15 02:11:58] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:11:58] Found 4750 unlabelled features.
[2021-03-15 02:11:58] Showing labelled: True (270/5000 visible)
[2021-03-15 02:11:58] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:11:59] Training loss: 0.0476
[2021-03-15 02:11:59] Testing on 5000 data points...
[2021-03-15 02:11:59] Test accuracy: 0.9990
[2021-03-15 02:11:59] Score for 270 labels: 0.9990
[2021-03-15 02:11:59] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:11:59] Found 4730 unlabelled features.
[2021-03-15 02:11:59] Showing labelled: True (290/5000 visible)
[2021-03-15 02:11:59] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:12:01] Training loss: 0.0351
[2021-03-15 02:12:01] Testing on 5000 data points...
[2021-03-15 02:12:01] Test accuracy: 0.9976
[2021-03-15 02:12:01] Score for 290 labels: 0.9976
[2021-03-15 02:12:01] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:12:01] Found 4710 unlabelled features.
[2021-03-15 02:12:01] Showing labelled: True (310/5000 visible)
[2021-03-15 02:12:01] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:12:03] Training loss: 0.0271
[2021-03-15 02:12:03] Testing on 5000 data points...
[2021-03-15 02:12:03] Test accuracy: 0.9986
[2021-03-15 02:12:03] Score for 310 labels: 0.9986
[2021-03-15 02:12:03] Running: experiment 3
[2021-03-15 02:12:03] Showing labelled: True (50/5000 visible)
[2021-03-15 02:12:03] mlp: initialized 1482 parameters.
[2021-03-15 02:12:03] Creating trainer with model on device: cuda
[2021-03-15 02:12:03] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:12:04] Training loss: 1.1685
[2021-03-15 02:12:04] Testing on 5000 data points...
[2021-03-15 02:12:04] Test accuracy: 0.5644
[2021-03-15 02:12:04] Score for 50 labels: 0.5644
[2021-03-15 02:12:04] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:12:04] Found 4950 unlabelled features.
[2021-03-15 02:12:04] Showing labelled: True (70/5000 visible)
[2021-03-15 02:12:04] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:12:04] Training loss: 0.4623
[2021-03-15 02:12:04] Testing on 5000 data points...
[2021-03-15 02:12:05] Test accuracy: 0.6000
[2021-03-15 02:12:05] Score for 70 labels: 0.6000
[2021-03-15 02:12:05] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:12:05] Found 4930 unlabelled features.
[2021-03-15 02:12:05] Showing labelled: True (90/5000 visible)
[2021-03-15 02:12:05] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:12:05] Training loss: 0.2754
[2021-03-15 02:12:05] Testing on 5000 data points...
[2021-03-15 02:12:05] Test accuracy: 0.7994
[2021-03-15 02:12:05] Score for 90 labels: 0.7994
[2021-03-15 02:12:05] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:12:05] Found 4910 unlabelled features.
[2021-03-15 02:12:05] Showing labelled: True (110/5000 visible)
[2021-03-15 02:12:05] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:12:06] Training loss: 0.1348
[2021-03-15 02:12:06] Testing on 5000 data points...
[2021-03-15 02:12:06] Test accuracy: 0.8026
[2021-03-15 02:12:06] Score for 110 labels: 0.8026
[2021-03-15 02:12:06] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:12:06] Found 4890 unlabelled features.
[2021-03-15 02:12:06] Showing labelled: True (130/5000 visible)
[2021-03-15 02:12:06] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:12:07] Training loss: 0.1073
[2021-03-15 02:12:07] Testing on 5000 data points...
[2021-03-15 02:12:07] Test accuracy: 0.8996
[2021-03-15 02:12:07] Score for 130 labels: 0.8996
[2021-03-15 02:12:07] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:12:07] Found 4870 unlabelled features.
[2021-03-15 02:12:07] Showing labelled: True (150/5000 visible)
[2021-03-15 02:12:07] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:12:08] Training loss: 0.1010
[2021-03-15 02:12:08] Testing on 5000 data points...
[2021-03-15 02:12:08] Test accuracy: 0.9934
[2021-03-15 02:12:08] Score for 150 labels: 0.9934
[2021-03-15 02:12:08] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:12:08] Found 4850 unlabelled features.
[2021-03-15 02:12:08] Showing labelled: True (170/5000 visible)
[2021-03-15 02:12:08] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:12:10] Training loss: 0.0773
[2021-03-15 02:12:10] Testing on 5000 data points...
[2021-03-15 02:12:10] Test accuracy: 0.9972
[2021-03-15 02:12:10] Score for 170 labels: 0.9972
[2021-03-15 02:12:10] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:12:10] Found 4830 unlabelled features.
[2021-03-15 02:12:10] Showing labelled: True (190/5000 visible)
[2021-03-15 02:12:10] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:12:11] Training loss: 0.0720
[2021-03-15 02:12:11] Testing on 5000 data points...
[2021-03-15 02:12:11] Test accuracy: 0.9946
[2021-03-15 02:12:11] Score for 190 labels: 0.9946
[2021-03-15 02:12:11] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:12:11] Found 4810 unlabelled features.
[2021-03-15 02:12:11] Showing labelled: True (210/5000 visible)
[2021-03-15 02:12:11] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:12:13] Training loss: 0.0781
[2021-03-15 02:12:13] Testing on 5000 data points...
[2021-03-15 02:12:13] Test accuracy: 0.9976
[2021-03-15 02:12:13] Score for 210 labels: 0.9976
[2021-03-15 02:12:13] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:12:13] Found 4790 unlabelled features.
[2021-03-15 02:12:13] Showing labelled: True (230/5000 visible)
[2021-03-15 02:12:13] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:12:14] Training loss: 0.0787
[2021-03-15 02:12:14] Testing on 5000 data points...
[2021-03-15 02:12:14] Test accuracy: 0.9978
[2021-03-15 02:12:14] Score for 230 labels: 0.9978
[2021-03-15 02:12:14] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:12:14] Found 4770 unlabelled features.
[2021-03-15 02:12:14] Showing labelled: True (250/5000 visible)
[2021-03-15 02:12:14] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:12:16] Training loss: 0.0702
[2021-03-15 02:12:16] Testing on 5000 data points...
[2021-03-15 02:12:16] Test accuracy: 0.9974
[2021-03-15 02:12:16] Score for 250 labels: 0.9974
[2021-03-15 02:12:16] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:12:16] Found 4750 unlabelled features.
[2021-03-15 02:12:16] Showing labelled: True (270/5000 visible)
[2021-03-15 02:12:16] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:12:18] Training loss: 0.0533
[2021-03-15 02:12:18] Testing on 5000 data points...
[2021-03-15 02:12:18] Test accuracy: 0.9976
[2021-03-15 02:12:18] Score for 270 labels: 0.9976
[2021-03-15 02:12:18] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:12:18] Found 4730 unlabelled features.
[2021-03-15 02:12:18] Showing labelled: True (290/5000 visible)
[2021-03-15 02:12:18] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:12:20] Training loss: 0.0392
[2021-03-15 02:12:20] Testing on 5000 data points...
[2021-03-15 02:12:20] Test accuracy: 0.9974
[2021-03-15 02:12:20] Score for 290 labels: 0.9974
[2021-03-15 02:12:20] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:12:20] Found 4710 unlabelled features.
[2021-03-15 02:12:20] Showing labelled: True (310/5000 visible)
[2021-03-15 02:12:20] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:12:22] Training loss: 0.0311
[2021-03-15 02:12:22] Testing on 5000 data points...
[2021-03-15 02:12:22] Test accuracy: 0.9986
[2021-03-15 02:12:22] Score for 310 labels: 0.9986
[2021-03-15 02:12:22] Running: experiment 4
[2021-03-15 02:12:22] Showing labelled: True (50/5000 visible)
[2021-03-15 02:12:22] mlp: initialized 1482 parameters.
[2021-03-15 02:12:22] Creating trainer with model on device: cuda
[2021-03-15 02:12:22] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:12:22] Training loss: 1.3297
[2021-03-15 02:12:22] Testing on 5000 data points...
[2021-03-15 02:12:22] Test accuracy: 0.5438
[2021-03-15 02:12:22] Score for 50 labels: 0.5438
[2021-03-15 02:12:22] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:12:22] Found 4950 unlabelled features.
[2021-03-15 02:12:22] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:22] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:23] Scoring random batches...
[2021-03-15 02:12:23] Showing labelled: True (70/5000 visible)
[2021-03-15 02:12:23] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:12:23] Training loss: 0.5249
[2021-03-15 02:12:23] Testing on 5000 data points...
[2021-03-15 02:12:23] Test accuracy: 0.6994
[2021-03-15 02:12:23] Score for 70 labels: 0.6994
[2021-03-15 02:12:23] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:12:23] Found 4930 unlabelled features.
[2021-03-15 02:12:23] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:24] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:24] Scoring random batches...
[2021-03-15 02:12:24] Showing labelled: True (90/5000 visible)
[2021-03-15 02:12:24] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:12:25] Training loss: 0.2870
[2021-03-15 02:12:25] Testing on 5000 data points...
[2021-03-15 02:12:25] Test accuracy: 0.7000
[2021-03-15 02:12:25] Score for 90 labels: 0.7000
[2021-03-15 02:12:25] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:12:25] Found 4910 unlabelled features.
[2021-03-15 02:12:25] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:25] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:25] Scoring random batches...
[2021-03-15 02:12:25] Showing labelled: True (110/5000 visible)
[2021-03-15 02:12:25] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:12:26] Training loss: 0.1673
[2021-03-15 02:12:26] Testing on 5000 data points...
[2021-03-15 02:12:26] Test accuracy: 0.7580
[2021-03-15 02:12:26] Score for 110 labels: 0.7580
[2021-03-15 02:12:26] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:12:26] Found 4890 unlabelled features.
[2021-03-15 02:12:26] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:26] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:27] Scoring random batches...
[2021-03-15 02:12:27] Showing labelled: True (130/5000 visible)
[2021-03-15 02:12:27] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:12:28] Training loss: 0.1279
[2021-03-15 02:12:28] Testing on 5000 data points...
[2021-03-15 02:12:28] Test accuracy: 0.8004
[2021-03-15 02:12:28] Score for 130 labels: 0.8004
[2021-03-15 02:12:28] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:12:28] Found 4870 unlabelled features.
[2021-03-15 02:12:28] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:28] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:28] Scoring random batches...
[2021-03-15 02:12:28] Showing labelled: True (150/5000 visible)
[2021-03-15 02:12:28] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:12:29] Training loss: 0.1037
[2021-03-15 02:12:29] Testing on 5000 data points...
[2021-03-15 02:12:29] Test accuracy: 0.8434
[2021-03-15 02:12:29] Score for 150 labels: 0.8434
[2021-03-15 02:12:29] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:12:29] Found 4850 unlabelled features.
[2021-03-15 02:12:29] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:29] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:30] Scoring random batches...
[2021-03-15 02:12:30] Showing labelled: True (170/5000 visible)
[2021-03-15 02:12:30] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:12:31] Training loss: 0.0761
[2021-03-15 02:12:31] Testing on 5000 data points...
[2021-03-15 02:12:31] Test accuracy: 0.8898
[2021-03-15 02:12:31] Score for 170 labels: 0.8898
[2021-03-15 02:12:31] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:12:31] Found 4830 unlabelled features.
[2021-03-15 02:12:31] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:31] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:32] Scoring random batches...
[2021-03-15 02:12:32] Showing labelled: True (190/5000 visible)
[2021-03-15 02:12:32] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:12:33] Training loss: 0.0506
[2021-03-15 02:12:33] Testing on 5000 data points...
[2021-03-15 02:12:33] Test accuracy: 0.8944
[2021-03-15 02:12:33] Score for 190 labels: 0.8944
[2021-03-15 02:12:33] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:12:33] Found 4810 unlabelled features.
[2021-03-15 02:12:33] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:33] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:34] Scoring random batches...
[2021-03-15 02:12:34] Showing labelled: True (210/5000 visible)
[2021-03-15 02:12:34] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:12:35] Training loss: 0.0339
[2021-03-15 02:12:35] Testing on 5000 data points...
[2021-03-15 02:12:35] Test accuracy: 0.8948
[2021-03-15 02:12:35] Score for 210 labels: 0.8948
[2021-03-15 02:12:35] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:12:35] Found 4790 unlabelled features.
[2021-03-15 02:12:35] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:35] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:36] Scoring random batches...
[2021-03-15 02:12:36] Showing labelled: True (230/5000 visible)
[2021-03-15 02:12:36] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:12:37] Training loss: 0.0260
[2021-03-15 02:12:37] Testing on 5000 data points...
[2021-03-15 02:12:37] Test accuracy: 0.8954
[2021-03-15 02:12:37] Score for 230 labels: 0.8954
[2021-03-15 02:12:37] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:12:37] Found 4770 unlabelled features.
[2021-03-15 02:12:37] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:37] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:38] Scoring random batches...
[2021-03-15 02:12:38] Showing labelled: True (250/5000 visible)
[2021-03-15 02:12:38] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:12:39] Training loss: 0.0191
[2021-03-15 02:12:39] Testing on 5000 data points...
[2021-03-15 02:12:39] Test accuracy: 0.8962
[2021-03-15 02:12:39] Score for 250 labels: 0.8962
[2021-03-15 02:12:39] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:12:39] Found 4750 unlabelled features.
[2021-03-15 02:12:39] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:40] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:40] Scoring random batches...
[2021-03-15 02:12:40] Showing labelled: True (270/5000 visible)
[2021-03-15 02:12:40] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:12:42] Training loss: 0.0147
[2021-03-15 02:12:42] Testing on 5000 data points...
[2021-03-15 02:12:42] Test accuracy: 0.8962
[2021-03-15 02:12:42] Score for 270 labels: 0.8962
[2021-03-15 02:12:42] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:12:42] Found 4730 unlabelled features.
[2021-03-15 02:12:42] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:42] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:43] Scoring random batches...
[2021-03-15 02:12:43] Showing labelled: True (290/5000 visible)
[2021-03-15 02:12:43] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:12:44] Training loss: 0.0121
[2021-03-15 02:12:44] Testing on 5000 data points...
[2021-03-15 02:12:44] Test accuracy: 0.8970
[2021-03-15 02:12:44] Score for 290 labels: 0.8970
[2021-03-15 02:12:44] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:12:44] Found 4710 unlabelled features.
[2021-03-15 02:12:44] Training GMM (k=32) on labelled features...
[2021-03-15 02:12:45] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:12:45] Scoring random batches...
[2021-03-15 02:12:45] Showing labelled: True (310/5000 visible)
[2021-03-15 02:12:45] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:12:47] Training loss: 0.0237
[2021-03-15 02:12:47] Testing on 5000 data points...
[2021-03-15 02:12:47] Test accuracy: 0.8968
[2021-03-15 02:12:47] Score for 310 labels: 0.8968
[2021-03-15 02:12:47] Experiment repeat 3/10
[2021-03-15 02:12:47] Randomly labelled 50/5000
[2021-03-15 02:12:47] Showing labelled: True (50/5000 visible)
[2021-03-15 02:12:47] Running: experiment 0
[2021-03-15 02:12:47] Showing labelled: True (50/5000 visible)
[2021-03-15 02:12:47] mlp: initialized 1482 parameters.
[2021-03-15 02:12:47] Creating trainer with model on device: cuda
[2021-03-15 02:12:47] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:12:47] Training loss: 1.2550
[2021-03-15 02:12:47] Testing on 5000 data points...
[2021-03-15 02:12:47] Test accuracy: 0.5000
[2021-03-15 02:12:47] Score for 50 labels: 0.5000
[2021-03-15 02:12:47] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:12:47] Found 4950 unlabelled features.
[2021-03-15 02:12:47] Searching core-set greedily...
[2021-03-15 02:12:49] Showing labelled: True (70/5000 visible)
[2021-03-15 02:12:49] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:12:50] Training loss: 0.6980
[2021-03-15 02:12:50] Testing on 5000 data points...
[2021-03-15 02:12:50] Test accuracy: 0.8958
[2021-03-15 02:12:50] Score for 70 labels: 0.8958
[2021-03-15 02:12:50] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:12:50] Found 4930 unlabelled features.
[2021-03-15 02:12:50] Searching core-set greedily...
[2021-03-15 02:12:52] Showing labelled: True (90/5000 visible)
[2021-03-15 02:12:52] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:12:53] Training loss: 0.3758
[2021-03-15 02:12:53] Testing on 5000 data points...
[2021-03-15 02:12:53] Test accuracy: 0.8998
[2021-03-15 02:12:53] Score for 90 labels: 0.8998
[2021-03-15 02:12:53] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:12:53] Found 4910 unlabelled features.
[2021-03-15 02:12:53] Searching core-set greedily...
[2021-03-15 02:12:55] Showing labelled: True (110/5000 visible)
[2021-03-15 02:12:55] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:12:56] Training loss: 0.2490
[2021-03-15 02:12:56] Testing on 5000 data points...
[2021-03-15 02:12:56] Test accuracy: 0.9930
[2021-03-15 02:12:56] Score for 110 labels: 0.9930
[2021-03-15 02:12:56] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:12:56] Found 4890 unlabelled features.
[2021-03-15 02:12:56] Searching core-set greedily...
[2021-03-15 02:12:59] Showing labelled: True (130/5000 visible)
[2021-03-15 02:12:59] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:13:00] Training loss: 0.1575
[2021-03-15 02:13:00] Testing on 5000 data points...
[2021-03-15 02:13:00] Test accuracy: 0.9952
[2021-03-15 02:13:00] Score for 130 labels: 0.9952
[2021-03-15 02:13:00] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:13:00] Found 4870 unlabelled features.
[2021-03-15 02:13:00] Searching core-set greedily...
[2021-03-15 02:13:03] Showing labelled: True (150/5000 visible)
[2021-03-15 02:13:03] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:13:04] Training loss: 0.1063
[2021-03-15 02:13:04] Testing on 5000 data points...
[2021-03-15 02:13:04] Test accuracy: 0.9964
[2021-03-15 02:13:04] Score for 150 labels: 0.9964
[2021-03-15 02:13:04] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:13:04] Found 4850 unlabelled features.
[2021-03-15 02:13:04] Searching core-set greedily...
[2021-03-15 02:13:08] Showing labelled: True (170/5000 visible)
[2021-03-15 02:13:08] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:13:09] Training loss: 0.0835
[2021-03-15 02:13:09] Testing on 5000 data points...
[2021-03-15 02:13:09] Test accuracy: 0.9980
[2021-03-15 02:13:09] Score for 170 labels: 0.9980
[2021-03-15 02:13:09] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:13:09] Found 4830 unlabelled features.
[2021-03-15 02:13:09] Searching core-set greedily...
[2021-03-15 02:13:12] Showing labelled: True (190/5000 visible)
[2021-03-15 02:13:12] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:13:14] Training loss: 0.0648
[2021-03-15 02:13:14] Testing on 5000 data points...
[2021-03-15 02:13:14] Test accuracy: 0.9984
[2021-03-15 02:13:14] Score for 190 labels: 0.9984
[2021-03-15 02:13:14] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:13:14] Found 4810 unlabelled features.
[2021-03-15 02:13:14] Searching core-set greedily...
[2021-03-15 02:13:17] Showing labelled: True (210/5000 visible)
[2021-03-15 02:13:17] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:13:18] Training loss: 0.0499
[2021-03-15 02:13:18] Testing on 5000 data points...
[2021-03-15 02:13:18] Test accuracy: 0.9984
[2021-03-15 02:13:18] Score for 210 labels: 0.9984
[2021-03-15 02:13:18] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:13:18] Found 4790 unlabelled features.
[2021-03-15 02:13:18] Searching core-set greedily...
[2021-03-15 02:13:22] Showing labelled: True (230/5000 visible)
[2021-03-15 02:13:22] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:13:23] Training loss: 0.0386
[2021-03-15 02:13:23] Testing on 5000 data points...
[2021-03-15 02:13:23] Test accuracy: 0.9984
[2021-03-15 02:13:23] Score for 230 labels: 0.9984
[2021-03-15 02:13:23] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:13:23] Found 4770 unlabelled features.
[2021-03-15 02:13:23] Searching core-set greedily...
[2021-03-15 02:13:27] Showing labelled: True (250/5000 visible)
[2021-03-15 02:13:27] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:13:28] Training loss: 0.0309
[2021-03-15 02:13:28] Testing on 5000 data points...
[2021-03-15 02:13:28] Test accuracy: 0.9984
[2021-03-15 02:13:28] Score for 250 labels: 0.9984
[2021-03-15 02:13:28] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:13:28] Found 4750 unlabelled features.
[2021-03-15 02:13:29] Searching core-set greedily...
[2021-03-15 02:13:32] Showing labelled: True (270/5000 visible)
[2021-03-15 02:13:32] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:13:34] Training loss: 0.0251
[2021-03-15 02:13:34] Testing on 5000 data points...
[2021-03-15 02:13:34] Test accuracy: 0.9988
[2021-03-15 02:13:34] Score for 270 labels: 0.9988
[2021-03-15 02:13:34] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:13:34] Found 4730 unlabelled features.
[2021-03-15 02:13:34] Searching core-set greedily...
[2021-03-15 02:13:38] Showing labelled: True (290/5000 visible)
[2021-03-15 02:13:38] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:13:40] Training loss: 0.0238
[2021-03-15 02:13:40] Testing on 5000 data points...
[2021-03-15 02:13:40] Test accuracy: 0.9986
[2021-03-15 02:13:40] Score for 290 labels: 0.9986
[2021-03-15 02:13:40] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:13:40] Found 4710 unlabelled features.
[2021-03-15 02:13:40] Searching core-set greedily...
[2021-03-15 02:13:44] Showing labelled: True (310/5000 visible)
[2021-03-15 02:13:44] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:13:46] Training loss: 0.0198
[2021-03-15 02:13:46] Testing on 5000 data points...
[2021-03-15 02:13:46] Test accuracy: 0.9984
[2021-03-15 02:13:46] Score for 310 labels: 0.9984
[2021-03-15 02:13:46] Running: experiment 1
[2021-03-15 02:13:46] Showing labelled: True (50/5000 visible)
[2021-03-15 02:13:46] mlp: initialized 1482 parameters.
[2021-03-15 02:13:46] Creating trainer with model on device: cuda
[2021-03-15 02:13:46] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:13:46] Training loss: 1.2468
[2021-03-15 02:13:46] Testing on 5000 data points...
[2021-03-15 02:13:46] Test accuracy: 0.5000
[2021-03-15 02:13:46] Score for 50 labels: 0.5000
[2021-03-15 02:13:46] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:13:46] Found 4950 unlabelled features.
[2021-03-15 02:13:46] Showing labelled: True (70/5000 visible)
[2021-03-15 02:13:46] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:13:47] Training loss: 0.4118
[2021-03-15 02:13:47] Testing on 5000 data points...
[2021-03-15 02:13:47] Test accuracy: 0.6044
[2021-03-15 02:13:47] Score for 70 labels: 0.6044
[2021-03-15 02:13:47] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:13:47] Found 4930 unlabelled features.
[2021-03-15 02:13:47] Showing labelled: True (90/5000 visible)
[2021-03-15 02:13:47] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:13:48] Training loss: 0.1738
[2021-03-15 02:13:48] Testing on 5000 data points...
[2021-03-15 02:13:48] Test accuracy: 0.6968
[2021-03-15 02:13:48] Score for 90 labels: 0.6968
[2021-03-15 02:13:48] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:13:48] Found 4910 unlabelled features.
[2021-03-15 02:13:48] Showing labelled: True (110/5000 visible)
[2021-03-15 02:13:48] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:13:49] Training loss: 0.1304
[2021-03-15 02:13:49] Testing on 5000 data points...
[2021-03-15 02:13:49] Test accuracy: 0.7000
[2021-03-15 02:13:49] Score for 110 labels: 0.7000
[2021-03-15 02:13:49] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:13:49] Found 4890 unlabelled features.
[2021-03-15 02:13:49] Showing labelled: True (130/5000 visible)
[2021-03-15 02:13:49] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:13:50] Training loss: 0.1090
[2021-03-15 02:13:50] Testing on 5000 data points...
[2021-03-15 02:13:50] Test accuracy: 0.7996
[2021-03-15 02:13:50] Score for 130 labels: 0.7996
[2021-03-15 02:13:50] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:13:50] Found 4870 unlabelled features.
[2021-03-15 02:13:50] Showing labelled: True (150/5000 visible)
[2021-03-15 02:13:50] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:13:51] Training loss: 0.0861
[2021-03-15 02:13:51] Testing on 5000 data points...
[2021-03-15 02:13:51] Test accuracy: 0.7996
[2021-03-15 02:13:51] Score for 150 labels: 0.7996
[2021-03-15 02:13:51] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:13:51] Found 4850 unlabelled features.
[2021-03-15 02:13:51] Showing labelled: True (170/5000 visible)
[2021-03-15 02:13:51] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:13:52] Training loss: 0.0611
[2021-03-15 02:13:52] Testing on 5000 data points...
[2021-03-15 02:13:52] Test accuracy: 0.8288
[2021-03-15 02:13:52] Score for 170 labels: 0.8288
[2021-03-15 02:13:52] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:13:52] Found 4830 unlabelled features.
[2021-03-15 02:13:52] Showing labelled: True (190/5000 visible)
[2021-03-15 02:13:52] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:13:54] Training loss: 0.0434
[2021-03-15 02:13:54] Testing on 5000 data points...
[2021-03-15 02:13:54] Test accuracy: 0.8412
[2021-03-15 02:13:54] Score for 190 labels: 0.8412
[2021-03-15 02:13:54] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:13:54] Found 4810 unlabelled features.
[2021-03-15 02:13:54] Showing labelled: True (210/5000 visible)
[2021-03-15 02:13:54] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:13:55] Training loss: 0.0310
[2021-03-15 02:13:55] Testing on 5000 data points...
[2021-03-15 02:13:55] Test accuracy: 0.8614
[2021-03-15 02:13:55] Score for 210 labels: 0.8614
[2021-03-15 02:13:55] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:13:55] Found 4790 unlabelled features.
[2021-03-15 02:13:55] Showing labelled: True (230/5000 visible)
[2021-03-15 02:13:55] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:13:57] Training loss: 0.0225
[2021-03-15 02:13:57] Testing on 5000 data points...
[2021-03-15 02:13:57] Test accuracy: 0.8832
[2021-03-15 02:13:57] Score for 230 labels: 0.8832
[2021-03-15 02:13:57] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:13:57] Found 4770 unlabelled features.
[2021-03-15 02:13:57] Showing labelled: True (250/5000 visible)
[2021-03-15 02:13:57] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:13:58] Training loss: 0.0171
[2021-03-15 02:13:58] Testing on 5000 data points...
[2021-03-15 02:13:58] Test accuracy: 0.8878
[2021-03-15 02:13:58] Score for 250 labels: 0.8878
[2021-03-15 02:13:58] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:13:58] Found 4750 unlabelled features.
[2021-03-15 02:13:58] Showing labelled: True (270/5000 visible)
[2021-03-15 02:13:58] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:14:00] Training loss: 0.0145
[2021-03-15 02:14:00] Testing on 5000 data points...
[2021-03-15 02:14:00] Test accuracy: 0.8922
[2021-03-15 02:14:00] Score for 270 labels: 0.8922
[2021-03-15 02:14:00] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:14:00] Found 4730 unlabelled features.
[2021-03-15 02:14:00] Showing labelled: True (290/5000 visible)
[2021-03-15 02:14:00] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:14:02] Training loss: 0.0115
[2021-03-15 02:14:02] Testing on 5000 data points...
[2021-03-15 02:14:02] Test accuracy: 0.8930
[2021-03-15 02:14:02] Score for 290 labels: 0.8930
[2021-03-15 02:14:02] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:14:02] Found 4710 unlabelled features.
[2021-03-15 02:14:02] Showing labelled: True (310/5000 visible)
[2021-03-15 02:14:02] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:14:04] Training loss: 0.0098
[2021-03-15 02:14:04] Testing on 5000 data points...
[2021-03-15 02:14:04] Test accuracy: 0.8948
[2021-03-15 02:14:04] Score for 310 labels: 0.8948
[2021-03-15 02:14:04] Running: experiment 2
[2021-03-15 02:14:04] Showing labelled: True (50/5000 visible)
[2021-03-15 02:14:04] mlp: initialized 1482 parameters.
[2021-03-15 02:14:04] Creating trainer with model on device: cuda
[2021-03-15 02:14:04] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:14:05] Training loss: 1.4062
[2021-03-15 02:14:05] Testing on 5000 data points...
[2021-03-15 02:14:05] Test accuracy: 0.5000
[2021-03-15 02:14:05] Score for 50 labels: 0.5000
[2021-03-15 02:14:05] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:14:05] Found 4950 unlabelled features.
[2021-03-15 02:14:05] Showing labelled: True (70/5000 visible)
[2021-03-15 02:14:05] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:14:05] Training loss: 0.4851
[2021-03-15 02:14:05] Testing on 5000 data points...
[2021-03-15 02:14:05] Test accuracy: 0.6004
[2021-03-15 02:14:05] Score for 70 labels: 0.6004
[2021-03-15 02:14:05] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:14:05] Found 4930 unlabelled features.
[2021-03-15 02:14:05] Showing labelled: True (90/5000 visible)
[2021-03-15 02:14:05] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:14:06] Training loss: 0.1972
[2021-03-15 02:14:06] Testing on 5000 data points...
[2021-03-15 02:14:06] Test accuracy: 0.7578
[2021-03-15 02:14:06] Score for 90 labels: 0.7578
[2021-03-15 02:14:06] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:14:06] Found 4910 unlabelled features.
[2021-03-15 02:14:06] Showing labelled: True (110/5000 visible)
[2021-03-15 02:14:06] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:14:07] Training loss: 0.1177
[2021-03-15 02:14:07] Testing on 5000 data points...
[2021-03-15 02:14:07] Test accuracy: 0.7942
[2021-03-15 02:14:07] Score for 110 labels: 0.7942
[2021-03-15 02:14:07] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:14:07] Found 4890 unlabelled features.
[2021-03-15 02:14:07] Showing labelled: True (130/5000 visible)
[2021-03-15 02:14:07] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:14:08] Training loss: 0.0903
[2021-03-15 02:14:08] Testing on 5000 data points...
[2021-03-15 02:14:08] Test accuracy: 0.7982
[2021-03-15 02:14:08] Score for 130 labels: 0.7982
[2021-03-15 02:14:08] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:14:08] Found 4870 unlabelled features.
[2021-03-15 02:14:08] Showing labelled: True (150/5000 visible)
[2021-03-15 02:14:08] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:14:09] Training loss: 0.0812
[2021-03-15 02:14:09] Testing on 5000 data points...
[2021-03-15 02:14:09] Test accuracy: 0.7992
[2021-03-15 02:14:09] Score for 150 labels: 0.7992
[2021-03-15 02:14:09] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:14:09] Found 4850 unlabelled features.
[2021-03-15 02:14:09] Showing labelled: True (170/5000 visible)
[2021-03-15 02:14:09] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:14:11] Training loss: 0.1028
[2021-03-15 02:14:11] Testing on 5000 data points...
[2021-03-15 02:14:11] Test accuracy: 0.8398
[2021-03-15 02:14:11] Score for 170 labels: 0.8398
[2021-03-15 02:14:11] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:14:11] Found 4830 unlabelled features.
[2021-03-15 02:14:11] Showing labelled: True (190/5000 visible)
[2021-03-15 02:14:11] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:14:12] Training loss: 0.0933
[2021-03-15 02:14:12] Testing on 5000 data points...
[2021-03-15 02:14:12] Test accuracy: 0.8982
[2021-03-15 02:14:12] Score for 190 labels: 0.8982
[2021-03-15 02:14:12] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:14:12] Found 4810 unlabelled features.
[2021-03-15 02:14:12] Showing labelled: True (210/5000 visible)
[2021-03-15 02:14:12] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:14:13] Training loss: 0.1040
[2021-03-15 02:14:13] Testing on 5000 data points...
[2021-03-15 02:14:13] Test accuracy: 0.9610
[2021-03-15 02:14:13] Score for 210 labels: 0.9610
[2021-03-15 02:14:13] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:14:13] Found 4790 unlabelled features.
[2021-03-15 02:14:14] Showing labelled: True (230/5000 visible)
[2021-03-15 02:14:14] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:14:15] Training loss: 0.0649
[2021-03-15 02:14:15] Testing on 5000 data points...
[2021-03-15 02:14:15] Test accuracy: 0.9962
[2021-03-15 02:14:15] Score for 230 labels: 0.9962
[2021-03-15 02:14:15] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:14:15] Found 4770 unlabelled features.
[2021-03-15 02:14:15] Showing labelled: True (250/5000 visible)
[2021-03-15 02:14:15] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:14:17] Training loss: 0.0743
[2021-03-15 02:14:17] Testing on 5000 data points...
[2021-03-15 02:14:17] Test accuracy: 0.9984
[2021-03-15 02:14:17] Score for 250 labels: 0.9984
[2021-03-15 02:14:17] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:14:17] Found 4750 unlabelled features.
[2021-03-15 02:14:17] Showing labelled: True (270/5000 visible)
[2021-03-15 02:14:17] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:14:18] Training loss: 0.0627
[2021-03-15 02:14:18] Testing on 5000 data points...
[2021-03-15 02:14:19] Test accuracy: 0.9974
[2021-03-15 02:14:19] Score for 270 labels: 0.9974
[2021-03-15 02:14:19] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:14:19] Found 4730 unlabelled features.
[2021-03-15 02:14:19] Showing labelled: True (290/5000 visible)
[2021-03-15 02:14:19] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:14:20] Training loss: 0.0470
[2021-03-15 02:14:20] Testing on 5000 data points...
[2021-03-15 02:14:20] Test accuracy: 0.9972
[2021-03-15 02:14:20] Score for 290 labels: 0.9972
[2021-03-15 02:14:20] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:14:20] Found 4710 unlabelled features.
[2021-03-15 02:14:20] Showing labelled: True (310/5000 visible)
[2021-03-15 02:14:20] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:14:22] Training loss: 0.0360
[2021-03-15 02:14:22] Testing on 5000 data points...
[2021-03-15 02:14:23] Test accuracy: 0.9984
[2021-03-15 02:14:23] Score for 310 labels: 0.9984
[2021-03-15 02:14:23] Running: experiment 3
[2021-03-15 02:14:23] Showing labelled: True (50/5000 visible)
[2021-03-15 02:14:23] mlp: initialized 1482 parameters.
[2021-03-15 02:14:23] Creating trainer with model on device: cuda
[2021-03-15 02:14:23] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:14:23] Training loss: 1.5090
[2021-03-15 02:14:23] Testing on 5000 data points...
[2021-03-15 02:14:23] Test accuracy: 0.4984
[2021-03-15 02:14:23] Score for 50 labels: 0.4984
[2021-03-15 02:14:23] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:14:23] Found 4950 unlabelled features.
[2021-03-15 02:14:23] Showing labelled: True (70/5000 visible)
[2021-03-15 02:14:23] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:14:24] Training loss: 0.5720
[2021-03-15 02:14:24] Testing on 5000 data points...
[2021-03-15 02:14:24] Test accuracy: 0.6092
[2021-03-15 02:14:24] Score for 70 labels: 0.6092
[2021-03-15 02:14:24] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:14:24] Found 4930 unlabelled features.
[2021-03-15 02:14:24] Showing labelled: True (90/5000 visible)
[2021-03-15 02:14:24] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:14:24] Training loss: 0.2982
[2021-03-15 02:14:24] Testing on 5000 data points...
[2021-03-15 02:14:25] Test accuracy: 0.6828
[2021-03-15 02:14:25] Score for 90 labels: 0.6828
[2021-03-15 02:14:25] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:14:25] Found 4910 unlabelled features.
[2021-03-15 02:14:25] Showing labelled: True (110/5000 visible)
[2021-03-15 02:14:25] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:14:25] Training loss: 0.1391
[2021-03-15 02:14:25] Testing on 5000 data points...
[2021-03-15 02:14:26] Test accuracy: 0.7972
[2021-03-15 02:14:26] Score for 110 labels: 0.7972
[2021-03-15 02:14:26] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:14:26] Found 4890 unlabelled features.
[2021-03-15 02:14:26] Showing labelled: True (130/5000 visible)
[2021-03-15 02:14:26] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:14:27] Training loss: 0.1182
[2021-03-15 02:14:27] Testing on 5000 data points...
[2021-03-15 02:14:27] Test accuracy: 0.8000
[2021-03-15 02:14:27] Score for 130 labels: 0.8000
[2021-03-15 02:14:27] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:14:27] Found 4870 unlabelled features.
[2021-03-15 02:14:27] Showing labelled: True (150/5000 visible)
[2021-03-15 02:14:27] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:14:28] Training loss: 0.1135
[2021-03-15 02:14:28] Testing on 5000 data points...
[2021-03-15 02:14:28] Test accuracy: 0.7992
[2021-03-15 02:14:28] Score for 150 labels: 0.7992
[2021-03-15 02:14:28] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:14:28] Found 4850 unlabelled features.
[2021-03-15 02:14:28] Showing labelled: True (170/5000 visible)
[2021-03-15 02:14:28] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:14:29] Training loss: 0.1194
[2021-03-15 02:14:29] Testing on 5000 data points...
[2021-03-15 02:14:29] Test accuracy: 0.8756
[2021-03-15 02:14:29] Score for 170 labels: 0.8756
[2021-03-15 02:14:29] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:14:29] Found 4830 unlabelled features.
[2021-03-15 02:14:29] Showing labelled: True (190/5000 visible)
[2021-03-15 02:14:29] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:14:30] Training loss: 0.0824
[2021-03-15 02:14:30] Testing on 5000 data points...
[2021-03-15 02:14:30] Test accuracy: 0.8978
[2021-03-15 02:14:30] Score for 190 labels: 0.8978
[2021-03-15 02:14:30] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:14:30] Found 4810 unlabelled features.
[2021-03-15 02:14:30] Showing labelled: True (210/5000 visible)
[2021-03-15 02:14:30] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:14:32] Training loss: 0.0805
[2021-03-15 02:14:32] Testing on 5000 data points...
[2021-03-15 02:14:32] Test accuracy: 0.8974
[2021-03-15 02:14:32] Score for 210 labels: 0.8974
[2021-03-15 02:14:32] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:14:32] Found 4790 unlabelled features.
[2021-03-15 02:14:32] Showing labelled: True (230/5000 visible)
[2021-03-15 02:14:32] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:14:33] Training loss: 0.1081
[2021-03-15 02:14:33] Testing on 5000 data points...
[2021-03-15 02:14:34] Test accuracy: 0.9984
[2021-03-15 02:14:34] Score for 230 labels: 0.9984
[2021-03-15 02:14:34] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:14:34] Found 4770 unlabelled features.
[2021-03-15 02:14:34] Showing labelled: True (250/5000 visible)
[2021-03-15 02:14:34] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:14:35] Training loss: 0.0670
[2021-03-15 02:14:35] Testing on 5000 data points...
[2021-03-15 02:14:35] Test accuracy: 0.9972
[2021-03-15 02:14:35] Score for 250 labels: 0.9972
[2021-03-15 02:14:35] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:14:35] Found 4750 unlabelled features.
[2021-03-15 02:14:35] Showing labelled: True (270/5000 visible)
[2021-03-15 02:14:35] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:14:37] Training loss: 0.0542
[2021-03-15 02:14:37] Testing on 5000 data points...
[2021-03-15 02:14:37] Test accuracy: 0.9988
[2021-03-15 02:14:37] Score for 270 labels: 0.9988
[2021-03-15 02:14:37] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:14:37] Found 4730 unlabelled features.
[2021-03-15 02:14:37] Showing labelled: True (290/5000 visible)
[2021-03-15 02:14:37] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:14:39] Training loss: 0.0399
[2021-03-15 02:14:39] Testing on 5000 data points...
[2021-03-15 02:14:39] Test accuracy: 0.9980
[2021-03-15 02:14:39] Score for 290 labels: 0.9980
[2021-03-15 02:14:39] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:14:39] Found 4710 unlabelled features.
[2021-03-15 02:14:39] Showing labelled: True (310/5000 visible)
[2021-03-15 02:14:39] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:14:41] Training loss: 0.0303
[2021-03-15 02:14:41] Testing on 5000 data points...
[2021-03-15 02:14:41] Test accuracy: 0.9974
[2021-03-15 02:14:41] Score for 310 labels: 0.9974
[2021-03-15 02:14:41] Running: experiment 4
[2021-03-15 02:14:41] Showing labelled: True (50/5000 visible)
[2021-03-15 02:14:41] mlp: initialized 1482 parameters.
[2021-03-15 02:14:41] Creating trainer with model on device: cuda
[2021-03-15 02:14:41] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:14:41] Training loss: 1.4061
[2021-03-15 02:14:41] Testing on 5000 data points...
[2021-03-15 02:14:41] Test accuracy: 0.5000
[2021-03-15 02:14:41] Score for 50 labels: 0.5000
[2021-03-15 02:14:41] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:14:41] Found 4950 unlabelled features.
[2021-03-15 02:14:42] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:42] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:42] Scoring random batches...
[2021-03-15 02:14:42] Showing labelled: True (70/5000 visible)
[2021-03-15 02:14:42] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:14:43] Training loss: 0.5504
[2021-03-15 02:14:43] Testing on 5000 data points...
[2021-03-15 02:14:43] Test accuracy: 0.6134
[2021-03-15 02:14:43] Score for 70 labels: 0.6134
[2021-03-15 02:14:43] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:14:43] Found 4930 unlabelled features.
[2021-03-15 02:14:43] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:43] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:43] Scoring random batches...
[2021-03-15 02:14:43] Showing labelled: True (90/5000 visible)
[2021-03-15 02:14:43] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:14:44] Training loss: 0.2231
[2021-03-15 02:14:44] Testing on 5000 data points...
[2021-03-15 02:14:44] Test accuracy: 0.6862
[2021-03-15 02:14:44] Score for 90 labels: 0.6862
[2021-03-15 02:14:44] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:14:44] Found 4910 unlabelled features.
[2021-03-15 02:14:44] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:44] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:44] Scoring random batches...
[2021-03-15 02:14:44] Showing labelled: True (110/5000 visible)
[2021-03-15 02:14:44] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:14:45] Training loss: 0.1140
[2021-03-15 02:14:45] Testing on 5000 data points...
[2021-03-15 02:14:45] Test accuracy: 0.6984
[2021-03-15 02:14:45] Score for 110 labels: 0.6984
[2021-03-15 02:14:45] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:14:45] Found 4890 unlabelled features.
[2021-03-15 02:14:45] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:45] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:46] Scoring random batches...
[2021-03-15 02:14:46] Showing labelled: True (130/5000 visible)
[2021-03-15 02:14:46] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:14:47] Training loss: 0.1132
[2021-03-15 02:14:47] Testing on 5000 data points...
[2021-03-15 02:14:47] Test accuracy: 0.7986
[2021-03-15 02:14:47] Score for 130 labels: 0.7986
[2021-03-15 02:14:47] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:14:47] Found 4870 unlabelled features.
[2021-03-15 02:14:47] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:47] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:47] Scoring random batches...
[2021-03-15 02:14:47] Showing labelled: True (150/5000 visible)
[2021-03-15 02:14:47] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:14:48] Training loss: 0.1135
[2021-03-15 02:14:48] Testing on 5000 data points...
[2021-03-15 02:14:48] Test accuracy: 0.8988
[2021-03-15 02:14:48] Score for 150 labels: 0.8988
[2021-03-15 02:14:48] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:14:48] Found 4850 unlabelled features.
[2021-03-15 02:14:48] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:48] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:49] Scoring random batches...
[2021-03-15 02:14:49] Showing labelled: True (170/5000 visible)
[2021-03-15 02:14:49] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:14:50] Training loss: 0.0894
[2021-03-15 02:14:50] Testing on 5000 data points...
[2021-03-15 02:14:50] Test accuracy: 0.9242
[2021-03-15 02:14:50] Score for 170 labels: 0.9242
[2021-03-15 02:14:50] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:14:50] Found 4830 unlabelled features.
[2021-03-15 02:14:50] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:50] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:51] Scoring random batches...
[2021-03-15 02:14:51] Showing labelled: True (190/5000 visible)
[2021-03-15 02:14:51] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:14:52] Training loss: 0.0599
[2021-03-15 02:14:52] Testing on 5000 data points...
[2021-03-15 02:14:52] Test accuracy: 0.9772
[2021-03-15 02:14:52] Score for 190 labels: 0.9772
[2021-03-15 02:14:52] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:14:52] Found 4810 unlabelled features.
[2021-03-15 02:14:52] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:52] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:52] Scoring random batches...
[2021-03-15 02:14:52] Showing labelled: True (210/5000 visible)
[2021-03-15 02:14:52] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:14:54] Training loss: 0.0435
[2021-03-15 02:14:54] Testing on 5000 data points...
[2021-03-15 02:14:54] Test accuracy: 0.9912
[2021-03-15 02:14:54] Score for 210 labels: 0.9912
[2021-03-15 02:14:54] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:14:54] Found 4790 unlabelled features.
[2021-03-15 02:14:54] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:54] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:55] Scoring random batches...
[2021-03-15 02:14:55] Showing labelled: True (230/5000 visible)
[2021-03-15 02:14:55] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:14:56] Training loss: 0.0301
[2021-03-15 02:14:56] Testing on 5000 data points...
[2021-03-15 02:14:56] Test accuracy: 0.9940
[2021-03-15 02:14:56] Score for 230 labels: 0.9940
[2021-03-15 02:14:56] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:14:56] Found 4770 unlabelled features.
[2021-03-15 02:14:56] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:56] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:57] Scoring random batches...
[2021-03-15 02:14:57] Showing labelled: True (250/5000 visible)
[2021-03-15 02:14:57] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:14:58] Training loss: 0.0233
[2021-03-15 02:14:58] Testing on 5000 data points...
[2021-03-15 02:14:58] Test accuracy: 0.9948
[2021-03-15 02:14:58] Score for 250 labels: 0.9948
[2021-03-15 02:14:58] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:14:58] Found 4750 unlabelled features.
[2021-03-15 02:14:58] Training GMM (k=32) on labelled features...
[2021-03-15 02:14:58] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:14:59] Scoring random batches...
[2021-03-15 02:14:59] Showing labelled: True (270/5000 visible)
[2021-03-15 02:14:59] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:15:00] Training loss: 0.0175
[2021-03-15 02:15:00] Testing on 5000 data points...
[2021-03-15 02:15:00] Test accuracy: 0.9954
[2021-03-15 02:15:00] Score for 270 labels: 0.9954
[2021-03-15 02:15:00] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:15:00] Found 4730 unlabelled features.
[2021-03-15 02:15:00] Training GMM (k=32) on labelled features...
[2021-03-15 02:15:01] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:15:01] Scoring random batches...
[2021-03-15 02:15:01] Showing labelled: True (290/5000 visible)
[2021-03-15 02:15:01] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:15:03] Training loss: 0.0132
[2021-03-15 02:15:03] Testing on 5000 data points...
[2021-03-15 02:15:03] Test accuracy: 0.9954
[2021-03-15 02:15:03] Score for 290 labels: 0.9954
[2021-03-15 02:15:03] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:15:03] Found 4710 unlabelled features.
[2021-03-15 02:15:03] Training GMM (k=32) on labelled features...
[2021-03-15 02:15:03] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:15:04] Scoring random batches...
[2021-03-15 02:15:04] Showing labelled: True (310/5000 visible)
[2021-03-15 02:15:04] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:15:06] Training loss: 0.0107
[2021-03-15 02:15:06] Testing on 5000 data points...
[2021-03-15 02:15:06] Test accuracy: 0.9954
[2021-03-15 02:15:06] Score for 310 labels: 0.9954
[2021-03-15 02:15:06] Experiment repeat 4/10
[2021-03-15 02:15:06] Randomly labelled 50/5000
[2021-03-15 02:15:06] Showing labelled: True (50/5000 visible)
[2021-03-15 02:15:06] Running: experiment 0
[2021-03-15 02:15:06] Showing labelled: True (50/5000 visible)
[2021-03-15 02:15:06] mlp: initialized 1482 parameters.
[2021-03-15 02:15:06] Creating trainer with model on device: cuda
[2021-03-15 02:15:06] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:15:06] Training loss: 1.3259
[2021-03-15 02:15:06] Testing on 5000 data points...
[2021-03-15 02:15:06] Test accuracy: 0.5944
[2021-03-15 02:15:06] Score for 50 labels: 0.5944
[2021-03-15 02:15:06] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:15:06] Found 4950 unlabelled features.
[2021-03-15 02:15:06] Searching core-set greedily...
[2021-03-15 02:15:08] Showing labelled: True (70/5000 visible)
[2021-03-15 02:15:08] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:15:08] Training loss: 0.6892
[2021-03-15 02:15:08] Testing on 5000 data points...
[2021-03-15 02:15:09] Test accuracy: 0.8920
[2021-03-15 02:15:09] Score for 70 labels: 0.8920
[2021-03-15 02:15:09] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:15:09] Found 4930 unlabelled features.
[2021-03-15 02:15:09] Searching core-set greedily...
[2021-03-15 02:15:10] Showing labelled: True (90/5000 visible)
[2021-03-15 02:15:10] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:15:11] Training loss: 0.3942
[2021-03-15 02:15:11] Testing on 5000 data points...
[2021-03-15 02:15:11] Test accuracy: 0.8998
[2021-03-15 02:15:11] Score for 90 labels: 0.8998
[2021-03-15 02:15:11] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:15:11] Found 4910 unlabelled features.
[2021-03-15 02:15:11] Searching core-set greedily...
[2021-03-15 02:15:13] Showing labelled: True (110/5000 visible)
[2021-03-15 02:15:13] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:15:14] Training loss: 0.2660
[2021-03-15 02:15:14] Testing on 5000 data points...
[2021-03-15 02:15:14] Test accuracy: 0.9780
[2021-03-15 02:15:14] Score for 110 labels: 0.9780
[2021-03-15 02:15:14] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:15:14] Found 4890 unlabelled features.
[2021-03-15 02:15:14] Searching core-set greedily...
[2021-03-15 02:15:16] Showing labelled: True (130/5000 visible)
[2021-03-15 02:15:16] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:15:17] Training loss: 0.1699
[2021-03-15 02:15:17] Testing on 5000 data points...
[2021-03-15 02:15:17] Test accuracy: 0.9796
[2021-03-15 02:15:17] Score for 130 labels: 0.9796
[2021-03-15 02:15:17] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:15:17] Found 4870 unlabelled features.
[2021-03-15 02:15:17] Searching core-set greedily...
[2021-03-15 02:15:20] Showing labelled: True (150/5000 visible)
[2021-03-15 02:15:20] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:15:21] Training loss: 0.1199
[2021-03-15 02:15:21] Testing on 5000 data points...
[2021-03-15 02:15:21] Test accuracy: 0.9978
[2021-03-15 02:15:21] Score for 150 labels: 0.9978
[2021-03-15 02:15:21] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:15:21] Found 4850 unlabelled features.
[2021-03-15 02:15:21] Searching core-set greedily...
[2021-03-15 02:15:24] Showing labelled: True (170/5000 visible)
[2021-03-15 02:15:24] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:15:25] Training loss: 0.0859
[2021-03-15 02:15:25] Testing on 5000 data points...
[2021-03-15 02:15:25] Test accuracy: 0.9978
[2021-03-15 02:15:25] Score for 170 labels: 0.9978
[2021-03-15 02:15:25] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:15:25] Found 4830 unlabelled features.
[2021-03-15 02:15:25] Searching core-set greedily...
[2021-03-15 02:15:28] Showing labelled: True (190/5000 visible)
[2021-03-15 02:15:28] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:15:29] Training loss: 0.0598
[2021-03-15 02:15:29] Testing on 5000 data points...
[2021-03-15 02:15:29] Test accuracy: 0.9990
[2021-03-15 02:15:29] Score for 190 labels: 0.9990
[2021-03-15 02:15:29] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:15:29] Found 4810 unlabelled features.
[2021-03-15 02:15:30] Searching core-set greedily...
[2021-03-15 02:15:33] Showing labelled: True (210/5000 visible)
[2021-03-15 02:15:33] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:15:34] Training loss: 0.0454
[2021-03-15 02:15:34] Testing on 5000 data points...
[2021-03-15 02:15:34] Test accuracy: 0.9986
[2021-03-15 02:15:34] Score for 210 labels: 0.9986
[2021-03-15 02:15:34] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:15:34] Found 4790 unlabelled features.
[2021-03-15 02:15:35] Searching core-set greedily...
[2021-03-15 02:15:38] Showing labelled: True (230/5000 visible)
[2021-03-15 02:15:38] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:15:40] Training loss: 0.0379
[2021-03-15 02:15:40] Testing on 5000 data points...
[2021-03-15 02:15:40] Test accuracy: 0.9986
[2021-03-15 02:15:40] Score for 230 labels: 0.9986
[2021-03-15 02:15:40] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:15:40] Found 4770 unlabelled features.
[2021-03-15 02:15:40] Searching core-set greedily...
[2021-03-15 02:15:44] Showing labelled: True (250/5000 visible)
[2021-03-15 02:15:44] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:15:45] Training loss: 0.0304
[2021-03-15 02:15:45] Testing on 5000 data points...
[2021-03-15 02:15:45] Test accuracy: 0.9986
[2021-03-15 02:15:45] Score for 250 labels: 0.9986
[2021-03-15 02:15:45] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:15:45] Found 4750 unlabelled features.
[2021-03-15 02:15:45] Searching core-set greedily...
[2021-03-15 02:15:49] Showing labelled: True (270/5000 visible)
[2021-03-15 02:15:49] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:15:51] Training loss: 0.0240
[2021-03-15 02:15:51] Testing on 5000 data points...
[2021-03-15 02:15:51] Test accuracy: 0.9986
[2021-03-15 02:15:51] Score for 270 labels: 0.9986
[2021-03-15 02:15:51] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:15:51] Found 4730 unlabelled features.
[2021-03-15 02:15:51] Searching core-set greedily...
[2021-03-15 02:15:55] Showing labelled: True (290/5000 visible)
[2021-03-15 02:15:55] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:15:56] Training loss: 0.0196
[2021-03-15 02:15:56] Testing on 5000 data points...
[2021-03-15 02:15:56] Test accuracy: 0.9984
[2021-03-15 02:15:56] Score for 290 labels: 0.9984
[2021-03-15 02:15:56] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:15:56] Found 4710 unlabelled features.
[2021-03-15 02:15:57] Searching core-set greedily...
[2021-03-15 02:16:01] Showing labelled: True (310/5000 visible)
[2021-03-15 02:16:01] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:16:03] Training loss: 0.0175
[2021-03-15 02:16:03] Testing on 5000 data points...
[2021-03-15 02:16:03] Test accuracy: 0.9986
[2021-03-15 02:16:03] Score for 310 labels: 0.9986
[2021-03-15 02:16:03] Running: experiment 1
[2021-03-15 02:16:03] Showing labelled: True (50/5000 visible)
[2021-03-15 02:16:03] mlp: initialized 1482 parameters.
[2021-03-15 02:16:03] Creating trainer with model on device: cuda
[2021-03-15 02:16:03] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:16:03] Training loss: 1.1503
[2021-03-15 02:16:03] Testing on 5000 data points...
[2021-03-15 02:16:03] Test accuracy: 0.6128
[2021-03-15 02:16:03] Score for 50 labels: 0.6128
[2021-03-15 02:16:03] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:16:03] Found 4950 unlabelled features.
[2021-03-15 02:16:03] Showing labelled: True (70/5000 visible)
[2021-03-15 02:16:03] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:16:04] Training loss: 0.4371
[2021-03-15 02:16:04] Testing on 5000 data points...
[2021-03-15 02:16:04] Test accuracy: 0.6986
[2021-03-15 02:16:04] Score for 70 labels: 0.6986
[2021-03-15 02:16:04] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:16:04] Found 4930 unlabelled features.
[2021-03-15 02:16:04] Showing labelled: True (90/5000 visible)
[2021-03-15 02:16:04] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:16:05] Training loss: 0.2190
[2021-03-15 02:16:05] Testing on 5000 data points...
[2021-03-15 02:16:05] Test accuracy: 0.7980
[2021-03-15 02:16:05] Score for 90 labels: 0.7980
[2021-03-15 02:16:05] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:16:05] Found 4910 unlabelled features.
[2021-03-15 02:16:05] Showing labelled: True (110/5000 visible)
[2021-03-15 02:16:05] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:16:06] Training loss: 0.1531
[2021-03-15 02:16:06] Testing on 5000 data points...
[2021-03-15 02:16:06] Test accuracy: 0.9444
[2021-03-15 02:16:06] Score for 110 labels: 0.9444
[2021-03-15 02:16:06] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:16:06] Found 4890 unlabelled features.
[2021-03-15 02:16:06] Showing labelled: True (130/5000 visible)
[2021-03-15 02:16:06] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:16:07] Training loss: 0.1018
[2021-03-15 02:16:07] Testing on 5000 data points...
[2021-03-15 02:16:07] Test accuracy: 0.9778
[2021-03-15 02:16:07] Score for 130 labels: 0.9778
[2021-03-15 02:16:07] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:16:07] Found 4870 unlabelled features.
[2021-03-15 02:16:07] Showing labelled: True (150/5000 visible)
[2021-03-15 02:16:07] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:16:08] Training loss: 0.0756
[2021-03-15 02:16:08] Testing on 5000 data points...
[2021-03-15 02:16:08] Test accuracy: 0.9924
[2021-03-15 02:16:08] Score for 150 labels: 0.9924
[2021-03-15 02:16:08] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:16:08] Found 4850 unlabelled features.
[2021-03-15 02:16:08] Showing labelled: True (170/5000 visible)
[2021-03-15 02:16:08] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:16:09] Training loss: 0.0501
[2021-03-15 02:16:09] Testing on 5000 data points...
[2021-03-15 02:16:09] Test accuracy: 0.9948
[2021-03-15 02:16:09] Score for 170 labels: 0.9948
[2021-03-15 02:16:09] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:16:09] Found 4830 unlabelled features.
[2021-03-15 02:16:09] Showing labelled: True (190/5000 visible)
[2021-03-15 02:16:09] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:16:10] Training loss: 0.0326
[2021-03-15 02:16:10] Testing on 5000 data points...
[2021-03-15 02:16:10] Test accuracy: 0.9952
[2021-03-15 02:16:10] Score for 190 labels: 0.9952
[2021-03-15 02:16:10] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:16:10] Found 4810 unlabelled features.
[2021-03-15 02:16:10] Showing labelled: True (210/5000 visible)
[2021-03-15 02:16:10] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:16:12] Training loss: 0.0230
[2021-03-15 02:16:12] Testing on 5000 data points...
[2021-03-15 02:16:12] Test accuracy: 0.9954
[2021-03-15 02:16:12] Score for 210 labels: 0.9954
[2021-03-15 02:16:12] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:16:12] Found 4790 unlabelled features.
[2021-03-15 02:16:12] Showing labelled: True (230/5000 visible)
[2021-03-15 02:16:12] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:16:13] Training loss: 0.0174
[2021-03-15 02:16:13] Testing on 5000 data points...
[2021-03-15 02:16:14] Test accuracy: 0.9954
[2021-03-15 02:16:14] Score for 230 labels: 0.9954
[2021-03-15 02:16:14] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:16:14] Found 4770 unlabelled features.
[2021-03-15 02:16:14] Showing labelled: True (250/5000 visible)
[2021-03-15 02:16:14] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:16:15] Training loss: 0.0144
[2021-03-15 02:16:15] Testing on 5000 data points...
[2021-03-15 02:16:15] Test accuracy: 0.9960
[2021-03-15 02:16:15] Score for 250 labels: 0.9960
[2021-03-15 02:16:15] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:16:15] Found 4750 unlabelled features.
[2021-03-15 02:16:15] Showing labelled: True (270/5000 visible)
[2021-03-15 02:16:15] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:16:17] Training loss: 0.0134
[2021-03-15 02:16:17] Testing on 5000 data points...
[2021-03-15 02:16:17] Test accuracy: 0.9958
[2021-03-15 02:16:17] Score for 270 labels: 0.9958
[2021-03-15 02:16:17] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:16:17] Found 4730 unlabelled features.
[2021-03-15 02:16:17] Showing labelled: True (290/5000 visible)
[2021-03-15 02:16:17] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:16:19] Training loss: 0.0114
[2021-03-15 02:16:19] Testing on 5000 data points...
[2021-03-15 02:16:19] Test accuracy: 0.9954
[2021-03-15 02:16:19] Score for 290 labels: 0.9954
[2021-03-15 02:16:19] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:16:19] Found 4710 unlabelled features.
[2021-03-15 02:16:19] Showing labelled: True (310/5000 visible)
[2021-03-15 02:16:19] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:16:21] Training loss: 0.0092
[2021-03-15 02:16:21] Testing on 5000 data points...
[2021-03-15 02:16:21] Test accuracy: 0.9960
[2021-03-15 02:16:21] Score for 310 labels: 0.9960
[2021-03-15 02:16:21] Running: experiment 2
[2021-03-15 02:16:21] Showing labelled: True (50/5000 visible)
[2021-03-15 02:16:21] mlp: initialized 1482 parameters.
[2021-03-15 02:16:21] Creating trainer with model on device: cuda
[2021-03-15 02:16:21] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:16:21] Training loss: 1.2253
[2021-03-15 02:16:21] Testing on 5000 data points...
[2021-03-15 02:16:21] Test accuracy: 0.4000
[2021-03-15 02:16:21] Score for 50 labels: 0.4000
[2021-03-15 02:16:21] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:16:21] Found 4950 unlabelled features.
[2021-03-15 02:16:21] Showing labelled: True (70/5000 visible)
[2021-03-15 02:16:21] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:16:22] Training loss: 0.5609
[2021-03-15 02:16:22] Testing on 5000 data points...
[2021-03-15 02:16:22] Test accuracy: 0.6940
[2021-03-15 02:16:22] Score for 70 labels: 0.6940
[2021-03-15 02:16:22] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:16:22] Found 4930 unlabelled features.
[2021-03-15 02:16:22] Showing labelled: True (90/5000 visible)
[2021-03-15 02:16:22] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:16:23] Training loss: 0.2026
[2021-03-15 02:16:23] Testing on 5000 data points...
[2021-03-15 02:16:23] Test accuracy: 0.7984
[2021-03-15 02:16:23] Score for 90 labels: 0.7984
[2021-03-15 02:16:23] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:16:23] Found 4910 unlabelled features.
[2021-03-15 02:16:23] Showing labelled: True (110/5000 visible)
[2021-03-15 02:16:23] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:16:24] Training loss: 0.1464
[2021-03-15 02:16:24] Testing on 5000 data points...
[2021-03-15 02:16:24] Test accuracy: 0.8994
[2021-03-15 02:16:24] Score for 110 labels: 0.8994
[2021-03-15 02:16:24] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:16:24] Found 4890 unlabelled features.
[2021-03-15 02:16:24] Showing labelled: True (130/5000 visible)
[2021-03-15 02:16:24] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:16:25] Training loss: 0.1087
[2021-03-15 02:16:25] Testing on 5000 data points...
[2021-03-15 02:16:25] Test accuracy: 0.8934
[2021-03-15 02:16:25] Score for 130 labels: 0.8934
[2021-03-15 02:16:25] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:16:25] Found 4870 unlabelled features.
[2021-03-15 02:16:25] Showing labelled: True (150/5000 visible)
[2021-03-15 02:16:25] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:16:26] Training loss: 0.1031
[2021-03-15 02:16:26] Testing on 5000 data points...
[2021-03-15 02:16:26] Test accuracy: 0.8998
[2021-03-15 02:16:26] Score for 150 labels: 0.8998
[2021-03-15 02:16:26] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:16:26] Found 4850 unlabelled features.
[2021-03-15 02:16:26] Showing labelled: True (170/5000 visible)
[2021-03-15 02:16:26] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:16:27] Training loss: 0.0965
[2021-03-15 02:16:27] Testing on 5000 data points...
[2021-03-15 02:16:27] Test accuracy: 0.9966
[2021-03-15 02:16:27] Score for 170 labels: 0.9966
[2021-03-15 02:16:27] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:16:27] Found 4830 unlabelled features.
[2021-03-15 02:16:27] Showing labelled: True (190/5000 visible)
[2021-03-15 02:16:27] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:16:29] Training loss: 0.1011
[2021-03-15 02:16:29] Testing on 5000 data points...
[2021-03-15 02:16:29] Test accuracy: 0.9986
[2021-03-15 02:16:29] Score for 190 labels: 0.9986
[2021-03-15 02:16:29] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:16:29] Found 4810 unlabelled features.
[2021-03-15 02:16:29] Showing labelled: True (210/5000 visible)
[2021-03-15 02:16:29] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:16:30] Training loss: 0.1071
[2021-03-15 02:16:30] Testing on 5000 data points...
[2021-03-15 02:16:30] Test accuracy: 0.9988
[2021-03-15 02:16:30] Score for 210 labels: 0.9988
[2021-03-15 02:16:30] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:16:30] Found 4790 unlabelled features.
[2021-03-15 02:16:30] Showing labelled: True (230/5000 visible)
[2021-03-15 02:16:30] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:16:32] Training loss: 0.0862
[2021-03-15 02:16:32] Testing on 5000 data points...
[2021-03-15 02:16:32] Test accuracy: 0.9952
[2021-03-15 02:16:32] Score for 230 labels: 0.9952
[2021-03-15 02:16:32] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:16:32] Found 4770 unlabelled features.
[2021-03-15 02:16:32] Showing labelled: True (250/5000 visible)
[2021-03-15 02:16:32] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:16:33] Training loss: 0.0715
[2021-03-15 02:16:33] Testing on 5000 data points...
[2021-03-15 02:16:33] Test accuracy: 0.9976
[2021-03-15 02:16:33] Score for 250 labels: 0.9976
[2021-03-15 02:16:33] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:16:33] Found 4750 unlabelled features.
[2021-03-15 02:16:33] Showing labelled: True (270/5000 visible)
[2021-03-15 02:16:33] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:16:35] Training loss: 0.0503
[2021-03-15 02:16:35] Testing on 5000 data points...
[2021-03-15 02:16:35] Test accuracy: 0.9984
[2021-03-15 02:16:35] Score for 270 labels: 0.9984
[2021-03-15 02:16:35] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:16:35] Found 4730 unlabelled features.
[2021-03-15 02:16:35] Showing labelled: True (290/5000 visible)
[2021-03-15 02:16:35] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:16:37] Training loss: 0.0377
[2021-03-15 02:16:37] Testing on 5000 data points...
[2021-03-15 02:16:37] Test accuracy: 0.9976
[2021-03-15 02:16:37] Score for 290 labels: 0.9976
[2021-03-15 02:16:37] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:16:37] Found 4710 unlabelled features.
[2021-03-15 02:16:37] Showing labelled: True (310/5000 visible)
[2021-03-15 02:16:37] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:16:39] Training loss: 0.0289
[2021-03-15 02:16:39] Testing on 5000 data points...
[2021-03-15 02:16:39] Test accuracy: 0.9978
[2021-03-15 02:16:39] Score for 310 labels: 0.9978
[2021-03-15 02:16:39] Running: experiment 3
[2021-03-15 02:16:39] Showing labelled: True (50/5000 visible)
[2021-03-15 02:16:39] mlp: initialized 1482 parameters.
[2021-03-15 02:16:39] Creating trainer with model on device: cuda
[2021-03-15 02:16:39] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:16:40] Training loss: 1.4301
[2021-03-15 02:16:40] Testing on 5000 data points...
[2021-03-15 02:16:40] Test accuracy: 0.4990
[2021-03-15 02:16:40] Score for 50 labels: 0.4990
[2021-03-15 02:16:40] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:16:40] Found 4950 unlabelled features.
[2021-03-15 02:16:40] Showing labelled: True (70/5000 visible)
[2021-03-15 02:16:40] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:16:40] Training loss: 0.5202
[2021-03-15 02:16:40] Testing on 5000 data points...
[2021-03-15 02:16:40] Test accuracy: 0.6920
[2021-03-15 02:16:40] Score for 70 labels: 0.6920
[2021-03-15 02:16:40] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:16:40] Found 4930 unlabelled features.
[2021-03-15 02:16:41] Showing labelled: True (90/5000 visible)
[2021-03-15 02:16:41] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:16:41] Training loss: 0.2445
[2021-03-15 02:16:41] Testing on 5000 data points...
[2021-03-15 02:16:41] Test accuracy: 0.8258
[2021-03-15 02:16:41] Score for 90 labels: 0.8258
[2021-03-15 02:16:41] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:16:41] Found 4910 unlabelled features.
[2021-03-15 02:16:41] Showing labelled: True (110/5000 visible)
[2021-03-15 02:16:41] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:16:42] Training loss: 0.2028
[2021-03-15 02:16:42] Testing on 5000 data points...
[2021-03-15 02:16:42] Test accuracy: 0.9014
[2021-03-15 02:16:42] Score for 110 labels: 0.9014
[2021-03-15 02:16:42] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:16:42] Found 4890 unlabelled features.
[2021-03-15 02:16:42] Showing labelled: True (130/5000 visible)
[2021-03-15 02:16:42] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:16:43] Training loss: 0.1769
[2021-03-15 02:16:43] Testing on 5000 data points...
[2021-03-15 02:16:43] Test accuracy: 0.9820
[2021-03-15 02:16:43] Score for 130 labels: 0.9820
[2021-03-15 02:16:43] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:16:43] Found 4870 unlabelled features.
[2021-03-15 02:16:43] Showing labelled: True (150/5000 visible)
[2021-03-15 02:16:43] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:16:44] Training loss: 0.1110
[2021-03-15 02:16:44] Testing on 5000 data points...
[2021-03-15 02:16:44] Test accuracy: 0.9824
[2021-03-15 02:16:44] Score for 150 labels: 0.9824
[2021-03-15 02:16:44] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:16:44] Found 4850 unlabelled features.
[2021-03-15 02:16:44] Showing labelled: True (170/5000 visible)
[2021-03-15 02:16:44] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:16:46] Training loss: 0.0906
[2021-03-15 02:16:46] Testing on 5000 data points...
[2021-03-15 02:16:46] Test accuracy: 0.9978
[2021-03-15 02:16:46] Score for 170 labels: 0.9978
[2021-03-15 02:16:46] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:16:46] Found 4830 unlabelled features.
[2021-03-15 02:16:46] Showing labelled: True (190/5000 visible)
[2021-03-15 02:16:46] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:16:47] Training loss: 0.0838
[2021-03-15 02:16:47] Testing on 5000 data points...
[2021-03-15 02:16:47] Test accuracy: 0.9950
[2021-03-15 02:16:47] Score for 190 labels: 0.9950
[2021-03-15 02:16:47] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:16:47] Found 4810 unlabelled features.
[2021-03-15 02:16:47] Showing labelled: True (210/5000 visible)
[2021-03-15 02:16:47] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:16:48] Training loss: 0.0669
[2021-03-15 02:16:49] Testing on 5000 data points...
[2021-03-15 02:16:49] Test accuracy: 0.9984
[2021-03-15 02:16:49] Score for 210 labels: 0.9984
[2021-03-15 02:16:49] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:16:49] Found 4790 unlabelled features.
[2021-03-15 02:16:49] Showing labelled: True (230/5000 visible)
[2021-03-15 02:16:49] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:16:50] Training loss: 0.0725
[2021-03-15 02:16:50] Testing on 5000 data points...
[2021-03-15 02:16:50] Test accuracy: 0.9972
[2021-03-15 02:16:50] Score for 230 labels: 0.9972
[2021-03-15 02:16:50] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:16:50] Found 4770 unlabelled features.
[2021-03-15 02:16:50] Showing labelled: True (250/5000 visible)
[2021-03-15 02:16:50] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:16:52] Training loss: 0.0616
[2021-03-15 02:16:52] Testing on 5000 data points...
[2021-03-15 02:16:52] Test accuracy: 0.9978
[2021-03-15 02:16:52] Score for 250 labels: 0.9978
[2021-03-15 02:16:52] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:16:52] Found 4750 unlabelled features.
[2021-03-15 02:16:52] Showing labelled: True (270/5000 visible)
[2021-03-15 02:16:52] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:16:54] Training loss: 0.0482
[2021-03-15 02:16:54] Testing on 5000 data points...
[2021-03-15 02:16:54] Test accuracy: 0.9972
[2021-03-15 02:16:54] Score for 270 labels: 0.9972
[2021-03-15 02:16:54] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:16:54] Found 4730 unlabelled features.
[2021-03-15 02:16:54] Showing labelled: True (290/5000 visible)
[2021-03-15 02:16:54] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:16:55] Training loss: 0.0358
[2021-03-15 02:16:55] Testing on 5000 data points...
[2021-03-15 02:16:56] Test accuracy: 0.9986
[2021-03-15 02:16:56] Score for 290 labels: 0.9986
[2021-03-15 02:16:56] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:16:56] Found 4710 unlabelled features.
[2021-03-15 02:16:56] Showing labelled: True (310/5000 visible)
[2021-03-15 02:16:56] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:16:58] Training loss: 0.0284
[2021-03-15 02:16:58] Testing on 5000 data points...
[2021-03-15 02:16:58] Test accuracy: 0.9980
[2021-03-15 02:16:58] Score for 310 labels: 0.9980
[2021-03-15 02:16:58] Running: experiment 4
[2021-03-15 02:16:58] Showing labelled: True (50/5000 visible)
[2021-03-15 02:16:58] mlp: initialized 1482 parameters.
[2021-03-15 02:16:58] Creating trainer with model on device: cuda
[2021-03-15 02:16:58] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:16:58] Training loss: 1.4877
[2021-03-15 02:16:58] Testing on 5000 data points...
[2021-03-15 02:16:58] Test accuracy: 0.5748
[2021-03-15 02:16:58] Score for 50 labels: 0.5748
[2021-03-15 02:16:58] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:16:58] Found 4950 unlabelled features.
[2021-03-15 02:16:58] Training GMM (k=32) on labelled features...
[2021-03-15 02:16:58] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:16:59] Scoring random batches...
[2021-03-15 02:16:59] Showing labelled: True (70/5000 visible)
[2021-03-15 02:16:59] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:16:59] Training loss: 0.6776
[2021-03-15 02:16:59] Testing on 5000 data points...
[2021-03-15 02:16:59] Test accuracy: 0.7126
[2021-03-15 02:16:59] Score for 70 labels: 0.7126
[2021-03-15 02:16:59] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:16:59] Found 4930 unlabelled features.
[2021-03-15 02:16:59] Training GMM (k=32) on labelled features...
[2021-03-15 02:16:59] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:00] Scoring random batches...
[2021-03-15 02:17:00] Showing labelled: True (90/5000 visible)
[2021-03-15 02:17:00] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:17:00] Training loss: 0.3205
[2021-03-15 02:17:00] Testing on 5000 data points...
[2021-03-15 02:17:00] Test accuracy: 0.7968
[2021-03-15 02:17:00] Score for 90 labels: 0.7968
[2021-03-15 02:17:00] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:17:00] Found 4910 unlabelled features.
[2021-03-15 02:17:00] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:00] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:01] Scoring random batches...
[2021-03-15 02:17:01] Showing labelled: True (110/5000 visible)
[2021-03-15 02:17:01] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:17:02] Training loss: 0.1893
[2021-03-15 02:17:02] Testing on 5000 data points...
[2021-03-15 02:17:02] Test accuracy: 0.7986
[2021-03-15 02:17:02] Score for 110 labels: 0.7986
[2021-03-15 02:17:02] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:17:02] Found 4890 unlabelled features.
[2021-03-15 02:17:02] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:02] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:02] Scoring random batches...
[2021-03-15 02:17:02] Showing labelled: True (130/5000 visible)
[2021-03-15 02:17:02] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:17:03] Training loss: 0.1451
[2021-03-15 02:17:03] Testing on 5000 data points...
[2021-03-15 02:17:03] Test accuracy: 0.9242
[2021-03-15 02:17:03] Score for 130 labels: 0.9242
[2021-03-15 02:17:03] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:17:03] Found 4870 unlabelled features.
[2021-03-15 02:17:03] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:03] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:04] Scoring random batches...
[2021-03-15 02:17:04] Showing labelled: True (150/5000 visible)
[2021-03-15 02:17:04] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:17:05] Training loss: 0.1010
[2021-03-15 02:17:05] Testing on 5000 data points...
[2021-03-15 02:17:05] Test accuracy: 0.9570
[2021-03-15 02:17:05] Score for 150 labels: 0.9570
[2021-03-15 02:17:05] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:17:05] Found 4850 unlabelled features.
[2021-03-15 02:17:05] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:05] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:05] Scoring random batches...
[2021-03-15 02:17:05] Showing labelled: True (170/5000 visible)
[2021-03-15 02:17:05] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:17:06] Training loss: 0.0799
[2021-03-15 02:17:06] Testing on 5000 data points...
[2021-03-15 02:17:06] Test accuracy: 0.9844
[2021-03-15 02:17:06] Score for 170 labels: 0.9844
[2021-03-15 02:17:06] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:17:06] Found 4830 unlabelled features.
[2021-03-15 02:17:06] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:07] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:07] Scoring random batches...
[2021-03-15 02:17:07] Showing labelled: True (190/5000 visible)
[2021-03-15 02:17:07] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:17:08] Training loss: 0.0547
[2021-03-15 02:17:08] Testing on 5000 data points...
[2021-03-15 02:17:08] Test accuracy: 0.9884
[2021-03-15 02:17:08] Score for 190 labels: 0.9884
[2021-03-15 02:17:08] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:17:08] Found 4810 unlabelled features.
[2021-03-15 02:17:08] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:08] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:09] Scoring random batches...
[2021-03-15 02:17:09] Showing labelled: True (210/5000 visible)
[2021-03-15 02:17:09] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:17:10] Training loss: 0.0369
[2021-03-15 02:17:10] Testing on 5000 data points...
[2021-03-15 02:17:10] Test accuracy: 0.9910
[2021-03-15 02:17:10] Score for 210 labels: 0.9910
[2021-03-15 02:17:10] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:17:10] Found 4790 unlabelled features.
[2021-03-15 02:17:10] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:10] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:11] Scoring random batches...
[2021-03-15 02:17:11] Showing labelled: True (230/5000 visible)
[2021-03-15 02:17:11] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:17:12] Training loss: 0.0281
[2021-03-15 02:17:12] Testing on 5000 data points...
[2021-03-15 02:17:12] Test accuracy: 0.9948
[2021-03-15 02:17:12] Score for 230 labels: 0.9948
[2021-03-15 02:17:12] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:17:12] Found 4770 unlabelled features.
[2021-03-15 02:17:12] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:13] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:13] Scoring random batches...
[2021-03-15 02:17:13] Showing labelled: True (250/5000 visible)
[2021-03-15 02:17:13] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:17:15] Training loss: 0.0223
[2021-03-15 02:17:15] Testing on 5000 data points...
[2021-03-15 02:17:15] Test accuracy: 0.9952
[2021-03-15 02:17:15] Score for 250 labels: 0.9952
[2021-03-15 02:17:15] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:17:15] Found 4750 unlabelled features.
[2021-03-15 02:17:15] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:15] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:15] Scoring random batches...
[2021-03-15 02:17:15] Showing labelled: True (270/5000 visible)
[2021-03-15 02:17:15] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:17:17] Training loss: 0.0168
[2021-03-15 02:17:17] Testing on 5000 data points...
[2021-03-15 02:17:17] Test accuracy: 0.9954
[2021-03-15 02:17:17] Score for 270 labels: 0.9954
[2021-03-15 02:17:17] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:17:17] Found 4730 unlabelled features.
[2021-03-15 02:17:17] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:17] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:18] Scoring random batches...
[2021-03-15 02:17:18] Showing labelled: True (290/5000 visible)
[2021-03-15 02:17:18] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:17:19] Training loss: 0.0133
[2021-03-15 02:17:19] Testing on 5000 data points...
[2021-03-15 02:17:19] Test accuracy: 0.9956
[2021-03-15 02:17:19] Score for 290 labels: 0.9956
[2021-03-15 02:17:19] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:17:19] Found 4710 unlabelled features.
[2021-03-15 02:17:19] Training GMM (k=32) on labelled features...
[2021-03-15 02:17:20] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:17:20] Scoring random batches...
[2021-03-15 02:17:20] Showing labelled: True (310/5000 visible)
[2021-03-15 02:17:20] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:17:22] Training loss: 0.0103
[2021-03-15 02:17:22] Testing on 5000 data points...
[2021-03-15 02:17:22] Test accuracy: 0.9956
[2021-03-15 02:17:22] Score for 310 labels: 0.9956
[2021-03-15 02:17:22] Experiment repeat 5/10
[2021-03-15 02:17:22] Randomly labelled 50/5000
[2021-03-15 02:17:22] Showing labelled: True (50/5000 visible)
[2021-03-15 02:17:22] Running: experiment 0
[2021-03-15 02:17:22] Showing labelled: True (50/5000 visible)
[2021-03-15 02:17:22] mlp: initialized 1482 parameters.
[2021-03-15 02:17:22] Creating trainer with model on device: cuda
[2021-03-15 02:17:22] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:17:23] Training loss: 1.2455
[2021-03-15 02:17:23] Testing on 5000 data points...
[2021-03-15 02:17:23] Test accuracy: 0.4864
[2021-03-15 02:17:23] Score for 50 labels: 0.4864
[2021-03-15 02:17:23] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:17:23] Found 4950 unlabelled features.
[2021-03-15 02:17:23] Searching core-set greedily...
[2021-03-15 02:17:24] Showing labelled: True (70/5000 visible)
[2021-03-15 02:17:24] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:17:25] Training loss: 0.6669
[2021-03-15 02:17:25] Testing on 5000 data points...
[2021-03-15 02:17:25] Test accuracy: 0.8420
[2021-03-15 02:17:25] Score for 70 labels: 0.8420
[2021-03-15 02:17:25] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:17:25] Found 4930 unlabelled features.
[2021-03-15 02:17:25] Searching core-set greedily...
[2021-03-15 02:17:27] Showing labelled: True (90/5000 visible)
[2021-03-15 02:17:27] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:17:28] Training loss: 0.3509
[2021-03-15 02:17:28] Testing on 5000 data points...
[2021-03-15 02:17:28] Test accuracy: 0.8986
[2021-03-15 02:17:28] Score for 90 labels: 0.8986
[2021-03-15 02:17:28] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:17:28] Found 4910 unlabelled features.
[2021-03-15 02:17:28] Searching core-set greedily...
[2021-03-15 02:17:30] Showing labelled: True (110/5000 visible)
[2021-03-15 02:17:30] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:17:31] Training loss: 0.2506
[2021-03-15 02:17:31] Testing on 5000 data points...
[2021-03-15 02:17:31] Test accuracy: 0.9896
[2021-03-15 02:17:31] Score for 110 labels: 0.9896
[2021-03-15 02:17:31] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:17:31] Found 4890 unlabelled features.
[2021-03-15 02:17:31] Searching core-set greedily...
[2021-03-15 02:17:34] Showing labelled: True (130/5000 visible)
[2021-03-15 02:17:34] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:17:35] Training loss: 0.1701
[2021-03-15 02:17:35] Testing on 5000 data points...
[2021-03-15 02:17:35] Test accuracy: 0.9946
[2021-03-15 02:17:35] Score for 130 labels: 0.9946
[2021-03-15 02:17:35] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:17:35] Found 4870 unlabelled features.
[2021-03-15 02:17:35] Searching core-set greedily...
[2021-03-15 02:17:38] Showing labelled: True (150/5000 visible)
[2021-03-15 02:17:38] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:17:39] Training loss: 0.1345
[2021-03-15 02:17:39] Testing on 5000 data points...
[2021-03-15 02:17:39] Test accuracy: 0.9984
[2021-03-15 02:17:39] Score for 150 labels: 0.9984
[2021-03-15 02:17:39] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:17:39] Found 4850 unlabelled features.
[2021-03-15 02:17:39] Searching core-set greedily...
[2021-03-15 02:17:43] Showing labelled: True (170/5000 visible)
[2021-03-15 02:17:43] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:17:44] Training loss: 0.0974
[2021-03-15 02:17:44] Testing on 5000 data points...
[2021-03-15 02:17:44] Test accuracy: 0.9970
[2021-03-15 02:17:44] Score for 170 labels: 0.9970
[2021-03-15 02:17:44] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:17:44] Found 4830 unlabelled features.
[2021-03-15 02:17:44] Searching core-set greedily...
[2021-03-15 02:17:47] Showing labelled: True (190/5000 visible)
[2021-03-15 02:17:47] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:17:49] Training loss: 0.0787
[2021-03-15 02:17:49] Testing on 5000 data points...
[2021-03-15 02:17:49] Test accuracy: 0.9982
[2021-03-15 02:17:49] Score for 190 labels: 0.9982
[2021-03-15 02:17:49] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:17:49] Found 4810 unlabelled features.
[2021-03-15 02:17:49] Searching core-set greedily...
[2021-03-15 02:17:52] Showing labelled: True (210/5000 visible)
[2021-03-15 02:17:52] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:17:53] Training loss: 0.0659
[2021-03-15 02:17:53] Testing on 5000 data points...
[2021-03-15 02:17:53] Test accuracy: 0.9986
[2021-03-15 02:17:53] Score for 210 labels: 0.9986
[2021-03-15 02:17:53] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:17:53] Found 4790 unlabelled features.
[2021-03-15 02:17:54] Searching core-set greedily...
[2021-03-15 02:17:57] Showing labelled: True (230/5000 visible)
[2021-03-15 02:17:57] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:17:58] Training loss: 0.0537
[2021-03-15 02:17:58] Testing on 5000 data points...
[2021-03-15 02:17:59] Test accuracy: 0.9986
[2021-03-15 02:17:59] Score for 230 labels: 0.9986
[2021-03-15 02:17:59] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:17:59] Found 4770 unlabelled features.
[2021-03-15 02:17:59] Searching core-set greedily...
[2021-03-15 02:18:02] Showing labelled: True (250/5000 visible)
[2021-03-15 02:18:02] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:18:04] Training loss: 0.0451
[2021-03-15 02:18:04] Testing on 5000 data points...
[2021-03-15 02:18:04] Test accuracy: 0.9982
[2021-03-15 02:18:04] Score for 250 labels: 0.9982
[2021-03-15 02:18:04] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:18:04] Found 4750 unlabelled features.
[2021-03-15 02:18:04] Searching core-set greedily...
[2021-03-15 02:18:07] Showing labelled: True (270/5000 visible)
[2021-03-15 02:18:07] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:18:09] Training loss: 0.0386
[2021-03-15 02:18:09] Testing on 5000 data points...
[2021-03-15 02:18:09] Test accuracy: 0.9984
[2021-03-15 02:18:09] Score for 270 labels: 0.9984
[2021-03-15 02:18:09] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:18:09] Found 4730 unlabelled features.
[2021-03-15 02:18:09] Searching core-set greedily...
[2021-03-15 02:18:13] Showing labelled: True (290/5000 visible)
[2021-03-15 02:18:13] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:18:15] Training loss: 0.0326
[2021-03-15 02:18:15] Testing on 5000 data points...
[2021-03-15 02:18:15] Test accuracy: 0.9984
[2021-03-15 02:18:15] Score for 290 labels: 0.9984
[2021-03-15 02:18:15] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:18:15] Found 4710 unlabelled features.
[2021-03-15 02:18:15] Searching core-set greedily...
[2021-03-15 02:18:19] Showing labelled: True (310/5000 visible)
[2021-03-15 02:18:19] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:18:21] Training loss: 0.0282
[2021-03-15 02:18:21] Testing on 5000 data points...
[2021-03-15 02:18:21] Test accuracy: 0.9970
[2021-03-15 02:18:21] Score for 310 labels: 0.9970
[2021-03-15 02:18:21] Running: experiment 1
[2021-03-15 02:18:21] Showing labelled: True (50/5000 visible)
[2021-03-15 02:18:21] mlp: initialized 1482 parameters.
[2021-03-15 02:18:21] Creating trainer with model on device: cuda
[2021-03-15 02:18:21] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:18:21] Training loss: 1.2615
[2021-03-15 02:18:21] Testing on 5000 data points...
[2021-03-15 02:18:21] Test accuracy: 0.4578
[2021-03-15 02:18:21] Score for 50 labels: 0.4578
[2021-03-15 02:18:21] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:18:21] Found 4950 unlabelled features.
[2021-03-15 02:18:22] Showing labelled: True (70/5000 visible)
[2021-03-15 02:18:22] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:18:22] Training loss: 0.5155
[2021-03-15 02:18:22] Testing on 5000 data points...
[2021-03-15 02:18:22] Test accuracy: 0.5998
[2021-03-15 02:18:22] Score for 70 labels: 0.5998
[2021-03-15 02:18:22] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:18:22] Found 4930 unlabelled features.
[2021-03-15 02:18:22] Showing labelled: True (90/5000 visible)
[2021-03-15 02:18:22] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:18:23] Training loss: 0.2475
[2021-03-15 02:18:23] Testing on 5000 data points...
[2021-03-15 02:18:23] Test accuracy: 0.6790
[2021-03-15 02:18:23] Score for 90 labels: 0.6790
[2021-03-15 02:18:23] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:18:23] Found 4910 unlabelled features.
[2021-03-15 02:18:23] Showing labelled: True (110/5000 visible)
[2021-03-15 02:18:23] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:18:24] Training loss: 0.1656
[2021-03-15 02:18:24] Testing on 5000 data points...
[2021-03-15 02:18:24] Test accuracy: 0.7070
[2021-03-15 02:18:24] Score for 110 labels: 0.7070
[2021-03-15 02:18:24] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:18:24] Found 4890 unlabelled features.
[2021-03-15 02:18:24] Showing labelled: True (130/5000 visible)
[2021-03-15 02:18:24] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:18:25] Training loss: 0.1269
[2021-03-15 02:18:25] Testing on 5000 data points...
[2021-03-15 02:18:25] Test accuracy: 0.8052
[2021-03-15 02:18:25] Score for 130 labels: 0.8052
[2021-03-15 02:18:25] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:18:25] Found 4870 unlabelled features.
[2021-03-15 02:18:25] Showing labelled: True (150/5000 visible)
[2021-03-15 02:18:25] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:18:26] Training loss: 0.0903
[2021-03-15 02:18:26] Testing on 5000 data points...
[2021-03-15 02:18:26] Test accuracy: 0.8764
[2021-03-15 02:18:26] Score for 150 labels: 0.8764
[2021-03-15 02:18:26] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:18:26] Found 4850 unlabelled features.
[2021-03-15 02:18:26] Showing labelled: True (170/5000 visible)
[2021-03-15 02:18:26] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:18:27] Training loss: 0.0591
[2021-03-15 02:18:27] Testing on 5000 data points...
[2021-03-15 02:18:27] Test accuracy: 0.8910
[2021-03-15 02:18:27] Score for 170 labels: 0.8910
[2021-03-15 02:18:27] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:18:27] Found 4830 unlabelled features.
[2021-03-15 02:18:27] Showing labelled: True (190/5000 visible)
[2021-03-15 02:18:27] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:18:29] Training loss: 0.0407
[2021-03-15 02:18:29] Testing on 5000 data points...
[2021-03-15 02:18:29] Test accuracy: 0.8928
[2021-03-15 02:18:29] Score for 190 labels: 0.8928
[2021-03-15 02:18:29] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:18:29] Found 4810 unlabelled features.
[2021-03-15 02:18:29] Showing labelled: True (210/5000 visible)
[2021-03-15 02:18:29] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:18:30] Training loss: 0.0301
[2021-03-15 02:18:30] Testing on 5000 data points...
[2021-03-15 02:18:30] Test accuracy: 0.8942
[2021-03-15 02:18:30] Score for 210 labels: 0.8942
[2021-03-15 02:18:30] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:18:30] Found 4790 unlabelled features.
[2021-03-15 02:18:30] Showing labelled: True (230/5000 visible)
[2021-03-15 02:18:30] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:18:32] Training loss: 0.0209
[2021-03-15 02:18:32] Testing on 5000 data points...
[2021-03-15 02:18:32] Test accuracy: 0.8948
[2021-03-15 02:18:32] Score for 230 labels: 0.8948
[2021-03-15 02:18:32] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:18:32] Found 4770 unlabelled features.
[2021-03-15 02:18:32] Showing labelled: True (250/5000 visible)
[2021-03-15 02:18:32] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:18:33] Training loss: 0.0160
[2021-03-15 02:18:33] Testing on 5000 data points...
[2021-03-15 02:18:33] Test accuracy: 0.8956
[2021-03-15 02:18:33] Score for 250 labels: 0.8956
[2021-03-15 02:18:33] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:18:33] Found 4750 unlabelled features.
[2021-03-15 02:18:33] Showing labelled: True (270/5000 visible)
[2021-03-15 02:18:33] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:18:35] Training loss: 0.0118
[2021-03-15 02:18:35] Testing on 5000 data points...
[2021-03-15 02:18:35] Test accuracy: 0.8956
[2021-03-15 02:18:35] Score for 270 labels: 0.8956
[2021-03-15 02:18:35] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:18:35] Found 4730 unlabelled features.
[2021-03-15 02:18:35] Showing labelled: True (290/5000 visible)
[2021-03-15 02:18:35] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:18:37] Training loss: 0.0107
[2021-03-15 02:18:37] Testing on 5000 data points...
[2021-03-15 02:18:37] Test accuracy: 0.8950
[2021-03-15 02:18:37] Score for 290 labels: 0.8950
[2021-03-15 02:18:37] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:18:37] Found 4710 unlabelled features.
[2021-03-15 02:18:37] Showing labelled: True (310/5000 visible)
[2021-03-15 02:18:37] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:18:39] Training loss: 0.0102
[2021-03-15 02:18:39] Testing on 5000 data points...
[2021-03-15 02:18:39] Test accuracy: 0.8958
[2021-03-15 02:18:39] Score for 310 labels: 0.8958
[2021-03-15 02:18:39] Running: experiment 2
[2021-03-15 02:18:39] Showing labelled: True (50/5000 visible)
[2021-03-15 02:18:39] mlp: initialized 1482 parameters.
[2021-03-15 02:18:39] Creating trainer with model on device: cuda
[2021-03-15 02:18:39] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:18:40] Training loss: 1.2341
[2021-03-15 02:18:40] Testing on 5000 data points...
[2021-03-15 02:18:40] Test accuracy: 0.4828
[2021-03-15 02:18:40] Score for 50 labels: 0.4828
[2021-03-15 02:18:40] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:18:40] Found 4950 unlabelled features.
[2021-03-15 02:18:40] Showing labelled: True (70/5000 visible)
[2021-03-15 02:18:40] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:18:40] Training loss: 0.5874
[2021-03-15 02:18:40] Testing on 5000 data points...
[2021-03-15 02:18:40] Test accuracy: 0.6330
[2021-03-15 02:18:40] Score for 70 labels: 0.6330
[2021-03-15 02:18:40] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:18:40] Found 4930 unlabelled features.
[2021-03-15 02:18:40] Showing labelled: True (90/5000 visible)
[2021-03-15 02:18:40] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:18:41] Training loss: 0.2396
[2021-03-15 02:18:41] Testing on 5000 data points...
[2021-03-15 02:18:41] Test accuracy: 0.6994
[2021-03-15 02:18:41] Score for 90 labels: 0.6994
[2021-03-15 02:18:41] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:18:41] Found 4910 unlabelled features.
[2021-03-15 02:18:41] Showing labelled: True (110/5000 visible)
[2021-03-15 02:18:41] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:18:42] Training loss: 0.1456
[2021-03-15 02:18:42] Testing on 5000 data points...
[2021-03-15 02:18:42] Test accuracy: 0.6936
[2021-03-15 02:18:42] Score for 110 labels: 0.6936
[2021-03-15 02:18:42] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:18:42] Found 4890 unlabelled features.
[2021-03-15 02:18:42] Showing labelled: True (130/5000 visible)
[2021-03-15 02:18:42] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:18:43] Training loss: 0.1174
[2021-03-15 02:18:43] Testing on 5000 data points...
[2021-03-15 02:18:43] Test accuracy: 0.7064
[2021-03-15 02:18:43] Score for 130 labels: 0.7064
[2021-03-15 02:18:43] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:18:43] Found 4870 unlabelled features.
[2021-03-15 02:18:43] Showing labelled: True (150/5000 visible)
[2021-03-15 02:18:43] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:18:44] Training loss: 0.1028
[2021-03-15 02:18:44] Testing on 5000 data points...
[2021-03-15 02:18:44] Test accuracy: 0.7888
[2021-03-15 02:18:44] Score for 150 labels: 0.7888
[2021-03-15 02:18:44] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:18:44] Found 4850 unlabelled features.
[2021-03-15 02:18:44] Showing labelled: True (170/5000 visible)
[2021-03-15 02:18:44] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:18:46] Training loss: 0.0909
[2021-03-15 02:18:46] Testing on 5000 data points...
[2021-03-15 02:18:46] Test accuracy: 0.7978
[2021-03-15 02:18:46] Score for 170 labels: 0.7978
[2021-03-15 02:18:46] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:18:46] Found 4830 unlabelled features.
[2021-03-15 02:18:46] Showing labelled: True (190/5000 visible)
[2021-03-15 02:18:46] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:18:47] Training loss: 0.0942
[2021-03-15 02:18:47] Testing on 5000 data points...
[2021-03-15 02:18:47] Test accuracy: 0.7968
[2021-03-15 02:18:47] Score for 190 labels: 0.7968
[2021-03-15 02:18:47] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:18:47] Found 4810 unlabelled features.
[2021-03-15 02:18:47] Showing labelled: True (210/5000 visible)
[2021-03-15 02:18:47] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:18:48] Training loss: 0.0955
[2021-03-15 02:18:48] Testing on 5000 data points...
[2021-03-15 02:18:49] Test accuracy: 0.7982
[2021-03-15 02:18:49] Score for 210 labels: 0.7982
[2021-03-15 02:18:49] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:18:49] Found 4790 unlabelled features.
[2021-03-15 02:18:49] Showing labelled: True (230/5000 visible)
[2021-03-15 02:18:49] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:18:50] Training loss: 0.0759
[2021-03-15 02:18:50] Testing on 5000 data points...
[2021-03-15 02:18:50] Test accuracy: 0.7976
[2021-03-15 02:18:50] Score for 230 labels: 0.7976
[2021-03-15 02:18:50] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:18:50] Found 4770 unlabelled features.
[2021-03-15 02:18:50] Showing labelled: True (250/5000 visible)
[2021-03-15 02:18:50] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:18:52] Training loss: 0.0591
[2021-03-15 02:18:52] Testing on 5000 data points...
[2021-03-15 02:18:52] Test accuracy: 0.7980
[2021-03-15 02:18:52] Score for 250 labels: 0.7980
[2021-03-15 02:18:52] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:18:52] Found 4750 unlabelled features.
[2021-03-15 02:18:52] Showing labelled: True (270/5000 visible)
[2021-03-15 02:18:52] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:18:53] Training loss: 0.0446
[2021-03-15 02:18:53] Testing on 5000 data points...
[2021-03-15 02:18:53] Test accuracy: 0.7974
[2021-03-15 02:18:53] Score for 270 labels: 0.7974
[2021-03-15 02:18:53] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:18:53] Found 4730 unlabelled features.
[2021-03-15 02:18:54] Showing labelled: True (290/5000 visible)
[2021-03-15 02:18:54] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:18:55] Training loss: 0.0345
[2021-03-15 02:18:55] Testing on 5000 data points...
[2021-03-15 02:18:55] Test accuracy: 0.7974
[2021-03-15 02:18:55] Score for 290 labels: 0.7974
[2021-03-15 02:18:55] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:18:55] Found 4710 unlabelled features.
[2021-03-15 02:18:55] Showing labelled: True (310/5000 visible)
[2021-03-15 02:18:55] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:18:57] Training loss: 0.0270
[2021-03-15 02:18:57] Testing on 5000 data points...
[2021-03-15 02:18:57] Test accuracy: 0.7972
[2021-03-15 02:18:57] Score for 310 labels: 0.7972
[2021-03-15 02:18:57] Running: experiment 3
[2021-03-15 02:18:57] Showing labelled: True (50/5000 visible)
[2021-03-15 02:18:57] mlp: initialized 1482 parameters.
[2021-03-15 02:18:57] Creating trainer with model on device: cuda
[2021-03-15 02:18:57] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:18:58] Training loss: 1.3887
[2021-03-15 02:18:58] Testing on 5000 data points...
[2021-03-15 02:18:58] Test accuracy: 0.4398
[2021-03-15 02:18:58] Score for 50 labels: 0.4398
[2021-03-15 02:18:58] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:18:58] Found 4950 unlabelled features.
[2021-03-15 02:18:58] Showing labelled: True (70/5000 visible)
[2021-03-15 02:18:58] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:18:59] Training loss: 0.5213
[2021-03-15 02:18:59] Testing on 5000 data points...
[2021-03-15 02:18:59] Test accuracy: 0.7514
[2021-03-15 02:18:59] Score for 70 labels: 0.7514
[2021-03-15 02:18:59] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:18:59] Found 4930 unlabelled features.
[2021-03-15 02:18:59] Showing labelled: True (90/5000 visible)
[2021-03-15 02:18:59] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:18:59] Training loss: 0.2701
[2021-03-15 02:18:59] Testing on 5000 data points...
[2021-03-15 02:18:59] Test accuracy: 0.7944
[2021-03-15 02:18:59] Score for 90 labels: 0.7944
[2021-03-15 02:18:59] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:18:59] Found 4910 unlabelled features.
[2021-03-15 02:19:00] Showing labelled: True (110/5000 visible)
[2021-03-15 02:19:00] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:19:00] Training loss: 0.1304
[2021-03-15 02:19:00] Testing on 5000 data points...
[2021-03-15 02:19:00] Test accuracy: 0.7970
[2021-03-15 02:19:00] Score for 110 labels: 0.7970
[2021-03-15 02:19:00] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:19:00] Found 4890 unlabelled features.
[2021-03-15 02:19:01] Showing labelled: True (130/5000 visible)
[2021-03-15 02:19:01] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:19:01] Training loss: 0.1039
[2021-03-15 02:19:01] Testing on 5000 data points...
[2021-03-15 02:19:01] Test accuracy: 0.7984
[2021-03-15 02:19:01] Score for 130 labels: 0.7984
[2021-03-15 02:19:01] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:19:01] Found 4870 unlabelled features.
[2021-03-15 02:19:02] Showing labelled: True (150/5000 visible)
[2021-03-15 02:19:02] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:19:03] Training loss: 0.1071
[2021-03-15 02:19:03] Testing on 5000 data points...
[2021-03-15 02:19:03] Test accuracy: 0.8900
[2021-03-15 02:19:03] Score for 150 labels: 0.8900
[2021-03-15 02:19:03] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:19:03] Found 4850 unlabelled features.
[2021-03-15 02:19:03] Showing labelled: True (170/5000 visible)
[2021-03-15 02:19:03] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:19:04] Training loss: 0.0715
[2021-03-15 02:19:04] Testing on 5000 data points...
[2021-03-15 02:19:04] Test accuracy: 0.8960
[2021-03-15 02:19:04] Score for 170 labels: 0.8960
[2021-03-15 02:19:04] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:19:04] Found 4830 unlabelled features.
[2021-03-15 02:19:04] Showing labelled: True (190/5000 visible)
[2021-03-15 02:19:04] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:19:05] Training loss: 0.0669
[2021-03-15 02:19:05] Testing on 5000 data points...
[2021-03-15 02:19:05] Test accuracy: 0.8936
[2021-03-15 02:19:05] Score for 190 labels: 0.8936
[2021-03-15 02:19:05] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:19:05] Found 4810 unlabelled features.
[2021-03-15 02:19:05] Showing labelled: True (210/5000 visible)
[2021-03-15 02:19:05] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:19:07] Training loss: 0.0739
[2021-03-15 02:19:07] Testing on 5000 data points...
[2021-03-15 02:19:07] Test accuracy: 0.8978
[2021-03-15 02:19:07] Score for 210 labels: 0.8978
[2021-03-15 02:19:07] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:19:07] Found 4790 unlabelled features.
[2021-03-15 02:19:07] Showing labelled: True (230/5000 visible)
[2021-03-15 02:19:07] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:19:08] Training loss: 0.0857
[2021-03-15 02:19:08] Testing on 5000 data points...
[2021-03-15 02:19:08] Test accuracy: 0.8986
[2021-03-15 02:19:08] Score for 230 labels: 0.8986
[2021-03-15 02:19:08] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:19:08] Found 4770 unlabelled features.
[2021-03-15 02:19:08] Showing labelled: True (250/5000 visible)
[2021-03-15 02:19:08] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:19:10] Training loss: 0.0697
[2021-03-15 02:19:10] Testing on 5000 data points...
[2021-03-15 02:19:10] Test accuracy: 0.8984
[2021-03-15 02:19:10] Score for 250 labels: 0.8984
[2021-03-15 02:19:10] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:19:10] Found 4750 unlabelled features.
[2021-03-15 02:19:10] Showing labelled: True (270/5000 visible)
[2021-03-15 02:19:10] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:19:12] Training loss: 0.0541
[2021-03-15 02:19:12] Testing on 5000 data points...
[2021-03-15 02:19:12] Test accuracy: 0.8972
[2021-03-15 02:19:12] Score for 270 labels: 0.8972
[2021-03-15 02:19:12] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:19:12] Found 4730 unlabelled features.
[2021-03-15 02:19:12] Showing labelled: True (290/5000 visible)
[2021-03-15 02:19:12] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:19:14] Training loss: 0.0406
[2021-03-15 02:19:14] Testing on 5000 data points...
[2021-03-15 02:19:14] Test accuracy: 0.8984
[2021-03-15 02:19:14] Score for 290 labels: 0.8984
[2021-03-15 02:19:14] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:19:14] Found 4710 unlabelled features.
[2021-03-15 02:19:14] Showing labelled: True (310/5000 visible)
[2021-03-15 02:19:14] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:19:16] Training loss: 0.0319
[2021-03-15 02:19:16] Testing on 5000 data points...
[2021-03-15 02:19:16] Test accuracy: 0.8988
[2021-03-15 02:19:16] Score for 310 labels: 0.8988
[2021-03-15 02:19:16] Running: experiment 4
[2021-03-15 02:19:16] Showing labelled: True (50/5000 visible)
[2021-03-15 02:19:16] mlp: initialized 1482 parameters.
[2021-03-15 02:19:16] Creating trainer with model on device: cuda
[2021-03-15 02:19:16] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:19:16] Training loss: 1.4448
[2021-03-15 02:19:16] Testing on 5000 data points...
[2021-03-15 02:19:16] Test accuracy: 0.4672
[2021-03-15 02:19:16] Score for 50 labels: 0.4672
[2021-03-15 02:19:16] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:19:16] Found 4950 unlabelled features.
[2021-03-15 02:19:16] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:16] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:17] Scoring random batches...
[2021-03-15 02:19:17] Showing labelled: True (70/5000 visible)
[2021-03-15 02:19:17] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:19:17] Training loss: 0.6430
[2021-03-15 02:19:17] Testing on 5000 data points...
[2021-03-15 02:19:17] Test accuracy: 0.5740
[2021-03-15 02:19:17] Score for 70 labels: 0.5740
[2021-03-15 02:19:17] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:19:17] Found 4930 unlabelled features.
[2021-03-15 02:19:17] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:17] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:18] Scoring random batches...
[2021-03-15 02:19:18] Showing labelled: True (90/5000 visible)
[2021-03-15 02:19:18] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:19:19] Training loss: 0.4101
[2021-03-15 02:19:19] Testing on 5000 data points...
[2021-03-15 02:19:19] Test accuracy: 0.7880
[2021-03-15 02:19:19] Score for 90 labels: 0.7880
[2021-03-15 02:19:19] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:19:19] Found 4910 unlabelled features.
[2021-03-15 02:19:19] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:19] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:19] Scoring random batches...
[2021-03-15 02:19:19] Showing labelled: True (110/5000 visible)
[2021-03-15 02:19:19] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:19:20] Training loss: 0.2501
[2021-03-15 02:19:20] Testing on 5000 data points...
[2021-03-15 02:19:20] Test accuracy: 0.7958
[2021-03-15 02:19:20] Score for 110 labels: 0.7958
[2021-03-15 02:19:20] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:19:20] Found 4890 unlabelled features.
[2021-03-15 02:19:20] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:20] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:20] Scoring random batches...
[2021-03-15 02:19:20] Showing labelled: True (130/5000 visible)
[2021-03-15 02:19:20] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:19:21] Training loss: 0.1612
[2021-03-15 02:19:21] Testing on 5000 data points...
[2021-03-15 02:19:21] Test accuracy: 0.7990
[2021-03-15 02:19:21] Score for 130 labels: 0.7990
[2021-03-15 02:19:21] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:19:21] Found 4870 unlabelled features.
[2021-03-15 02:19:21] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:22] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:22] Scoring random batches...
[2021-03-15 02:19:22] Showing labelled: True (150/5000 visible)
[2021-03-15 02:19:22] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:19:23] Training loss: 0.1351
[2021-03-15 02:19:23] Testing on 5000 data points...
[2021-03-15 02:19:23] Test accuracy: 0.8026
[2021-03-15 02:19:23] Score for 150 labels: 0.8026
[2021-03-15 02:19:23] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:19:23] Found 4850 unlabelled features.
[2021-03-15 02:19:23] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:23] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:23] Scoring random batches...
[2021-03-15 02:19:23] Showing labelled: True (170/5000 visible)
[2021-03-15 02:19:23] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:19:25] Training loss: 0.1072
[2021-03-15 02:19:25] Testing on 5000 data points...
[2021-03-15 02:19:25] Test accuracy: 0.8130
[2021-03-15 02:19:25] Score for 170 labels: 0.8130
[2021-03-15 02:19:25] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:19:25] Found 4830 unlabelled features.
[2021-03-15 02:19:25] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:25] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:25] Scoring random batches...
[2021-03-15 02:19:25] Showing labelled: True (190/5000 visible)
[2021-03-15 02:19:25] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:19:26] Training loss: 0.1115
[2021-03-15 02:19:26] Testing on 5000 data points...
[2021-03-15 02:19:27] Test accuracy: 0.9354
[2021-03-15 02:19:27] Score for 190 labels: 0.9354
[2021-03-15 02:19:27] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:19:27] Found 4810 unlabelled features.
[2021-03-15 02:19:27] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:27] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:27] Scoring random batches...
[2021-03-15 02:19:27] Showing labelled: True (210/5000 visible)
[2021-03-15 02:19:27] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:19:29] Training loss: 0.0728
[2021-03-15 02:19:29] Testing on 5000 data points...
[2021-03-15 02:19:29] Test accuracy: 0.9808
[2021-03-15 02:19:29] Score for 210 labels: 0.9808
[2021-03-15 02:19:29] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:19:29] Found 4790 unlabelled features.
[2021-03-15 02:19:29] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:29] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:29] Scoring random batches...
[2021-03-15 02:19:29] Showing labelled: True (230/5000 visible)
[2021-03-15 02:19:29] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:19:31] Training loss: 0.0589
[2021-03-15 02:19:31] Testing on 5000 data points...
[2021-03-15 02:19:31] Test accuracy: 0.9848
[2021-03-15 02:19:31] Score for 230 labels: 0.9848
[2021-03-15 02:19:31] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:19:31] Found 4770 unlabelled features.
[2021-03-15 02:19:31] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:31] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:31] Scoring random batches...
[2021-03-15 02:19:31] Showing labelled: True (250/5000 visible)
[2021-03-15 02:19:31] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:19:33] Training loss: 0.0436
[2021-03-15 02:19:33] Testing on 5000 data points...
[2021-03-15 02:19:33] Test accuracy: 0.9916
[2021-03-15 02:19:33] Score for 250 labels: 0.9916
[2021-03-15 02:19:33] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:19:33] Found 4750 unlabelled features.
[2021-03-15 02:19:33] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:33] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:33] Scoring random batches...
[2021-03-15 02:19:33] Showing labelled: True (270/5000 visible)
[2021-03-15 02:19:33] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:19:35] Training loss: 0.0306
[2021-03-15 02:19:35] Testing on 5000 data points...
[2021-03-15 02:19:35] Test accuracy: 0.9950
[2021-03-15 02:19:35] Score for 270 labels: 0.9950
[2021-03-15 02:19:35] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:19:35] Found 4730 unlabelled features.
[2021-03-15 02:19:35] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:35] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:36] Scoring random batches...
[2021-03-15 02:19:36] Showing labelled: True (290/5000 visible)
[2021-03-15 02:19:36] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:19:37] Training loss: 0.0221
[2021-03-15 02:19:37] Testing on 5000 data points...
[2021-03-15 02:19:38] Test accuracy: 0.9960
[2021-03-15 02:19:38] Score for 290 labels: 0.9960
[2021-03-15 02:19:38] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:19:38] Found 4710 unlabelled features.
[2021-03-15 02:19:38] Training GMM (k=32) on labelled features...
[2021-03-15 02:19:38] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:19:38] Scoring random batches...
[2021-03-15 02:19:38] Showing labelled: True (310/5000 visible)
[2021-03-15 02:19:38] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:19:40] Training loss: 0.0167
[2021-03-15 02:19:40] Testing on 5000 data points...
[2021-03-15 02:19:40] Test accuracy: 0.9960
[2021-03-15 02:19:40] Score for 310 labels: 0.9960
[2021-03-15 02:19:40] Experiment repeat 6/10
[2021-03-15 02:19:40] Randomly labelled 50/5000
[2021-03-15 02:19:40] Showing labelled: True (50/5000 visible)
[2021-03-15 02:19:40] Running: experiment 0
[2021-03-15 02:19:40] Showing labelled: True (50/5000 visible)
[2021-03-15 02:19:40] mlp: initialized 1482 parameters.
[2021-03-15 02:19:40] Creating trainer with model on device: cuda
[2021-03-15 02:19:40] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:19:41] Training loss: 1.3612
[2021-03-15 02:19:41] Testing on 5000 data points...
[2021-03-15 02:19:41] Test accuracy: 0.4078
[2021-03-15 02:19:41] Score for 50 labels: 0.4078
[2021-03-15 02:19:41] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:19:41] Found 4950 unlabelled features.
[2021-03-15 02:19:41] Searching core-set greedily...
[2021-03-15 02:19:42] Showing labelled: True (70/5000 visible)
[2021-03-15 02:19:42] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:19:43] Training loss: 0.6612
[2021-03-15 02:19:43] Testing on 5000 data points...
[2021-03-15 02:19:43] Test accuracy: 0.7506
[2021-03-15 02:19:43] Score for 70 labels: 0.7506
[2021-03-15 02:19:43] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:19:43] Found 4930 unlabelled features.
[2021-03-15 02:19:43] Searching core-set greedily...
[2021-03-15 02:19:45] Showing labelled: True (90/5000 visible)
[2021-03-15 02:19:45] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:19:46] Training loss: 0.3763
[2021-03-15 02:19:46] Testing on 5000 data points...
[2021-03-15 02:19:46] Test accuracy: 0.8994
[2021-03-15 02:19:46] Score for 90 labels: 0.8994
[2021-03-15 02:19:46] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:19:46] Found 4910 unlabelled features.
[2021-03-15 02:19:46] Searching core-set greedily...
[2021-03-15 02:19:48] Showing labelled: True (110/5000 visible)
[2021-03-15 02:19:48] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:19:49] Training loss: 0.2212
[2021-03-15 02:19:49] Testing on 5000 data points...
[2021-03-15 02:19:49] Test accuracy: 0.9950
[2021-03-15 02:19:49] Score for 110 labels: 0.9950
[2021-03-15 02:19:49] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:19:49] Found 4890 unlabelled features.
[2021-03-15 02:19:49] Searching core-set greedily...
[2021-03-15 02:19:52] Showing labelled: True (130/5000 visible)
[2021-03-15 02:19:52] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:19:53] Training loss: 0.1495
[2021-03-15 02:19:53] Testing on 5000 data points...
[2021-03-15 02:19:53] Test accuracy: 0.9912
[2021-03-15 02:19:53] Score for 130 labels: 0.9912
[2021-03-15 02:19:53] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:19:53] Found 4870 unlabelled features.
[2021-03-15 02:19:53] Searching core-set greedily...
[2021-03-15 02:19:55] Showing labelled: True (150/5000 visible)
[2021-03-15 02:19:55] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:19:56] Training loss: 0.1123
[2021-03-15 02:19:56] Testing on 5000 data points...
[2021-03-15 02:19:56] Test accuracy: 0.9964
[2021-03-15 02:19:56] Score for 150 labels: 0.9964
[2021-03-15 02:19:56] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:19:56] Found 4850 unlabelled features.
[2021-03-15 02:19:56] Searching core-set greedily...
[2021-03-15 02:20:00] Showing labelled: True (170/5000 visible)
[2021-03-15 02:20:00] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:20:01] Training loss: 0.0855
[2021-03-15 02:20:01] Testing on 5000 data points...
[2021-03-15 02:20:01] Test accuracy: 0.9980
[2021-03-15 02:20:01] Score for 170 labels: 0.9980
[2021-03-15 02:20:01] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:20:01] Found 4830 unlabelled features.
[2021-03-15 02:20:01] Searching core-set greedily...
[2021-03-15 02:20:05] Showing labelled: True (190/5000 visible)
[2021-03-15 02:20:05] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:20:06] Training loss: 0.0632
[2021-03-15 02:20:06] Testing on 5000 data points...
[2021-03-15 02:20:06] Test accuracy: 0.9982
[2021-03-15 02:20:06] Score for 190 labels: 0.9982
[2021-03-15 02:20:06] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:20:06] Found 4810 unlabelled features.
[2021-03-15 02:20:06] Searching core-set greedily...
[2021-03-15 02:20:09] Showing labelled: True (210/5000 visible)
[2021-03-15 02:20:09] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:20:11] Training loss: 0.0511
[2021-03-15 02:20:11] Testing on 5000 data points...
[2021-03-15 02:20:11] Test accuracy: 0.9988
[2021-03-15 02:20:11] Score for 210 labels: 0.9988
[2021-03-15 02:20:11] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:20:11] Found 4790 unlabelled features.
[2021-03-15 02:20:11] Searching core-set greedily...
[2021-03-15 02:20:15] Showing labelled: True (230/5000 visible)
[2021-03-15 02:20:15] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:20:16] Training loss: 0.0412
[2021-03-15 02:20:16] Testing on 5000 data points...
[2021-03-15 02:20:16] Test accuracy: 0.9986
[2021-03-15 02:20:16] Score for 230 labels: 0.9986
[2021-03-15 02:20:16] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:20:16] Found 4770 unlabelled features.
[2021-03-15 02:20:16] Searching core-set greedily...
[2021-03-15 02:20:20] Showing labelled: True (250/5000 visible)
[2021-03-15 02:20:20] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:20:21] Training loss: 0.0337
[2021-03-15 02:20:21] Testing on 5000 data points...
[2021-03-15 02:20:22] Test accuracy: 0.9986
[2021-03-15 02:20:22] Score for 250 labels: 0.9986
[2021-03-15 02:20:22] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:20:22] Found 4750 unlabelled features.
[2021-03-15 02:20:22] Searching core-set greedily...
[2021-03-15 02:20:26] Showing labelled: True (270/5000 visible)
[2021-03-15 02:20:26] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:20:27] Training loss: 0.0303
[2021-03-15 02:20:27] Testing on 5000 data points...
[2021-03-15 02:20:27] Test accuracy: 0.9984
[2021-03-15 02:20:27] Score for 270 labels: 0.9984
[2021-03-15 02:20:27] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:20:27] Found 4730 unlabelled features.
[2021-03-15 02:20:27] Searching core-set greedily...
[2021-03-15 02:20:31] Showing labelled: True (290/5000 visible)
[2021-03-15 02:20:31] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:20:33] Training loss: 0.0251
[2021-03-15 02:20:33] Testing on 5000 data points...
[2021-03-15 02:20:33] Test accuracy: 0.9984
[2021-03-15 02:20:33] Score for 290 labels: 0.9984
[2021-03-15 02:20:33] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:20:33] Found 4710 unlabelled features.
[2021-03-15 02:20:33] Searching core-set greedily...
[2021-03-15 02:20:37] Showing labelled: True (310/5000 visible)
[2021-03-15 02:20:37] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:20:39] Training loss: 0.0223
[2021-03-15 02:20:39] Testing on 5000 data points...
[2021-03-15 02:20:39] Test accuracy: 0.9970
[2021-03-15 02:20:39] Score for 310 labels: 0.9970
[2021-03-15 02:20:39] Running: experiment 1
[2021-03-15 02:20:39] Showing labelled: True (50/5000 visible)
[2021-03-15 02:20:39] mlp: initialized 1482 parameters.
[2021-03-15 02:20:39] Creating trainer with model on device: cuda
[2021-03-15 02:20:39] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:20:39] Training loss: 1.2920
[2021-03-15 02:20:39] Testing on 5000 data points...
[2021-03-15 02:20:40] Test accuracy: 0.3918
[2021-03-15 02:20:40] Score for 50 labels: 0.3918
[2021-03-15 02:20:40] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:20:40] Found 4950 unlabelled features.
[2021-03-15 02:20:40] Showing labelled: True (70/5000 visible)
[2021-03-15 02:20:40] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:20:40] Training loss: 0.6428
[2021-03-15 02:20:40] Testing on 5000 data points...
[2021-03-15 02:20:40] Test accuracy: 0.8156
[2021-03-15 02:20:40] Score for 70 labels: 0.8156
[2021-03-15 02:20:40] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:20:40] Found 4930 unlabelled features.
[2021-03-15 02:20:40] Showing labelled: True (90/5000 visible)
[2021-03-15 02:20:40] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:20:41] Training loss: 0.3220
[2021-03-15 02:20:41] Testing on 5000 data points...
[2021-03-15 02:20:41] Test accuracy: 0.8986
[2021-03-15 02:20:41] Score for 90 labels: 0.8986
[2021-03-15 02:20:41] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:20:41] Found 4910 unlabelled features.
[2021-03-15 02:20:41] Showing labelled: True (110/5000 visible)
[2021-03-15 02:20:41] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:20:42] Training loss: 0.2103
[2021-03-15 02:20:42] Testing on 5000 data points...
[2021-03-15 02:20:42] Test accuracy: 0.9006
[2021-03-15 02:20:42] Score for 110 labels: 0.9006
[2021-03-15 02:20:42] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:20:42] Found 4890 unlabelled features.
[2021-03-15 02:20:42] Showing labelled: True (130/5000 visible)
[2021-03-15 02:20:42] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:20:43] Training loss: 0.1501
[2021-03-15 02:20:43] Testing on 5000 data points...
[2021-03-15 02:20:43] Test accuracy: 0.9494
[2021-03-15 02:20:43] Score for 130 labels: 0.9494
[2021-03-15 02:20:43] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:20:43] Found 4870 unlabelled features.
[2021-03-15 02:20:43] Showing labelled: True (150/5000 visible)
[2021-03-15 02:20:43] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:20:44] Training loss: 0.1065
[2021-03-15 02:20:44] Testing on 5000 data points...
[2021-03-15 02:20:44] Test accuracy: 0.9900
[2021-03-15 02:20:44] Score for 150 labels: 0.9900
[2021-03-15 02:20:44] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:20:44] Found 4850 unlabelled features.
[2021-03-15 02:20:44] Showing labelled: True (170/5000 visible)
[2021-03-15 02:20:44] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:20:45] Training loss: 0.0787
[2021-03-15 02:20:45] Testing on 5000 data points...
[2021-03-15 02:20:45] Test accuracy: 0.9958
[2021-03-15 02:20:45] Score for 170 labels: 0.9958
[2021-03-15 02:20:45] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:20:45] Found 4830 unlabelled features.
[2021-03-15 02:20:45] Showing labelled: True (190/5000 visible)
[2021-03-15 02:20:45] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:20:47] Training loss: 0.0525
[2021-03-15 02:20:47] Testing on 5000 data points...
[2021-03-15 02:20:47] Test accuracy: 0.9968
[2021-03-15 02:20:47] Score for 190 labels: 0.9968
[2021-03-15 02:20:47] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:20:47] Found 4810 unlabelled features.
[2021-03-15 02:20:47] Showing labelled: True (210/5000 visible)
[2021-03-15 02:20:47] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:20:48] Training loss: 0.0340
[2021-03-15 02:20:48] Testing on 5000 data points...
[2021-03-15 02:20:48] Test accuracy: 0.9982
[2021-03-15 02:20:48] Score for 210 labels: 0.9982
[2021-03-15 02:20:48] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:20:48] Found 4790 unlabelled features.
[2021-03-15 02:20:48] Showing labelled: True (230/5000 visible)
[2021-03-15 02:20:48] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:20:50] Training loss: 0.0245
[2021-03-15 02:20:50] Testing on 5000 data points...
[2021-03-15 02:20:50] Test accuracy: 0.9978
[2021-03-15 02:20:50] Score for 230 labels: 0.9978
[2021-03-15 02:20:50] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:20:50] Found 4770 unlabelled features.
[2021-03-15 02:20:50] Showing labelled: True (250/5000 visible)
[2021-03-15 02:20:50] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:20:51] Training loss: 0.0186
[2021-03-15 02:20:51] Testing on 5000 data points...
[2021-03-15 02:20:51] Test accuracy: 0.9980
[2021-03-15 02:20:51] Score for 250 labels: 0.9980
[2021-03-15 02:20:51] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:20:51] Found 4750 unlabelled features.
[2021-03-15 02:20:52] Showing labelled: True (270/5000 visible)
[2021-03-15 02:20:52] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:20:53] Training loss: 0.0138
[2021-03-15 02:20:53] Testing on 5000 data points...
[2021-03-15 02:20:53] Test accuracy: 0.9982
[2021-03-15 02:20:53] Score for 270 labels: 0.9982
[2021-03-15 02:20:53] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:20:53] Found 4730 unlabelled features.
[2021-03-15 02:20:53] Showing labelled: True (290/5000 visible)
[2021-03-15 02:20:53] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:20:55] Training loss: 0.0104
[2021-03-15 02:20:55] Testing on 5000 data points...
[2021-03-15 02:20:55] Test accuracy: 0.9982
[2021-03-15 02:20:55] Score for 290 labels: 0.9982
[2021-03-15 02:20:55] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:20:55] Found 4710 unlabelled features.
[2021-03-15 02:20:55] Showing labelled: True (310/5000 visible)
[2021-03-15 02:20:55] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:20:58] Training loss: 0.0084
[2021-03-15 02:20:58] Testing on 5000 data points...
[2021-03-15 02:20:58] Test accuracy: 0.9984
[2021-03-15 02:20:58] Score for 310 labels: 0.9984
[2021-03-15 02:20:58] Running: experiment 2
[2021-03-15 02:20:58] Showing labelled: True (50/5000 visible)
[2021-03-15 02:20:58] mlp: initialized 1482 parameters.
[2021-03-15 02:20:58] Creating trainer with model on device: cuda
[2021-03-15 02:20:58] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:20:58] Training loss: 1.3399
[2021-03-15 02:20:58] Testing on 5000 data points...
[2021-03-15 02:20:58] Test accuracy: 0.4996
[2021-03-15 02:20:58] Score for 50 labels: 0.4996
[2021-03-15 02:20:58] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:20:58] Found 4950 unlabelled features.
[2021-03-15 02:20:58] Showing labelled: True (70/5000 visible)
[2021-03-15 02:20:58] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:20:59] Training loss: 0.5433
[2021-03-15 02:20:59] Testing on 5000 data points...
[2021-03-15 02:20:59] Test accuracy: 0.6992
[2021-03-15 02:20:59] Score for 70 labels: 0.6992
[2021-03-15 02:20:59] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:20:59] Found 4930 unlabelled features.
[2021-03-15 02:20:59] Showing labelled: True (90/5000 visible)
[2021-03-15 02:20:59] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:20:59] Training loss: 0.3230
[2021-03-15 02:20:59] Testing on 5000 data points...
[2021-03-15 02:21:00] Test accuracy: 0.8822
[2021-03-15 02:21:00] Score for 90 labels: 0.8822
[2021-03-15 02:21:00] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:21:00] Found 4910 unlabelled features.
[2021-03-15 02:21:00] Showing labelled: True (110/5000 visible)
[2021-03-15 02:21:00] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:21:01] Training loss: 0.2263
[2021-03-15 02:21:01] Testing on 5000 data points...
[2021-03-15 02:21:01] Test accuracy: 0.9778
[2021-03-15 02:21:01] Score for 110 labels: 0.9778
[2021-03-15 02:21:01] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:21:01] Found 4890 unlabelled features.
[2021-03-15 02:21:01] Showing labelled: True (130/5000 visible)
[2021-03-15 02:21:01] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:21:02] Training loss: 0.1632
[2021-03-15 02:21:02] Testing on 5000 data points...
[2021-03-15 02:21:02] Test accuracy: 0.9948
[2021-03-15 02:21:02] Score for 130 labels: 0.9948
[2021-03-15 02:21:02] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:21:02] Found 4870 unlabelled features.
[2021-03-15 02:21:02] Showing labelled: True (150/5000 visible)
[2021-03-15 02:21:02] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:21:03] Training loss: 0.1330
[2021-03-15 02:21:03] Testing on 5000 data points...
[2021-03-15 02:21:03] Test accuracy: 0.9950
[2021-03-15 02:21:03] Score for 150 labels: 0.9950
[2021-03-15 02:21:03] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:21:03] Found 4850 unlabelled features.
[2021-03-15 02:21:03] Showing labelled: True (170/5000 visible)
[2021-03-15 02:21:03] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:21:04] Training loss: 0.1116
[2021-03-15 02:21:04] Testing on 5000 data points...
[2021-03-15 02:21:04] Test accuracy: 0.9976
[2021-03-15 02:21:04] Score for 170 labels: 0.9976
[2021-03-15 02:21:04] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:21:04] Found 4830 unlabelled features.
[2021-03-15 02:21:04] Showing labelled: True (190/5000 visible)
[2021-03-15 02:21:04] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:21:05] Training loss: 0.1020
[2021-03-15 02:21:05] Testing on 5000 data points...
[2021-03-15 02:21:05] Test accuracy: 0.9972
[2021-03-15 02:21:05] Score for 190 labels: 0.9972
[2021-03-15 02:21:05] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:21:05] Found 4810 unlabelled features.
[2021-03-15 02:21:05] Showing labelled: True (210/5000 visible)
[2021-03-15 02:21:05] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:21:07] Training loss: 0.0782
[2021-03-15 02:21:07] Testing on 5000 data points...
[2021-03-15 02:21:07] Test accuracy: 0.9974
[2021-03-15 02:21:07] Score for 210 labels: 0.9974
[2021-03-15 02:21:07] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:21:07] Found 4790 unlabelled features.
[2021-03-15 02:21:07] Showing labelled: True (230/5000 visible)
[2021-03-15 02:21:07] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:21:08] Training loss: 0.0562
[2021-03-15 02:21:08] Testing on 5000 data points...
[2021-03-15 02:21:08] Test accuracy: 0.9988
[2021-03-15 02:21:08] Score for 230 labels: 0.9988
[2021-03-15 02:21:08] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:21:08] Found 4770 unlabelled features.
[2021-03-15 02:21:08] Showing labelled: True (250/5000 visible)
[2021-03-15 02:21:08] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:21:10] Training loss: 0.0419
[2021-03-15 02:21:10] Testing on 5000 data points...
[2021-03-15 02:21:10] Test accuracy: 0.9976
[2021-03-15 02:21:10] Score for 250 labels: 0.9976
[2021-03-15 02:21:10] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:21:10] Found 4750 unlabelled features.
[2021-03-15 02:21:10] Showing labelled: True (270/5000 visible)
[2021-03-15 02:21:10] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:21:12] Training loss: 0.0329
[2021-03-15 02:21:12] Testing on 5000 data points...
[2021-03-15 02:21:12] Test accuracy: 0.9972
[2021-03-15 02:21:12] Score for 270 labels: 0.9972
[2021-03-15 02:21:12] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:21:12] Found 4730 unlabelled features.
[2021-03-15 02:21:12] Showing labelled: True (290/5000 visible)
[2021-03-15 02:21:12] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:21:14] Training loss: 0.0256
[2021-03-15 02:21:14] Testing on 5000 data points...
[2021-03-15 02:21:14] Test accuracy: 0.9976
[2021-03-15 02:21:14] Score for 290 labels: 0.9976
[2021-03-15 02:21:14] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:21:14] Found 4710 unlabelled features.
[2021-03-15 02:21:14] Showing labelled: True (310/5000 visible)
[2021-03-15 02:21:14] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:21:16] Training loss: 0.0207
[2021-03-15 02:21:16] Testing on 5000 data points...
[2021-03-15 02:21:16] Test accuracy: 0.9976
[2021-03-15 02:21:16] Score for 310 labels: 0.9976
[2021-03-15 02:21:16] Running: experiment 3
[2021-03-15 02:21:16] Showing labelled: True (50/5000 visible)
[2021-03-15 02:21:16] mlp: initialized 1482 parameters.
[2021-03-15 02:21:16] Creating trainer with model on device: cuda
[2021-03-15 02:21:16] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:21:16] Training loss: 1.3471
[2021-03-15 02:21:16] Testing on 5000 data points...
[2021-03-15 02:21:16] Test accuracy: 0.3928
[2021-03-15 02:21:16] Score for 50 labels: 0.3928
[2021-03-15 02:21:16] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:21:16] Found 4950 unlabelled features.
[2021-03-15 02:21:16] Showing labelled: True (70/5000 visible)
[2021-03-15 02:21:16] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:21:17] Training loss: 0.6047
[2021-03-15 02:21:17] Testing on 5000 data points...
[2021-03-15 02:21:17] Test accuracy: 0.6982
[2021-03-15 02:21:17] Score for 70 labels: 0.6982
[2021-03-15 02:21:17] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:21:17] Found 4930 unlabelled features.
[2021-03-15 02:21:17] Showing labelled: True (90/5000 visible)
[2021-03-15 02:21:17] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:21:18] Training loss: 0.2044
[2021-03-15 02:21:18] Testing on 5000 data points...
[2021-03-15 02:21:18] Test accuracy: 0.7610
[2021-03-15 02:21:18] Score for 90 labels: 0.7610
[2021-03-15 02:21:18] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:21:18] Found 4910 unlabelled features.
[2021-03-15 02:21:18] Showing labelled: True (110/5000 visible)
[2021-03-15 02:21:18] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:21:19] Training loss: 0.1762
[2021-03-15 02:21:19] Testing on 5000 data points...
[2021-03-15 02:21:19] Test accuracy: 0.8786
[2021-03-15 02:21:19] Score for 110 labels: 0.8786
[2021-03-15 02:21:19] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:21:19] Found 4890 unlabelled features.
[2021-03-15 02:21:19] Showing labelled: True (130/5000 visible)
[2021-03-15 02:21:19] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:21:20] Training loss: 0.0980
[2021-03-15 02:21:20] Testing on 5000 data points...
[2021-03-15 02:21:20] Test accuracy: 0.8910
[2021-03-15 02:21:20] Score for 130 labels: 0.8910
[2021-03-15 02:21:20] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:21:20] Found 4870 unlabelled features.
[2021-03-15 02:21:20] Showing labelled: True (150/5000 visible)
[2021-03-15 02:21:20] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:21:21] Training loss: 0.0774
[2021-03-15 02:21:21] Testing on 5000 data points...
[2021-03-15 02:21:21] Test accuracy: 0.8946
[2021-03-15 02:21:21] Score for 150 labels: 0.8946
[2021-03-15 02:21:21] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:21:21] Found 4850 unlabelled features.
[2021-03-15 02:21:21] Showing labelled: True (170/5000 visible)
[2021-03-15 02:21:21] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:21:22] Training loss: 0.0702
[2021-03-15 02:21:22] Testing on 5000 data points...
[2021-03-15 02:21:22] Test accuracy: 0.8962
[2021-03-15 02:21:22] Score for 170 labels: 0.8962
[2021-03-15 02:21:22] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:21:22] Found 4830 unlabelled features.
[2021-03-15 02:21:22] Showing labelled: True (190/5000 visible)
[2021-03-15 02:21:22] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:21:23] Training loss: 0.0681
[2021-03-15 02:21:23] Testing on 5000 data points...
[2021-03-15 02:21:24] Test accuracy: 0.8982
[2021-03-15 02:21:24] Score for 190 labels: 0.8982
[2021-03-15 02:21:24] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:21:24] Found 4810 unlabelled features.
[2021-03-15 02:21:24] Showing labelled: True (210/5000 visible)
[2021-03-15 02:21:24] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:21:25] Training loss: 0.0713
[2021-03-15 02:21:25] Testing on 5000 data points...
[2021-03-15 02:21:25] Test accuracy: 0.8974
[2021-03-15 02:21:25] Score for 210 labels: 0.8974
[2021-03-15 02:21:25] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:21:25] Found 4790 unlabelled features.
[2021-03-15 02:21:25] Showing labelled: True (230/5000 visible)
[2021-03-15 02:21:25] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:21:27] Training loss: 0.0618
[2021-03-15 02:21:27] Testing on 5000 data points...
[2021-03-15 02:21:27] Test accuracy: 0.8986
[2021-03-15 02:21:27] Score for 230 labels: 0.8986
[2021-03-15 02:21:27] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:21:27] Found 4770 unlabelled features.
[2021-03-15 02:21:27] Showing labelled: True (250/5000 visible)
[2021-03-15 02:21:27] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:21:28] Training loss: 0.0498
[2021-03-15 02:21:28] Testing on 5000 data points...
[2021-03-15 02:21:28] Test accuracy: 0.8976
[2021-03-15 02:21:28] Score for 250 labels: 0.8976
[2021-03-15 02:21:28] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:21:28] Found 4750 unlabelled features.
[2021-03-15 02:21:28] Showing labelled: True (270/5000 visible)
[2021-03-15 02:21:28] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:21:30] Training loss: 0.0388
[2021-03-15 02:21:30] Testing on 5000 data points...
[2021-03-15 02:21:30] Test accuracy: 0.8976
[2021-03-15 02:21:30] Score for 270 labels: 0.8976
[2021-03-15 02:21:30] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:21:30] Found 4730 unlabelled features.
[2021-03-15 02:21:30] Showing labelled: True (290/5000 visible)
[2021-03-15 02:21:30] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:21:32] Training loss: 0.0548
[2021-03-15 02:21:32] Testing on 5000 data points...
[2021-03-15 02:21:32] Test accuracy: 0.9978
[2021-03-15 02:21:32] Score for 290 labels: 0.9978
[2021-03-15 02:21:32] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:21:32] Found 4710 unlabelled features.
[2021-03-15 02:21:32] Showing labelled: True (310/5000 visible)
[2021-03-15 02:21:32] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:21:34] Training loss: 0.0265
[2021-03-15 02:21:34] Testing on 5000 data points...
[2021-03-15 02:21:34] Test accuracy: 0.9980
[2021-03-15 02:21:34] Score for 310 labels: 0.9980
[2021-03-15 02:21:34] Running: experiment 4
[2021-03-15 02:21:34] Showing labelled: True (50/5000 visible)
[2021-03-15 02:21:34] mlp: initialized 1482 parameters.
[2021-03-15 02:21:34] Creating trainer with model on device: cuda
[2021-03-15 02:21:34] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:21:35] Training loss: 1.4814
[2021-03-15 02:21:35] Testing on 5000 data points...
[2021-03-15 02:21:35] Test accuracy: 0.3660
[2021-03-15 02:21:35] Score for 50 labels: 0.3660
[2021-03-15 02:21:35] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:21:35] Found 4950 unlabelled features.
[2021-03-15 02:21:35] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:35] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:35] Scoring random batches...
[2021-03-15 02:21:35] Showing labelled: True (70/5000 visible)
[2021-03-15 02:21:35] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:21:36] Training loss: 0.6806
[2021-03-15 02:21:36] Testing on 5000 data points...
[2021-03-15 02:21:36] Test accuracy: 0.7000
[2021-03-15 02:21:36] Score for 70 labels: 0.7000
[2021-03-15 02:21:36] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:21:36] Found 4930 unlabelled features.
[2021-03-15 02:21:36] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:36] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:36] Scoring random batches...
[2021-03-15 02:21:36] Showing labelled: True (90/5000 visible)
[2021-03-15 02:21:36] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:21:37] Training loss: 0.3367
[2021-03-15 02:21:37] Testing on 5000 data points...
[2021-03-15 02:21:37] Test accuracy: 0.7000
[2021-03-15 02:21:37] Score for 90 labels: 0.7000
[2021-03-15 02:21:37] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:21:37] Found 4910 unlabelled features.
[2021-03-15 02:21:37] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:37] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:37] Scoring random batches...
[2021-03-15 02:21:37] Showing labelled: True (110/5000 visible)
[2021-03-15 02:21:37] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:21:38] Training loss: 0.2257
[2021-03-15 02:21:38] Testing on 5000 data points...
[2021-03-15 02:21:38] Test accuracy: 0.7580
[2021-03-15 02:21:38] Score for 110 labels: 0.7580
[2021-03-15 02:21:38] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:21:38] Found 4890 unlabelled features.
[2021-03-15 02:21:38] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:38] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:39] Scoring random batches...
[2021-03-15 02:21:39] Showing labelled: True (130/5000 visible)
[2021-03-15 02:21:39] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:21:40] Training loss: 0.1310
[2021-03-15 02:21:40] Testing on 5000 data points...
[2021-03-15 02:21:40] Test accuracy: 0.8892
[2021-03-15 02:21:40] Score for 130 labels: 0.8892
[2021-03-15 02:21:40] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:21:40] Found 4870 unlabelled features.
[2021-03-15 02:21:40] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:40] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:40] Scoring random batches...
[2021-03-15 02:21:40] Showing labelled: True (150/5000 visible)
[2021-03-15 02:21:40] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:21:41] Training loss: 0.0873
[2021-03-15 02:21:41] Testing on 5000 data points...
[2021-03-15 02:21:41] Test accuracy: 0.9640
[2021-03-15 02:21:41] Score for 150 labels: 0.9640
[2021-03-15 02:21:41] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:21:41] Found 4850 unlabelled features.
[2021-03-15 02:21:41] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:42] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:42] Scoring random batches...
[2021-03-15 02:21:42] Showing labelled: True (170/5000 visible)
[2021-03-15 02:21:42] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:21:43] Training loss: 0.0599
[2021-03-15 02:21:43] Testing on 5000 data points...
[2021-03-15 02:21:43] Test accuracy: 0.9870
[2021-03-15 02:21:43] Score for 170 labels: 0.9870
[2021-03-15 02:21:43] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:21:43] Found 4830 unlabelled features.
[2021-03-15 02:21:43] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:43] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:44] Scoring random batches...
[2021-03-15 02:21:44] Showing labelled: True (190/5000 visible)
[2021-03-15 02:21:44] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:21:45] Training loss: 0.0391
[2021-03-15 02:21:45] Testing on 5000 data points...
[2021-03-15 02:21:45] Test accuracy: 0.9906
[2021-03-15 02:21:45] Score for 190 labels: 0.9906
[2021-03-15 02:21:45] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:21:45] Found 4810 unlabelled features.
[2021-03-15 02:21:45] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:45] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:46] Scoring random batches...
[2021-03-15 02:21:46] Showing labelled: True (210/5000 visible)
[2021-03-15 02:21:46] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:21:47] Training loss: 0.0278
[2021-03-15 02:21:47] Testing on 5000 data points...
[2021-03-15 02:21:47] Test accuracy: 0.9918
[2021-03-15 02:21:47] Score for 210 labels: 0.9918
[2021-03-15 02:21:47] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:21:47] Found 4790 unlabelled features.
[2021-03-15 02:21:47] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:47] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:48] Scoring random batches...
[2021-03-15 02:21:48] Showing labelled: True (230/5000 visible)
[2021-03-15 02:21:48] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:21:49] Training loss: 0.0191
[2021-03-15 02:21:49] Testing on 5000 data points...
[2021-03-15 02:21:49] Test accuracy: 0.9920
[2021-03-15 02:21:49] Score for 230 labels: 0.9920
[2021-03-15 02:21:49] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:21:49] Found 4770 unlabelled features.
[2021-03-15 02:21:49] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:49] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:50] Scoring random batches...
[2021-03-15 02:21:50] Showing labelled: True (250/5000 visible)
[2021-03-15 02:21:50] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:21:51] Training loss: 0.0142
[2021-03-15 02:21:51] Testing on 5000 data points...
[2021-03-15 02:21:51] Test accuracy: 0.9924
[2021-03-15 02:21:51] Score for 250 labels: 0.9924
[2021-03-15 02:21:51] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:21:51] Found 4750 unlabelled features.
[2021-03-15 02:21:51] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:51] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:52] Scoring random batches...
[2021-03-15 02:21:52] Showing labelled: True (270/5000 visible)
[2021-03-15 02:21:52] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:21:53] Training loss: 0.0116
[2021-03-15 02:21:53] Testing on 5000 data points...
[2021-03-15 02:21:54] Test accuracy: 0.9946
[2021-03-15 02:21:54] Score for 270 labels: 0.9946
[2021-03-15 02:21:54] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:21:54] Found 4730 unlabelled features.
[2021-03-15 02:21:54] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:54] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:54] Scoring random batches...
[2021-03-15 02:21:54] Showing labelled: True (290/5000 visible)
[2021-03-15 02:21:54] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:21:56] Training loss: 0.0091
[2021-03-15 02:21:56] Testing on 5000 data points...
[2021-03-15 02:21:56] Test accuracy: 0.9938
[2021-03-15 02:21:56] Score for 290 labels: 0.9938
[2021-03-15 02:21:56] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:21:56] Found 4710 unlabelled features.
[2021-03-15 02:21:56] Training GMM (k=32) on labelled features...
[2021-03-15 02:21:56] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:21:57] Scoring random batches...
[2021-03-15 02:21:57] Showing labelled: True (310/5000 visible)
[2021-03-15 02:21:57] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:21:59] Training loss: 0.0094
[2021-03-15 02:21:59] Testing on 5000 data points...
[2021-03-15 02:21:59] Test accuracy: 0.9958
[2021-03-15 02:21:59] Score for 310 labels: 0.9958
[2021-03-15 02:21:59] Experiment repeat 7/10
[2021-03-15 02:21:59] Randomly labelled 50/5000
[2021-03-15 02:21:59] Showing labelled: True (50/5000 visible)
[2021-03-15 02:21:59] Running: experiment 0
[2021-03-15 02:21:59] Showing labelled: True (50/5000 visible)
[2021-03-15 02:21:59] mlp: initialized 1482 parameters.
[2021-03-15 02:21:59] Creating trainer with model on device: cuda
[2021-03-15 02:21:59] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:21:59] Training loss: 1.3025
[2021-03-15 02:21:59] Testing on 5000 data points...
[2021-03-15 02:21:59] Test accuracy: 0.3032
[2021-03-15 02:21:59] Score for 50 labels: 0.3032
[2021-03-15 02:21:59] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:21:59] Found 4950 unlabelled features.
[2021-03-15 02:21:59] Searching core-set greedily...
[2021-03-15 02:22:01] Showing labelled: True (70/5000 visible)
[2021-03-15 02:22:01] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:22:02] Training loss: 0.8451
[2021-03-15 02:22:02] Testing on 5000 data points...
[2021-03-15 02:22:02] Test accuracy: 0.8926
[2021-03-15 02:22:02] Score for 70 labels: 0.8926
[2021-03-15 02:22:02] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:22:02] Found 4930 unlabelled features.
[2021-03-15 02:22:02] Searching core-set greedily...
[2021-03-15 02:22:03] Showing labelled: True (90/5000 visible)
[2021-03-15 02:22:03] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:22:04] Training loss: 0.4033
[2021-03-15 02:22:04] Testing on 5000 data points...
[2021-03-15 02:22:04] Test accuracy: 0.8996
[2021-03-15 02:22:04] Score for 90 labels: 0.8996
[2021-03-15 02:22:04] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:22:04] Found 4910 unlabelled features.
[2021-03-15 02:22:04] Searching core-set greedily...
[2021-03-15 02:22:06] Showing labelled: True (110/5000 visible)
[2021-03-15 02:22:06] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:22:07] Training loss: 0.2494
[2021-03-15 02:22:07] Testing on 5000 data points...
[2021-03-15 02:22:07] Test accuracy: 0.9396
[2021-03-15 02:22:07] Score for 110 labels: 0.9396
[2021-03-15 02:22:07] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:22:07] Found 4890 unlabelled features.
[2021-03-15 02:22:07] Searching core-set greedily...
[2021-03-15 02:22:10] Showing labelled: True (130/5000 visible)
[2021-03-15 02:22:10] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:22:11] Training loss: 0.1610
[2021-03-15 02:22:11] Testing on 5000 data points...
[2021-03-15 02:22:11] Test accuracy: 0.9974
[2021-03-15 02:22:11] Score for 130 labels: 0.9974
[2021-03-15 02:22:11] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:22:11] Found 4870 unlabelled features.
[2021-03-15 02:22:11] Searching core-set greedily...
[2021-03-15 02:22:14] Showing labelled: True (150/5000 visible)
[2021-03-15 02:22:14] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:22:15] Training loss: 0.1064
[2021-03-15 02:22:15] Testing on 5000 data points...
[2021-03-15 02:22:15] Test accuracy: 0.9980
[2021-03-15 02:22:15] Score for 150 labels: 0.9980
[2021-03-15 02:22:15] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:22:15] Found 4850 unlabelled features.
[2021-03-15 02:22:15] Searching core-set greedily...
[2021-03-15 02:22:19] Showing labelled: True (170/5000 visible)
[2021-03-15 02:22:19] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:22:20] Training loss: 0.0721
[2021-03-15 02:22:20] Testing on 5000 data points...
[2021-03-15 02:22:20] Test accuracy: 0.9980
[2021-03-15 02:22:20] Score for 170 labels: 0.9980
[2021-03-15 02:22:20] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:22:20] Found 4830 unlabelled features.
[2021-03-15 02:22:20] Searching core-set greedily...
[2021-03-15 02:22:24] Showing labelled: True (190/5000 visible)
[2021-03-15 02:22:24] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:22:25] Training loss: 0.0544
[2021-03-15 02:22:25] Testing on 5000 data points...
[2021-03-15 02:22:25] Test accuracy: 0.9986
[2021-03-15 02:22:25] Score for 190 labels: 0.9986
[2021-03-15 02:22:25] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:22:25] Found 4810 unlabelled features.
[2021-03-15 02:22:25] Searching core-set greedily...
[2021-03-15 02:22:29] Showing labelled: True (210/5000 visible)
[2021-03-15 02:22:29] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:22:30] Training loss: 0.0423
[2021-03-15 02:22:30] Testing on 5000 data points...
[2021-03-15 02:22:30] Test accuracy: 0.9984
[2021-03-15 02:22:30] Score for 210 labels: 0.9984
[2021-03-15 02:22:30] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:22:30] Found 4790 unlabelled features.
[2021-03-15 02:22:30] Searching core-set greedily...
[2021-03-15 02:22:34] Showing labelled: True (230/5000 visible)
[2021-03-15 02:22:34] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:22:35] Training loss: 0.0360
[2021-03-15 02:22:35] Testing on 5000 data points...
[2021-03-15 02:22:35] Test accuracy: 0.9984
[2021-03-15 02:22:35] Score for 230 labels: 0.9984
[2021-03-15 02:22:35] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:22:35] Found 4770 unlabelled features.
[2021-03-15 02:22:36] Searching core-set greedily...
[2021-03-15 02:22:40] Showing labelled: True (250/5000 visible)
[2021-03-15 02:22:40] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:22:41] Training loss: 0.0285
[2021-03-15 02:22:41] Testing on 5000 data points...
[2021-03-15 02:22:41] Test accuracy: 0.9982
[2021-03-15 02:22:41] Score for 250 labels: 0.9982
[2021-03-15 02:22:41] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:22:41] Found 4750 unlabelled features.
[2021-03-15 02:22:41] Searching core-set greedily...
[2021-03-15 02:22:46] Showing labelled: True (270/5000 visible)
[2021-03-15 02:22:46] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:22:47] Training loss: 0.0229
[2021-03-15 02:22:47] Testing on 5000 data points...
[2021-03-15 02:22:47] Test accuracy: 0.9984
[2021-03-15 02:22:47] Score for 270 labels: 0.9984
[2021-03-15 02:22:47] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:22:47] Found 4730 unlabelled features.
[2021-03-15 02:22:48] Searching core-set greedily...
[2021-03-15 02:22:52] Showing labelled: True (290/5000 visible)
[2021-03-15 02:22:52] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:22:53] Training loss: 0.0183
[2021-03-15 02:22:53] Testing on 5000 data points...
[2021-03-15 02:22:53] Test accuracy: 0.9984
[2021-03-15 02:22:53] Score for 290 labels: 0.9984
[2021-03-15 02:22:53] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:22:53] Found 4710 unlabelled features.
[2021-03-15 02:22:53] Searching core-set greedily...
[2021-03-15 02:22:57] Showing labelled: True (310/5000 visible)
[2021-03-15 02:22:57] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:22:59] Training loss: 0.0163
[2021-03-15 02:22:59] Testing on 5000 data points...
[2021-03-15 02:22:59] Test accuracy: 0.9978
[2021-03-15 02:22:59] Score for 310 labels: 0.9978
[2021-03-15 02:22:59] Running: experiment 1
[2021-03-15 02:22:59] Showing labelled: True (50/5000 visible)
[2021-03-15 02:22:59] mlp: initialized 1482 parameters.
[2021-03-15 02:22:59] Creating trainer with model on device: cuda
[2021-03-15 02:22:59] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:23:00] Training loss: 1.1572
[2021-03-15 02:23:00] Testing on 5000 data points...
[2021-03-15 02:23:00] Test accuracy: 0.4704
[2021-03-15 02:23:00] Score for 50 labels: 0.4704
[2021-03-15 02:23:00] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:23:00] Found 4950 unlabelled features.
[2021-03-15 02:23:00] Showing labelled: True (70/5000 visible)
[2021-03-15 02:23:00] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:23:00] Training loss: 0.5061
[2021-03-15 02:23:00] Testing on 5000 data points...
[2021-03-15 02:23:00] Test accuracy: 0.5000
[2021-03-15 02:23:00] Score for 70 labels: 0.5000
[2021-03-15 02:23:00] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:23:00] Found 4930 unlabelled features.
[2021-03-15 02:23:01] Showing labelled: True (90/5000 visible)
[2021-03-15 02:23:01] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:23:01] Training loss: 0.2938
[2021-03-15 02:23:01] Testing on 5000 data points...
[2021-03-15 02:23:01] Test accuracy: 0.6318
[2021-03-15 02:23:01] Score for 90 labels: 0.6318
[2021-03-15 02:23:01] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:23:01] Found 4910 unlabelled features.
[2021-03-15 02:23:01] Showing labelled: True (110/5000 visible)
[2021-03-15 02:23:01] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:23:02] Training loss: 0.3344
[2021-03-15 02:23:02] Testing on 5000 data points...
[2021-03-15 02:23:02] Test accuracy: 0.7856
[2021-03-15 02:23:02] Score for 110 labels: 0.7856
[2021-03-15 02:23:02] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:23:02] Found 4890 unlabelled features.
[2021-03-15 02:23:02] Showing labelled: True (130/5000 visible)
[2021-03-15 02:23:02] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:23:03] Training loss: 0.1829
[2021-03-15 02:23:03] Testing on 5000 data points...
[2021-03-15 02:23:03] Test accuracy: 0.9382
[2021-03-15 02:23:03] Score for 130 labels: 0.9382
[2021-03-15 02:23:03] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:23:03] Found 4870 unlabelled features.
[2021-03-15 02:23:03] Showing labelled: True (150/5000 visible)
[2021-03-15 02:23:03] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:23:04] Training loss: 0.1242
[2021-03-15 02:23:04] Testing on 5000 data points...
[2021-03-15 02:23:04] Test accuracy: 0.9642
[2021-03-15 02:23:04] Score for 150 labels: 0.9642
[2021-03-15 02:23:04] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:23:04] Found 4850 unlabelled features.
[2021-03-15 02:23:04] Showing labelled: True (170/5000 visible)
[2021-03-15 02:23:04] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:23:06] Training loss: 0.0810
[2021-03-15 02:23:06] Testing on 5000 data points...
[2021-03-15 02:23:06] Test accuracy: 0.9788
[2021-03-15 02:23:06] Score for 170 labels: 0.9788
[2021-03-15 02:23:06] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:23:06] Found 4830 unlabelled features.
[2021-03-15 02:23:06] Showing labelled: True (190/5000 visible)
[2021-03-15 02:23:06] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:23:07] Training loss: 0.0519
[2021-03-15 02:23:07] Testing on 5000 data points...
[2021-03-15 02:23:07] Test accuracy: 0.9862
[2021-03-15 02:23:07] Score for 190 labels: 0.9862
[2021-03-15 02:23:07] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:23:07] Found 4810 unlabelled features.
[2021-03-15 02:23:07] Showing labelled: True (210/5000 visible)
[2021-03-15 02:23:07] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:23:08] Training loss: 0.0376
[2021-03-15 02:23:08] Testing on 5000 data points...
[2021-03-15 02:23:08] Test accuracy: 0.9938
[2021-03-15 02:23:08] Score for 210 labels: 0.9938
[2021-03-15 02:23:08] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:23:08] Found 4790 unlabelled features.
[2021-03-15 02:23:09] Showing labelled: True (230/5000 visible)
[2021-03-15 02:23:09] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:23:10] Training loss: 0.0257
[2021-03-15 02:23:10] Testing on 5000 data points...
[2021-03-15 02:23:10] Test accuracy: 0.9938
[2021-03-15 02:23:10] Score for 230 labels: 0.9938
[2021-03-15 02:23:10] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:23:10] Found 4770 unlabelled features.
[2021-03-15 02:23:10] Showing labelled: True (250/5000 visible)
[2021-03-15 02:23:10] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:23:12] Training loss: 0.0206
[2021-03-15 02:23:12] Testing on 5000 data points...
[2021-03-15 02:23:12] Test accuracy: 0.9952
[2021-03-15 02:23:12] Score for 250 labels: 0.9952
[2021-03-15 02:23:12] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:23:12] Found 4750 unlabelled features.
[2021-03-15 02:23:12] Showing labelled: True (270/5000 visible)
[2021-03-15 02:23:12] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:23:13] Training loss: 0.0193
[2021-03-15 02:23:13] Testing on 5000 data points...
[2021-03-15 02:23:13] Test accuracy: 0.9968
[2021-03-15 02:23:13] Score for 270 labels: 0.9968
[2021-03-15 02:23:13] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:23:13] Found 4730 unlabelled features.
[2021-03-15 02:23:14] Showing labelled: True (290/5000 visible)
[2021-03-15 02:23:14] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:23:15] Training loss: 0.0150
[2021-03-15 02:23:15] Testing on 5000 data points...
[2021-03-15 02:23:15] Test accuracy: 0.9970
[2021-03-15 02:23:15] Score for 290 labels: 0.9970
[2021-03-15 02:23:15] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:23:15] Found 4710 unlabelled features.
[2021-03-15 02:23:15] Showing labelled: True (310/5000 visible)
[2021-03-15 02:23:15] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:23:17] Training loss: 0.0119
[2021-03-15 02:23:17] Testing on 5000 data points...
[2021-03-15 02:23:17] Test accuracy: 0.9970
[2021-03-15 02:23:17] Score for 310 labels: 0.9970
[2021-03-15 02:23:17] Running: experiment 2
[2021-03-15 02:23:17] Showing labelled: True (50/5000 visible)
[2021-03-15 02:23:17] mlp: initialized 1482 parameters.
[2021-03-15 02:23:17] Creating trainer with model on device: cuda
[2021-03-15 02:23:17] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:23:18] Training loss: 1.1467
[2021-03-15 02:23:18] Testing on 5000 data points...
[2021-03-15 02:23:18] Test accuracy: 0.4046
[2021-03-15 02:23:18] Score for 50 labels: 0.4046
[2021-03-15 02:23:18] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:23:18] Found 4950 unlabelled features.
[2021-03-15 02:23:18] Showing labelled: True (70/5000 visible)
[2021-03-15 02:23:18] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:23:19] Training loss: 0.5494
[2021-03-15 02:23:19] Testing on 5000 data points...
[2021-03-15 02:23:19] Test accuracy: 0.4966
[2021-03-15 02:23:19] Score for 70 labels: 0.4966
[2021-03-15 02:23:19] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:23:19] Found 4930 unlabelled features.
[2021-03-15 02:23:19] Showing labelled: True (90/5000 visible)
[2021-03-15 02:23:19] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:23:19] Training loss: 0.2989
[2021-03-15 02:23:19] Testing on 5000 data points...
[2021-03-15 02:23:19] Test accuracy: 0.5000
[2021-03-15 02:23:19] Score for 90 labels: 0.5000
[2021-03-15 02:23:19] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:23:19] Found 4910 unlabelled features.
[2021-03-15 02:23:20] Showing labelled: True (110/5000 visible)
[2021-03-15 02:23:20] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:23:20] Training loss: 0.2541
[2021-03-15 02:23:20] Testing on 5000 data points...
[2021-03-15 02:23:20] Test accuracy: 0.6000
[2021-03-15 02:23:20] Score for 110 labels: 0.6000
[2021-03-15 02:23:20] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:23:20] Found 4890 unlabelled features.
[2021-03-15 02:23:20] Showing labelled: True (130/5000 visible)
[2021-03-15 02:23:20] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:23:21] Training loss: 0.2502
[2021-03-15 02:23:21] Testing on 5000 data points...
[2021-03-15 02:23:21] Test accuracy: 0.6946
[2021-03-15 02:23:21] Score for 130 labels: 0.6946
[2021-03-15 02:23:21] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:23:21] Found 4870 unlabelled features.
[2021-03-15 02:23:22] Showing labelled: True (150/5000 visible)
[2021-03-15 02:23:22] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:23:23] Training loss: 0.1839
[2021-03-15 02:23:23] Testing on 5000 data points...
[2021-03-15 02:23:23] Test accuracy: 0.8200
[2021-03-15 02:23:23] Score for 150 labels: 0.8200
[2021-03-15 02:23:23] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:23:23] Found 4850 unlabelled features.
[2021-03-15 02:23:23] Showing labelled: True (170/5000 visible)
[2021-03-15 02:23:23] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:23:24] Training loss: 0.1137
[2021-03-15 02:23:24] Testing on 5000 data points...
[2021-03-15 02:23:24] Test accuracy: 0.8984
[2021-03-15 02:23:24] Score for 170 labels: 0.8984
[2021-03-15 02:23:24] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:23:24] Found 4830 unlabelled features.
[2021-03-15 02:23:24] Showing labelled: True (190/5000 visible)
[2021-03-15 02:23:24] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:23:25] Training loss: 0.1080
[2021-03-15 02:23:25] Testing on 5000 data points...
[2021-03-15 02:23:25] Test accuracy: 0.8960
[2021-03-15 02:23:25] Score for 190 labels: 0.8960
[2021-03-15 02:23:25] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:23:25] Found 4810 unlabelled features.
[2021-03-15 02:23:25] Showing labelled: True (210/5000 visible)
[2021-03-15 02:23:25] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:23:27] Training loss: 0.1225
[2021-03-15 02:23:27] Testing on 5000 data points...
[2021-03-15 02:23:27] Test accuracy: 0.9990
[2021-03-15 02:23:27] Score for 210 labels: 0.9990
[2021-03-15 02:23:27] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:23:27] Found 4790 unlabelled features.
[2021-03-15 02:23:27] Showing labelled: True (230/5000 visible)
[2021-03-15 02:23:27] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:23:28] Training loss: 0.0815
[2021-03-15 02:23:28] Testing on 5000 data points...
[2021-03-15 02:23:28] Test accuracy: 0.9988
[2021-03-15 02:23:28] Score for 230 labels: 0.9988
[2021-03-15 02:23:28] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:23:28] Found 4770 unlabelled features.
[2021-03-15 02:23:28] Showing labelled: True (250/5000 visible)
[2021-03-15 02:23:28] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:23:30] Training loss: 0.0678
[2021-03-15 02:23:30] Testing on 5000 data points...
[2021-03-15 02:23:30] Test accuracy: 0.9972
[2021-03-15 02:23:30] Score for 250 labels: 0.9972
[2021-03-15 02:23:30] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:23:30] Found 4750 unlabelled features.
[2021-03-15 02:23:30] Showing labelled: True (270/5000 visible)
[2021-03-15 02:23:30] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:23:32] Training loss: 0.0520
[2021-03-15 02:23:32] Testing on 5000 data points...
[2021-03-15 02:23:32] Test accuracy: 0.9974
[2021-03-15 02:23:32] Score for 270 labels: 0.9974
[2021-03-15 02:23:32] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:23:32] Found 4730 unlabelled features.
[2021-03-15 02:23:32] Showing labelled: True (290/5000 visible)
[2021-03-15 02:23:32] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:23:34] Training loss: 0.0387
[2021-03-15 02:23:34] Testing on 5000 data points...
[2021-03-15 02:23:34] Test accuracy: 0.9976
[2021-03-15 02:23:34] Score for 290 labels: 0.9976
[2021-03-15 02:23:34] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:23:34] Found 4710 unlabelled features.
[2021-03-15 02:23:34] Showing labelled: True (310/5000 visible)
[2021-03-15 02:23:34] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:23:36] Training loss: 0.0297
[2021-03-15 02:23:36] Testing on 5000 data points...
[2021-03-15 02:23:36] Test accuracy: 0.9974
[2021-03-15 02:23:36] Score for 310 labels: 0.9974
[2021-03-15 02:23:36] Running: experiment 3
[2021-03-15 02:23:36] Showing labelled: True (50/5000 visible)
[2021-03-15 02:23:36] mlp: initialized 1482 parameters.
[2021-03-15 02:23:36] Creating trainer with model on device: cuda
[2021-03-15 02:23:36] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:23:36] Training loss: 1.1867
[2021-03-15 02:23:36] Testing on 5000 data points...
[2021-03-15 02:23:36] Test accuracy: 0.3802
[2021-03-15 02:23:36] Score for 50 labels: 0.3802
[2021-03-15 02:23:36] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:23:36] Found 4950 unlabelled features.
[2021-03-15 02:23:36] Showing labelled: True (70/5000 visible)
[2021-03-15 02:23:36] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:23:37] Training loss: 0.5725
[2021-03-15 02:23:37] Testing on 5000 data points...
[2021-03-15 02:23:37] Test accuracy: 0.5000
[2021-03-15 02:23:37] Score for 70 labels: 0.5000
[2021-03-15 02:23:37] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:23:37] Found 4930 unlabelled features.
[2021-03-15 02:23:37] Showing labelled: True (90/5000 visible)
[2021-03-15 02:23:37] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:23:38] Training loss: 0.3413
[2021-03-15 02:23:38] Testing on 5000 data points...
[2021-03-15 02:23:38] Test accuracy: 0.6008
[2021-03-15 02:23:38] Score for 90 labels: 0.6008
[2021-03-15 02:23:38] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:23:38] Found 4910 unlabelled features.
[2021-03-15 02:23:38] Showing labelled: True (110/5000 visible)
[2021-03-15 02:23:38] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:23:39] Training loss: 0.2862
[2021-03-15 02:23:39] Testing on 5000 data points...
[2021-03-15 02:23:39] Test accuracy: 0.6440
[2021-03-15 02:23:39] Score for 110 labels: 0.6440
[2021-03-15 02:23:39] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:23:39] Found 4890 unlabelled features.
[2021-03-15 02:23:39] Showing labelled: True (130/5000 visible)
[2021-03-15 02:23:39] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:23:40] Training loss: 0.2066
[2021-03-15 02:23:40] Testing on 5000 data points...
[2021-03-15 02:23:40] Test accuracy: 0.7410
[2021-03-15 02:23:40] Score for 130 labels: 0.7410
[2021-03-15 02:23:40] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:23:40] Found 4870 unlabelled features.
[2021-03-15 02:23:40] Showing labelled: True (150/5000 visible)
[2021-03-15 02:23:40] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:23:41] Training loss: 0.2313
[2021-03-15 02:23:41] Testing on 5000 data points...
[2021-03-15 02:23:41] Test accuracy: 0.8660
[2021-03-15 02:23:41] Score for 150 labels: 0.8660
[2021-03-15 02:23:41] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:23:41] Found 4850 unlabelled features.
[2021-03-15 02:23:41] Showing labelled: True (170/5000 visible)
[2021-03-15 02:23:41] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:23:42] Training loss: 0.0979
[2021-03-15 02:23:42] Testing on 5000 data points...
[2021-03-15 02:23:42] Test accuracy: 0.8866
[2021-03-15 02:23:42] Score for 170 labels: 0.8866
[2021-03-15 02:23:42] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:23:42] Found 4830 unlabelled features.
[2021-03-15 02:23:42] Showing labelled: True (190/5000 visible)
[2021-03-15 02:23:42] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:23:43] Training loss: 0.0983
[2021-03-15 02:23:43] Testing on 5000 data points...
[2021-03-15 02:23:44] Test accuracy: 0.8984
[2021-03-15 02:23:44] Score for 190 labels: 0.8984
[2021-03-15 02:23:44] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:23:44] Found 4810 unlabelled features.
[2021-03-15 02:23:44] Showing labelled: True (210/5000 visible)
[2021-03-15 02:23:44] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:23:45] Training loss: 0.1016
[2021-03-15 02:23:45] Testing on 5000 data points...
[2021-03-15 02:23:45] Test accuracy: 0.8960
[2021-03-15 02:23:45] Score for 210 labels: 0.8960
[2021-03-15 02:23:45] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:23:45] Found 4790 unlabelled features.
[2021-03-15 02:23:45] Showing labelled: True (230/5000 visible)
[2021-03-15 02:23:45] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:23:47] Training loss: 0.0882
[2021-03-15 02:23:47] Testing on 5000 data points...
[2021-03-15 02:23:47] Test accuracy: 0.8988
[2021-03-15 02:23:47] Score for 230 labels: 0.8988
[2021-03-15 02:23:47] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:23:47] Found 4770 unlabelled features.
[2021-03-15 02:23:47] Showing labelled: True (250/5000 visible)
[2021-03-15 02:23:47] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:23:48] Training loss: 0.0702
[2021-03-15 02:23:48] Testing on 5000 data points...
[2021-03-15 02:23:48] Test accuracy: 0.8974
[2021-03-15 02:23:48] Score for 250 labels: 0.8974
[2021-03-15 02:23:48] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:23:48] Found 4750 unlabelled features.
[2021-03-15 02:23:48] Showing labelled: True (270/5000 visible)
[2021-03-15 02:23:48] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:23:50] Training loss: 0.0532
[2021-03-15 02:23:50] Testing on 5000 data points...
[2021-03-15 02:23:50] Test accuracy: 0.8974
[2021-03-15 02:23:50] Score for 270 labels: 0.8974
[2021-03-15 02:23:50] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:23:50] Found 4730 unlabelled features.
[2021-03-15 02:23:50] Showing labelled: True (290/5000 visible)
[2021-03-15 02:23:50] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:23:52] Training loss: 0.0388
[2021-03-15 02:23:52] Testing on 5000 data points...
[2021-03-15 02:23:52] Test accuracy: 0.8978
[2021-03-15 02:23:52] Score for 290 labels: 0.8978
[2021-03-15 02:23:52] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:23:52] Found 4710 unlabelled features.
[2021-03-15 02:23:52] Showing labelled: True (310/5000 visible)
[2021-03-15 02:23:52] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:23:54] Training loss: 0.0300
[2021-03-15 02:23:54] Testing on 5000 data points...
[2021-03-15 02:23:54] Test accuracy: 0.8990
[2021-03-15 02:23:54] Score for 310 labels: 0.8990
[2021-03-15 02:23:54] Running: experiment 4
[2021-03-15 02:23:54] Showing labelled: True (50/5000 visible)
[2021-03-15 02:23:54] mlp: initialized 1482 parameters.
[2021-03-15 02:23:54] Creating trainer with model on device: cuda
[2021-03-15 02:23:54] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:23:54] Training loss: 1.2537
[2021-03-15 02:23:54] Testing on 5000 data points...
[2021-03-15 02:23:54] Test accuracy: 0.3892
[2021-03-15 02:23:54] Score for 50 labels: 0.3892
[2021-03-15 02:23:54] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:23:54] Found 4950 unlabelled features.
[2021-03-15 02:23:54] Training GMM (k=32) on labelled features...
[2021-03-15 02:23:55] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:23:55] Scoring random batches...
[2021-03-15 02:23:55] Showing labelled: True (70/5000 visible)
[2021-03-15 02:23:55] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:23:55] Training loss: 0.6610
[2021-03-15 02:23:55] Testing on 5000 data points...
[2021-03-15 02:23:55] Test accuracy: 0.5956
[2021-03-15 02:23:55] Score for 70 labels: 0.5956
[2021-03-15 02:23:55] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:23:55] Found 4930 unlabelled features.
[2021-03-15 02:23:56] Training GMM (k=32) on labelled features...
[2021-03-15 02:23:56] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:23:56] Scoring random batches...
[2021-03-15 02:23:56] Showing labelled: True (90/5000 visible)
[2021-03-15 02:23:56] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:23:57] Training loss: 0.4199
[2021-03-15 02:23:57] Testing on 5000 data points...
[2021-03-15 02:23:57] Test accuracy: 0.6824
[2021-03-15 02:23:57] Score for 90 labels: 0.6824
[2021-03-15 02:23:57] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:23:57] Found 4910 unlabelled features.
[2021-03-15 02:23:57] Training GMM (k=32) on labelled features...
[2021-03-15 02:23:57] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:23:57] Scoring random batches...
[2021-03-15 02:23:57] Showing labelled: True (110/5000 visible)
[2021-03-15 02:23:57] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:23:58] Training loss: 0.3229
[2021-03-15 02:23:58] Testing on 5000 data points...
[2021-03-15 02:23:58] Test accuracy: 0.8126
[2021-03-15 02:23:58] Score for 110 labels: 0.8126
[2021-03-15 02:23:58] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:23:58] Found 4890 unlabelled features.
[2021-03-15 02:23:58] Training GMM (k=32) on labelled features...
[2021-03-15 02:23:58] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:23:58] Scoring random batches...
[2021-03-15 02:23:58] Showing labelled: True (130/5000 visible)
[2021-03-15 02:23:58] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:23:59] Training loss: 0.2056
[2021-03-15 02:23:59] Testing on 5000 data points...
[2021-03-15 02:23:59] Test accuracy: 0.9008
[2021-03-15 02:23:59] Score for 130 labels: 0.9008
[2021-03-15 02:23:59] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:23:59] Found 4870 unlabelled features.
[2021-03-15 02:24:00] Training GMM (k=32) on labelled features...
[2021-03-15 02:24:00] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:24:00] Scoring random batches...
[2021-03-15 02:24:00] Showing labelled: True (150/5000 visible)
[2021-03-15 02:24:00] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:24:01] Training loss: 0.1445
[2021-03-15 02:24:01] Testing on 5000 data points...
[2021-03-15 02:24:01] Test accuracy: 0.9248
[2021-03-15 02:24:01] Score for 150 labels: 0.9248
[2021-03-15 02:24:01] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:24:01] Found 4850 unlabelled features.
[2021-03-15 02:24:01] Training GMM (k=32) on labelled features...
[2021-03-15 02:24:01] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:24:02] Scoring random batches...
[2021-03-15 02:24:02] Showing labelled: True (170/5000 visible)
[2021-03-15 02:24:02] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:24:03] Training loss: 0.0987
[2021-03-15 02:24:03] Testing on 5000 data points...
[2021-03-15 02:24:03] Test accuracy: 0.9846
[2021-03-15 02:24:03] Score for 170 labels: 0.9846
[2021-03-15 02:24:03] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:24:03] Found 4830 unlabelled features.
[2021-03-15 02:24:03] Training GMM (k=32) on labelled features...
[2021-03-15 02:24:03] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:24:03] Scoring random batches...
[2021-03-15 02:24:03] Showing labelled: True (190/5000 visible)
[2021-03-15 02:24:03] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:24:04] Training loss: 0.0650
[2021-03-15 02:24:04] Testing on 5000 data points...
[2021-03-15 02:24:04] Test accuracy: 0.9892
[2021-03-15 02:24:04] Score for 190 labels: 0.9892
[2021-03-15 02:24:04] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:24:04] Found 4810 unlabelled features.
[2021-03-15 02:24:05] Training GMM (k=32) on labelled features...
[2021-03-15 02:24:05] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:24:05] Scoring random batches...
[2021-03-15 02:24:05] Showing labelled: True (210/5000 visible)
[2021-03-15 02:24:05] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:24:06] Training loss: 0.0439
[2021-03-15 02:24:06] Testing on 5000 data points...
[2021-03-15 02:24:07] Test accuracy: 0.9926
[2021-03-15 02:24:07] Score for 210 labels: 0.9926
[2021-03-15 02:24:07] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:24:07] Found 4790 unlabelled features.
[2021-03-15 02:24:07] Training GMM (k=32) on labelled features...
[2021-03-15 02:24:07] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:24:07] Scoring random batches...
[2021-03-15 02:24:07] Showing labelled: True (230/5000 visible)
[2021-03-15 02:24:07] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:24:09] Training loss: 0.0320
[2021-03-15 02:24:09] Testing on 5000 data points...
[2021-03-15 02:24:09] Test accuracy: 0.9944
[2021-03-15 02:24:09] Score for 230 labels: 0.9944
[2021-03-15 02:24:09] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:24:09] Found 4770 unlabelled features.
[2021-03-15 02:24:09] Training GMM (k=32) on labelled features...
[2021-03-15 02:24:09] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:24:09] Scoring random batches...
[2021-03-15 02:24:09] Showing labelled: True (250/5000 visible)
[2021-03-15 02:24:09] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:24:11] Training loss: 0.0243
[2021-03-15 02:24:11] Testing on 5000 data points...
[2021-03-15 02:24:11] Test accuracy: 0.9944
[2021-03-15 02:24:11] Score for 250 labels: 0.9944
[2021-03-15 02:24:11] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:24:11] Found 4750 unlabelled features.
[2021-03-15 02:24:11] Training GMM (k=32) on labelled features...
[2021-03-15 02:24:11] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:24:11] Scoring random batches...
[2021-03-15 02:24:11] Showing labelled: True (270/5000 visible)
[2021-03-15 02:24:11] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:24:13] Training loss: 0.0194
[2021-03-15 02:24:13] Testing on 5000 data points...
[2021-03-15 02:24:13] Test accuracy: 0.9960
[2021-03-15 02:24:13] Score for 270 labels: 0.9960
[2021-03-15 02:24:13] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:24:13] Found 4730 unlabelled features.
[2021-03-15 02:24:13] Training GMM (k=32) on labelled features...
[2021-03-15 02:24:14] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:24:14] Scoring random batches...
[2021-03-15 02:24:14] Showing labelled: True (290/5000 visible)
[2021-03-15 02:24:14] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:24:16] Training loss: 0.0155
[2021-03-15 02:24:16] Testing on 5000 data points...
[2021-03-15 02:24:16] Test accuracy: 0.9964
[2021-03-15 02:24:16] Score for 290 labels: 0.9964
[2021-03-15 02:24:16] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:24:16] Found 4710 unlabelled features.
[2021-03-15 02:24:16] Training GMM (k=32) on labelled features...
[2021-03-15 02:24:16] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:24:17] Scoring random batches...
[2021-03-15 02:24:17] Showing labelled: True (310/5000 visible)
[2021-03-15 02:24:17] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:24:19] Training loss: 0.0131
[2021-03-15 02:24:19] Testing on 5000 data points...
[2021-03-15 02:24:19] Test accuracy: 0.9972
[2021-03-15 02:24:19] Score for 310 labels: 0.9972
[2021-03-15 02:24:19] Experiment repeat 8/10
[2021-03-15 02:24:19] Randomly labelled 50/5000
[2021-03-15 02:24:19] Showing labelled: True (50/5000 visible)
[2021-03-15 02:24:19] Running: experiment 0
[2021-03-15 02:24:19] Showing labelled: True (50/5000 visible)
[2021-03-15 02:24:19] mlp: initialized 1482 parameters.
[2021-03-15 02:24:19] Creating trainer with model on device: cuda
[2021-03-15 02:24:19] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:24:19] Training loss: 1.2319
[2021-03-15 02:24:19] Testing on 5000 data points...
[2021-03-15 02:24:19] Test accuracy: 0.4972
[2021-03-15 02:24:19] Score for 50 labels: 0.4972
[2021-03-15 02:24:19] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:24:19] Found 4950 unlabelled features.
[2021-03-15 02:24:19] Searching core-set greedily...
[2021-03-15 02:24:21] Showing labelled: True (70/5000 visible)
[2021-03-15 02:24:21] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:24:22] Training loss: 0.7259
[2021-03-15 02:24:22] Testing on 5000 data points...
[2021-03-15 02:24:22] Test accuracy: 0.8000
[2021-03-15 02:24:22] Score for 70 labels: 0.8000
[2021-03-15 02:24:22] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:24:22] Found 4930 unlabelled features.
[2021-03-15 02:24:22] Searching core-set greedily...
[2021-03-15 02:24:24] Showing labelled: True (90/5000 visible)
[2021-03-15 02:24:24] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:24:25] Training loss: 0.3644
[2021-03-15 02:24:25] Testing on 5000 data points...
[2021-03-15 02:24:25] Test accuracy: 0.8986
[2021-03-15 02:24:25] Score for 90 labels: 0.8986
[2021-03-15 02:24:25] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:24:25] Found 4910 unlabelled features.
[2021-03-15 02:24:25] Searching core-set greedily...
[2021-03-15 02:24:27] Showing labelled: True (110/5000 visible)
[2021-03-15 02:24:27] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:24:28] Training loss: 0.2522
[2021-03-15 02:24:28] Testing on 5000 data points...
[2021-03-15 02:24:28] Test accuracy: 0.9690
[2021-03-15 02:24:28] Score for 110 labels: 0.9690
[2021-03-15 02:24:28] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:24:28] Found 4890 unlabelled features.
[2021-03-15 02:24:28] Searching core-set greedily...
[2021-03-15 02:24:31] Showing labelled: True (130/5000 visible)
[2021-03-15 02:24:31] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:24:32] Training loss: 0.1613
[2021-03-15 02:24:32] Testing on 5000 data points...
[2021-03-15 02:24:32] Test accuracy: 0.9944
[2021-03-15 02:24:32] Score for 130 labels: 0.9944
[2021-03-15 02:24:32] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:24:32] Found 4870 unlabelled features.
[2021-03-15 02:24:32] Searching core-set greedily...
[2021-03-15 02:24:34] Showing labelled: True (150/5000 visible)
[2021-03-15 02:24:34] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:24:35] Training loss: 0.1147
[2021-03-15 02:24:35] Testing on 5000 data points...
[2021-03-15 02:24:35] Test accuracy: 0.9976
[2021-03-15 02:24:35] Score for 150 labels: 0.9976
[2021-03-15 02:24:35] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:24:35] Found 4850 unlabelled features.
[2021-03-15 02:24:35] Searching core-set greedily...
[2021-03-15 02:24:39] Showing labelled: True (170/5000 visible)
[2021-03-15 02:24:39] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:24:40] Training loss: 0.0838
[2021-03-15 02:24:40] Testing on 5000 data points...
[2021-03-15 02:24:40] Test accuracy: 0.9986
[2021-03-15 02:24:40] Score for 170 labels: 0.9986
[2021-03-15 02:24:40] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:24:40] Found 4830 unlabelled features.
[2021-03-15 02:24:40] Searching core-set greedily...
[2021-03-15 02:24:43] Showing labelled: True (190/5000 visible)
[2021-03-15 02:24:43] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:24:45] Training loss: 0.0635
[2021-03-15 02:24:45] Testing on 5000 data points...
[2021-03-15 02:24:45] Test accuracy: 0.9980
[2021-03-15 02:24:45] Score for 190 labels: 0.9980
[2021-03-15 02:24:45] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:24:45] Found 4810 unlabelled features.
[2021-03-15 02:24:45] Searching core-set greedily...
[2021-03-15 02:24:48] Showing labelled: True (210/5000 visible)
[2021-03-15 02:24:48] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:24:50] Training loss: 0.0529
[2021-03-15 02:24:50] Testing on 5000 data points...
[2021-03-15 02:24:50] Test accuracy: 0.9978
[2021-03-15 02:24:50] Score for 210 labels: 0.9978
[2021-03-15 02:24:50] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:24:50] Found 4790 unlabelled features.
[2021-03-15 02:24:50] Searching core-set greedily...
[2021-03-15 02:24:53] Showing labelled: True (230/5000 visible)
[2021-03-15 02:24:53] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:24:55] Training loss: 0.0417
[2021-03-15 02:24:55] Testing on 5000 data points...
[2021-03-15 02:24:55] Test accuracy: 0.9986
[2021-03-15 02:24:55] Score for 230 labels: 0.9986
[2021-03-15 02:24:55] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:24:55] Found 4770 unlabelled features.
[2021-03-15 02:24:55] Searching core-set greedily...
[2021-03-15 02:24:58] Showing labelled: True (250/5000 visible)
[2021-03-15 02:24:58] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:25:00] Training loss: 0.0342
[2021-03-15 02:25:00] Testing on 5000 data points...
[2021-03-15 02:25:00] Test accuracy: 0.9984
[2021-03-15 02:25:00] Score for 250 labels: 0.9984
[2021-03-15 02:25:00] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:25:00] Found 4750 unlabelled features.
[2021-03-15 02:25:00] Searching core-set greedily...
[2021-03-15 02:25:04] Showing labelled: True (270/5000 visible)
[2021-03-15 02:25:04] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:25:06] Training loss: 0.0278
[2021-03-15 02:25:06] Testing on 5000 data points...
[2021-03-15 02:25:06] Test accuracy: 0.9986
[2021-03-15 02:25:06] Score for 270 labels: 0.9986
[2021-03-15 02:25:06] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:25:06] Found 4730 unlabelled features.
[2021-03-15 02:25:06] Searching core-set greedily...
[2021-03-15 02:25:11] Showing labelled: True (290/5000 visible)
[2021-03-15 02:25:11] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:25:13] Training loss: 0.0252
[2021-03-15 02:25:13] Testing on 5000 data points...
[2021-03-15 02:25:13] Test accuracy: 0.9988
[2021-03-15 02:25:13] Score for 290 labels: 0.9988
[2021-03-15 02:25:13] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:25:13] Found 4710 unlabelled features.
[2021-03-15 02:25:13] Searching core-set greedily...
[2021-03-15 02:25:17] Showing labelled: True (310/5000 visible)
[2021-03-15 02:25:17] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:25:19] Training loss: 0.0205
[2021-03-15 02:25:19] Testing on 5000 data points...
[2021-03-15 02:25:19] Test accuracy: 0.9988
[2021-03-15 02:25:19] Score for 310 labels: 0.9988
[2021-03-15 02:25:19] Running: experiment 1
[2021-03-15 02:25:19] Showing labelled: True (50/5000 visible)
[2021-03-15 02:25:19] mlp: initialized 1482 parameters.
[2021-03-15 02:25:19] Creating trainer with model on device: cuda
[2021-03-15 02:25:19] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:25:19] Training loss: 1.1167
[2021-03-15 02:25:19] Testing on 5000 data points...
[2021-03-15 02:25:19] Test accuracy: 0.4548
[2021-03-15 02:25:19] Score for 50 labels: 0.4548
[2021-03-15 02:25:19] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:25:19] Found 4950 unlabelled features.
[2021-03-15 02:25:19] Showing labelled: True (70/5000 visible)
[2021-03-15 02:25:19] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:25:20] Training loss: 0.5212
[2021-03-15 02:25:20] Testing on 5000 data points...
[2021-03-15 02:25:20] Test accuracy: 0.6712
[2021-03-15 02:25:20] Score for 70 labels: 0.6712
[2021-03-15 02:25:20] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:25:20] Found 4930 unlabelled features.
[2021-03-15 02:25:20] Showing labelled: True (90/5000 visible)
[2021-03-15 02:25:20] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:25:21] Training loss: 0.2452
[2021-03-15 02:25:21] Testing on 5000 data points...
[2021-03-15 02:25:21] Test accuracy: 0.7984
[2021-03-15 02:25:21] Score for 90 labels: 0.7984
[2021-03-15 02:25:21] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:25:21] Found 4910 unlabelled features.
[2021-03-15 02:25:21] Showing labelled: True (110/5000 visible)
[2021-03-15 02:25:21] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:25:22] Training loss: 0.1270
[2021-03-15 02:25:22] Testing on 5000 data points...
[2021-03-15 02:25:22] Test accuracy: 0.7988
[2021-03-15 02:25:22] Score for 110 labels: 0.7988
[2021-03-15 02:25:22] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:25:22] Found 4890 unlabelled features.
[2021-03-15 02:25:22] Showing labelled: True (130/5000 visible)
[2021-03-15 02:25:22] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:25:23] Training loss: 0.0798
[2021-03-15 02:25:23] Testing on 5000 data points...
[2021-03-15 02:25:23] Test accuracy: 0.7992
[2021-03-15 02:25:23] Score for 130 labels: 0.7992
[2021-03-15 02:25:23] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:25:23] Found 4870 unlabelled features.
[2021-03-15 02:25:23] Showing labelled: True (150/5000 visible)
[2021-03-15 02:25:23] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:25:24] Training loss: 0.1153
[2021-03-15 02:25:24] Testing on 5000 data points...
[2021-03-15 02:25:24] Test accuracy: 0.7992
[2021-03-15 02:25:24] Score for 150 labels: 0.7992
[2021-03-15 02:25:24] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:25:24] Found 4850 unlabelled features.
[2021-03-15 02:25:24] Showing labelled: True (170/5000 visible)
[2021-03-15 02:25:24] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:25:25] Training loss: 0.0749
[2021-03-15 02:25:25] Testing on 5000 data points...
[2021-03-15 02:25:25] Test accuracy: 0.9082
[2021-03-15 02:25:25] Score for 170 labels: 0.9082
[2021-03-15 02:25:25] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:25:25] Found 4830 unlabelled features.
[2021-03-15 02:25:25] Showing labelled: True (190/5000 visible)
[2021-03-15 02:25:25] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:25:27] Training loss: 0.0519
[2021-03-15 02:25:27] Testing on 5000 data points...
[2021-03-15 02:25:27] Test accuracy: 0.9462
[2021-03-15 02:25:27] Score for 190 labels: 0.9462
[2021-03-15 02:25:27] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:25:27] Found 4810 unlabelled features.
[2021-03-15 02:25:27] Showing labelled: True (210/5000 visible)
[2021-03-15 02:25:27] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:25:28] Training loss: 0.0385
[2021-03-15 02:25:28] Testing on 5000 data points...
[2021-03-15 02:25:28] Test accuracy: 0.9740
[2021-03-15 02:25:28] Score for 210 labels: 0.9740
[2021-03-15 02:25:28] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:25:28] Found 4790 unlabelled features.
[2021-03-15 02:25:28] Showing labelled: True (230/5000 visible)
[2021-03-15 02:25:28] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:25:30] Training loss: 0.0274
[2021-03-15 02:25:30] Testing on 5000 data points...
[2021-03-15 02:25:30] Test accuracy: 0.9904
[2021-03-15 02:25:30] Score for 230 labels: 0.9904
[2021-03-15 02:25:30] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:25:30] Found 4770 unlabelled features.
[2021-03-15 02:25:30] Showing labelled: True (250/5000 visible)
[2021-03-15 02:25:30] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:25:31] Training loss: 0.0211
[2021-03-15 02:25:31] Testing on 5000 data points...
[2021-03-15 02:25:31] Test accuracy: 0.9890
[2021-03-15 02:25:31] Score for 250 labels: 0.9890
[2021-03-15 02:25:31] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:25:31] Found 4750 unlabelled features.
[2021-03-15 02:25:31] Showing labelled: True (270/5000 visible)
[2021-03-15 02:25:31] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:25:33] Training loss: 0.0167
[2021-03-15 02:25:33] Testing on 5000 data points...
[2021-03-15 02:25:33] Test accuracy: 0.9916
[2021-03-15 02:25:33] Score for 270 labels: 0.9916
[2021-03-15 02:25:33] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:25:33] Found 4730 unlabelled features.
[2021-03-15 02:25:33] Showing labelled: True (290/5000 visible)
[2021-03-15 02:25:33] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:25:35] Training loss: 0.0124
[2021-03-15 02:25:35] Testing on 5000 data points...
[2021-03-15 02:25:35] Test accuracy: 0.9920
[2021-03-15 02:25:35] Score for 290 labels: 0.9920
[2021-03-15 02:25:35] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:25:35] Found 4710 unlabelled features.
[2021-03-15 02:25:35] Showing labelled: True (310/5000 visible)
[2021-03-15 02:25:35] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:25:37] Training loss: 0.0098
[2021-03-15 02:25:37] Testing on 5000 data points...
[2021-03-15 02:25:37] Test accuracy: 0.9936
[2021-03-15 02:25:37] Score for 310 labels: 0.9936
[2021-03-15 02:25:37] Running: experiment 2
[2021-03-15 02:25:37] Showing labelled: True (50/5000 visible)
[2021-03-15 02:25:37] mlp: initialized 1482 parameters.
[2021-03-15 02:25:37] Creating trainer with model on device: cuda
[2021-03-15 02:25:37] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:25:38] Training loss: 1.2472
[2021-03-15 02:25:38] Testing on 5000 data points...
[2021-03-15 02:25:38] Test accuracy: 0.5000
[2021-03-15 02:25:38] Score for 50 labels: 0.5000
[2021-03-15 02:25:38] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:25:38] Found 4950 unlabelled features.
[2021-03-15 02:25:38] Showing labelled: True (70/5000 visible)
[2021-03-15 02:25:38] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:25:38] Training loss: 0.5993
[2021-03-15 02:25:38] Testing on 5000 data points...
[2021-03-15 02:25:38] Test accuracy: 0.6000
[2021-03-15 02:25:38] Score for 70 labels: 0.6000
[2021-03-15 02:25:38] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:25:38] Found 4930 unlabelled features.
[2021-03-15 02:25:38] Showing labelled: True (90/5000 visible)
[2021-03-15 02:25:38] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:25:39] Training loss: 0.3397
[2021-03-15 02:25:39] Testing on 5000 data points...
[2021-03-15 02:25:39] Test accuracy: 0.7728
[2021-03-15 02:25:39] Score for 90 labels: 0.7728
[2021-03-15 02:25:39] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:25:39] Found 4910 unlabelled features.
[2021-03-15 02:25:39] Showing labelled: True (110/5000 visible)
[2021-03-15 02:25:39] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:25:40] Training loss: 0.1613
[2021-03-15 02:25:40] Testing on 5000 data points...
[2021-03-15 02:25:40] Test accuracy: 0.8984
[2021-03-15 02:25:40] Score for 110 labels: 0.8984
[2021-03-15 02:25:40] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:25:40] Found 4890 unlabelled features.
[2021-03-15 02:25:40] Showing labelled: True (130/5000 visible)
[2021-03-15 02:25:40] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:25:41] Training loss: 0.1454
[2021-03-15 02:25:41] Testing on 5000 data points...
[2021-03-15 02:25:41] Test accuracy: 0.9028
[2021-03-15 02:25:41] Score for 130 labels: 0.9028
[2021-03-15 02:25:41] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:25:41] Found 4870 unlabelled features.
[2021-03-15 02:25:41] Showing labelled: True (150/5000 visible)
[2021-03-15 02:25:41] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:25:42] Training loss: 0.1298
[2021-03-15 02:25:42] Testing on 5000 data points...
[2021-03-15 02:25:42] Test accuracy: 0.9906
[2021-03-15 02:25:42] Score for 150 labels: 0.9906
[2021-03-15 02:25:42] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:25:42] Found 4850 unlabelled features.
[2021-03-15 02:25:42] Showing labelled: True (170/5000 visible)
[2021-03-15 02:25:42] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:25:44] Training loss: 0.1110
[2021-03-15 02:25:44] Testing on 5000 data points...
[2021-03-15 02:25:44] Test accuracy: 0.9966
[2021-03-15 02:25:44] Score for 170 labels: 0.9966
[2021-03-15 02:25:44] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:25:44] Found 4830 unlabelled features.
[2021-03-15 02:25:44] Showing labelled: True (190/5000 visible)
[2021-03-15 02:25:44] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:25:45] Training loss: 0.1119
[2021-03-15 02:25:45] Testing on 5000 data points...
[2021-03-15 02:25:45] Test accuracy: 0.9984
[2021-03-15 02:25:45] Score for 190 labels: 0.9984
[2021-03-15 02:25:45] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:25:45] Found 4810 unlabelled features.
[2021-03-15 02:25:45] Showing labelled: True (210/5000 visible)
[2021-03-15 02:25:45] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:25:46] Training loss: 0.1049
[2021-03-15 02:25:46] Testing on 5000 data points...
[2021-03-15 02:25:46] Test accuracy: 0.9960
[2021-03-15 02:25:46] Score for 210 labels: 0.9960
[2021-03-15 02:25:46] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:25:46] Found 4790 unlabelled features.
[2021-03-15 02:25:46] Showing labelled: True (230/5000 visible)
[2021-03-15 02:25:46] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:25:48] Training loss: 0.0905
[2021-03-15 02:25:48] Testing on 5000 data points...
[2021-03-15 02:25:48] Test accuracy: 0.9986
[2021-03-15 02:25:48] Score for 230 labels: 0.9986
[2021-03-15 02:25:48] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:25:48] Found 4770 unlabelled features.
[2021-03-15 02:25:48] Showing labelled: True (250/5000 visible)
[2021-03-15 02:25:48] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:25:50] Training loss: 0.0685
[2021-03-15 02:25:50] Testing on 5000 data points...
[2021-03-15 02:25:50] Test accuracy: 0.9978
[2021-03-15 02:25:50] Score for 250 labels: 0.9978
[2021-03-15 02:25:50] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:25:50] Found 4750 unlabelled features.
[2021-03-15 02:25:50] Showing labelled: True (270/5000 visible)
[2021-03-15 02:25:50] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:25:51] Training loss: 0.0497
[2021-03-15 02:25:51] Testing on 5000 data points...
[2021-03-15 02:25:51] Test accuracy: 0.9970
[2021-03-15 02:25:51] Score for 270 labels: 0.9970
[2021-03-15 02:25:51] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:25:51] Found 4730 unlabelled features.
[2021-03-15 02:25:51] Showing labelled: True (290/5000 visible)
[2021-03-15 02:25:51] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:25:53] Training loss: 0.0368
[2021-03-15 02:25:53] Testing on 5000 data points...
[2021-03-15 02:25:53] Test accuracy: 0.9984
[2021-03-15 02:25:53] Score for 290 labels: 0.9984
[2021-03-15 02:25:53] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:25:53] Found 4710 unlabelled features.
[2021-03-15 02:25:53] Showing labelled: True (310/5000 visible)
[2021-03-15 02:25:53] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:25:55] Training loss: 0.0288
[2021-03-15 02:25:55] Testing on 5000 data points...
[2021-03-15 02:25:55] Test accuracy: 0.9986
[2021-03-15 02:25:55] Score for 310 labels: 0.9986
[2021-03-15 02:25:55] Running: experiment 3
[2021-03-15 02:25:55] Showing labelled: True (50/5000 visible)
[2021-03-15 02:25:55] mlp: initialized 1482 parameters.
[2021-03-15 02:25:55] Creating trainer with model on device: cuda
[2021-03-15 02:25:55] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:25:56] Training loss: 1.1458
[2021-03-15 02:25:56] Testing on 5000 data points...
[2021-03-15 02:25:56] Test accuracy: 0.5720
[2021-03-15 02:25:56] Score for 50 labels: 0.5720
[2021-03-15 02:25:56] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:25:56] Found 4950 unlabelled features.
[2021-03-15 02:25:56] Showing labelled: True (70/5000 visible)
[2021-03-15 02:25:56] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:25:56] Training loss: 0.5089
[2021-03-15 02:25:56] Testing on 5000 data points...
[2021-03-15 02:25:57] Test accuracy: 0.6112
[2021-03-15 02:25:57] Score for 70 labels: 0.6112
[2021-03-15 02:25:57] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:25:57] Found 4930 unlabelled features.
[2021-03-15 02:25:57] Showing labelled: True (90/5000 visible)
[2021-03-15 02:25:57] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:25:57] Training loss: 0.2301
[2021-03-15 02:25:57] Testing on 5000 data points...
[2021-03-15 02:25:57] Test accuracy: 0.7922
[2021-03-15 02:25:57] Score for 90 labels: 0.7922
[2021-03-15 02:25:57] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:25:57] Found 4910 unlabelled features.
[2021-03-15 02:25:57] Showing labelled: True (110/5000 visible)
[2021-03-15 02:25:57] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:25:58] Training loss: 0.2165
[2021-03-15 02:25:58] Testing on 5000 data points...
[2021-03-15 02:25:58] Test accuracy: 0.9770
[2021-03-15 02:25:58] Score for 110 labels: 0.9770
[2021-03-15 02:25:58] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:25:58] Found 4890 unlabelled features.
[2021-03-15 02:25:58] Showing labelled: True (130/5000 visible)
[2021-03-15 02:25:58] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:25:59] Training loss: 0.1072
[2021-03-15 02:25:59] Testing on 5000 data points...
[2021-03-15 02:25:59] Test accuracy: 0.9958
[2021-03-15 02:25:59] Score for 130 labels: 0.9958
[2021-03-15 02:25:59] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:25:59] Found 4870 unlabelled features.
[2021-03-15 02:25:59] Showing labelled: True (150/5000 visible)
[2021-03-15 02:25:59] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:26:00] Training loss: 0.0915
[2021-03-15 02:26:00] Testing on 5000 data points...
[2021-03-15 02:26:00] Test accuracy: 0.9946
[2021-03-15 02:26:00] Score for 150 labels: 0.9946
[2021-03-15 02:26:00] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:26:00] Found 4850 unlabelled features.
[2021-03-15 02:26:01] Showing labelled: True (170/5000 visible)
[2021-03-15 02:26:01] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:26:02] Training loss: 0.0872
[2021-03-15 02:26:02] Testing on 5000 data points...
[2021-03-15 02:26:02] Test accuracy: 0.9970
[2021-03-15 02:26:02] Score for 170 labels: 0.9970
[2021-03-15 02:26:02] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:26:02] Found 4830 unlabelled features.
[2021-03-15 02:26:02] Showing labelled: True (190/5000 visible)
[2021-03-15 02:26:02] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:26:03] Training loss: 0.0879
[2021-03-15 02:26:03] Testing on 5000 data points...
[2021-03-15 02:26:03] Test accuracy: 0.9986
[2021-03-15 02:26:03] Score for 190 labels: 0.9986
[2021-03-15 02:26:03] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:26:03] Found 4810 unlabelled features.
[2021-03-15 02:26:03] Showing labelled: True (210/5000 visible)
[2021-03-15 02:26:03] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:26:05] Training loss: 0.0809
[2021-03-15 02:26:05] Testing on 5000 data points...
[2021-03-15 02:26:05] Test accuracy: 0.9984
[2021-03-15 02:26:05] Score for 210 labels: 0.9984
[2021-03-15 02:26:05] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:26:05] Found 4790 unlabelled features.
[2021-03-15 02:26:05] Showing labelled: True (230/5000 visible)
[2021-03-15 02:26:05] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:26:06] Training loss: 0.0695
[2021-03-15 02:26:06] Testing on 5000 data points...
[2021-03-15 02:26:06] Test accuracy: 0.9978
[2021-03-15 02:26:06] Score for 230 labels: 0.9978
[2021-03-15 02:26:06] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:26:06] Found 4770 unlabelled features.
[2021-03-15 02:26:06] Showing labelled: True (250/5000 visible)
[2021-03-15 02:26:06] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:26:08] Training loss: 0.0521
[2021-03-15 02:26:08] Testing on 5000 data points...
[2021-03-15 02:26:08] Test accuracy: 0.9982
[2021-03-15 02:26:08] Score for 250 labels: 0.9982
[2021-03-15 02:26:08] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:26:08] Found 4750 unlabelled features.
[2021-03-15 02:26:08] Showing labelled: True (270/5000 visible)
[2021-03-15 02:26:08] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:26:10] Training loss: 0.0398
[2021-03-15 02:26:10] Testing on 5000 data points...
[2021-03-15 02:26:10] Test accuracy: 0.9986
[2021-03-15 02:26:10] Score for 270 labels: 0.9986
[2021-03-15 02:26:10] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:26:10] Found 4730 unlabelled features.
[2021-03-15 02:26:10] Showing labelled: True (290/5000 visible)
[2021-03-15 02:26:10] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:26:12] Training loss: 0.0304
[2021-03-15 02:26:12] Testing on 5000 data points...
[2021-03-15 02:26:12] Test accuracy: 0.9988
[2021-03-15 02:26:12] Score for 290 labels: 0.9988
[2021-03-15 02:26:12] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:26:12] Found 4710 unlabelled features.
[2021-03-15 02:26:12] Showing labelled: True (310/5000 visible)
[2021-03-15 02:26:12] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:26:14] Training loss: 0.0239
[2021-03-15 02:26:14] Testing on 5000 data points...
[2021-03-15 02:26:14] Test accuracy: 0.9980
[2021-03-15 02:26:14] Score for 310 labels: 0.9980
[2021-03-15 02:26:14] Running: experiment 4
[2021-03-15 02:26:14] Showing labelled: True (50/5000 visible)
[2021-03-15 02:26:14] mlp: initialized 1482 parameters.
[2021-03-15 02:26:14] Creating trainer with model on device: cuda
[2021-03-15 02:26:14] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:26:14] Training loss: 1.0921
[2021-03-15 02:26:14] Testing on 5000 data points...
[2021-03-15 02:26:14] Test accuracy: 0.5400
[2021-03-15 02:26:14] Score for 50 labels: 0.5400
[2021-03-15 02:26:14] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:26:14] Found 4950 unlabelled features.
[2021-03-15 02:26:14] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:14] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:15] Scoring random batches...
[2021-03-15 02:26:15] Showing labelled: True (70/5000 visible)
[2021-03-15 02:26:15] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:26:15] Training loss: 0.5179
[2021-03-15 02:26:15] Testing on 5000 data points...
[2021-03-15 02:26:15] Test accuracy: 0.6834
[2021-03-15 02:26:15] Score for 70 labels: 0.6834
[2021-03-15 02:26:15] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:26:15] Found 4930 unlabelled features.
[2021-03-15 02:26:16] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:16] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:16] Scoring random batches...
[2021-03-15 02:26:16] Showing labelled: True (90/5000 visible)
[2021-03-15 02:26:16] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:26:17] Training loss: 0.2300
[2021-03-15 02:26:17] Testing on 5000 data points...
[2021-03-15 02:26:17] Test accuracy: 0.7782
[2021-03-15 02:26:17] Score for 90 labels: 0.7782
[2021-03-15 02:26:17] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:26:17] Found 4910 unlabelled features.
[2021-03-15 02:26:17] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:17] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:17] Scoring random batches...
[2021-03-15 02:26:17] Showing labelled: True (110/5000 visible)
[2021-03-15 02:26:17] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:26:18] Training loss: 0.1634
[2021-03-15 02:26:18] Testing on 5000 data points...
[2021-03-15 02:26:18] Test accuracy: 0.9256
[2021-03-15 02:26:18] Score for 110 labels: 0.9256
[2021-03-15 02:26:18] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:26:18] Found 4890 unlabelled features.
[2021-03-15 02:26:18] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:18] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:18] Scoring random batches...
[2021-03-15 02:26:18] Showing labelled: True (130/5000 visible)
[2021-03-15 02:26:18] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:26:19] Training loss: 0.1068
[2021-03-15 02:26:19] Testing on 5000 data points...
[2021-03-15 02:26:19] Test accuracy: 0.9332
[2021-03-15 02:26:19] Score for 130 labels: 0.9332
[2021-03-15 02:26:19] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:26:19] Found 4870 unlabelled features.
[2021-03-15 02:26:20] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:20] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:20] Scoring random batches...
[2021-03-15 02:26:20] Showing labelled: True (150/5000 visible)
[2021-03-15 02:26:20] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:26:21] Training loss: 0.0738
[2021-03-15 02:26:21] Testing on 5000 data points...
[2021-03-15 02:26:21] Test accuracy: 0.9510
[2021-03-15 02:26:21] Score for 150 labels: 0.9510
[2021-03-15 02:26:21] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:26:21] Found 4850 unlabelled features.
[2021-03-15 02:26:21] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:21] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:21] Scoring random batches...
[2021-03-15 02:26:21] Showing labelled: True (170/5000 visible)
[2021-03-15 02:26:21] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:26:23] Training loss: 0.0564
[2021-03-15 02:26:23] Testing on 5000 data points...
[2021-03-15 02:26:23] Test accuracy: 0.9926
[2021-03-15 02:26:23] Score for 170 labels: 0.9926
[2021-03-15 02:26:23] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:26:23] Found 4830 unlabelled features.
[2021-03-15 02:26:23] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:23] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:23] Scoring random batches...
[2021-03-15 02:26:23] Showing labelled: True (190/5000 visible)
[2021-03-15 02:26:23] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:26:24] Training loss: 0.0349
[2021-03-15 02:26:24] Testing on 5000 data points...
[2021-03-15 02:26:24] Test accuracy: 0.9942
[2021-03-15 02:26:24] Score for 190 labels: 0.9942
[2021-03-15 02:26:24] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:26:24] Found 4810 unlabelled features.
[2021-03-15 02:26:24] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:25] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:25] Scoring random batches...
[2021-03-15 02:26:25] Showing labelled: True (210/5000 visible)
[2021-03-15 02:26:25] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:26:26] Training loss: 0.0236
[2021-03-15 02:26:26] Testing on 5000 data points...
[2021-03-15 02:26:26] Test accuracy: 0.9960
[2021-03-15 02:26:26] Score for 210 labels: 0.9960
[2021-03-15 02:26:26] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:26:26] Found 4790 unlabelled features.
[2021-03-15 02:26:26] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:27] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:27] Scoring random batches...
[2021-03-15 02:26:27] Showing labelled: True (230/5000 visible)
[2021-03-15 02:26:27] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:26:28] Training loss: 0.0170
[2021-03-15 02:26:28] Testing on 5000 data points...
[2021-03-15 02:26:28] Test accuracy: 0.9950
[2021-03-15 02:26:28] Score for 230 labels: 0.9950
[2021-03-15 02:26:28] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:26:28] Found 4770 unlabelled features.
[2021-03-15 02:26:28] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:29] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:29] Scoring random batches...
[2021-03-15 02:26:29] Showing labelled: True (250/5000 visible)
[2021-03-15 02:26:29] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:26:30] Training loss: 0.0128
[2021-03-15 02:26:30] Testing on 5000 data points...
[2021-03-15 02:26:30] Test accuracy: 0.9958
[2021-03-15 02:26:30] Score for 250 labels: 0.9958
[2021-03-15 02:26:30] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:26:30] Found 4750 unlabelled features.
[2021-03-15 02:26:30] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:31] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:31] Scoring random batches...
[2021-03-15 02:26:31] Showing labelled: True (270/5000 visible)
[2021-03-15 02:26:31] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:26:33] Training loss: 0.0111
[2021-03-15 02:26:33] Testing on 5000 data points...
[2021-03-15 02:26:33] Test accuracy: 0.9966
[2021-03-15 02:26:33] Score for 270 labels: 0.9966
[2021-03-15 02:26:33] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:26:33] Found 4730 unlabelled features.
[2021-03-15 02:26:33] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:33] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:33] Scoring random batches...
[2021-03-15 02:26:33] Showing labelled: True (290/5000 visible)
[2021-03-15 02:26:33] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:26:35] Training loss: 0.0089
[2021-03-15 02:26:35] Testing on 5000 data points...
[2021-03-15 02:26:35] Test accuracy: 0.9960
[2021-03-15 02:26:35] Score for 290 labels: 0.9960
[2021-03-15 02:26:35] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:26:35] Found 4710 unlabelled features.
[2021-03-15 02:26:35] Training GMM (k=32) on labelled features...
[2021-03-15 02:26:35] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:26:36] Scoring random batches...
[2021-03-15 02:26:36] Showing labelled: True (310/5000 visible)
[2021-03-15 02:26:36] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:26:38] Training loss: 0.0083
[2021-03-15 02:26:38] Testing on 5000 data points...
[2021-03-15 02:26:38] Test accuracy: 0.9964
[2021-03-15 02:26:38] Score for 310 labels: 0.9964
[2021-03-15 02:26:38] Experiment repeat 9/10
[2021-03-15 02:26:38] Randomly labelled 50/5000
[2021-03-15 02:26:38] Showing labelled: True (50/5000 visible)
[2021-03-15 02:26:38] Running: experiment 0
[2021-03-15 02:26:38] Showing labelled: True (50/5000 visible)
[2021-03-15 02:26:38] mlp: initialized 1482 parameters.
[2021-03-15 02:26:38] Creating trainer with model on device: cuda
[2021-03-15 02:26:38] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:26:38] Training loss: 1.1856
[2021-03-15 02:26:38] Testing on 5000 data points...
[2021-03-15 02:26:38] Test accuracy: 0.4146
[2021-03-15 02:26:38] Score for 50 labels: 0.4146
[2021-03-15 02:26:38] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:26:38] Found 4950 unlabelled features.
[2021-03-15 02:26:38] Searching core-set greedily...
[2021-03-15 02:26:40] Showing labelled: True (70/5000 visible)
[2021-03-15 02:26:40] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:26:40] Training loss: 0.7063
[2021-03-15 02:26:40] Testing on 5000 data points...
[2021-03-15 02:26:41] Test accuracy: 0.8684
[2021-03-15 02:26:41] Score for 70 labels: 0.8684
[2021-03-15 02:26:41] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:26:41] Found 4930 unlabelled features.
[2021-03-15 02:26:41] Searching core-set greedily...
[2021-03-15 02:26:43] Showing labelled: True (90/5000 visible)
[2021-03-15 02:26:43] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:26:44] Training loss: 0.3458
[2021-03-15 02:26:44] Testing on 5000 data points...
[2021-03-15 02:26:44] Test accuracy: 0.9070
[2021-03-15 02:26:44] Score for 90 labels: 0.9070
[2021-03-15 02:26:44] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:26:44] Found 4910 unlabelled features.
[2021-03-15 02:26:44] Searching core-set greedily...
[2021-03-15 02:26:46] Showing labelled: True (110/5000 visible)
[2021-03-15 02:26:46] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:26:47] Training loss: 0.2218
[2021-03-15 02:26:47] Testing on 5000 data points...
[2021-03-15 02:26:47] Test accuracy: 0.9934
[2021-03-15 02:26:47] Score for 110 labels: 0.9934
[2021-03-15 02:26:47] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:26:47] Found 4890 unlabelled features.
[2021-03-15 02:26:47] Searching core-set greedily...
[2021-03-15 02:26:49] Showing labelled: True (130/5000 visible)
[2021-03-15 02:26:49] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:26:50] Training loss: 0.1471
[2021-03-15 02:26:50] Testing on 5000 data points...
[2021-03-15 02:26:50] Test accuracy: 0.9970
[2021-03-15 02:26:50] Score for 130 labels: 0.9970
[2021-03-15 02:26:50] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:26:50] Found 4870 unlabelled features.
[2021-03-15 02:26:50] Searching core-set greedily...
[2021-03-15 02:26:53] Showing labelled: True (150/5000 visible)
[2021-03-15 02:26:53] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:26:54] Training loss: 0.1086
[2021-03-15 02:26:54] Testing on 5000 data points...
[2021-03-15 02:26:54] Test accuracy: 0.9980
[2021-03-15 02:26:54] Score for 150 labels: 0.9980
[2021-03-15 02:26:54] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:26:54] Found 4850 unlabelled features.
[2021-03-15 02:26:54] Searching core-set greedily...
[2021-03-15 02:26:57] Showing labelled: True (170/5000 visible)
[2021-03-15 02:26:57] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:26:59] Training loss: 0.0809
[2021-03-15 02:26:59] Testing on 5000 data points...
[2021-03-15 02:26:59] Test accuracy: 0.9984
[2021-03-15 02:26:59] Score for 170 labels: 0.9984
[2021-03-15 02:26:59] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:26:59] Found 4830 unlabelled features.
[2021-03-15 02:26:59] Searching core-set greedily...
[2021-03-15 02:27:02] Showing labelled: True (190/5000 visible)
[2021-03-15 02:27:02] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:27:03] Training loss: 0.0627
[2021-03-15 02:27:03] Testing on 5000 data points...
[2021-03-15 02:27:03] Test accuracy: 0.9970
[2021-03-15 02:27:03] Score for 190 labels: 0.9970
[2021-03-15 02:27:03] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:27:03] Found 4810 unlabelled features.
[2021-03-15 02:27:03] Searching core-set greedily...
[2021-03-15 02:27:06] Showing labelled: True (210/5000 visible)
[2021-03-15 02:27:06] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:27:08] Training loss: 0.0512
[2021-03-15 02:27:08] Testing on 5000 data points...
[2021-03-15 02:27:08] Test accuracy: 0.9968
[2021-03-15 02:27:08] Score for 210 labels: 0.9968
[2021-03-15 02:27:08] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:27:08] Found 4790 unlabelled features.
[2021-03-15 02:27:08] Searching core-set greedily...
[2021-03-15 02:27:12] Showing labelled: True (230/5000 visible)
[2021-03-15 02:27:12] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:27:13] Training loss: 0.0438
[2021-03-15 02:27:13] Testing on 5000 data points...
[2021-03-15 02:27:13] Test accuracy: 0.9970
[2021-03-15 02:27:13] Score for 230 labels: 0.9970
[2021-03-15 02:27:13] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:27:13] Found 4770 unlabelled features.
[2021-03-15 02:27:13] Searching core-set greedily...
[2021-03-15 02:27:17] Showing labelled: True (250/5000 visible)
[2021-03-15 02:27:17] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:27:18] Training loss: 0.0348
[2021-03-15 02:27:18] Testing on 5000 data points...
[2021-03-15 02:27:18] Test accuracy: 0.9974
[2021-03-15 02:27:18] Score for 250 labels: 0.9974
[2021-03-15 02:27:18] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:27:18] Found 4750 unlabelled features.
[2021-03-15 02:27:18] Searching core-set greedily...
[2021-03-15 02:27:22] Showing labelled: True (270/5000 visible)
[2021-03-15 02:27:22] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:27:24] Training loss: 0.0319
[2021-03-15 02:27:24] Testing on 5000 data points...
[2021-03-15 02:27:24] Test accuracy: 0.9974
[2021-03-15 02:27:24] Score for 270 labels: 0.9974
[2021-03-15 02:27:24] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:27:24] Found 4730 unlabelled features.
[2021-03-15 02:27:24] Searching core-set greedily...
[2021-03-15 02:27:28] Showing labelled: True (290/5000 visible)
[2021-03-15 02:27:28] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:27:29] Training loss: 0.0262
[2021-03-15 02:27:29] Testing on 5000 data points...
[2021-03-15 02:27:29] Test accuracy: 0.9980
[2021-03-15 02:27:29] Score for 290 labels: 0.9980
[2021-03-15 02:27:29] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:27:29] Found 4710 unlabelled features.
[2021-03-15 02:27:29] Searching core-set greedily...
[2021-03-15 02:27:34] Showing labelled: True (310/5000 visible)
[2021-03-15 02:27:34] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:27:36] Training loss: 0.0219
[2021-03-15 02:27:36] Testing on 5000 data points...
[2021-03-15 02:27:36] Test accuracy: 0.9988
[2021-03-15 02:27:36] Score for 310 labels: 0.9988
[2021-03-15 02:27:36] Running: experiment 1
[2021-03-15 02:27:36] Showing labelled: True (50/5000 visible)
[2021-03-15 02:27:36] mlp: initialized 1482 parameters.
[2021-03-15 02:27:36] Creating trainer with model on device: cuda
[2021-03-15 02:27:36] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:27:36] Training loss: 1.3447
[2021-03-15 02:27:36] Testing on 5000 data points...
[2021-03-15 02:27:36] Test accuracy: 0.2998
[2021-03-15 02:27:36] Score for 50 labels: 0.2998
[2021-03-15 02:27:36] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:27:36] Found 4950 unlabelled features.
[2021-03-15 02:27:36] Showing labelled: True (70/5000 visible)
[2021-03-15 02:27:36] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:27:37] Training loss: 0.6491
[2021-03-15 02:27:37] Testing on 5000 data points...
[2021-03-15 02:27:37] Test accuracy: 0.4962
[2021-03-15 02:27:37] Score for 70 labels: 0.4962
[2021-03-15 02:27:37] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:27:37] Found 4930 unlabelled features.
[2021-03-15 02:27:37] Showing labelled: True (90/5000 visible)
[2021-03-15 02:27:37] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:27:38] Training loss: 0.3680
[2021-03-15 02:27:38] Testing on 5000 data points...
[2021-03-15 02:27:38] Test accuracy: 0.6762
[2021-03-15 02:27:38] Score for 90 labels: 0.6762
[2021-03-15 02:27:38] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:27:38] Found 4910 unlabelled features.
[2021-03-15 02:27:38] Showing labelled: True (110/5000 visible)
[2021-03-15 02:27:38] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:27:39] Training loss: 0.2141
[2021-03-15 02:27:39] Testing on 5000 data points...
[2021-03-15 02:27:39] Test accuracy: 0.6960
[2021-03-15 02:27:39] Score for 110 labels: 0.6960
[2021-03-15 02:27:39] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:27:39] Found 4890 unlabelled features.
[2021-03-15 02:27:39] Showing labelled: True (130/5000 visible)
[2021-03-15 02:27:39] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:27:40] Training loss: 0.1466
[2021-03-15 02:27:40] Testing on 5000 data points...
[2021-03-15 02:27:40] Test accuracy: 0.6992
[2021-03-15 02:27:40] Score for 130 labels: 0.6992
[2021-03-15 02:27:40] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:27:40] Found 4870 unlabelled features.
[2021-03-15 02:27:40] Showing labelled: True (150/5000 visible)
[2021-03-15 02:27:40] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:27:41] Training loss: 0.1136
[2021-03-15 02:27:41] Testing on 5000 data points...
[2021-03-15 02:27:41] Test accuracy: 0.7218
[2021-03-15 02:27:41] Score for 150 labels: 0.7218
[2021-03-15 02:27:41] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:27:41] Found 4850 unlabelled features.
[2021-03-15 02:27:41] Showing labelled: True (170/5000 visible)
[2021-03-15 02:27:41] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:27:42] Training loss: 0.0930
[2021-03-15 02:27:42] Testing on 5000 data points...
[2021-03-15 02:27:42] Test accuracy: 0.7816
[2021-03-15 02:27:42] Score for 170 labels: 0.7816
[2021-03-15 02:27:42] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:27:42] Found 4830 unlabelled features.
[2021-03-15 02:27:42] Showing labelled: True (190/5000 visible)
[2021-03-15 02:27:42] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:27:44] Training loss: 0.0654
[2021-03-15 02:27:44] Testing on 5000 data points...
[2021-03-15 02:27:44] Test accuracy: 0.7904
[2021-03-15 02:27:44] Score for 190 labels: 0.7904
[2021-03-15 02:27:44] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:27:44] Found 4810 unlabelled features.
[2021-03-15 02:27:44] Showing labelled: True (210/5000 visible)
[2021-03-15 02:27:44] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:27:45] Training loss: 0.0450
[2021-03-15 02:27:45] Testing on 5000 data points...
[2021-03-15 02:27:45] Test accuracy: 0.7934
[2021-03-15 02:27:45] Score for 210 labels: 0.7934
[2021-03-15 02:27:45] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:27:45] Found 4790 unlabelled features.
[2021-03-15 02:27:45] Showing labelled: True (230/5000 visible)
[2021-03-15 02:27:45] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:27:47] Training loss: 0.0337
[2021-03-15 02:27:47] Testing on 5000 data points...
[2021-03-15 02:27:47] Test accuracy: 0.7940
[2021-03-15 02:27:47] Score for 230 labels: 0.7940
[2021-03-15 02:27:47] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:27:47] Found 4770 unlabelled features.
[2021-03-15 02:27:47] Showing labelled: True (250/5000 visible)
[2021-03-15 02:27:47] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:27:48] Training loss: 0.0354
[2021-03-15 02:27:48] Testing on 5000 data points...
[2021-03-15 02:27:48] Test accuracy: 0.7946
[2021-03-15 02:27:48] Score for 250 labels: 0.7946
[2021-03-15 02:27:48] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:27:48] Found 4750 unlabelled features.
[2021-03-15 02:27:48] Showing labelled: True (270/5000 visible)
[2021-03-15 02:27:48] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:27:50] Training loss: 0.0480
[2021-03-15 02:27:50] Testing on 5000 data points...
[2021-03-15 02:27:50] Test accuracy: 0.9236
[2021-03-15 02:27:50] Score for 270 labels: 0.9236
[2021-03-15 02:27:50] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:27:50] Found 4730 unlabelled features.
[2021-03-15 02:27:50] Showing labelled: True (290/5000 visible)
[2021-03-15 02:27:50] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:27:52] Training loss: 0.0214
[2021-03-15 02:27:52] Testing on 5000 data points...
[2021-03-15 02:27:52] Test accuracy: 0.9924
[2021-03-15 02:27:52] Score for 290 labels: 0.9924
[2021-03-15 02:27:52] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:27:52] Found 4710 unlabelled features.
[2021-03-15 02:27:52] Showing labelled: True (310/5000 visible)
[2021-03-15 02:27:52] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:27:54] Training loss: 0.0141
[2021-03-15 02:27:54] Testing on 5000 data points...
[2021-03-15 02:27:54] Test accuracy: 0.9958
[2021-03-15 02:27:54] Score for 310 labels: 0.9958
[2021-03-15 02:27:54] Running: experiment 2
[2021-03-15 02:27:54] Showing labelled: True (50/5000 visible)
[2021-03-15 02:27:54] mlp: initialized 1482 parameters.
[2021-03-15 02:27:54] Creating trainer with model on device: cuda
[2021-03-15 02:27:54] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:27:55] Training loss: 1.1961
[2021-03-15 02:27:55] Testing on 5000 data points...
[2021-03-15 02:27:55] Test accuracy: 0.3992
[2021-03-15 02:27:55] Score for 50 labels: 0.3992
[2021-03-15 02:27:55] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:27:55] Found 4950 unlabelled features.
[2021-03-15 02:27:55] Showing labelled: True (70/5000 visible)
[2021-03-15 02:27:55] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:27:55] Training loss: 0.6725
[2021-03-15 02:27:55] Testing on 5000 data points...
[2021-03-15 02:27:55] Test accuracy: 0.5000
[2021-03-15 02:27:55] Score for 70 labels: 0.5000
[2021-03-15 02:27:55] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:27:55] Found 4930 unlabelled features.
[2021-03-15 02:27:56] Showing labelled: True (90/5000 visible)
[2021-03-15 02:27:56] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:27:56] Training loss: 0.4278
[2021-03-15 02:27:56] Testing on 5000 data points...
[2021-03-15 02:27:56] Test accuracy: 0.6210
[2021-03-15 02:27:56] Score for 90 labels: 0.6210
[2021-03-15 02:27:56] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:27:56] Found 4910 unlabelled features.
[2021-03-15 02:27:56] Showing labelled: True (110/5000 visible)
[2021-03-15 02:27:56] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:27:57] Training loss: 0.2033
[2021-03-15 02:27:57] Testing on 5000 data points...
[2021-03-15 02:27:57] Test accuracy: 0.7106
[2021-03-15 02:27:57] Score for 110 labels: 0.7106
[2021-03-15 02:27:57] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:27:57] Found 4890 unlabelled features.
[2021-03-15 02:27:57] Showing labelled: True (130/5000 visible)
[2021-03-15 02:27:57] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:27:58] Training loss: 0.1253
[2021-03-15 02:27:58] Testing on 5000 data points...
[2021-03-15 02:27:58] Test accuracy: 0.7960
[2021-03-15 02:27:58] Score for 130 labels: 0.7960
[2021-03-15 02:27:58] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:27:58] Found 4870 unlabelled features.
[2021-03-15 02:27:58] Showing labelled: True (150/5000 visible)
[2021-03-15 02:27:58] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:27:59] Training loss: 0.1259
[2021-03-15 02:27:59] Testing on 5000 data points...
[2021-03-15 02:27:59] Test accuracy: 0.7978
[2021-03-15 02:27:59] Score for 150 labels: 0.7978
[2021-03-15 02:27:59] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:27:59] Found 4850 unlabelled features.
[2021-03-15 02:27:59] Showing labelled: True (170/5000 visible)
[2021-03-15 02:27:59] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:28:01] Training loss: 0.1231
[2021-03-15 02:28:01] Testing on 5000 data points...
[2021-03-15 02:28:01] Test accuracy: 0.7964
[2021-03-15 02:28:01] Score for 170 labels: 0.7964
[2021-03-15 02:28:01] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:28:01] Found 4830 unlabelled features.
[2021-03-15 02:28:01] Showing labelled: True (190/5000 visible)
[2021-03-15 02:28:01] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:28:02] Training loss: 0.1247
[2021-03-15 02:28:02] Testing on 5000 data points...
[2021-03-15 02:28:02] Test accuracy: 0.8982
[2021-03-15 02:28:02] Score for 190 labels: 0.8982
[2021-03-15 02:28:02] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:28:02] Found 4810 unlabelled features.
[2021-03-15 02:28:02] Showing labelled: True (210/5000 visible)
[2021-03-15 02:28:02] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:28:04] Training loss: 0.0897
[2021-03-15 02:28:04] Testing on 5000 data points...
[2021-03-15 02:28:04] Test accuracy: 0.8988
[2021-03-15 02:28:04] Score for 210 labels: 0.8988
[2021-03-15 02:28:04] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:28:04] Found 4790 unlabelled features.
[2021-03-15 02:28:04] Showing labelled: True (230/5000 visible)
[2021-03-15 02:28:04] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:28:05] Training loss: 0.0677
[2021-03-15 02:28:05] Testing on 5000 data points...
[2021-03-15 02:28:05] Test accuracy: 0.8966
[2021-03-15 02:28:05] Score for 230 labels: 0.8966
[2021-03-15 02:28:05] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:28:05] Found 4770 unlabelled features.
[2021-03-15 02:28:05] Showing labelled: True (250/5000 visible)
[2021-03-15 02:28:05] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:28:07] Training loss: 0.0533
[2021-03-15 02:28:07] Testing on 5000 data points...
[2021-03-15 02:28:07] Test accuracy: 0.8984
[2021-03-15 02:28:07] Score for 250 labels: 0.8984
[2021-03-15 02:28:07] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:28:07] Found 4750 unlabelled features.
[2021-03-15 02:28:07] Showing labelled: True (270/5000 visible)
[2021-03-15 02:28:07] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:28:09] Training loss: 0.0537
[2021-03-15 02:28:09] Testing on 5000 data points...
[2021-03-15 02:28:09] Test accuracy: 0.9904
[2021-03-15 02:28:09] Score for 270 labels: 0.9904
[2021-03-15 02:28:09] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:28:09] Found 4730 unlabelled features.
[2021-03-15 02:28:09] Showing labelled: True (290/5000 visible)
[2021-03-15 02:28:09] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:28:10] Training loss: 0.0318
[2021-03-15 02:28:10] Testing on 5000 data points...
[2021-03-15 02:28:11] Test accuracy: 0.9982
[2021-03-15 02:28:11] Score for 290 labels: 0.9982
[2021-03-15 02:28:11] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:28:11] Found 4710 unlabelled features.
[2021-03-15 02:28:11] Showing labelled: True (310/5000 visible)
[2021-03-15 02:28:11] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:28:13] Training loss: 0.0247
[2021-03-15 02:28:13] Testing on 5000 data points...
[2021-03-15 02:28:13] Test accuracy: 0.9986
[2021-03-15 02:28:13] Score for 310 labels: 0.9986
[2021-03-15 02:28:13] Running: experiment 3
[2021-03-15 02:28:13] Showing labelled: True (50/5000 visible)
[2021-03-15 02:28:13] mlp: initialized 1482 parameters.
[2021-03-15 02:28:13] Creating trainer with model on device: cuda
[2021-03-15 02:28:13] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:28:13] Training loss: 1.2645
[2021-03-15 02:28:13] Testing on 5000 data points...
[2021-03-15 02:28:13] Test accuracy: 0.3826
[2021-03-15 02:28:13] Score for 50 labels: 0.3826
[2021-03-15 02:28:13] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:28:13] Found 4950 unlabelled features.
[2021-03-15 02:28:13] Showing labelled: True (70/5000 visible)
[2021-03-15 02:28:13] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:28:14] Training loss: 0.5693
[2021-03-15 02:28:14] Testing on 5000 data points...
[2021-03-15 02:28:14] Test accuracy: 0.5000
[2021-03-15 02:28:14] Score for 70 labels: 0.5000
[2021-03-15 02:28:14] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:28:14] Found 4930 unlabelled features.
[2021-03-15 02:28:14] Showing labelled: True (90/5000 visible)
[2021-03-15 02:28:14] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:28:15] Training loss: 0.2566
[2021-03-15 02:28:15] Testing on 5000 data points...
[2021-03-15 02:28:15] Test accuracy: 0.6194
[2021-03-15 02:28:15] Score for 90 labels: 0.6194
[2021-03-15 02:28:15] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:28:15] Found 4910 unlabelled features.
[2021-03-15 02:28:15] Showing labelled: True (110/5000 visible)
[2021-03-15 02:28:15] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:28:16] Training loss: 0.1563
[2021-03-15 02:28:16] Testing on 5000 data points...
[2021-03-15 02:28:16] Test accuracy: 0.6758
[2021-03-15 02:28:16] Score for 110 labels: 0.6758
[2021-03-15 02:28:16] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:28:16] Found 4890 unlabelled features.
[2021-03-15 02:28:16] Showing labelled: True (130/5000 visible)
[2021-03-15 02:28:16] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:28:17] Training loss: 0.1440
[2021-03-15 02:28:17] Testing on 5000 data points...
[2021-03-15 02:28:17] Test accuracy: 0.7834
[2021-03-15 02:28:17] Score for 130 labels: 0.7834
[2021-03-15 02:28:17] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:28:17] Found 4870 unlabelled features.
[2021-03-15 02:28:17] Showing labelled: True (150/5000 visible)
[2021-03-15 02:28:17] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:28:18] Training loss: 0.0698
[2021-03-15 02:28:18] Testing on 5000 data points...
[2021-03-15 02:28:18] Test accuracy: 0.8892
[2021-03-15 02:28:18] Score for 150 labels: 0.8892
[2021-03-15 02:28:18] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:28:18] Found 4850 unlabelled features.
[2021-03-15 02:28:18] Showing labelled: True (170/5000 visible)
[2021-03-15 02:28:18] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:28:19] Training loss: 0.0451
[2021-03-15 02:28:19] Testing on 5000 data points...
[2021-03-15 02:28:19] Test accuracy: 0.8956
[2021-03-15 02:28:19] Score for 170 labels: 0.8956
[2021-03-15 02:28:19] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:28:19] Found 4830 unlabelled features.
[2021-03-15 02:28:19] Showing labelled: True (190/5000 visible)
[2021-03-15 02:28:19] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:28:20] Training loss: 0.0553
[2021-03-15 02:28:20] Testing on 5000 data points...
[2021-03-15 02:28:21] Test accuracy: 0.8978
[2021-03-15 02:28:21] Score for 190 labels: 0.8978
[2021-03-15 02:28:21] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:28:21] Found 4810 unlabelled features.
[2021-03-15 02:28:21] Showing labelled: True (210/5000 visible)
[2021-03-15 02:28:21] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:28:22] Training loss: 0.0720
[2021-03-15 02:28:22] Testing on 5000 data points...
[2021-03-15 02:28:22] Test accuracy: 0.8972
[2021-03-15 02:28:22] Score for 210 labels: 0.8972
[2021-03-15 02:28:22] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:28:22] Found 4790 unlabelled features.
[2021-03-15 02:28:22] Showing labelled: True (230/5000 visible)
[2021-03-15 02:28:22] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:28:24] Training loss: 0.0700
[2021-03-15 02:28:24] Testing on 5000 data points...
[2021-03-15 02:28:24] Test accuracy: 0.8984
[2021-03-15 02:28:24] Score for 230 labels: 0.8984
[2021-03-15 02:28:24] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:28:24] Found 4770 unlabelled features.
[2021-03-15 02:28:24] Showing labelled: True (250/5000 visible)
[2021-03-15 02:28:24] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:28:25] Training loss: 0.0612
[2021-03-15 02:28:25] Testing on 5000 data points...
[2021-03-15 02:28:25] Test accuracy: 0.8972
[2021-03-15 02:28:25] Score for 250 labels: 0.8972
[2021-03-15 02:28:25] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:28:25] Found 4750 unlabelled features.
[2021-03-15 02:28:25] Showing labelled: True (270/5000 visible)
[2021-03-15 02:28:25] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:28:27] Training loss: 0.0941
[2021-03-15 02:28:27] Testing on 5000 data points...
[2021-03-15 02:28:27] Test accuracy: 0.9984
[2021-03-15 02:28:27] Score for 270 labels: 0.9984
[2021-03-15 02:28:27] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:28:27] Found 4730 unlabelled features.
[2021-03-15 02:28:27] Showing labelled: True (290/5000 visible)
[2021-03-15 02:28:27] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:28:29] Training loss: 0.0400
[2021-03-15 02:28:29] Testing on 5000 data points...
[2021-03-15 02:28:29] Test accuracy: 0.9988
[2021-03-15 02:28:29] Score for 290 labels: 0.9988
[2021-03-15 02:28:29] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:28:29] Found 4710 unlabelled features.
[2021-03-15 02:28:29] Showing labelled: True (310/5000 visible)
[2021-03-15 02:28:29] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:28:31] Training loss: 0.0308
[2021-03-15 02:28:31] Testing on 5000 data points...
[2021-03-15 02:28:31] Test accuracy: 0.9986
[2021-03-15 02:28:31] Score for 310 labels: 0.9986
[2021-03-15 02:28:31] Running: experiment 4
[2021-03-15 02:28:31] Showing labelled: True (50/5000 visible)
[2021-03-15 02:28:31] mlp: initialized 1482 parameters.
[2021-03-15 02:28:31] Creating trainer with model on device: cuda
[2021-03-15 02:28:31] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:28:32] Training loss: 1.2103
[2021-03-15 02:28:32] Testing on 5000 data points...
[2021-03-15 02:28:32] Test accuracy: 0.4000
[2021-03-15 02:28:32] Score for 50 labels: 0.4000
[2021-03-15 02:28:32] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:28:32] Found 4950 unlabelled features.
[2021-03-15 02:28:32] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:32] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:32] Scoring random batches...
[2021-03-15 02:28:32] Showing labelled: True (70/5000 visible)
[2021-03-15 02:28:32] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:28:33] Training loss: 0.4970
[2021-03-15 02:28:33] Testing on 5000 data points...
[2021-03-15 02:28:33] Test accuracy: 0.5304
[2021-03-15 02:28:33] Score for 70 labels: 0.5304
[2021-03-15 02:28:33] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:28:33] Found 4930 unlabelled features.
[2021-03-15 02:28:33] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:33] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:33] Scoring random batches...
[2021-03-15 02:28:33] Showing labelled: True (90/5000 visible)
[2021-03-15 02:28:33] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:28:34] Training loss: 0.2497
[2021-03-15 02:28:34] Testing on 5000 data points...
[2021-03-15 02:28:34] Test accuracy: 0.5982
[2021-03-15 02:28:34] Score for 90 labels: 0.5982
[2021-03-15 02:28:34] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:28:34] Found 4910 unlabelled features.
[2021-03-15 02:28:34] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:34] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:35] Scoring random batches...
[2021-03-15 02:28:35] Showing labelled: True (110/5000 visible)
[2021-03-15 02:28:35] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:28:36] Training loss: 0.2598
[2021-03-15 02:28:36] Testing on 5000 data points...
[2021-03-15 02:28:36] Test accuracy: 0.5998
[2021-03-15 02:28:36] Score for 110 labels: 0.5998
[2021-03-15 02:28:36] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:28:36] Found 4890 unlabelled features.
[2021-03-15 02:28:36] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:36] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:36] Scoring random batches...
[2021-03-15 02:28:36] Showing labelled: True (130/5000 visible)
[2021-03-15 02:28:36] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:28:37] Training loss: 0.1368
[2021-03-15 02:28:37] Testing on 5000 data points...
[2021-03-15 02:28:37] Test accuracy: 0.7968
[2021-03-15 02:28:37] Score for 130 labels: 0.7968
[2021-03-15 02:28:37] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:28:37] Found 4870 unlabelled features.
[2021-03-15 02:28:37] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:37] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:37] Scoring random batches...
[2021-03-15 02:28:37] Showing labelled: True (150/5000 visible)
[2021-03-15 02:28:37] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:28:38] Training loss: 0.0942
[2021-03-15 02:28:38] Testing on 5000 data points...
[2021-03-15 02:28:39] Test accuracy: 0.8022
[2021-03-15 02:28:39] Score for 150 labels: 0.8022
[2021-03-15 02:28:39] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:28:39] Found 4850 unlabelled features.
[2021-03-15 02:28:39] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:39] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:39] Scoring random batches...
[2021-03-15 02:28:39] Showing labelled: True (170/5000 visible)
[2021-03-15 02:28:39] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:28:40] Training loss: 0.0967
[2021-03-15 02:28:40] Testing on 5000 data points...
[2021-03-15 02:28:40] Test accuracy: 0.9676
[2021-03-15 02:28:40] Score for 170 labels: 0.9676
[2021-03-15 02:28:40] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:28:40] Found 4830 unlabelled features.
[2021-03-15 02:28:40] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:40] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:41] Scoring random batches...
[2021-03-15 02:28:41] Showing labelled: True (190/5000 visible)
[2021-03-15 02:28:41] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:28:42] Training loss: 0.0574
[2021-03-15 02:28:42] Testing on 5000 data points...
[2021-03-15 02:28:42] Test accuracy: 0.9880
[2021-03-15 02:28:42] Score for 190 labels: 0.9880
[2021-03-15 02:28:42] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:28:42] Found 4810 unlabelled features.
[2021-03-15 02:28:42] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:42] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:42] Scoring random batches...
[2021-03-15 02:28:42] Showing labelled: True (210/5000 visible)
[2021-03-15 02:28:42] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:28:44] Training loss: 0.0394
[2021-03-15 02:28:44] Testing on 5000 data points...
[2021-03-15 02:28:44] Test accuracy: 0.9958
[2021-03-15 02:28:44] Score for 210 labels: 0.9958
[2021-03-15 02:28:44] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:28:44] Found 4790 unlabelled features.
[2021-03-15 02:28:44] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:44] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:45] Scoring random batches...
[2021-03-15 02:28:45] Showing labelled: True (230/5000 visible)
[2021-03-15 02:28:45] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:28:46] Training loss: 0.0281
[2021-03-15 02:28:46] Testing on 5000 data points...
[2021-03-15 02:28:46] Test accuracy: 0.9968
[2021-03-15 02:28:46] Score for 230 labels: 0.9968
[2021-03-15 02:28:46] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:28:46] Found 4770 unlabelled features.
[2021-03-15 02:28:46] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:46] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:47] Scoring random batches...
[2021-03-15 02:28:47] Showing labelled: True (250/5000 visible)
[2021-03-15 02:28:47] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:28:48] Training loss: 0.0234
[2021-03-15 02:28:48] Testing on 5000 data points...
[2021-03-15 02:28:48] Test accuracy: 0.9972
[2021-03-15 02:28:48] Score for 250 labels: 0.9972
[2021-03-15 02:28:48] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:28:48] Found 4750 unlabelled features.
[2021-03-15 02:28:48] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:48] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:49] Scoring random batches...
[2021-03-15 02:28:49] Showing labelled: True (270/5000 visible)
[2021-03-15 02:28:49] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:28:50] Training loss: 0.0177
[2021-03-15 02:28:50] Testing on 5000 data points...
[2021-03-15 02:28:51] Test accuracy: 0.9974
[2021-03-15 02:28:51] Score for 270 labels: 0.9974
[2021-03-15 02:28:51] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:28:51] Found 4730 unlabelled features.
[2021-03-15 02:28:51] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:51] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:51] Scoring random batches...
[2021-03-15 02:28:51] Showing labelled: True (290/5000 visible)
[2021-03-15 02:28:51] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:28:53] Training loss: 0.0135
[2021-03-15 02:28:53] Testing on 5000 data points...
[2021-03-15 02:28:53] Test accuracy: 0.9976
[2021-03-15 02:28:53] Score for 290 labels: 0.9976
[2021-03-15 02:28:53] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:28:53] Found 4710 unlabelled features.
[2021-03-15 02:28:53] Training GMM (k=32) on labelled features...
[2021-03-15 02:28:53] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:28:53] Scoring random batches...
[2021-03-15 02:28:53] Showing labelled: True (310/5000 visible)
[2021-03-15 02:28:53] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:28:55] Training loss: 0.0127
[2021-03-15 02:28:55] Testing on 5000 data points...
[2021-03-15 02:28:55] Test accuracy: 0.9972
[2021-03-15 02:28:55] Score for 310 labels: 0.9972
[2021-03-15 02:28:55] Experiment repeat 10/10
[2021-03-15 02:28:55] Randomly labelled 50/5000
[2021-03-15 02:28:55] Showing labelled: True (50/5000 visible)
[2021-03-15 02:28:55] Running: experiment 0
[2021-03-15 02:28:55] Showing labelled: True (50/5000 visible)
[2021-03-15 02:28:55] mlp: initialized 1482 parameters.
[2021-03-15 02:28:55] Creating trainer with model on device: cuda
[2021-03-15 02:28:55] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:28:56] Training loss: 1.1960
[2021-03-15 02:28:56] Testing on 5000 data points...
[2021-03-15 02:28:56] Test accuracy: 0.4000
[2021-03-15 02:28:56] Score for 50 labels: 0.4000
[2021-03-15 02:28:56] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:28:56] Found 4950 unlabelled features.
[2021-03-15 02:28:56] Searching core-set greedily...
[2021-03-15 02:28:58] Showing labelled: True (70/5000 visible)
[2021-03-15 02:28:58] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:28:59] Training loss: 0.6954
[2021-03-15 02:28:59] Testing on 5000 data points...
[2021-03-15 02:28:59] Test accuracy: 0.7296
[2021-03-15 02:28:59] Score for 70 labels: 0.7296
[2021-03-15 02:28:59] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:28:59] Found 4930 unlabelled features.
[2021-03-15 02:28:59] Searching core-set greedily...
[2021-03-15 02:29:01] Showing labelled: True (90/5000 visible)
[2021-03-15 02:29:01] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:29:01] Training loss: 0.4370
[2021-03-15 02:29:01] Testing on 5000 data points...
[2021-03-15 02:29:02] Test accuracy: 0.8958
[2021-03-15 02:29:02] Score for 90 labels: 0.8958
[2021-03-15 02:29:02] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:29:02] Found 4910 unlabelled features.
[2021-03-15 02:29:02] Searching core-set greedily...
[2021-03-15 02:29:04] Showing labelled: True (110/5000 visible)
[2021-03-15 02:29:04] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:29:04] Training loss: 0.2731
[2021-03-15 02:29:04] Testing on 5000 data points...
[2021-03-15 02:29:05] Test accuracy: 0.8980
[2021-03-15 02:29:05] Score for 110 labels: 0.8980
[2021-03-15 02:29:05] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:29:05] Found 4890 unlabelled features.
[2021-03-15 02:29:05] Searching core-set greedily...
[2021-03-15 02:29:07] Showing labelled: True (130/5000 visible)
[2021-03-15 02:29:07] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:29:08] Training loss: 0.1911
[2021-03-15 02:29:08] Testing on 5000 data points...
[2021-03-15 02:29:08] Test accuracy: 0.9930
[2021-03-15 02:29:08] Score for 130 labels: 0.9930
[2021-03-15 02:29:08] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:29:08] Found 4870 unlabelled features.
[2021-03-15 02:29:08] Searching core-set greedily...
[2021-03-15 02:29:10] Showing labelled: True (150/5000 visible)
[2021-03-15 02:29:10] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:29:11] Training loss: 0.1531
[2021-03-15 02:29:11] Testing on 5000 data points...
[2021-03-15 02:29:11] Test accuracy: 0.9956
[2021-03-15 02:29:11] Score for 150 labels: 0.9956
[2021-03-15 02:29:11] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:29:11] Found 4850 unlabelled features.
[2021-03-15 02:29:11] Searching core-set greedily...
[2021-03-15 02:29:15] Showing labelled: True (170/5000 visible)
[2021-03-15 02:29:15] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:29:16] Training loss: 0.1102
[2021-03-15 02:29:16] Testing on 5000 data points...
[2021-03-15 02:29:16] Test accuracy: 0.9986
[2021-03-15 02:29:16] Score for 170 labels: 0.9986
[2021-03-15 02:29:16] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:29:16] Found 4830 unlabelled features.
[2021-03-15 02:29:16] Searching core-set greedily...
[2021-03-15 02:29:19] Showing labelled: True (190/5000 visible)
[2021-03-15 02:29:19] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:29:20] Training loss: 0.0754
[2021-03-15 02:29:20] Testing on 5000 data points...
[2021-03-15 02:29:20] Test accuracy: 0.9980
[2021-03-15 02:29:20] Score for 190 labels: 0.9980
[2021-03-15 02:29:20] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:29:20] Found 4810 unlabelled features.
[2021-03-15 02:29:21] Searching core-set greedily...
[2021-03-15 02:29:24] Showing labelled: True (210/5000 visible)
[2021-03-15 02:29:24] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:29:26] Training loss: 0.0596
[2021-03-15 02:29:26] Testing on 5000 data points...
[2021-03-15 02:29:26] Test accuracy: 0.9964
[2021-03-15 02:29:26] Score for 210 labels: 0.9964
[2021-03-15 02:29:26] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:29:26] Found 4790 unlabelled features.
[2021-03-15 02:29:26] Searching core-set greedily...
[2021-03-15 02:29:30] Showing labelled: True (230/5000 visible)
[2021-03-15 02:29:30] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:29:31] Training loss: 0.0478
[2021-03-15 02:29:31] Testing on 5000 data points...
[2021-03-15 02:29:32] Test accuracy: 0.9980
[2021-03-15 02:29:32] Score for 230 labels: 0.9980
[2021-03-15 02:29:32] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:29:32] Found 4770 unlabelled features.
[2021-03-15 02:29:32] Searching core-set greedily...
[2021-03-15 02:29:35] Showing labelled: True (250/5000 visible)
[2021-03-15 02:29:35] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:29:37] Training loss: 0.0364
[2021-03-15 02:29:37] Testing on 5000 data points...
[2021-03-15 02:29:37] Test accuracy: 0.9980
[2021-03-15 02:29:37] Score for 250 labels: 0.9980
[2021-03-15 02:29:37] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:29:37] Found 4750 unlabelled features.
[2021-03-15 02:29:37] Searching core-set greedily...
[2021-03-15 02:29:41] Showing labelled: True (270/5000 visible)
[2021-03-15 02:29:41] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:29:42] Training loss: 0.0349
[2021-03-15 02:29:42] Testing on 5000 data points...
[2021-03-15 02:29:42] Test accuracy: 0.9980
[2021-03-15 02:29:42] Score for 270 labels: 0.9980
[2021-03-15 02:29:42] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:29:42] Found 4730 unlabelled features.
[2021-03-15 02:29:42] Searching core-set greedily...
[2021-03-15 02:29:47] Showing labelled: True (290/5000 visible)
[2021-03-15 02:29:47] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:29:48] Training loss: 0.0285
[2021-03-15 02:29:48] Testing on 5000 data points...
[2021-03-15 02:29:48] Test accuracy: 0.9984
[2021-03-15 02:29:48] Score for 290 labels: 0.9984
[2021-03-15 02:29:48] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:29:48] Found 4710 unlabelled features.
[2021-03-15 02:29:49] Searching core-set greedily...
[2021-03-15 02:29:53] Showing labelled: True (310/5000 visible)
[2021-03-15 02:29:53] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:29:55] Training loss: 0.0237
[2021-03-15 02:29:55] Testing on 5000 data points...
[2021-03-15 02:29:55] Test accuracy: 0.9980
[2021-03-15 02:29:55] Score for 310 labels: 0.9980
[2021-03-15 02:29:55] Running: experiment 1
[2021-03-15 02:29:55] Showing labelled: True (50/5000 visible)
[2021-03-15 02:29:55] mlp: initialized 1482 parameters.
[2021-03-15 02:29:55] Creating trainer with model on device: cuda
[2021-03-15 02:29:55] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:29:55] Training loss: 1.0310
[2021-03-15 02:29:55] Testing on 5000 data points...
[2021-03-15 02:29:55] Test accuracy: 0.4000
[2021-03-15 02:29:55] Score for 50 labels: 0.4000
[2021-03-15 02:29:55] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:29:55] Found 4950 unlabelled features.
[2021-03-15 02:29:55] Showing labelled: True (70/5000 visible)
[2021-03-15 02:29:55] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:29:56] Training loss: 0.4844
[2021-03-15 02:29:56] Testing on 5000 data points...
[2021-03-15 02:29:56] Test accuracy: 0.5998
[2021-03-15 02:29:56] Score for 70 labels: 0.5998
[2021-03-15 02:29:56] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:29:56] Found 4930 unlabelled features.
[2021-03-15 02:29:56] Showing labelled: True (90/5000 visible)
[2021-03-15 02:29:56] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:29:57] Training loss: 0.3634
[2021-03-15 02:29:57] Testing on 5000 data points...
[2021-03-15 02:29:57] Test accuracy: 0.5994
[2021-03-15 02:29:57] Score for 90 labels: 0.5994
[2021-03-15 02:29:57] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:29:57] Found 4910 unlabelled features.
[2021-03-15 02:29:57] Showing labelled: True (110/5000 visible)
[2021-03-15 02:29:57] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:29:58] Training loss: 0.2228
[2021-03-15 02:29:58] Testing on 5000 data points...
[2021-03-15 02:29:58] Test accuracy: 0.7796
[2021-03-15 02:29:58] Score for 110 labels: 0.7796
[2021-03-15 02:29:58] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:29:58] Found 4890 unlabelled features.
[2021-03-15 02:29:58] Showing labelled: True (130/5000 visible)
[2021-03-15 02:29:58] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:29:59] Training loss: 0.1298
[2021-03-15 02:29:59] Testing on 5000 data points...
[2021-03-15 02:29:59] Test accuracy: 0.7970
[2021-03-15 02:29:59] Score for 130 labels: 0.7970
[2021-03-15 02:29:59] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:29:59] Found 4870 unlabelled features.
[2021-03-15 02:29:59] Showing labelled: True (150/5000 visible)
[2021-03-15 02:29:59] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:30:00] Training loss: 0.1006
[2021-03-15 02:30:00] Testing on 5000 data points...
[2021-03-15 02:30:00] Test accuracy: 0.8104
[2021-03-15 02:30:00] Score for 150 labels: 0.8104
[2021-03-15 02:30:00] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:30:00] Found 4850 unlabelled features.
[2021-03-15 02:30:00] Showing labelled: True (170/5000 visible)
[2021-03-15 02:30:00] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:30:01] Training loss: 0.0732
[2021-03-15 02:30:01] Testing on 5000 data points...
[2021-03-15 02:30:01] Test accuracy: 0.8632
[2021-03-15 02:30:01] Score for 170 labels: 0.8632
[2021-03-15 02:30:01] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:30:01] Found 4830 unlabelled features.
[2021-03-15 02:30:01] Showing labelled: True (190/5000 visible)
[2021-03-15 02:30:01] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:30:03] Training loss: 0.0715
[2021-03-15 02:30:03] Testing on 5000 data points...
[2021-03-15 02:30:03] Test accuracy: 0.9870
[2021-03-15 02:30:03] Score for 190 labels: 0.9870
[2021-03-15 02:30:03] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:30:03] Found 4810 unlabelled features.
[2021-03-15 02:30:03] Showing labelled: True (210/5000 visible)
[2021-03-15 02:30:03] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:30:04] Training loss: 0.0423
[2021-03-15 02:30:04] Testing on 5000 data points...
[2021-03-15 02:30:04] Test accuracy: 0.9930
[2021-03-15 02:30:04] Score for 210 labels: 0.9930
[2021-03-15 02:30:04] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:30:04] Found 4790 unlabelled features.
[2021-03-15 02:30:04] Showing labelled: True (230/5000 visible)
[2021-03-15 02:30:04] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:30:06] Training loss: 0.0314
[2021-03-15 02:30:06] Testing on 5000 data points...
[2021-03-15 02:30:06] Test accuracy: 0.9950
[2021-03-15 02:30:06] Score for 230 labels: 0.9950
[2021-03-15 02:30:06] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:30:06] Found 4770 unlabelled features.
[2021-03-15 02:30:06] Showing labelled: True (250/5000 visible)
[2021-03-15 02:30:06] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:30:07] Training loss: 0.0226
[2021-03-15 02:30:07] Testing on 5000 data points...
[2021-03-15 02:30:07] Test accuracy: 0.9954
[2021-03-15 02:30:07] Score for 250 labels: 0.9954
[2021-03-15 02:30:07] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:30:07] Found 4750 unlabelled features.
[2021-03-15 02:30:07] Showing labelled: True (270/5000 visible)
[2021-03-15 02:30:07] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:30:09] Training loss: 0.0191
[2021-03-15 02:30:09] Testing on 5000 data points...
[2021-03-15 02:30:09] Test accuracy: 0.9960
[2021-03-15 02:30:09] Score for 270 labels: 0.9960
[2021-03-15 02:30:09] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:30:09] Found 4730 unlabelled features.
[2021-03-15 02:30:09] Showing labelled: True (290/5000 visible)
[2021-03-15 02:30:09] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:30:11] Training loss: 0.0144
[2021-03-15 02:30:11] Testing on 5000 data points...
[2021-03-15 02:30:11] Test accuracy: 0.9962
[2021-03-15 02:30:11] Score for 290 labels: 0.9962
[2021-03-15 02:30:11] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:30:11] Found 4710 unlabelled features.
[2021-03-15 02:30:11] Showing labelled: True (310/5000 visible)
[2021-03-15 02:30:11] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:30:13] Training loss: 0.0114
[2021-03-15 02:30:13] Testing on 5000 data points...
[2021-03-15 02:30:13] Test accuracy: 0.9966
[2021-03-15 02:30:13] Score for 310 labels: 0.9966
[2021-03-15 02:30:13] Running: experiment 2
[2021-03-15 02:30:13] Showing labelled: True (50/5000 visible)
[2021-03-15 02:30:13] mlp: initialized 1482 parameters.
[2021-03-15 02:30:13] Creating trainer with model on device: cuda
[2021-03-15 02:30:13] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:30:13] Training loss: 0.9430
[2021-03-15 02:30:13] Testing on 5000 data points...
[2021-03-15 02:30:13] Test accuracy: 0.4000
[2021-03-15 02:30:13] Score for 50 labels: 0.4000
[2021-03-15 02:30:13] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:30:13] Found 4950 unlabelled features.
[2021-03-15 02:30:14] Showing labelled: True (70/5000 visible)
[2021-03-15 02:30:14] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:30:14] Training loss: 0.3758
[2021-03-15 02:30:14] Testing on 5000 data points...
[2021-03-15 02:30:14] Test accuracy: 0.7854
[2021-03-15 02:30:14] Score for 70 labels: 0.7854
[2021-03-15 02:30:14] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:30:14] Found 4930 unlabelled features.
[2021-03-15 02:30:14] Showing labelled: True (90/5000 visible)
[2021-03-15 02:30:14] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:30:15] Training loss: 0.3240
[2021-03-15 02:30:15] Testing on 5000 data points...
[2021-03-15 02:30:15] Test accuracy: 0.7984
[2021-03-15 02:30:15] Score for 90 labels: 0.7984
[2021-03-15 02:30:15] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:30:15] Found 4910 unlabelled features.
[2021-03-15 02:30:15] Showing labelled: True (110/5000 visible)
[2021-03-15 02:30:15] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:30:16] Training loss: 0.2567
[2021-03-15 02:30:16] Testing on 5000 data points...
[2021-03-15 02:30:16] Test accuracy: 0.8996
[2021-03-15 02:30:16] Score for 110 labels: 0.8996
[2021-03-15 02:30:16] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:30:16] Found 4890 unlabelled features.
[2021-03-15 02:30:16] Showing labelled: True (130/5000 visible)
[2021-03-15 02:30:16] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:30:17] Training loss: 0.1893
[2021-03-15 02:30:17] Testing on 5000 data points...
[2021-03-15 02:30:17] Test accuracy: 0.8998
[2021-03-15 02:30:17] Score for 130 labels: 0.8998
[2021-03-15 02:30:17] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:30:17] Found 4870 unlabelled features.
[2021-03-15 02:30:17] Showing labelled: True (150/5000 visible)
[2021-03-15 02:30:17] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:30:18] Training loss: 0.1634
[2021-03-15 02:30:18] Testing on 5000 data points...
[2021-03-15 02:30:18] Test accuracy: 0.9604
[2021-03-15 02:30:18] Score for 150 labels: 0.9604
[2021-03-15 02:30:18] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:30:18] Found 4850 unlabelled features.
[2021-03-15 02:30:18] Showing labelled: True (170/5000 visible)
[2021-03-15 02:30:18] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:30:19] Training loss: 0.1223
[2021-03-15 02:30:19] Testing on 5000 data points...
[2021-03-15 02:30:19] Test accuracy: 0.9974
[2021-03-15 02:30:19] Score for 170 labels: 0.9974
[2021-03-15 02:30:19] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:30:19] Found 4830 unlabelled features.
[2021-03-15 02:30:20] Showing labelled: True (190/5000 visible)
[2021-03-15 02:30:20] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:30:21] Training loss: 0.1095
[2021-03-15 02:30:21] Testing on 5000 data points...
[2021-03-15 02:30:21] Test accuracy: 0.9952
[2021-03-15 02:30:21] Score for 190 labels: 0.9952
[2021-03-15 02:30:21] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:30:21] Found 4810 unlabelled features.
[2021-03-15 02:30:21] Showing labelled: True (210/5000 visible)
[2021-03-15 02:30:21] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:30:22] Training loss: 0.1015
[2021-03-15 02:30:22] Testing on 5000 data points...
[2021-03-15 02:30:22] Test accuracy: 0.9980
[2021-03-15 02:30:22] Score for 210 labels: 0.9980
[2021-03-15 02:30:22] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:30:22] Found 4790 unlabelled features.
[2021-03-15 02:30:22] Showing labelled: True (230/5000 visible)
[2021-03-15 02:30:22] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:30:24] Training loss: 0.0875
[2021-03-15 02:30:24] Testing on 5000 data points...
[2021-03-15 02:30:24] Test accuracy: 0.9972
[2021-03-15 02:30:24] Score for 230 labels: 0.9972
[2021-03-15 02:30:24] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:30:24] Found 4770 unlabelled features.
[2021-03-15 02:30:24] Showing labelled: True (250/5000 visible)
[2021-03-15 02:30:24] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:30:26] Training loss: 0.0682
[2021-03-15 02:30:26] Testing on 5000 data points...
[2021-03-15 02:30:26] Test accuracy: 0.9982
[2021-03-15 02:30:26] Score for 250 labels: 0.9982
[2021-03-15 02:30:26] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:30:26] Found 4750 unlabelled features.
[2021-03-15 02:30:26] Showing labelled: True (270/5000 visible)
[2021-03-15 02:30:26] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:30:27] Training loss: 0.0514
[2021-03-15 02:30:27] Testing on 5000 data points...
[2021-03-15 02:30:27] Test accuracy: 0.9970
[2021-03-15 02:30:27] Score for 270 labels: 0.9970
[2021-03-15 02:30:27] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:30:27] Found 4730 unlabelled features.
[2021-03-15 02:30:28] Showing labelled: True (290/5000 visible)
[2021-03-15 02:30:28] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:30:29] Training loss: 0.0374
[2021-03-15 02:30:29] Testing on 5000 data points...
[2021-03-15 02:30:29] Test accuracy: 0.9988
[2021-03-15 02:30:29] Score for 290 labels: 0.9988
[2021-03-15 02:30:29] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:30:29] Found 4710 unlabelled features.
[2021-03-15 02:30:29] Showing labelled: True (310/5000 visible)
[2021-03-15 02:30:29] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:30:31] Training loss: 0.0290
[2021-03-15 02:30:31] Testing on 5000 data points...
[2021-03-15 02:30:31] Test accuracy: 0.9976
[2021-03-15 02:30:31] Score for 310 labels: 0.9976
[2021-03-15 02:30:31] Running: experiment 3
[2021-03-15 02:30:31] Showing labelled: True (50/5000 visible)
[2021-03-15 02:30:31] mlp: initialized 1482 parameters.
[2021-03-15 02:30:31] Creating trainer with model on device: cuda
[2021-03-15 02:30:31] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:30:32] Training loss: 0.9801
[2021-03-15 02:30:32] Testing on 5000 data points...
[2021-03-15 02:30:32] Test accuracy: 0.4000
[2021-03-15 02:30:32] Score for 50 labels: 0.4000
[2021-03-15 02:30:32] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:30:32] Found 4950 unlabelled features.
[2021-03-15 02:30:32] Showing labelled: True (70/5000 visible)
[2021-03-15 02:30:32] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:30:33] Training loss: 0.3768
[2021-03-15 02:30:33] Testing on 5000 data points...
[2021-03-15 02:30:33] Test accuracy: 0.6270
[2021-03-15 02:30:33] Score for 70 labels: 0.6270
[2021-03-15 02:30:33] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:30:33] Found 4930 unlabelled features.
[2021-03-15 02:30:33] Showing labelled: True (90/5000 visible)
[2021-03-15 02:30:33] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:30:33] Training loss: 0.2755
[2021-03-15 02:30:33] Testing on 5000 data points...
[2021-03-15 02:30:33] Test accuracy: 0.6944
[2021-03-15 02:30:33] Score for 90 labels: 0.6944
[2021-03-15 02:30:33] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:30:33] Found 4910 unlabelled features.
[2021-03-15 02:30:33] Showing labelled: True (110/5000 visible)
[2021-03-15 02:30:33] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:30:34] Training loss: 0.1669
[2021-03-15 02:30:34] Testing on 5000 data points...
[2021-03-15 02:30:34] Test accuracy: 0.7084
[2021-03-15 02:30:34] Score for 110 labels: 0.7084
[2021-03-15 02:30:34] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:30:34] Found 4890 unlabelled features.
[2021-03-15 02:30:34] Showing labelled: True (130/5000 visible)
[2021-03-15 02:30:34] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:30:35] Training loss: 0.1128
[2021-03-15 02:30:35] Testing on 5000 data points...
[2021-03-15 02:30:35] Test accuracy: 0.7918
[2021-03-15 02:30:35] Score for 130 labels: 0.7918
[2021-03-15 02:30:35] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:30:35] Found 4870 unlabelled features.
[2021-03-15 02:30:36] Showing labelled: True (150/5000 visible)
[2021-03-15 02:30:36] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:30:37] Training loss: 0.1440
[2021-03-15 02:30:37] Testing on 5000 data points...
[2021-03-15 02:30:37] Test accuracy: 0.8930
[2021-03-15 02:30:37] Score for 150 labels: 0.8930
[2021-03-15 02:30:37] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:30:37] Found 4850 unlabelled features.
[2021-03-15 02:30:37] Showing labelled: True (170/5000 visible)
[2021-03-15 02:30:37] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:30:38] Training loss: 0.0898
[2021-03-15 02:30:38] Testing on 5000 data points...
[2021-03-15 02:30:38] Test accuracy: 0.8976
[2021-03-15 02:30:38] Score for 170 labels: 0.8976
[2021-03-15 02:30:38] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:30:38] Found 4830 unlabelled features.
[2021-03-15 02:30:38] Showing labelled: True (190/5000 visible)
[2021-03-15 02:30:38] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:30:39] Training loss: 0.0882
[2021-03-15 02:30:39] Testing on 5000 data points...
[2021-03-15 02:30:39] Test accuracy: 0.8962
[2021-03-15 02:30:39] Score for 190 labels: 0.8962
[2021-03-15 02:30:39] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:30:39] Found 4810 unlabelled features.
[2021-03-15 02:30:39] Showing labelled: True (210/5000 visible)
[2021-03-15 02:30:39] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:30:41] Training loss: 0.0891
[2021-03-15 02:30:41] Testing on 5000 data points...
[2021-03-15 02:30:41] Test accuracy: 0.8966
[2021-03-15 02:30:41] Score for 210 labels: 0.8966
[2021-03-15 02:30:41] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:30:41] Found 4790 unlabelled features.
[2021-03-15 02:30:41] Showing labelled: True (230/5000 visible)
[2021-03-15 02:30:41] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:30:43] Training loss: 0.0749
[2021-03-15 02:30:43] Testing on 5000 data points...
[2021-03-15 02:30:43] Test accuracy: 0.8982
[2021-03-15 02:30:43] Score for 230 labels: 0.8982
[2021-03-15 02:30:43] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:30:43] Found 4770 unlabelled features.
[2021-03-15 02:30:43] Showing labelled: True (250/5000 visible)
[2021-03-15 02:30:43] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:30:44] Training loss: 0.0844
[2021-03-15 02:30:44] Testing on 5000 data points...
[2021-03-15 02:30:44] Test accuracy: 0.9988
[2021-03-15 02:30:44] Score for 250 labels: 0.9988
[2021-03-15 02:30:44] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:30:44] Found 4750 unlabelled features.
[2021-03-15 02:30:44] Showing labelled: True (270/5000 visible)
[2021-03-15 02:30:44] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:30:46] Training loss: 0.0440
[2021-03-15 02:30:46] Testing on 5000 data points...
[2021-03-15 02:30:46] Test accuracy: 0.9986
[2021-03-15 02:30:46] Score for 270 labels: 0.9986
[2021-03-15 02:30:46] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:30:46] Found 4730 unlabelled features.
[2021-03-15 02:30:46] Showing labelled: True (290/5000 visible)
[2021-03-15 02:30:46] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:30:48] Training loss: 0.0342
[2021-03-15 02:30:48] Testing on 5000 data points...
[2021-03-15 02:30:48] Test accuracy: 0.9976
[2021-03-15 02:30:48] Score for 290 labels: 0.9976
[2021-03-15 02:30:48] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:30:48] Found 4710 unlabelled features.
[2021-03-15 02:30:48] Showing labelled: True (310/5000 visible)
[2021-03-15 02:30:48] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:30:50] Training loss: 0.0276
[2021-03-15 02:30:50] Testing on 5000 data points...
[2021-03-15 02:30:50] Test accuracy: 0.9974
[2021-03-15 02:30:50] Score for 310 labels: 0.9974
[2021-03-15 02:30:50] Running: experiment 4
[2021-03-15 02:30:50] Showing labelled: True (50/5000 visible)
[2021-03-15 02:30:50] mlp: initialized 1482 parameters.
[2021-03-15 02:30:50] Creating trainer with model on device: cuda
[2021-03-15 02:30:50] Training mlp across 50 data points in blobsthin...
[2021-03-15 02:30:50] Training loss: 1.0164
[2021-03-15 02:30:50] Testing on 5000 data points...
[2021-03-15 02:30:51] Test accuracy: 0.4000
[2021-03-15 02:30:51] Score for 50 labels: 0.4000
[2021-03-15 02:30:51] Showing labelled: False (4950/5000 visible)
[2021-03-15 02:30:51] Found 4950 unlabelled features.
[2021-03-15 02:30:51] Training GMM (k=32) on labelled features...
[2021-03-15 02:30:51] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:30:51] Scoring random batches...
[2021-03-15 02:30:51] Showing labelled: True (70/5000 visible)
[2021-03-15 02:30:51] Training mlp across 70 data points in blobsthin...
[2021-03-15 02:30:52] Training loss: 0.4571
[2021-03-15 02:30:52] Testing on 5000 data points...
[2021-03-15 02:30:52] Test accuracy: 0.6724
[2021-03-15 02:30:52] Score for 70 labels: 0.6724
[2021-03-15 02:30:52] Showing labelled: False (4930/5000 visible)
[2021-03-15 02:30:52] Found 4930 unlabelled features.
[2021-03-15 02:30:52] Training GMM (k=32) on labelled features...
[2021-03-15 02:30:52] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:30:52] Scoring random batches...
[2021-03-15 02:30:52] Showing labelled: True (90/5000 visible)
[2021-03-15 02:30:52] Training mlp across 90 data points in blobsthin...
[2021-03-15 02:30:53] Training loss: 0.3478
[2021-03-15 02:30:53] Testing on 5000 data points...
[2021-03-15 02:30:53] Test accuracy: 0.6978
[2021-03-15 02:30:53] Score for 90 labels: 0.6978
[2021-03-15 02:30:53] Showing labelled: False (4910/5000 visible)
[2021-03-15 02:30:53] Found 4910 unlabelled features.
[2021-03-15 02:30:53] Training GMM (k=32) on labelled features...
[2021-03-15 02:30:53] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:30:53] Scoring random batches...
[2021-03-15 02:30:53] Showing labelled: True (110/5000 visible)
[2021-03-15 02:30:53] Training mlp across 110 data points in blobsthin...
[2021-03-15 02:30:54] Training loss: 0.1915
[2021-03-15 02:30:54] Testing on 5000 data points...
[2021-03-15 02:30:54] Test accuracy: 0.7544
[2021-03-15 02:30:54] Score for 110 labels: 0.7544
[2021-03-15 02:30:54] Showing labelled: False (4890/5000 visible)
[2021-03-15 02:30:54] Found 4890 unlabelled features.
[2021-03-15 02:30:54] Training GMM (k=32) on labelled features...
[2021-03-15 02:30:54] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:30:55] Scoring random batches...
[2021-03-15 02:30:55] Showing labelled: True (130/5000 visible)
[2021-03-15 02:30:55] Training mlp across 130 data points in blobsthin...
[2021-03-15 02:30:56] Training loss: 0.1397
[2021-03-15 02:30:56] Testing on 5000 data points...
[2021-03-15 02:30:56] Test accuracy: 0.7990
[2021-03-15 02:30:56] Score for 130 labels: 0.7990
[2021-03-15 02:30:56] Showing labelled: False (4870/5000 visible)
[2021-03-15 02:30:56] Found 4870 unlabelled features.
[2021-03-15 02:30:56] Training GMM (k=32) on labelled features...
[2021-03-15 02:30:56] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:30:56] Scoring random batches...
[2021-03-15 02:30:56] Showing labelled: True (150/5000 visible)
[2021-03-15 02:30:56] Training mlp across 150 data points in blobsthin...
[2021-03-15 02:30:57] Training loss: 0.1125
[2021-03-15 02:30:57] Testing on 5000 data points...
[2021-03-15 02:30:57] Test accuracy: 0.7992
[2021-03-15 02:30:57] Score for 150 labels: 0.7992
[2021-03-15 02:30:57] Showing labelled: False (4850/5000 visible)
[2021-03-15 02:30:57] Found 4850 unlabelled features.
[2021-03-15 02:30:57] Training GMM (k=32) on labelled features...
[2021-03-15 02:30:57] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:30:58] Scoring random batches...
[2021-03-15 02:30:58] Showing labelled: True (170/5000 visible)
[2021-03-15 02:30:58] Training mlp across 170 data points in blobsthin...
[2021-03-15 02:30:59] Training loss: 0.1077
[2021-03-15 02:30:59] Testing on 5000 data points...
[2021-03-15 02:30:59] Test accuracy: 0.9248
[2021-03-15 02:30:59] Score for 170 labels: 0.9248
[2021-03-15 02:30:59] Showing labelled: False (4830/5000 visible)
[2021-03-15 02:30:59] Found 4830 unlabelled features.
[2021-03-15 02:30:59] Training GMM (k=32) on labelled features...
[2021-03-15 02:30:59] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:31:00] Scoring random batches...
[2021-03-15 02:31:00] Showing labelled: True (190/5000 visible)
[2021-03-15 02:31:00] Training mlp across 190 data points in blobsthin...
[2021-03-15 02:31:01] Training loss: 0.0697
[2021-03-15 02:31:01] Testing on 5000 data points...
[2021-03-15 02:31:01] Test accuracy: 0.9800
[2021-03-15 02:31:01] Score for 190 labels: 0.9800
[2021-03-15 02:31:01] Showing labelled: False (4810/5000 visible)
[2021-03-15 02:31:01] Found 4810 unlabelled features.
[2021-03-15 02:31:01] Training GMM (k=32) on labelled features...
[2021-03-15 02:31:01] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:31:01] Scoring random batches...
[2021-03-15 02:31:01] Showing labelled: True (210/5000 visible)
[2021-03-15 02:31:01] Training mlp across 210 data points in blobsthin...
[2021-03-15 02:31:03] Training loss: 0.0456
[2021-03-15 02:31:03] Testing on 5000 data points...
[2021-03-15 02:31:03] Test accuracy: 0.9930
[2021-03-15 02:31:03] Score for 210 labels: 0.9930
[2021-03-15 02:31:03] Showing labelled: False (4790/5000 visible)
[2021-03-15 02:31:03] Found 4790 unlabelled features.
[2021-03-15 02:31:03] Training GMM (k=32) on labelled features...
[2021-03-15 02:31:03] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:31:04] Scoring random batches...
[2021-03-15 02:31:04] Showing labelled: True (230/5000 visible)
[2021-03-15 02:31:04] Training mlp across 230 data points in blobsthin...
[2021-03-15 02:31:05] Training loss: 0.0322
[2021-03-15 02:31:05] Testing on 5000 data points...
[2021-03-15 02:31:05] Test accuracy: 0.9924
[2021-03-15 02:31:05] Score for 230 labels: 0.9924
[2021-03-15 02:31:05] Showing labelled: False (4770/5000 visible)
[2021-03-15 02:31:05] Found 4770 unlabelled features.
[2021-03-15 02:31:05] Training GMM (k=32) on labelled features...
[2021-03-15 02:31:05] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:31:06] Scoring random batches...
[2021-03-15 02:31:06] Showing labelled: True (250/5000 visible)
[2021-03-15 02:31:06] Training mlp across 250 data points in blobsthin...
[2021-03-15 02:31:07] Training loss: 0.0255
[2021-03-15 02:31:07] Testing on 5000 data points...
[2021-03-15 02:31:07] Test accuracy: 0.9934
[2021-03-15 02:31:07] Score for 250 labels: 0.9934
[2021-03-15 02:31:07] Showing labelled: False (4750/5000 visible)
[2021-03-15 02:31:07] Found 4750 unlabelled features.
[2021-03-15 02:31:07] Training GMM (k=32) on labelled features...
[2021-03-15 02:31:07] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:31:08] Scoring random batches...
[2021-03-15 02:31:08] Showing labelled: True (270/5000 visible)
[2021-03-15 02:31:08] Training mlp across 270 data points in blobsthin...
[2021-03-15 02:31:10] Training loss: 0.0190
[2021-03-15 02:31:10] Testing on 5000 data points...
[2021-03-15 02:31:10] Test accuracy: 0.9946
[2021-03-15 02:31:10] Score for 270 labels: 0.9946
[2021-03-15 02:31:10] Showing labelled: False (4730/5000 visible)
[2021-03-15 02:31:10] Found 4730 unlabelled features.
[2021-03-15 02:31:10] Training GMM (k=32) on labelled features...
[2021-03-15 02:31:10] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:31:10] Scoring random batches...
[2021-03-15 02:31:10] Showing labelled: True (290/5000 visible)
[2021-03-15 02:31:10] Training mlp across 290 data points in blobsthin...
[2021-03-15 02:31:12] Training loss: 0.0146
[2021-03-15 02:31:12] Testing on 5000 data points...
[2021-03-15 02:31:12] Test accuracy: 0.9950
[2021-03-15 02:31:12] Score for 290 labels: 0.9950
[2021-03-15 02:31:12] Showing labelled: False (4710/5000 visible)
[2021-03-15 02:31:12] Found 4710 unlabelled features.
[2021-03-15 02:31:12] Training GMM (k=32) on labelled features...
[2021-03-15 02:31:12] Training GMM (k=32) on unlabelled features...
[2021-03-15 02:31:13] Scoring random batches...
[2021-03-15 02:31:13] Showing labelled: True (310/5000 visible)
[2021-03-15 02:31:13] Training mlp across 310 data points in blobsthin...
[2021-03-15 02:31:15] Training loss: 0.0119
[2021-03-15 02:31:15] Testing on 5000 data points...
[2021-03-15 02:31:15] Test accuracy: 0.9952
[2021-03-15 02:31:15] Score for 310 labels: 0.9952
[2021-03-15 02:31:15] Updated results: ../results/final/results.json
