[2021-03-24 01:33:31] Created experiment 0:
[2021-03-24 01:33:31]  - Model: mlp
[2021-03-24 01:33:31]  - Acquisition function: random
[2021-03-24 01:33:31] Created experiment 1:
[2021-03-24 01:33:31]  - Model: mlp
[2021-03-24 01:33:31]  - Acquisition function: greedy-coreset
[2021-03-24 01:33:31] Created experiment 2:
[2021-03-24 01:33:31]  - Model: mlp
[2021-03-24 01:33:31]  - Acquisition function: least-confidence
[2021-03-24 01:33:31] Loading blobs test set...
[2021-03-24 01:33:31] Generated 5000 blobs:
[2021-03-24 01:33:31] Class 0: 200
[2021-03-24 01:33:31] Class 1: 300
[2021-03-24 01:33:31] Class 2: 1000
[2021-03-24 01:33:31] Class 3: 100
[2021-03-24 01:33:31] Class 4: 50
[2021-03-24 01:33:31] Class 5: 200
[2021-03-24 01:33:31] Class 6: 400
[2021-03-24 01:33:31] Class 7: 1800
[2021-03-24 01:33:31] Class 8: 50
[2021-03-24 01:33:31] Class 9: 900
[2021-03-24 01:33:31] Saved blobs (n=5000) to ../data/blobs_data.npy
[2021-03-24 01:33:32] Saved figure to: ../data/blobs_data.png
[2021-03-24 01:33:32] Generated 5000 test points.
[2021-03-24 01:33:32] Saved blobs (n=5000) to ../data/blobs_test.npy
[2021-03-24 01:33:32] Saved figure to: ../data/blobs_test.png
[2021-03-24 01:33:32] Experiment repeat 1/3
[2021-03-24 01:33:32] Seeded: 5
[2021-03-24 01:33:32] Using 1.00% labels of the dataset (50/5000)
[2021-03-24 01:33:32] Randomly labelled 50/5000
[2021-03-24 01:33:32] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:33:32] Seeded: 6
[2021-03-24 01:33:32] Running: experiment 0
[2021-03-24 01:33:32] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:33:32] Reset parameters according to He et al.
[2021-03-24 01:33:32] mlp: initialized 18186 parameters.
[2021-03-24 01:33:32] Creating trainer with model on device: cuda
[2021-03-24 01:33:37] Training with expected score >= 0.0000
[2021-03-24 01:33:37] Training mlp across 50 data points in blobs...
[2021-03-24 01:33:37] Training accuracy: 0.7183
[2021-03-24 01:33:37] Testing on 5000 data points...
[2021-03-24 01:33:37] Test score for 50 training labels: 0.4940
[2021-03-24 01:33:37] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:37] Found 5000 unlabelled features.
[2021-03-24 01:33:37] Showing labelled: True (100/5000 visible, 0 redundant)
[2021-03-24 01:33:37] Reset parameters according to He et al.
[2021-03-24 01:33:37] mlp: initialized 18186 parameters.
[2021-03-24 01:33:37] Creating trainer with model on device: cuda
[2021-03-24 01:33:37] Training with expected score >= 0.0000
[2021-03-24 01:33:37] Training mlp across 100 data points in blobs...
[2021-03-24 01:33:38] Training accuracy: 0.8116
[2021-03-24 01:33:38] Testing on 5000 data points...
[2021-03-24 01:33:39] Test score for 100 training labels: 0.6726
[2021-03-24 01:33:39] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:39] Found 5000 unlabelled features.
[2021-03-24 01:33:39] Showing labelled: True (149/5000 visible, 1 redundant)
[2021-03-24 01:33:39] Reset parameters according to He et al.
[2021-03-24 01:33:39] mlp: initialized 18186 parameters.
[2021-03-24 01:33:39] Creating trainer with model on device: cuda
[2021-03-24 01:33:39] Training with expected score >= 0.0000
[2021-03-24 01:33:39] Training mlp across 150 data points in blobs...
[2021-03-24 01:33:40] Training accuracy: 0.7909
[2021-03-24 01:33:40] Testing on 5000 data points...
[2021-03-24 01:33:40] Test score for 150 training labels: 0.6814
[2021-03-24 01:33:40] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:40] Found 5000 unlabelled features.
[2021-03-24 01:33:40] Showing labelled: True (197/5000 visible, 3 redundant)
[2021-03-24 01:33:40] Reset parameters according to He et al.
[2021-03-24 01:33:40] mlp: initialized 18186 parameters.
[2021-03-24 01:33:40] Creating trainer with model on device: cuda
[2021-03-24 01:33:40] Training with expected score >= 0.0000
[2021-03-24 01:33:40] Training mlp across 200 data points in blobs...
[2021-03-24 01:33:43] Training accuracy: 0.7861
[2021-03-24 01:33:43] Testing on 5000 data points...
[2021-03-24 01:33:43] Test score for 200 training labels: 0.7472
[2021-03-24 01:33:43] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:43] Found 5000 unlabelled features.
[2021-03-24 01:33:43] Showing labelled: True (245/5000 visible, 5 redundant)
[2021-03-24 01:33:43] Reset parameters according to He et al.
[2021-03-24 01:33:43] mlp: initialized 18186 parameters.
[2021-03-24 01:33:43] Creating trainer with model on device: cuda
[2021-03-24 01:33:43] Training with expected score >= 0.0000
[2021-03-24 01:33:43] Training mlp across 250 data points in blobs...
[2021-03-24 01:33:46] Training accuracy: 0.8001
[2021-03-24 01:33:46] Testing on 5000 data points...
[2021-03-24 01:33:46] Test score for 250 training labels: 0.7726
[2021-03-24 01:33:46] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:46] Found 5000 unlabelled features.
[2021-03-24 01:33:46] Showing labelled: True (289/5000 visible, 11 redundant)
[2021-03-24 01:33:46] Reset parameters according to He et al.
[2021-03-24 01:33:46] mlp: initialized 18186 parameters.
[2021-03-24 01:33:46] Creating trainer with model on device: cuda
[2021-03-24 01:33:46] Training with expected score >= 0.0000
[2021-03-24 01:33:46] Training mlp across 300 data points in blobs...
[2021-03-24 01:33:50] Training accuracy: 0.8222
[2021-03-24 01:33:50] Testing on 5000 data points...
[2021-03-24 01:33:50] Test score for 300 training labels: 0.7642
[2021-03-24 01:33:50] Saved labelled data (n=300) to: ../data/random.npy
[2021-03-24 01:33:50] Seeded: 6
[2021-03-24 01:33:50] Running: experiment 1
[2021-03-24 01:33:50] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:33:50] Reset parameters according to He et al.
[2021-03-24 01:33:50] mlp: initialized 18186 parameters.
[2021-03-24 01:33:50] Creating trainer with model on device: cuda
[2021-03-24 01:33:50] Training with expected score >= 0.0000
[2021-03-24 01:33:50] Training mlp across 50 data points in blobs...
[2021-03-24 01:33:50] Training accuracy: 0.7183
[2021-03-24 01:33:50] Testing on 5000 data points...
[2021-03-24 01:33:50] Test score for 50 training labels: 0.4940
[2021-03-24 01:33:50] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:50] Found 5000 unlabelled features.
[2021-03-24 01:33:50] Computing distance between 50 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:33:50] Searching for coresets greedily...
[2021-03-24 01:33:50] Showing labelled: True (100/5000 visible, 0 redundant)
[2021-03-24 01:33:50] Reset parameters according to He et al.
[2021-03-24 01:33:50] mlp: initialized 18186 parameters.
[2021-03-24 01:33:50] Creating trainer with model on device: cuda
[2021-03-24 01:33:50] Training with expected score >= 0.0000
[2021-03-24 01:33:50] Training mlp across 100 data points in blobs...
[2021-03-24 01:33:51] Training accuracy: 0.6926
[2021-03-24 01:33:51] Testing on 5000 data points...
[2021-03-24 01:33:51] Test score for 100 training labels: 0.7912
[2021-03-24 01:33:52] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:52] Found 5000 unlabelled features.
[2021-03-24 01:33:52] Computing distance between 100 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:33:52] Searching for coresets greedily...
[2021-03-24 01:33:52] Showing labelled: True (150/5000 visible, 0 redundant)
[2021-03-24 01:33:52] Reset parameters according to He et al.
[2021-03-24 01:33:52] mlp: initialized 18186 parameters.
[2021-03-24 01:33:52] Creating trainer with model on device: cuda
[2021-03-24 01:33:52] Training with expected score >= 0.0000
[2021-03-24 01:33:52] Training mlp across 150 data points in blobs...
[2021-03-24 01:33:53] Training accuracy: 0.7313
[2021-03-24 01:33:53] Testing on 5000 data points...
[2021-03-24 01:33:53] Test score for 150 training labels: 0.8036
[2021-03-24 01:33:53] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:53] Found 5000 unlabelled features.
[2021-03-24 01:33:53] Computing distance between 150 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:33:54] Searching for coresets greedily...
[2021-03-24 01:33:54] Showing labelled: True (200/5000 visible, 0 redundant)
[2021-03-24 01:33:54] Reset parameters according to He et al.
[2021-03-24 01:33:54] mlp: initialized 18186 parameters.
[2021-03-24 01:33:54] Creating trainer with model on device: cuda
[2021-03-24 01:33:54] Training with expected score >= 0.0000
[2021-03-24 01:33:54] Training mlp across 200 data points in blobs...
[2021-03-24 01:33:56] Training accuracy: 0.7458
[2021-03-24 01:33:56] Testing on 5000 data points...
[2021-03-24 01:33:56] Test score for 200 training labels: 0.8196
[2021-03-24 01:33:56] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:56] Found 5000 unlabelled features.
[2021-03-24 01:33:56] Computing distance between 200 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:33:56] Searching for coresets greedily...
[2021-03-24 01:33:56] Showing labelled: True (250/5000 visible, 0 redundant)
[2021-03-24 01:33:56] Reset parameters according to He et al.
[2021-03-24 01:33:56] mlp: initialized 18186 parameters.
[2021-03-24 01:33:56] Creating trainer with model on device: cuda
[2021-03-24 01:33:56] Training with expected score >= 0.0000
[2021-03-24 01:33:56] Training mlp across 250 data points in blobs...
[2021-03-24 01:33:59] Training accuracy: 0.7444
[2021-03-24 01:33:59] Testing on 5000 data points...
[2021-03-24 01:33:59] Test score for 250 training labels: 0.8088
[2021-03-24 01:33:59] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:33:59] Found 5000 unlabelled features.
[2021-03-24 01:33:59] Computing distance between 250 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:33:59] Searching for coresets greedily...
[2021-03-24 01:33:59] Showing labelled: True (300/5000 visible, 0 redundant)
[2021-03-24 01:33:59] Reset parameters according to He et al.
[2021-03-24 01:33:59] mlp: initialized 18186 parameters.
[2021-03-24 01:33:59] Creating trainer with model on device: cuda
[2021-03-24 01:33:59] Training with expected score >= 0.0000
[2021-03-24 01:33:59] Training mlp across 300 data points in blobs...
[2021-03-24 01:34:03] Training accuracy: 0.7536
[2021-03-24 01:34:03] Testing on 5000 data points...
[2021-03-24 01:34:03] Test score for 300 training labels: 0.8124
[2021-03-24 01:34:03] Saved labelled data (n=300) to: ../data/greedy-coreset.npy
[2021-03-24 01:34:03] Seeded: 6
[2021-03-24 01:34:03] Running: experiment 2
[2021-03-24 01:34:03] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:34:03] Reset parameters according to He et al.
[2021-03-24 01:34:03] mlp: initialized 18186 parameters.
[2021-03-24 01:34:03] Creating trainer with model on device: cuda
[2021-03-24 01:34:03] Training with expected score >= 0.0000
[2021-03-24 01:34:03] Training mlp across 50 data points in blobs...
[2021-03-24 01:34:04] Training accuracy: 0.7183
[2021-03-24 01:34:04] Testing on 5000 data points...
[2021-03-24 01:34:04] Test score for 50 training labels: 0.4940
[2021-03-24 01:34:04] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:04] Found 5000 unlabelled features.
[2021-03-24 01:34:04] Showing labelled: True (98/5000 visible, 2 redundant)
[2021-03-24 01:34:04] Reset parameters according to He et al.
[2021-03-24 01:34:04] mlp: initialized 18186 parameters.
[2021-03-24 01:34:04] Creating trainer with model on device: cuda
[2021-03-24 01:34:04] Training with expected score >= 0.0000
[2021-03-24 01:34:04] Training mlp across 100 data points in blobs...
[2021-03-24 01:34:05] Training accuracy: 0.8209
[2021-03-24 01:34:05] Testing on 5000 data points...
[2021-03-24 01:34:05] Test score for 100 training labels: 0.4834
[2021-03-24 01:34:05] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:05] Found 5000 unlabelled features.
[2021-03-24 01:34:05] Showing labelled: True (146/5000 visible, 4 redundant)
[2021-03-24 01:34:05] Reset parameters according to He et al.
[2021-03-24 01:34:05] mlp: initialized 18186 parameters.
[2021-03-24 01:34:05] Creating trainer with model on device: cuda
[2021-03-24 01:34:05] Training with expected score >= 0.0000
[2021-03-24 01:34:05] Training mlp across 150 data points in blobs...
[2021-03-24 01:34:07] Training accuracy: 0.7744
[2021-03-24 01:34:07] Testing on 5000 data points...
[2021-03-24 01:34:07] Test score for 150 training labels: 0.6048
[2021-03-24 01:34:07] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:07] Found 5000 unlabelled features.
[2021-03-24 01:34:07] Showing labelled: True (195/5000 visible, 5 redundant)
[2021-03-24 01:34:07] Reset parameters according to He et al.
[2021-03-24 01:34:07] mlp: initialized 18186 parameters.
[2021-03-24 01:34:07] Creating trainer with model on device: cuda
[2021-03-24 01:34:07] Training with expected score >= 0.0000
[2021-03-24 01:34:07] Training mlp across 200 data points in blobs...
[2021-03-24 01:34:09] Training accuracy: 0.7560
[2021-03-24 01:34:09] Testing on 5000 data points...
[2021-03-24 01:34:09] Test score for 200 training labels: 0.5952
[2021-03-24 01:34:09] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:09] Found 5000 unlabelled features.
[2021-03-24 01:34:10] Showing labelled: True (241/5000 visible, 9 redundant)
[2021-03-24 01:34:10] Reset parameters according to He et al.
[2021-03-24 01:34:10] mlp: initialized 18186 parameters.
[2021-03-24 01:34:10] Creating trainer with model on device: cuda
[2021-03-24 01:34:10] Training with expected score >= 0.0000
[2021-03-24 01:34:10] Training mlp across 250 data points in blobs...
[2021-03-24 01:34:12] Training accuracy: 0.7011
[2021-03-24 01:34:12] Testing on 5000 data points...
[2021-03-24 01:34:12] Test score for 250 training labels: 0.5976
[2021-03-24 01:34:12] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:12] Found 5000 unlabelled features.
[2021-03-24 01:34:12] Showing labelled: True (263/5000 visible, 37 redundant)
[2021-03-24 01:34:12] Reset parameters according to He et al.
[2021-03-24 01:34:12] mlp: initialized 18186 parameters.
[2021-03-24 01:34:12] Creating trainer with model on device: cuda
[2021-03-24 01:34:12] Training with expected score >= 0.0000
[2021-03-24 01:34:12] Training mlp across 300 data points in blobs...
[2021-03-24 01:34:16] Training accuracy: 0.6418
[2021-03-24 01:34:16] Testing on 5000 data points...
[2021-03-24 01:34:16] Test score for 300 training labels: 0.5778
[2021-03-24 01:34:16] Saved labelled data (n=300) to: ../data/least-confidence.npy
[2021-03-24 01:34:16] Experiment repeat 2/3
[2021-03-24 01:34:16] Seeded: 6
[2021-03-24 01:34:16] Using 1.00% labels of the dataset (50/5000)
[2021-03-24 01:34:16] Randomly labelled 50/5000
[2021-03-24 01:34:16] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:34:16] Seeded: 7
[2021-03-24 01:34:16] Running: experiment 0
[2021-03-24 01:34:16] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:34:16] Reset parameters according to He et al.
[2021-03-24 01:34:16] mlp: initialized 18186 parameters.
[2021-03-24 01:34:16] Creating trainer with model on device: cuda
[2021-03-24 01:34:16] Training with expected score >= 0.0000
[2021-03-24 01:34:16] Training mlp across 50 data points in blobs...
[2021-03-24 01:34:17] Training accuracy: 0.7567
[2021-03-24 01:34:17] Testing on 5000 data points...
[2021-03-24 01:34:17] Test score for 50 training labels: 0.5286
[2021-03-24 01:34:17] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:17] Found 5000 unlabelled features.
[2021-03-24 01:34:17] Showing labelled: True (100/5000 visible, 0 redundant)
[2021-03-24 01:34:17] Reset parameters according to He et al.
[2021-03-24 01:34:17] mlp: initialized 18186 parameters.
[2021-03-24 01:34:17] Creating trainer with model on device: cuda
[2021-03-24 01:34:17] Training with expected score >= 0.0000
[2021-03-24 01:34:17] Training mlp across 100 data points in blobs...
[2021-03-24 01:34:18] Training accuracy: 0.8304
[2021-03-24 01:34:18] Testing on 5000 data points...
[2021-03-24 01:34:18] Test score for 100 training labels: 0.5598
[2021-03-24 01:34:18] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:18] Found 5000 unlabelled features.
[2021-03-24 01:34:18] Showing labelled: True (149/5000 visible, 1 redundant)
[2021-03-24 01:34:18] Reset parameters according to He et al.
[2021-03-24 01:34:18] mlp: initialized 18186 parameters.
[2021-03-24 01:34:18] Creating trainer with model on device: cuda
[2021-03-24 01:34:18] Training with expected score >= 0.0000
[2021-03-24 01:34:18] Training mlp across 150 data points in blobs...
[2021-03-24 01:34:20] Training accuracy: 0.8609
[2021-03-24 01:34:20] Testing on 5000 data points...
[2021-03-24 01:34:20] Test score for 150 training labels: 0.6036
[2021-03-24 01:34:20] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:20] Found 5000 unlabelled features.
[2021-03-24 01:34:20] Showing labelled: True (199/5000 visible, 1 redundant)
[2021-03-24 01:34:20] Reset parameters according to He et al.
[2021-03-24 01:34:20] mlp: initialized 18186 parameters.
[2021-03-24 01:34:20] Creating trainer with model on device: cuda
[2021-03-24 01:34:20] Training with expected score >= 0.0000
[2021-03-24 01:34:20] Training mlp across 200 data points in blobs...
[2021-03-24 01:34:22] Training accuracy: 0.8592
[2021-03-24 01:34:22] Testing on 5000 data points...
[2021-03-24 01:34:22] Test score for 200 training labels: 0.6118
[2021-03-24 01:34:22] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:22] Found 5000 unlabelled features.
[2021-03-24 01:34:22] Showing labelled: True (246/5000 visible, 4 redundant)
[2021-03-24 01:34:22] Reset parameters according to He et al.
[2021-03-24 01:34:22] mlp: initialized 18186 parameters.
[2021-03-24 01:34:22] Creating trainer with model on device: cuda
[2021-03-24 01:34:22] Training with expected score >= 0.0000
[2021-03-24 01:34:22] Training mlp across 250 data points in blobs...
[2021-03-24 01:34:25] Training accuracy: 0.8547
[2021-03-24 01:34:25] Testing on 5000 data points...
[2021-03-24 01:34:25] Test score for 250 training labels: 0.7634
[2021-03-24 01:34:25] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:25] Found 5000 unlabelled features.
[2021-03-24 01:34:25] Showing labelled: True (293/5000 visible, 7 redundant)
[2021-03-24 01:34:25] Reset parameters according to He et al.
[2021-03-24 01:34:25] mlp: initialized 18186 parameters.
[2021-03-24 01:34:25] Creating trainer with model on device: cuda
[2021-03-24 01:34:25] Training with expected score >= 0.0000
[2021-03-24 01:34:25] Training mlp across 300 data points in blobs...
[2021-03-24 01:34:29] Training accuracy: 0.8760
[2021-03-24 01:34:29] Testing on 5000 data points...
[2021-03-24 01:34:29] Test score for 300 training labels: 0.7628
[2021-03-24 01:34:29] Seeded: 7
[2021-03-24 01:34:29] Running: experiment 1
[2021-03-24 01:34:29] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:34:29] Reset parameters according to He et al.
[2021-03-24 01:34:29] mlp: initialized 18186 parameters.
[2021-03-24 01:34:29] Creating trainer with model on device: cuda
[2021-03-24 01:34:29] Training with expected score >= 0.0000
[2021-03-24 01:34:29] Training mlp across 50 data points in blobs...
[2021-03-24 01:34:29] Training accuracy: 0.7567
[2021-03-24 01:34:29] Testing on 5000 data points...
[2021-03-24 01:34:29] Test score for 50 training labels: 0.5286
[2021-03-24 01:34:29] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:29] Found 5000 unlabelled features.
[2021-03-24 01:34:29] Computing distance between 50 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:34:29] Searching for coresets greedily...
[2021-03-24 01:34:29] Showing labelled: True (100/5000 visible, 0 redundant)
[2021-03-24 01:34:29] Reset parameters according to He et al.
[2021-03-24 01:34:29] mlp: initialized 18186 parameters.
[2021-03-24 01:34:29] Creating trainer with model on device: cuda
[2021-03-24 01:34:29] Training with expected score >= 0.0000
[2021-03-24 01:34:29] Training mlp across 100 data points in blobs...
[2021-03-24 01:34:31] Training accuracy: 0.6989
[2021-03-24 01:34:31] Testing on 5000 data points...
[2021-03-24 01:34:31] Test score for 100 training labels: 0.7460
[2021-03-24 01:34:31] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:31] Found 5000 unlabelled features.
[2021-03-24 01:34:31] Computing distance between 100 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:34:31] Searching for coresets greedily...
[2021-03-24 01:34:31] Showing labelled: True (150/5000 visible, 0 redundant)
[2021-03-24 01:34:31] Reset parameters according to He et al.
[2021-03-24 01:34:31] mlp: initialized 18186 parameters.
[2021-03-24 01:34:31] Creating trainer with model on device: cuda
[2021-03-24 01:34:31] Training with expected score >= 0.0000
[2021-03-24 01:34:31] Training mlp across 150 data points in blobs...
[2021-03-24 01:34:32] Training accuracy: 0.7388
[2021-03-24 01:34:32] Testing on 5000 data points...
[2021-03-24 01:34:32] Test score for 150 training labels: 0.7842
[2021-03-24 01:34:33] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:33] Found 5000 unlabelled features.
[2021-03-24 01:34:33] Computing distance between 150 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:34:33] Searching for coresets greedily...
[2021-03-24 01:34:33] Showing labelled: True (200/5000 visible, 0 redundant)
[2021-03-24 01:34:33] Reset parameters according to He et al.
[2021-03-24 01:34:33] mlp: initialized 18186 parameters.
[2021-03-24 01:34:33] Creating trainer with model on device: cuda
[2021-03-24 01:34:33] Training with expected score >= 0.0000
[2021-03-24 01:34:33] Training mlp across 200 data points in blobs...
[2021-03-24 01:34:35] Training accuracy: 0.7405
[2021-03-24 01:34:35] Testing on 5000 data points...
[2021-03-24 01:34:35] Test score for 200 training labels: 0.7906
[2021-03-24 01:34:35] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:35] Found 5000 unlabelled features.
[2021-03-24 01:34:35] Computing distance between 200 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:34:35] Searching for coresets greedily...
[2021-03-24 01:34:35] Showing labelled: True (250/5000 visible, 0 redundant)
[2021-03-24 01:34:35] Reset parameters according to He et al.
[2021-03-24 01:34:35] mlp: initialized 18186 parameters.
[2021-03-24 01:34:35] Creating trainer with model on device: cuda
[2021-03-24 01:34:35] Training with expected score >= 0.0000
[2021-03-24 01:34:35] Training mlp across 250 data points in blobs...
[2021-03-24 01:34:38] Training accuracy: 0.7522
[2021-03-24 01:34:38] Testing on 5000 data points...
[2021-03-24 01:34:38] Test score for 250 training labels: 0.7954
[2021-03-24 01:34:38] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:38] Found 5000 unlabelled features.
[2021-03-24 01:34:38] Computing distance between 250 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:34:38] Searching for coresets greedily...
[2021-03-24 01:34:38] Showing labelled: True (300/5000 visible, 0 redundant)
[2021-03-24 01:34:38] Reset parameters according to He et al.
[2021-03-24 01:34:38] mlp: initialized 18186 parameters.
[2021-03-24 01:34:38] Creating trainer with model on device: cuda
[2021-03-24 01:34:38] Training with expected score >= 0.0000
[2021-03-24 01:34:38] Training mlp across 300 data points in blobs...
[2021-03-24 01:34:42] Training accuracy: 0.7547
[2021-03-24 01:34:42] Testing on 5000 data points...
[2021-03-24 01:34:42] Test score for 300 training labels: 0.8016
[2021-03-24 01:34:42] Seeded: 7
[2021-03-24 01:34:42] Running: experiment 2
[2021-03-24 01:34:42] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:34:42] Reset parameters according to He et al.
[2021-03-24 01:34:42] mlp: initialized 18186 parameters.
[2021-03-24 01:34:42] Creating trainer with model on device: cuda
[2021-03-24 01:34:42] Training with expected score >= 0.0000
[2021-03-24 01:34:42] Training mlp across 50 data points in blobs...
[2021-03-24 01:34:42] Training accuracy: 0.7567
[2021-03-24 01:34:42] Testing on 5000 data points...
[2021-03-24 01:34:42] Test score for 50 training labels: 0.5286
[2021-03-24 01:34:42] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:42] Found 5000 unlabelled features.
[2021-03-24 01:34:42] Showing labelled: True (100/5000 visible, 0 redundant)
[2021-03-24 01:34:42] Reset parameters according to He et al.
[2021-03-24 01:34:42] mlp: initialized 18186 parameters.
[2021-03-24 01:34:42] Creating trainer with model on device: cuda
[2021-03-24 01:34:42] Training with expected score >= 0.0000
[2021-03-24 01:34:42] Training mlp across 100 data points in blobs...
[2021-03-24 01:34:43] Training accuracy: 0.9130
[2021-03-24 01:34:43] Testing on 5000 data points...
[2021-03-24 01:34:43] Test score for 100 training labels: 0.5854
[2021-03-24 01:34:43] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:43] Found 5000 unlabelled features.
[2021-03-24 01:34:43] Showing labelled: True (147/5000 visible, 3 redundant)
[2021-03-24 01:34:43] Reset parameters according to He et al.
[2021-03-24 01:34:43] mlp: initialized 18186 parameters.
[2021-03-24 01:34:43] Creating trainer with model on device: cuda
[2021-03-24 01:34:43] Training with expected score >= 0.0000
[2021-03-24 01:34:43] Training mlp across 150 data points in blobs...
[2021-03-24 01:34:45] Training accuracy: 0.8188
[2021-03-24 01:34:45] Testing on 5000 data points...
[2021-03-24 01:34:45] Test score for 150 training labels: 0.6026
[2021-03-24 01:34:45] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:45] Found 5000 unlabelled features.
[2021-03-24 01:34:45] Showing labelled: True (189/5000 visible, 11 redundant)
[2021-03-24 01:34:45] Reset parameters according to He et al.
[2021-03-24 01:34:45] mlp: initialized 18186 parameters.
[2021-03-24 01:34:45] Creating trainer with model on device: cuda
[2021-03-24 01:34:45] Training with expected score >= 0.0000
[2021-03-24 01:34:45] Training mlp across 200 data points in blobs...
[2021-03-24 01:34:48] Training accuracy: 0.7608
[2021-03-24 01:34:48] Testing on 5000 data points...
[2021-03-24 01:34:48] Test score for 200 training labels: 0.6016
[2021-03-24 01:34:48] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:48] Found 5000 unlabelled features.
[2021-03-24 01:34:48] Showing labelled: True (217/5000 visible, 33 redundant)
[2021-03-24 01:34:48] Reset parameters according to He et al.
[2021-03-24 01:34:48] mlp: initialized 18186 parameters.
[2021-03-24 01:34:48] Creating trainer with model on device: cuda
[2021-03-24 01:34:48] Training with expected score >= 0.0000
[2021-03-24 01:34:48] Training mlp across 250 data points in blobs...
[2021-03-24 01:34:50] Training accuracy: 0.7352
[2021-03-24 01:34:50] Testing on 5000 data points...
[2021-03-24 01:34:51] Test score for 250 training labels: 0.5782
[2021-03-24 01:34:51] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:51] Found 5000 unlabelled features.
[2021-03-24 01:34:51] Showing labelled: True (248/5000 visible, 52 redundant)
[2021-03-24 01:34:51] Reset parameters according to He et al.
[2021-03-24 01:34:51] mlp: initialized 18186 parameters.
[2021-03-24 01:34:51] Creating trainer with model on device: cuda
[2021-03-24 01:34:51] Training with expected score >= 0.0000
[2021-03-24 01:34:51] Training mlp across 300 data points in blobs...
[2021-03-24 01:34:54] Training accuracy: 0.6789
[2021-03-24 01:34:54] Testing on 5000 data points...
[2021-03-24 01:34:54] Test score for 300 training labels: 0.5568
[2021-03-24 01:34:54] Experiment repeat 3/3
[2021-03-24 01:34:54] Seeded: 7
[2021-03-24 01:34:54] Using 1.00% labels of the dataset (50/5000)
[2021-03-24 01:34:54] Randomly labelled 50/5000
[2021-03-24 01:34:54] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:34:54] Seeded: 8
[2021-03-24 01:34:54] Running: experiment 0
[2021-03-24 01:34:54] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:34:54] Reset parameters according to He et al.
[2021-03-24 01:34:54] mlp: initialized 18186 parameters.
[2021-03-24 01:34:54] Creating trainer with model on device: cuda
[2021-03-24 01:34:54] Training with expected score >= 0.0000
[2021-03-24 01:34:54] Training mlp across 50 data points in blobs...
[2021-03-24 01:34:55] Training accuracy: 0.7789
[2021-03-24 01:34:55] Testing on 5000 data points...
[2021-03-24 01:34:55] Test score for 50 training labels: 0.4182
[2021-03-24 01:34:55] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:55] Found 5000 unlabelled features.
[2021-03-24 01:34:55] Showing labelled: True (100/5000 visible, 0 redundant)
[2021-03-24 01:34:55] Reset parameters according to He et al.
[2021-03-24 01:34:55] mlp: initialized 18186 parameters.
[2021-03-24 01:34:55] Creating trainer with model on device: cuda
[2021-03-24 01:34:55] Training with expected score >= 0.0000
[2021-03-24 01:34:55] Training mlp across 100 data points in blobs...
[2021-03-24 01:34:56] Training accuracy: 0.7890
[2021-03-24 01:34:56] Testing on 5000 data points...
[2021-03-24 01:34:56] Test score for 100 training labels: 0.5936
[2021-03-24 01:34:56] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:56] Found 5000 unlabelled features.
[2021-03-24 01:34:56] Showing labelled: True (150/5000 visible, 0 redundant)
[2021-03-24 01:34:56] Reset parameters according to He et al.
[2021-03-24 01:34:56] mlp: initialized 18186 parameters.
[2021-03-24 01:34:56] Creating trainer with model on device: cuda
[2021-03-24 01:34:56] Training with expected score >= 0.0000
[2021-03-24 01:34:56] Training mlp across 150 data points in blobs...
[2021-03-24 01:34:58] Training accuracy: 0.8398
[2021-03-24 01:34:58] Testing on 5000 data points...
[2021-03-24 01:34:58] Test score for 150 training labels: 0.6684
[2021-03-24 01:34:58] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:34:58] Found 5000 unlabelled features.
[2021-03-24 01:34:58] Showing labelled: True (199/5000 visible, 1 redundant)
[2021-03-24 01:34:58] Reset parameters according to He et al.
[2021-03-24 01:34:58] mlp: initialized 18186 parameters.
[2021-03-24 01:34:58] Creating trainer with model on device: cuda
[2021-03-24 01:34:58] Training with expected score >= 0.0000
[2021-03-24 01:34:58] Training mlp across 200 data points in blobs...
[2021-03-24 01:35:00] Training accuracy: 0.8336
[2021-03-24 01:35:00] Testing on 5000 data points...
[2021-03-24 01:35:00] Test score for 200 training labels: 0.7316
[2021-03-24 01:35:00] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:00] Found 5000 unlabelled features.
[2021-03-24 01:35:00] Showing labelled: True (246/5000 visible, 4 redundant)
[2021-03-24 01:35:00] Reset parameters according to He et al.
[2021-03-24 01:35:00] mlp: initialized 18186 parameters.
[2021-03-24 01:35:00] Creating trainer with model on device: cuda
[2021-03-24 01:35:00] Training with expected score >= 0.0000
[2021-03-24 01:35:00] Training mlp across 250 data points in blobs...
[2021-03-24 01:35:03] Training accuracy: 0.8558
[2021-03-24 01:35:03] Testing on 5000 data points...
[2021-03-24 01:35:03] Test score for 250 training labels: 0.7310
[2021-03-24 01:35:03] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:03] Found 5000 unlabelled features.
[2021-03-24 01:35:03] Showing labelled: True (292/5000 visible, 8 redundant)
[2021-03-24 01:35:03] Reset parameters according to He et al.
[2021-03-24 01:35:03] mlp: initialized 18186 parameters.
[2021-03-24 01:35:03] Creating trainer with model on device: cuda
[2021-03-24 01:35:03] Training with expected score >= 0.0000
[2021-03-24 01:35:03] Training mlp across 300 data points in blobs...
[2021-03-24 01:35:07] Training accuracy: 0.8614
[2021-03-24 01:35:07] Testing on 5000 data points...
[2021-03-24 01:35:07] Test score for 300 training labels: 0.7256
[2021-03-24 01:35:07] Seeded: 8
[2021-03-24 01:35:07] Running: experiment 1
[2021-03-24 01:35:07] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:35:07] Reset parameters according to He et al.
[2021-03-24 01:35:07] mlp: initialized 18186 parameters.
[2021-03-24 01:35:07] Creating trainer with model on device: cuda
[2021-03-24 01:35:07] Training with expected score >= 0.0000
[2021-03-24 01:35:07] Training mlp across 50 data points in blobs...
[2021-03-24 01:35:07] Training accuracy: 0.7789
[2021-03-24 01:35:07] Testing on 5000 data points...
[2021-03-24 01:35:07] Test score for 50 training labels: 0.4182
[2021-03-24 01:35:07] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:07] Found 5000 unlabelled features.
[2021-03-24 01:35:07] Computing distance between 50 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:35:07] Searching for coresets greedily...
[2021-03-24 01:35:07] Showing labelled: True (100/5000 visible, 0 redundant)
[2021-03-24 01:35:07] Reset parameters according to He et al.
[2021-03-24 01:35:07] mlp: initialized 18186 parameters.
[2021-03-24 01:35:07] Creating trainer with model on device: cuda
[2021-03-24 01:35:07] Training with expected score >= 0.0000
[2021-03-24 01:35:07] Training mlp across 100 data points in blobs...
[2021-03-24 01:35:08] Training accuracy: 0.6965
[2021-03-24 01:35:08] Testing on 5000 data points...
[2021-03-24 01:35:08] Test score for 100 training labels: 0.7384
[2021-03-24 01:35:08] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:08] Found 5000 unlabelled features.
[2021-03-24 01:35:09] Computing distance between 100 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:35:09] Searching for coresets greedily...
[2021-03-24 01:35:09] Showing labelled: True (150/5000 visible, 0 redundant)
[2021-03-24 01:35:09] Reset parameters according to He et al.
[2021-03-24 01:35:09] mlp: initialized 18186 parameters.
[2021-03-24 01:35:09] Creating trainer with model on device: cuda
[2021-03-24 01:35:09] Training with expected score >= 0.0000
[2021-03-24 01:35:09] Training mlp across 150 data points in blobs...
[2021-03-24 01:35:11] Training accuracy: 0.7257
[2021-03-24 01:35:11] Testing on 5000 data points...
[2021-03-24 01:35:11] Test score for 150 training labels: 0.7774
[2021-03-24 01:35:11] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:11] Found 5000 unlabelled features.
[2021-03-24 01:35:11] Computing distance between 150 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:35:11] Searching for coresets greedily...
[2021-03-24 01:35:11] Showing labelled: True (200/5000 visible, 0 redundant)
[2021-03-24 01:35:11] Reset parameters according to He et al.
[2021-03-24 01:35:11] mlp: initialized 18186 parameters.
[2021-03-24 01:35:11] Creating trainer with model on device: cuda
[2021-03-24 01:35:11] Training with expected score >= 0.0000
[2021-03-24 01:35:11] Training mlp across 200 data points in blobs...
[2021-03-24 01:35:13] Training accuracy: 0.7534
[2021-03-24 01:35:13] Testing on 5000 data points...
[2021-03-24 01:35:13] Test score for 200 training labels: 0.7928
[2021-03-24 01:35:13] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:13] Found 5000 unlabelled features.
[2021-03-24 01:35:13] Computing distance between 200 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:35:13] Searching for coresets greedily...
[2021-03-24 01:35:13] Showing labelled: True (250/5000 visible, 0 redundant)
[2021-03-24 01:35:13] Reset parameters according to He et al.
[2021-03-24 01:35:13] mlp: initialized 18186 parameters.
[2021-03-24 01:35:13] Creating trainer with model on device: cuda
[2021-03-24 01:35:13] Training with expected score >= 0.0000
[2021-03-24 01:35:13] Training mlp across 250 data points in blobs...
[2021-03-24 01:35:16] Training accuracy: 0.7708
[2021-03-24 01:35:16] Testing on 5000 data points...
[2021-03-24 01:35:16] Test score for 250 training labels: 0.8100
[2021-03-24 01:35:16] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:16] Found 5000 unlabelled features.
[2021-03-24 01:35:16] Computing distance between 250 labelled and 5000 unlabelled vectors of length 128...
[2021-03-24 01:35:16] Searching for coresets greedily...
[2021-03-24 01:35:16] Showing labelled: True (300/5000 visible, 0 redundant)
[2021-03-24 01:35:16] Reset parameters according to He et al.
[2021-03-24 01:35:16] mlp: initialized 18186 parameters.
[2021-03-24 01:35:16] Creating trainer with model on device: cuda
[2021-03-24 01:35:16] Training with expected score >= 0.0000
[2021-03-24 01:35:16] Training mlp across 300 data points in blobs...
[2021-03-24 01:35:19] Training accuracy: 0.7655
[2021-03-24 01:35:19] Testing on 5000 data points...
[2021-03-24 01:35:19] Test score for 300 training labels: 0.8036
[2021-03-24 01:35:19] Seeded: 8
[2021-03-24 01:35:19] Running: experiment 2
[2021-03-24 01:35:19] Showing labelled: True (50/5000 visible, 0 redundant)
[2021-03-24 01:35:19] Reset parameters according to He et al.
[2021-03-24 01:35:19] mlp: initialized 18186 parameters.
[2021-03-24 01:35:19] Creating trainer with model on device: cuda
[2021-03-24 01:35:19] Training with expected score >= 0.0000
[2021-03-24 01:35:19] Training mlp across 50 data points in blobs...
[2021-03-24 01:35:20] Training accuracy: 0.7789
[2021-03-24 01:35:20] Testing on 5000 data points...
[2021-03-24 01:35:20] Test score for 50 training labels: 0.4182
[2021-03-24 01:35:20] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:20] Found 5000 unlabelled features.
[2021-03-24 01:35:20] Showing labelled: True (100/5000 visible, 0 redundant)
[2021-03-24 01:35:20] Reset parameters according to He et al.
[2021-03-24 01:35:20] mlp: initialized 18186 parameters.
[2021-03-24 01:35:20] Creating trainer with model on device: cuda
[2021-03-24 01:35:20] Training with expected score >= 0.0000
[2021-03-24 01:35:20] Training mlp across 100 data points in blobs...
[2021-03-24 01:35:21] Training accuracy: 0.8992
[2021-03-24 01:35:21] Testing on 5000 data points...
[2021-03-24 01:35:21] Test score for 100 training labels: 0.4858
[2021-03-24 01:35:21] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:21] Found 5000 unlabelled features.
[2021-03-24 01:35:21] Showing labelled: True (149/5000 visible, 1 redundant)
[2021-03-24 01:35:21] Reset parameters according to He et al.
[2021-03-24 01:35:21] mlp: initialized 18186 parameters.
[2021-03-24 01:35:21] Creating trainer with model on device: cuda
[2021-03-24 01:35:21] Training with expected score >= 0.0000
[2021-03-24 01:35:21] Training mlp across 150 data points in blobs...
[2021-03-24 01:35:23] Training accuracy: 0.8128
[2021-03-24 01:35:23] Testing on 5000 data points...
[2021-03-24 01:35:23] Test score for 150 training labels: 0.5764
[2021-03-24 01:35:23] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:23] Found 5000 unlabelled features.
[2021-03-24 01:35:23] Showing labelled: True (190/5000 visible, 10 redundant)
[2021-03-24 01:35:23] Reset parameters according to He et al.
[2021-03-24 01:35:23] mlp: initialized 18186 parameters.
[2021-03-24 01:35:23] Creating trainer with model on device: cuda
[2021-03-24 01:35:23] Training with expected score >= 0.0000
[2021-03-24 01:35:23] Training mlp across 200 data points in blobs...
[2021-03-24 01:35:25] Training accuracy: 0.7749
[2021-03-24 01:35:25] Testing on 5000 data points...
[2021-03-24 01:35:25] Test score for 200 training labels: 0.6042
[2021-03-24 01:35:25] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:25] Found 5000 unlabelled features.
[2021-03-24 01:35:26] Showing labelled: True (220/5000 visible, 30 redundant)
[2021-03-24 01:35:26] Reset parameters according to He et al.
[2021-03-24 01:35:26] mlp: initialized 18186 parameters.
[2021-03-24 01:35:26] Creating trainer with model on device: cuda
[2021-03-24 01:35:26] Training with expected score >= 0.0000
[2021-03-24 01:35:26] Training mlp across 250 data points in blobs...
[2021-03-24 01:35:28] Training accuracy: 0.7258
[2021-03-24 01:35:28] Testing on 5000 data points...
[2021-03-24 01:35:28] Test score for 250 training labels: 0.5814
[2021-03-24 01:35:28] Showing labelled: False (5000/5000 visible, 0 redundant)
[2021-03-24 01:35:28] Found 5000 unlabelled features.
[2021-03-24 01:35:28] Showing labelled: True (247/5000 visible, 53 redundant)
[2021-03-24 01:35:28] Reset parameters according to He et al.
[2021-03-24 01:35:28] mlp: initialized 18186 parameters.
[2021-03-24 01:35:28] Creating trainer with model on device: cuda
[2021-03-24 01:35:28] Training with expected score >= 0.0000
[2021-03-24 01:35:28] Training mlp across 300 data points in blobs...
[2021-03-24 01:35:32] Training accuracy: 0.6765
[2021-03-24 01:35:32] Testing on 5000 data points...
[2021-03-24 01:35:32] Test score for 300 training labels: 0.5840
[2021-03-24 01:35:32] Updated results: ../results/blobs/mlp_savelabelled/results.json
