[2021-03-16 01:32:50] Seeded: 5
[2021-03-16 01:32:50] Created experiment 0:
[2021-03-16 01:32:50]  - Model: mlp
[2021-03-16 01:32:50]  - Acquisition function: least-confidence
[2021-03-16 01:32:50] Loading blobsthin test set...
[2021-03-16 01:32:50] Generated 5000 blobs:
[2021-03-16 01:32:50] Class 0: 200
[2021-03-16 01:32:50] Class 1: 300
[2021-03-16 01:32:50] Class 2: 1000
[2021-03-16 01:32:50] Class 3: 100
[2021-03-16 01:32:50] Class 4: 50
[2021-03-16 01:32:50] Class 5: 200
[2021-03-16 01:32:50] Class 6: 400
[2021-03-16 01:32:50] Class 7: 1800
[2021-03-16 01:32:50] Class 8: 50
[2021-03-16 01:32:50] Class 9: 900
[2021-03-16 01:32:50] Saved figure to: ../data/blobsthin_data.png
[2021-03-16 01:32:50] Generated 5000 test points.
[2021-03-16 01:32:50] Saved figure to: ../data/blobsthin_test.png
[2021-03-16 01:32:50] Experiment repeat 1/2
[2021-03-16 01:32:50] Randomly labelled 50/5000
[2021-03-16 01:32:50] Showing labelled: True (50/5000 visible)
[2021-03-16 01:32:50] Running: experiment 0
[2021-03-16 01:32:50] Showing labelled: True (50/5000 visible)
[2021-03-16 01:32:50] mlp: initialized 1482 parameters.
[2021-03-16 01:32:50] Creating trainer with model on device: cuda
[2021-03-16 01:32:55] Training mlp across 50 data points in blobsthin...
[2021-03-16 01:32:55] Training loss: -0.0614
[2021-03-16 01:32:55] Testing on 5000 data points...
[2021-03-16 01:32:55] Test accuracy: 0.0862
[2021-03-16 01:32:55] Score for 50 labels: 0.0862
[2021-03-16 01:32:55] Showing labelled: False (4950/5000 visible)
[2021-03-16 01:32:55] Found 4950 unlabelled features.
[2021-03-16 01:32:55] Showing labelled: True (75/5000 visible)
[2021-03-16 01:32:55] Training mlp across 75 data points in blobsthin...
[2021-03-16 01:32:56] Training loss: -0.0782
[2021-03-16 01:32:56] Testing on 5000 data points...
[2021-03-16 01:32:56] Test accuracy: 0.1058
[2021-03-16 01:32:56] Score for 75 labels: 0.1058
[2021-03-16 01:32:56] Showing labelled: False (4925/5000 visible)
[2021-03-16 01:32:56] Found 4925 unlabelled features.
[2021-03-16 01:32:56] Showing labelled: True (100/5000 visible)
[2021-03-16 01:32:56] Training mlp across 100 data points in blobsthin...
[2021-03-16 01:32:57] Training loss: -0.0825
[2021-03-16 01:32:57] Testing on 5000 data points...
[2021-03-16 01:32:57] Test accuracy: 0.1114
[2021-03-16 01:32:57] Score for 100 labels: 0.1114
[2021-03-16 01:32:57] Showing labelled: False (4900/5000 visible)
[2021-03-16 01:32:57] Found 4900 unlabelled features.
[2021-03-16 01:32:57] Showing labelled: True (125/5000 visible)
[2021-03-16 01:32:57] Training mlp across 125 data points in blobsthin...
[2021-03-16 01:32:57] Training loss: -0.0899
[2021-03-16 01:32:57] Testing on 5000 data points...
[2021-03-16 01:32:57] Test accuracy: 0.1024
[2021-03-16 01:32:57] Score for 125 labels: 0.1024
[2021-03-16 01:32:57] Showing labelled: False (4875/5000 visible)
[2021-03-16 01:32:57] Found 4875 unlabelled features.
[2021-03-16 01:32:58] Showing labelled: True (150/5000 visible)
[2021-03-16 01:32:58] Training mlp across 150 data points in blobsthin...
[2021-03-16 01:32:58] Training loss: -0.1020
[2021-03-16 01:32:58] Testing on 5000 data points...
[2021-03-16 01:32:58] Test accuracy: 0.1000
[2021-03-16 01:32:58] Score for 150 labels: 0.1000
[2021-03-16 01:32:58] Showing labelled: False (4850/5000 visible)
[2021-03-16 01:32:58] Found 4850 unlabelled features.
[2021-03-16 01:32:58] Showing labelled: True (175/5000 visible)
[2021-03-16 01:32:58] Training mlp across 175 data points in blobsthin...
[2021-03-16 01:32:59] Training loss: -0.1230
[2021-03-16 01:32:59] Testing on 5000 data points...
[2021-03-16 01:32:59] Test accuracy: 0.2000
[2021-03-16 01:32:59] Score for 175 labels: 0.2000
[2021-03-16 01:32:59] Showing labelled: False (4825/5000 visible)
[2021-03-16 01:32:59] Found 4825 unlabelled features.
[2021-03-16 01:33:00] Showing labelled: True (200/5000 visible)
[2021-03-16 01:33:00] Training mlp across 200 data points in blobsthin...
[2021-03-16 01:33:01] Training loss: -0.1541
[2021-03-16 01:33:01] Testing on 5000 data points...
[2021-03-16 01:33:01] Test accuracy: 0.2000
[2021-03-16 01:33:01] Score for 200 labels: 0.2000
[2021-03-16 01:33:01] Showing labelled: False (4800/5000 visible)
[2021-03-16 01:33:01] Found 4800 unlabelled features.
[2021-03-16 01:33:01] Showing labelled: True (225/5000 visible)
[2021-03-16 01:33:01] Training mlp across 225 data points in blobsthin...
[2021-03-16 01:33:02] Training loss: -0.2030
[2021-03-16 01:33:02] Testing on 5000 data points...
[2021-03-16 01:33:02] Test accuracy: 0.3000
[2021-03-16 01:33:02] Score for 225 labels: 0.3000
[2021-03-16 01:33:02] Showing labelled: False (4775/5000 visible)
[2021-03-16 01:33:02] Found 4775 unlabelled features.
[2021-03-16 01:33:02] Showing labelled: True (250/5000 visible)
[2021-03-16 01:33:02] Training mlp across 250 data points in blobsthin...
[2021-03-16 01:33:03] Training loss: -0.2926
[2021-03-16 01:33:03] Testing on 5000 data points...
[2021-03-16 01:33:03] Test accuracy: 0.3000
[2021-03-16 01:33:03] Score for 250 labels: 0.3000
[2021-03-16 01:33:03] Showing labelled: False (4750/5000 visible)
[2021-03-16 01:33:03] Found 4750 unlabelled features.
[2021-03-16 01:33:03] Showing labelled: True (275/5000 visible)
[2021-03-16 01:33:03] Training mlp across 275 data points in blobsthin...
[2021-03-16 01:33:05] Training loss: -0.4721
[2021-03-16 01:33:05] Testing on 5000 data points...
[2021-03-16 01:33:05] Test accuracy: 0.2002
[2021-03-16 01:33:05] Score for 275 labels: 0.2002
[2021-03-16 01:33:05] Showing labelled: False (4725/5000 visible)
[2021-03-16 01:33:05] Found 4725 unlabelled features.
[2021-03-16 01:33:05] Showing labelled: True (300/5000 visible)
[2021-03-16 01:33:05] Training mlp across 300 data points in blobsthin...
[2021-03-16 01:33:07] Training loss: -0.8506
[2021-03-16 01:33:07] Testing on 5000 data points...
[2021-03-16 01:33:07] Test accuracy: 0.2000
[2021-03-16 01:33:07] Score for 300 labels: 0.2000
[2021-03-16 01:33:07] Experiment repeat 2/2
[2021-03-16 01:33:07] Randomly labelled 50/5000
[2021-03-16 01:33:07] Showing labelled: True (50/5000 visible)
[2021-03-16 01:33:07] Running: experiment 0
[2021-03-16 01:33:07] Showing labelled: True (50/5000 visible)
[2021-03-16 01:33:07] mlp: initialized 1482 parameters.
[2021-03-16 01:33:07] Creating trainer with model on device: cuda
[2021-03-16 01:33:07] Training mlp across 50 data points in blobsthin...
[2021-03-16 01:33:07] Training loss: -0.0605
[2021-03-16 01:33:07] Testing on 5000 data points...
[2021-03-16 01:33:07] Test accuracy: 0.2000
[2021-03-16 01:33:07] Score for 50 labels: 0.2000
[2021-03-16 01:33:07] Showing labelled: False (4950/5000 visible)
[2021-03-16 01:33:07] Found 4950 unlabelled features.
[2021-03-16 01:33:07] Showing labelled: True (75/5000 visible)
[2021-03-16 01:33:07] Training mlp across 75 data points in blobsthin...
[2021-03-16 01:33:08] Training loss: -0.0694
[2021-03-16 01:33:08] Testing on 5000 data points...
[2021-03-16 01:33:08] Test accuracy: 0.2940
[2021-03-16 01:33:08] Score for 75 labels: 0.2940
[2021-03-16 01:33:08] Showing labelled: False (4925/5000 visible)
[2021-03-16 01:33:08] Found 4925 unlabelled features.
[2021-03-16 01:33:08] Showing labelled: True (100/5000 visible)
[2021-03-16 01:33:08] Training mlp across 100 data points in blobsthin...
[2021-03-16 01:33:08] Training loss: -0.0793
[2021-03-16 01:33:08] Testing on 5000 data points...
[2021-03-16 01:33:08] Test accuracy: 0.2970
[2021-03-16 01:33:08] Score for 100 labels: 0.2970
[2021-03-16 01:33:08] Showing labelled: False (4900/5000 visible)
[2021-03-16 01:33:08] Found 4900 unlabelled features.
[2021-03-16 01:33:08] Showing labelled: True (125/5000 visible)
[2021-03-16 01:33:08] Training mlp across 125 data points in blobsthin...
[2021-03-16 01:33:09] Training loss: -0.0941
[2021-03-16 01:33:09] Testing on 5000 data points...
[2021-03-16 01:33:09] Test accuracy: 0.2932
[2021-03-16 01:33:09] Score for 125 labels: 0.2932
[2021-03-16 01:33:09] Showing labelled: False (4875/5000 visible)
[2021-03-16 01:33:09] Found 4875 unlabelled features.
[2021-03-16 01:33:09] Showing labelled: True (150/5000 visible)
[2021-03-16 01:33:09] Training mlp across 150 data points in blobsthin...
[2021-03-16 01:33:10] Training loss: -0.1151
[2021-03-16 01:33:10] Testing on 5000 data points...
[2021-03-16 01:33:10] Test accuracy: 0.3000
[2021-03-16 01:33:10] Score for 150 labels: 0.3000
[2021-03-16 01:33:10] Showing labelled: False (4850/5000 visible)
[2021-03-16 01:33:10] Found 4850 unlabelled features.
[2021-03-16 01:33:10] Showing labelled: True (175/5000 visible)
[2021-03-16 01:33:10] Training mlp across 175 data points in blobsthin...
[2021-03-16 01:33:11] Training loss: -0.1438
[2021-03-16 01:33:11] Testing on 5000 data points...
[2021-03-16 01:33:11] Test accuracy: 0.3592
[2021-03-16 01:33:11] Score for 175 labels: 0.3592
[2021-03-16 01:33:11] Showing labelled: False (4825/5000 visible)
[2021-03-16 01:33:11] Found 4825 unlabelled features.
[2021-03-16 01:33:11] Showing labelled: True (200/5000 visible)
[2021-03-16 01:33:11] Training mlp across 200 data points in blobsthin...
[2021-03-16 01:33:12] Training loss: -0.1914
[2021-03-16 01:33:12] Testing on 5000 data points...
[2021-03-16 01:33:12] Test accuracy: 0.2000
[2021-03-16 01:33:12] Score for 200 labels: 0.2000
[2021-03-16 01:33:12] Showing labelled: False (4800/5000 visible)
[2021-03-16 01:33:12] Found 4800 unlabelled features.
[2021-03-16 01:33:12] Showing labelled: True (225/5000 visible)
[2021-03-16 01:33:12] Training mlp across 225 data points in blobsthin...
[2021-03-16 01:33:13] Training loss: -0.2692
[2021-03-16 01:33:13] Testing on 5000 data points...
[2021-03-16 01:33:13] Test accuracy: 0.2000
[2021-03-16 01:33:13] Score for 225 labels: 0.2000
[2021-03-16 01:33:13] Showing labelled: False (4775/5000 visible)
[2021-03-16 01:33:13] Found 4775 unlabelled features.
[2021-03-16 01:33:13] Showing labelled: True (250/5000 visible)
[2021-03-16 01:33:13] Training mlp across 250 data points in blobsthin...
[2021-03-16 01:33:15] Training loss: -0.3683
[2021-03-16 01:33:15] Testing on 5000 data points...
[2021-03-16 01:33:15] Test accuracy: 0.2000
[2021-03-16 01:33:15] Score for 250 labels: 0.2000
[2021-03-16 01:33:15] Showing labelled: False (4750/5000 visible)
[2021-03-16 01:33:15] Found 4750 unlabelled features.
[2021-03-16 01:33:15] Showing labelled: True (275/5000 visible)
[2021-03-16 01:33:15] Training mlp across 275 data points in blobsthin...
[2021-03-16 01:33:16] Training loss: -0.5595
[2021-03-16 01:33:16] Testing on 5000 data points...
[2021-03-16 01:33:16] Test accuracy: 0.1544
[2021-03-16 01:33:16] Score for 275 labels: 0.1544
[2021-03-16 01:33:16] Showing labelled: False (4725/5000 visible)
[2021-03-16 01:33:16] Found 4725 unlabelled features.
[2021-03-16 01:33:16] Showing labelled: True (300/5000 visible)
[2021-03-16 01:33:16] Training mlp across 300 data points in blobsthin...
[2021-03-16 01:33:18] Training loss: -0.9836
[2021-03-16 01:33:18] Testing on 5000 data points...
[2021-03-16 01:33:18] Test accuracy: 0.1000
[2021-03-16 01:33:18] Score for 300 labels: 0.1000
[2021-03-16 01:33:18] Updated results: ../results/label_smooth/results.json
