[2021-03-13 21:42:31] Seeded: 5
[2021-03-13 21:42:31] Created experiment 0:
[2021-03-13 21:42:31]  - Model: mlp
[2021-03-13 21:42:31]  - Acquisition function: random
[2021-03-13 21:42:31] Loading blobsthin test set...
[2021-03-13 21:42:31] Generated 500 blobs:
[2021-03-13 21:42:31] Class 0: 20
[2021-03-13 21:42:31] Class 1: 30
[2021-03-13 21:42:31] Class 2: 100
[2021-03-13 21:42:31] Class 3: 10
[2021-03-13 21:42:31] Class 4: 5
[2021-03-13 21:42:31] Class 5: 20
[2021-03-13 21:42:31] Class 6: 40
[2021-03-13 21:42:31] Class 7: 180
[2021-03-13 21:42:31] Class 8: 5
[2021-03-13 21:42:31] Class 9: 90
[2021-03-13 21:42:31] Saved figure to: ../data/blobsthin_data.png
[2021-03-13 21:42:31] Generated 500 test points.
[2021-03-13 21:42:32] Saved figure to: ../data/blobsthin_test.png
[2021-03-13 21:42:32] Experiment repeat 1/4
[2021-03-13 21:42:32] Randomly labelled 10/500
[2021-03-13 21:42:32] Showing labelled: True (10/500 visible)
[2021-03-13 21:42:32] Showing labelled: True (10/500 visible)
[2021-03-13 21:42:32] mlp: initialized 1482 parameters.
[2021-03-13 21:42:32] Creating trainer with model on device: cuda
[2021-03-13 21:42:36] Training mlp across 10 data points in blobsthin...
[2021-03-13 21:42:36] Training loss: 2.2200
[2021-03-13 21:42:36] Testing on 500 data points...
[2021-03-13 21:42:36] Test accuracy: 0.0620
[2021-03-13 21:42:36] Score for 10 labels: 0.0620
[2021-03-13 21:42:36] Showing labelled: False (490/500 visible)
[2021-03-13 21:42:36] Found 490 unlabelled features.
[2021-03-13 21:42:36] Showing labelled: True (20/500 visible)
[2021-03-13 21:42:36] Training mlp across 20 data points in blobsthin...
[2021-03-13 21:42:36] Training loss: 2.1764
[2021-03-13 21:42:36] Testing on 500 data points...
[2021-03-13 21:42:36] Test accuracy: 0.0600
[2021-03-13 21:42:36] Score for 20 labels: 0.0600
[2021-03-13 21:42:36] Showing labelled: False (480/500 visible)
[2021-03-13 21:42:36] Found 480 unlabelled features.
[2021-03-13 21:42:36] Showing labelled: True (30/500 visible)
[2021-03-13 21:42:36] Training mlp across 30 data points in blobsthin...
[2021-03-13 21:42:37] Training loss: 2.1763
[2021-03-13 21:42:37] Testing on 500 data points...
[2021-03-13 21:42:37] Test accuracy: 0.0640
[2021-03-13 21:42:37] Score for 30 labels: 0.0640
[2021-03-13 21:42:37] Showing labelled: False (470/500 visible)
[2021-03-13 21:42:37] Found 470 unlabelled features.
[2021-03-13 21:42:37] Showing labelled: True (40/500 visible)
[2021-03-13 21:42:37] Training mlp across 40 data points in blobsthin...
[2021-03-13 21:42:37] Training loss: 2.1232
[2021-03-13 21:42:37] Testing on 500 data points...
[2021-03-13 21:42:37] Test accuracy: 0.0760
[2021-03-13 21:42:37] Score for 40 labels: 0.0760
[2021-03-13 21:42:37] Showing labelled: False (460/500 visible)
[2021-03-13 21:42:37] Found 460 unlabelled features.
[2021-03-13 21:42:37] Showing labelled: True (50/500 visible)
[2021-03-13 21:42:37] Training mlp across 50 data points in blobsthin...
[2021-03-13 21:42:37] Training loss: 2.1456
[2021-03-13 21:42:37] Testing on 500 data points...
[2021-03-13 21:42:37] Test accuracy: 0.0960
[2021-03-13 21:42:37] Score for 50 labels: 0.0960
[2021-03-13 21:42:37] Showing labelled: False (450/500 visible)
[2021-03-13 21:42:37] Found 450 unlabelled features.
[2021-03-13 21:42:37] Showing labelled: True (60/500 visible)
[2021-03-13 21:42:37] Training mlp across 60 data points in blobsthin...
[2021-03-13 21:42:37] Training loss: 2.1075
[2021-03-13 21:42:37] Testing on 500 data points...
[2021-03-13 21:42:37] Test accuracy: 0.1460
[2021-03-13 21:42:37] Score for 60 labels: 0.1460
[2021-03-13 21:42:37] Showing labelled: False (440/500 visible)
[2021-03-13 21:42:37] Found 440 unlabelled features.
[2021-03-13 21:42:37] Showing labelled: True (70/500 visible)
[2021-03-13 21:42:37] Training mlp across 70 data points in blobsthin...
[2021-03-13 21:42:37] Training loss: 2.1117
[2021-03-13 21:42:37] Testing on 500 data points...
[2021-03-13 21:42:37] Test accuracy: 0.1440
[2021-03-13 21:42:37] Score for 70 labels: 0.1440
[2021-03-13 21:42:37] Showing labelled: False (430/500 visible)
[2021-03-13 21:42:37] Found 430 unlabelled features.
[2021-03-13 21:42:37] Showing labelled: True (80/500 visible)
[2021-03-13 21:42:37] Training mlp across 80 data points in blobsthin...
[2021-03-13 21:42:37] Training loss: 2.1214
[2021-03-13 21:42:37] Testing on 500 data points...
[2021-03-13 21:42:37] Test accuracy: 0.1440
[2021-03-13 21:42:37] Score for 80 labels: 0.1440
[2021-03-13 21:42:37] Showing labelled: False (420/500 visible)
[2021-03-13 21:42:37] Found 420 unlabelled features.
[2021-03-13 21:42:37] Showing labelled: True (90/500 visible)
[2021-03-13 21:42:37] Training mlp across 90 data points in blobsthin...
[2021-03-13 21:42:37] Training loss: 2.1191
[2021-03-13 21:42:37] Testing on 500 data points...
[2021-03-13 21:42:37] Test accuracy: 0.1380
[2021-03-13 21:42:37] Score for 90 labels: 0.1380
[2021-03-13 21:42:37] Showing labelled: False (410/500 visible)
[2021-03-13 21:42:37] Found 410 unlabelled features.
[2021-03-13 21:42:37] Showing labelled: True (100/500 visible)
[2021-03-13 21:42:37] Training mlp across 100 data points in blobsthin...
[2021-03-13 21:42:37] Training loss: 2.1364
[2021-03-13 21:42:37] Testing on 500 data points...
[2021-03-13 21:42:38] Test accuracy: 0.1360
[2021-03-13 21:42:38] Score for 100 labels: 0.1360
[2021-03-13 21:42:38] Experiment repeat 2/4
[2021-03-13 21:42:38] Randomly labelled 10/500
[2021-03-13 21:42:38] Showing labelled: True (10/500 visible)
[2021-03-13 21:42:38] Showing labelled: True (10/500 visible)
[2021-03-13 21:42:38] mlp: initialized 1482 parameters.
[2021-03-13 21:42:38] Creating trainer with model on device: cuda
[2021-03-13 21:42:38] Training mlp across 10 data points in blobsthin...
[2021-03-13 21:42:38] Training loss: 2.3287
[2021-03-13 21:42:38] Testing on 500 data points...
[2021-03-13 21:42:38] Test accuracy: 0.1720
[2021-03-13 21:42:38] Score for 10 labels: 0.1720
[2021-03-13 21:42:38] Showing labelled: False (490/500 visible)
[2021-03-13 21:42:38] Found 490 unlabelled features.
[2021-03-13 21:42:38] Showing labelled: True (20/500 visible)
[2021-03-13 21:42:38] Training mlp across 20 data points in blobsthin...
[2021-03-13 21:42:38] Training loss: 2.3884
[2021-03-13 21:42:38] Testing on 500 data points...
[2021-03-13 21:42:38] Test accuracy: 0.1680
[2021-03-13 21:42:38] Score for 20 labels: 0.1680
[2021-03-13 21:42:38] Showing labelled: False (480/500 visible)
[2021-03-13 21:42:38] Found 480 unlabelled features.
[2021-03-13 21:42:38] Showing labelled: True (30/500 visible)
[2021-03-13 21:42:38] Training mlp across 30 data points in blobsthin...
[2021-03-13 21:42:38] Training loss: 2.3523
[2021-03-13 21:42:38] Testing on 500 data points...
[2021-03-13 21:42:38] Test accuracy: 0.1700
[2021-03-13 21:42:38] Score for 30 labels: 0.1700
[2021-03-13 21:42:38] Showing labelled: False (470/500 visible)
[2021-03-13 21:42:38] Found 470 unlabelled features.
[2021-03-13 21:42:38] Showing labelled: True (40/500 visible)
[2021-03-13 21:42:38] Training mlp across 40 data points in blobsthin...
[2021-03-13 21:42:38] Training loss: 2.3072
[2021-03-13 21:42:38] Testing on 500 data points...
[2021-03-13 21:42:38] Test accuracy: 0.1700
[2021-03-13 21:42:38] Score for 40 labels: 0.1700
[2021-03-13 21:42:38] Showing labelled: False (460/500 visible)
[2021-03-13 21:42:38] Found 460 unlabelled features.
[2021-03-13 21:42:38] Showing labelled: True (50/500 visible)
[2021-03-13 21:42:38] Training mlp across 50 data points in blobsthin...
[2021-03-13 21:42:38] Training loss: 2.2184
[2021-03-13 21:42:38] Testing on 500 data points...
[2021-03-13 21:42:38] Test accuracy: 0.1720
[2021-03-13 21:42:38] Score for 50 labels: 0.1720
[2021-03-13 21:42:38] Showing labelled: False (450/500 visible)
[2021-03-13 21:42:38] Found 450 unlabelled features.
[2021-03-13 21:42:38] Showing labelled: True (60/500 visible)
[2021-03-13 21:42:38] Training mlp across 60 data points in blobsthin...
[2021-03-13 21:42:38] Training loss: 2.2134
[2021-03-13 21:42:38] Testing on 500 data points...
[2021-03-13 21:42:38] Test accuracy: 0.1740
[2021-03-13 21:42:38] Score for 60 labels: 0.1740
[2021-03-13 21:42:38] Showing labelled: False (440/500 visible)
[2021-03-13 21:42:38] Found 440 unlabelled features.
[2021-03-13 21:42:38] Showing labelled: True (70/500 visible)
[2021-03-13 21:42:38] Training mlp across 70 data points in blobsthin...
[2021-03-13 21:42:38] Training loss: 2.1865
[2021-03-13 21:42:38] Testing on 500 data points...
[2021-03-13 21:42:38] Test accuracy: 0.1760
[2021-03-13 21:42:38] Score for 70 labels: 0.1760
[2021-03-13 21:42:38] Showing labelled: False (430/500 visible)
[2021-03-13 21:42:38] Found 430 unlabelled features.
[2021-03-13 21:42:38] Showing labelled: True (80/500 visible)
[2021-03-13 21:42:38] Training mlp across 80 data points in blobsthin...
[2021-03-13 21:42:38] Training loss: 2.1448
[2021-03-13 21:42:38] Testing on 500 data points...
[2021-03-13 21:42:38] Test accuracy: 0.1780
[2021-03-13 21:42:38] Score for 80 labels: 0.1780
[2021-03-13 21:42:38] Showing labelled: False (420/500 visible)
[2021-03-13 21:42:38] Found 420 unlabelled features.
[2021-03-13 21:42:38] Showing labelled: True (90/500 visible)
[2021-03-13 21:42:38] Training mlp across 90 data points in blobsthin...
[2021-03-13 21:42:39] Training loss: 2.0941
[2021-03-13 21:42:39] Testing on 500 data points...
[2021-03-13 21:42:39] Test accuracy: 0.2060
[2021-03-13 21:42:39] Score for 90 labels: 0.2060
[2021-03-13 21:42:39] Showing labelled: False (410/500 visible)
[2021-03-13 21:42:39] Found 410 unlabelled features.
[2021-03-13 21:42:39] Showing labelled: True (100/500 visible)
[2021-03-13 21:42:39] Training mlp across 100 data points in blobsthin...
[2021-03-13 21:42:39] Training loss: 2.0518
[2021-03-13 21:42:39] Testing on 500 data points...
[2021-03-13 21:42:39] Test accuracy: 0.2500
[2021-03-13 21:42:39] Score for 100 labels: 0.2500
[2021-03-13 21:42:39] Experiment repeat 3/4
[2021-03-13 21:42:39] Randomly labelled 10/500
[2021-03-13 21:42:39] Showing labelled: True (10/500 visible)
[2021-03-13 21:42:39] Showing labelled: True (10/500 visible)
[2021-03-13 21:42:39] mlp: initialized 1482 parameters.
[2021-03-13 21:42:39] Creating trainer with model on device: cuda
[2021-03-13 21:42:39] Training mlp across 10 data points in blobsthin...
[2021-03-13 21:42:39] Training loss: 2.2783
[2021-03-13 21:42:39] Testing on 500 data points...
[2021-03-13 21:42:39] Test accuracy: 0.1000
[2021-03-13 21:42:39] Score for 10 labels: 0.1000
[2021-03-13 21:42:39] Showing labelled: False (490/500 visible)
[2021-03-13 21:42:39] Found 490 unlabelled features.
[2021-03-13 21:42:39] Showing labelled: True (20/500 visible)
[2021-03-13 21:42:39] Training mlp across 20 data points in blobsthin...
[2021-03-13 21:42:39] Training loss: 2.5104
[2021-03-13 21:42:39] Testing on 500 data points...
[2021-03-13 21:42:39] Test accuracy: 0.1000
[2021-03-13 21:42:39] Score for 20 labels: 0.1000
[2021-03-13 21:42:39] Showing labelled: False (480/500 visible)
[2021-03-13 21:42:39] Found 480 unlabelled features.
[2021-03-13 21:42:39] Showing labelled: True (30/500 visible)
[2021-03-13 21:42:39] Training mlp across 30 data points in blobsthin...
[2021-03-13 21:42:39] Training loss: 2.3408
[2021-03-13 21:42:39] Testing on 500 data points...
[2021-03-13 21:42:39] Test accuracy: 0.1000
[2021-03-13 21:42:39] Score for 30 labels: 0.1000
[2021-03-13 21:42:39] Showing labelled: False (470/500 visible)
[2021-03-13 21:42:39] Found 470 unlabelled features.
[2021-03-13 21:42:39] Showing labelled: True (40/500 visible)
[2021-03-13 21:42:39] Training mlp across 40 data points in blobsthin...
[2021-03-13 21:42:39] Training loss: 2.3121
[2021-03-13 21:42:39] Testing on 500 data points...
[2021-03-13 21:42:39] Test accuracy: 0.1000
[2021-03-13 21:42:39] Score for 40 labels: 0.1000
[2021-03-13 21:42:39] Showing labelled: False (460/500 visible)
[2021-03-13 21:42:39] Found 460 unlabelled features.
[2021-03-13 21:42:39] Showing labelled: True (50/500 visible)
[2021-03-13 21:42:39] Training mlp across 50 data points in blobsthin...
[2021-03-13 21:42:39] Training loss: 2.3035
[2021-03-13 21:42:39] Testing on 500 data points...
[2021-03-13 21:42:39] Test accuracy: 0.1000
[2021-03-13 21:42:39] Score for 50 labels: 0.1000
[2021-03-13 21:42:39] Showing labelled: False (450/500 visible)
[2021-03-13 21:42:39] Found 450 unlabelled features.
[2021-03-13 21:42:39] Showing labelled: True (60/500 visible)
[2021-03-13 21:42:39] Training mlp across 60 data points in blobsthin...
[2021-03-13 21:42:39] Training loss: 2.2590
[2021-03-13 21:42:39] Testing on 500 data points...
[2021-03-13 21:42:39] Test accuracy: 0.1000
[2021-03-13 21:42:39] Score for 60 labels: 0.1000
[2021-03-13 21:42:39] Showing labelled: False (440/500 visible)
[2021-03-13 21:42:39] Found 440 unlabelled features.
[2021-03-13 21:42:39] Showing labelled: True (70/500 visible)
[2021-03-13 21:42:39] Training mlp across 70 data points in blobsthin...
[2021-03-13 21:42:39] Training loss: 2.2185
[2021-03-13 21:42:39] Testing on 500 data points...
[2021-03-13 21:42:39] Test accuracy: 0.1000
[2021-03-13 21:42:39] Score for 70 labels: 0.1000
[2021-03-13 21:42:39] Showing labelled: False (430/500 visible)
[2021-03-13 21:42:39] Found 430 unlabelled features.
[2021-03-13 21:42:39] Showing labelled: True (80/500 visible)
[2021-03-13 21:42:39] Training mlp across 80 data points in blobsthin...
[2021-03-13 21:42:40] Training loss: 2.1909
[2021-03-13 21:42:40] Testing on 500 data points...
[2021-03-13 21:42:40] Test accuracy: 0.1000
[2021-03-13 21:42:40] Score for 80 labels: 0.1000
[2021-03-13 21:42:40] Showing labelled: False (420/500 visible)
[2021-03-13 21:42:40] Found 420 unlabelled features.
[2021-03-13 21:42:40] Showing labelled: True (90/500 visible)
[2021-03-13 21:42:40] Training mlp across 90 data points in blobsthin...
[2021-03-13 21:42:40] Training loss: 2.1440
[2021-03-13 21:42:40] Testing on 500 data points...
[2021-03-13 21:42:40] Test accuracy: 0.1000
[2021-03-13 21:42:40] Score for 90 labels: 0.1000
[2021-03-13 21:42:40] Showing labelled: False (410/500 visible)
[2021-03-13 21:42:40] Found 410 unlabelled features.
[2021-03-13 21:42:40] Showing labelled: True (100/500 visible)
[2021-03-13 21:42:40] Training mlp across 100 data points in blobsthin...
[2021-03-13 21:42:40] Training loss: 2.0982
[2021-03-13 21:42:40] Testing on 500 data points...
[2021-03-13 21:42:40] Test accuracy: 0.1000
[2021-03-13 21:42:40] Score for 100 labels: 0.1000
[2021-03-13 21:42:40] Experiment repeat 4/4
[2021-03-13 21:42:40] Randomly labelled 10/500
[2021-03-13 21:42:40] Showing labelled: True (10/500 visible)
[2021-03-13 21:42:40] Showing labelled: True (10/500 visible)
[2021-03-13 21:42:40] mlp: initialized 1482 parameters.
[2021-03-13 21:42:40] Creating trainer with model on device: cuda
[2021-03-13 21:42:40] Training mlp across 10 data points in blobsthin...
[2021-03-13 21:42:40] Training loss: 2.7795
[2021-03-13 21:42:40] Testing on 500 data points...
[2021-03-13 21:42:40] Test accuracy: 0.0000
[2021-03-13 21:42:40] Score for 10 labels: 0.0000
[2021-03-13 21:42:40] Showing labelled: False (490/500 visible)
[2021-03-13 21:42:40] Found 490 unlabelled features.
[2021-03-13 21:42:40] Showing labelled: True (20/500 visible)
[2021-03-13 21:42:40] Training mlp across 20 data points in blobsthin...
[2021-03-13 21:42:40] Training loss: 2.6554
[2021-03-13 21:42:40] Testing on 500 data points...
[2021-03-13 21:42:40] Test accuracy: 0.0000
[2021-03-13 21:42:40] Score for 20 labels: 0.0000
[2021-03-13 21:42:40] Showing labelled: False (480/500 visible)
[2021-03-13 21:42:40] Found 480 unlabelled features.
[2021-03-13 21:42:40] Showing labelled: True (30/500 visible)
[2021-03-13 21:42:40] Training mlp across 30 data points in blobsthin...
[2021-03-13 21:42:40] Training loss: 2.5849
[2021-03-13 21:42:40] Testing on 500 data points...
[2021-03-13 21:42:40] Test accuracy: 0.0000
[2021-03-13 21:42:40] Score for 30 labels: 0.0000
[2021-03-13 21:42:40] Showing labelled: False (470/500 visible)
[2021-03-13 21:42:40] Found 470 unlabelled features.
[2021-03-13 21:42:40] Showing labelled: True (40/500 visible)
[2021-03-13 21:42:40] Training mlp across 40 data points in blobsthin...
[2021-03-13 21:42:40] Training loss: 2.5573
[2021-03-13 21:42:40] Testing on 500 data points...
[2021-03-13 21:42:40] Test accuracy: 0.0000
[2021-03-13 21:42:40] Score for 40 labels: 0.0000
[2021-03-13 21:42:40] Showing labelled: False (460/500 visible)
[2021-03-13 21:42:40] Found 460 unlabelled features.
[2021-03-13 21:42:40] Showing labelled: True (50/500 visible)
[2021-03-13 21:42:40] Training mlp across 50 data points in blobsthin...
[2021-03-13 21:42:40] Training loss: 2.4928
[2021-03-13 21:42:40] Testing on 500 data points...
[2021-03-13 21:42:40] Test accuracy: 0.0000
[2021-03-13 21:42:40] Score for 50 labels: 0.0000
[2021-03-13 21:42:40] Showing labelled: False (450/500 visible)
[2021-03-13 21:42:40] Found 450 unlabelled features.
[2021-03-13 21:42:40] Showing labelled: True (60/500 visible)
[2021-03-13 21:42:40] Training mlp across 60 data points in blobsthin...
[2021-03-13 21:42:40] Training loss: 2.4112
[2021-03-13 21:42:40] Testing on 500 data points...
[2021-03-13 21:42:40] Test accuracy: 0.0000
[2021-03-13 21:42:40] Score for 60 labels: 0.0000
[2021-03-13 21:42:40] Showing labelled: False (440/500 visible)
[2021-03-13 21:42:40] Found 440 unlabelled features.
[2021-03-13 21:42:40] Showing labelled: True (70/500 visible)
[2021-03-13 21:42:40] Training mlp across 70 data points in blobsthin...
[2021-03-13 21:42:41] Training loss: 2.3351
[2021-03-13 21:42:41] Testing on 500 data points...
[2021-03-13 21:42:41] Test accuracy: 0.0000
[2021-03-13 21:42:41] Score for 70 labels: 0.0000
[2021-03-13 21:42:41] Showing labelled: False (430/500 visible)
[2021-03-13 21:42:41] Found 430 unlabelled features.
[2021-03-13 21:42:41] Showing labelled: True (80/500 visible)
[2021-03-13 21:42:41] Training mlp across 80 data points in blobsthin...
[2021-03-13 21:42:41] Training loss: 2.2553
[2021-03-13 21:42:41] Testing on 500 data points...
[2021-03-13 21:42:41] Test accuracy: 0.0000
[2021-03-13 21:42:41] Score for 80 labels: 0.0000
[2021-03-13 21:42:41] Showing labelled: False (420/500 visible)
[2021-03-13 21:42:41] Found 420 unlabelled features.
[2021-03-13 21:42:41] Showing labelled: True (90/500 visible)
[2021-03-13 21:42:41] Training mlp across 90 data points in blobsthin...
[2021-03-13 21:42:41] Training loss: 2.1813
[2021-03-13 21:42:41] Testing on 500 data points...
[2021-03-13 21:42:41] Test accuracy: 0.0960
[2021-03-13 21:42:41] Score for 90 labels: 0.0960
[2021-03-13 21:42:41] Showing labelled: False (410/500 visible)
[2021-03-13 21:42:41] Found 410 unlabelled features.
[2021-03-13 21:42:41] Showing labelled: True (100/500 visible)
[2021-03-13 21:42:41] Training mlp across 100 data points in blobsthin...
[2021-03-13 21:42:41] Training loss: 2.1079
[2021-03-13 21:42:41] Testing on 500 data points...
[2021-03-13 21:42:41] Test accuracy: 0.1620
[2021-03-13 21:42:41] Score for 100 labels: 0.1620
[2021-03-13 21:42:41] Updated results: ../results/sample/results.json
