{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Purpose\n", "\n", "This notebook will guide you through the basic steps to get started with Active Vision.\n", "\n", "By the end of this notebook, you will be able to:\n", "\n", "- Understand the basic workflow of active learning\n", "- Understand the basic components of Active Vision\n", "- Understand how to use Active Vision to train a model and iteratively improve your dataset" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Learner\n", "\n", "With the initial dataset ready, we can load it into an `ActiveLearner` object with a name for the cycle." ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [], "source": [ "from active_vision import ActiveLearner\n", "\n", "al = ActiveLearner(name=\"cycle-1\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Load Model\n", "Now let's load a model to be used for active learning. Any `fastai` and `timm` models are supported.\n", "\n", "I'd recommend using a model with a small number of parameters, such as `resnet18` to make sure the active learning cycle is fast. \n", "This model will only be used in the active learning cycle to sample the most impactful samples to label." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "\u001b[32m2025-02-04 21:53:06.162\u001b[0m | \u001b[1mINFO \u001b[0m | \u001b[36mactive_vision.core\u001b[0m:\u001b[36m_detect_optimal_device\u001b[0m:\u001b[36m87\u001b[0m - \u001b[1mApple Silicon GPU detected - will load model on MPS\u001b[0m\n", "\u001b[32m2025-02-04 21:53:06.162\u001b[0m | \u001b[1mINFO \u001b[0m | \u001b[36mactive_vision.core\u001b[0m:\u001b[36mload_model\u001b[0m:\u001b[36m70\u001b[0m - \u001b[1mLoading a pretrained timm model `resnet18` on `mps`\u001b[0m\n" ] } ], "source": [ "al.load_model(model=\"resnet18\", pretrained=True)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Load Initial Dataset\n", "\n", "First, let's load the initial dataset we prepared earlier." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", " | filepath | \n", "label | \n", "
---|---|---|
0 | \n", "data/imagenette/train/n02102040/n02102040_2788... | \n", "English springer | \n", "
1 | \n", "data/imagenette/train/n02102040/n02102040_3759... | \n", "English springer | \n", "
2 | \n", "data/imagenette/train/n02102040/n02102040_1916... | \n", "English springer | \n", "
3 | \n", "data/imagenette/train/n02102040/n02102040_6147... | \n", "English springer | \n", "
4 | \n", "data/imagenette/train/n02102040/n02102040_403.... | \n", "English springer | \n", "
... | \n", "... | \n", "... | \n", "
95 | \n", "data/imagenette/train/n01440764/n01440764_1004... | \n", "tench | \n", "
96 | \n", "data/imagenette/train/n01440764/n01440764_3153... | \n", "tench | \n", "
97 | \n", "data/imagenette/train/n01440764/n01440764_1284... | \n", "tench | \n", "
98 | \n", "data/imagenette/train/n01440764/n01440764_3997... | \n", "tench | \n", "
99 | \n", "data/imagenette/train/n01440764/n01440764_2978... | \n", "tench | \n", "
100 rows × 2 columns
\n", "\n", " | filepath | \n", "label | \n", "
---|---|---|
74 | \n", "data/imagenette/train/n03445777/n03445777_1058... | \n", "golf ball | \n", "
53 | \n", "data/imagenette/train/n03417042/n03417042_9128... | \n", "garbage truck | \n", "
29 | \n", "data/imagenette/train/n02979186/n02979186_7354... | \n", "cassette player | \n", "
96 | \n", "data/imagenette/train/n01440764/n01440764_3153... | \n", "tench | \n", "
70 | \n", "data/imagenette/train/n03445777/n03445777_4354... | \n", "golf ball | \n", "
... | \n", "... | \n", "... | \n", "
89 | \n", "data/imagenette/train/n03888257/n03888257_4345... | \n", "parachute | \n", "
2 | \n", "data/imagenette/train/n02102040/n02102040_1916... | \n", "English springer | \n", "
35 | \n", "data/imagenette/train/n03000684/n03000684_1381... | \n", "chain saw | \n", "
97 | \n", "data/imagenette/train/n01440764/n01440764_1284... | \n", "tench | \n", "
32 | \n", "data/imagenette/train/n03000684/n03000684_8985... | \n", "chain saw | \n", "
80 rows × 2 columns
\n", "\n", " | filepath | \n", "label | \n", "
---|---|---|
75 | \n", "data/imagenette/train/n03445777/ILSVRC2012_val... | \n", "golf ball | \n", "
15 | \n", "data/imagenette/train/n03394916/n03394916_3860... | \n", "French horn | \n", "
98 | \n", "data/imagenette/train/n01440764/n01440764_3997... | \n", "tench | \n", "
90 | \n", "data/imagenette/train/n01440764/n01440764_8805... | \n", "tench | \n", "
31 | \n", "data/imagenette/train/n03000684/n03000684_7905... | \n", "chain saw | \n", "
65 | \n", "data/imagenette/train/n03425413/n03425413_2074... | \n", "gas pump | \n", "
59 | \n", "data/imagenette/train/n03417042/n03417042_79.JPEG | \n", "garbage truck | \n", "
44 | \n", "data/imagenette/train/n03028079/n03028079_8632... | \n", "church | \n", "
30 | \n", "data/imagenette/train/n03000684/n03000684_9935... | \n", "chain saw | \n", "
18 | \n", "data/imagenette/train/n03394916/n03394916_3080... | \n", "French horn | \n", "
58 | \n", "data/imagenette/train/n03417042/ILSVRC2012_val... | \n", "garbage truck | \n", "
11 | \n", "data/imagenette/train/n03394916/n03394916_2128... | \n", "French horn | \n", "
19 | \n", "data/imagenette/train/n03394916/n03394916_3543... | \n", "French horn | \n", "
79 | \n", "data/imagenette/train/n03445777/n03445777_1250... | \n", "golf ball | \n", "
12 | \n", "data/imagenette/train/n03394916/n03394916_5342... | \n", "French horn | \n", "
16 | \n", "data/imagenette/train/n03394916/n03394916_4308... | \n", "French horn | \n", "
64 | \n", "data/imagenette/train/n03425413/n03425413_1007... | \n", "gas pump | \n", "
77 | \n", "data/imagenette/train/n03445777/n03445777_9105... | \n", "golf ball | \n", "
92 | \n", "data/imagenette/train/n01440764/n01440764_1520... | \n", "tench | \n", "
39 | \n", "data/imagenette/train/n03000684/n03000684_2753... | \n", "chain saw | \n", "
epoch | \n", "train_loss | \n", "valid_loss | \n", "accuracy | \n", "time | \n", "
---|---|---|---|---|
0 | \n", "3.548794 | \n", "2.326282 | \n", "0.250000 | \n", "00:00 | \n", "
1 | \n", "2.531440 | \n", "0.587719 | \n", "0.850000 | \n", "00:00 | \n", "
2 | \n", "1.712109 | \n", "0.455706 | \n", "0.800000 | \n", "00:00 | \n", "
epoch | \n", "train_loss | \n", "valid_loss | \n", "accuracy | \n", "time | \n", "
---|---|---|---|---|
0 | \n", "0.076002 | \n", "0.375373 | \n", "0.850000 | \n", "00:00 | \n", "
1 | \n", "0.071136 | \n", "0.379791 | \n", "0.900000 | \n", "00:00 | \n", "
2 | \n", "0.070615 | \n", "0.327519 | \n", "0.900000 | \n", "00:00 | \n", "
3 | \n", "0.070802 | \n", "0.502693 | \n", "0.800000 | \n", "00:00 | \n", "
4 | \n", "0.082460 | \n", "0.544212 | \n", "0.800000 | \n", "00:00 | \n", "
5 | \n", "0.075920 | \n", "0.491695 | \n", "0.800000 | \n", "00:00 | \n", "
6 | \n", "0.071243 | \n", "0.527742 | \n", "0.800000 | \n", "00:00 | \n", "
7 | \n", "0.067941 | \n", "0.484508 | \n", "0.800000 | \n", "00:00 | \n", "
8 | \n", "0.069538 | \n", "0.462621 | \n", "0.800000 | \n", "00:00 | \n", "
9 | \n", "0.062958 | \n", "0.493862 | \n", "0.800000 | \n", "00:00 | \n", "
\n", " | filepath | \n", "label | \n", "
---|---|---|
0 | \n", "data/imagenette/val/n03394916/n03394916_32422.... | \n", "French horn | \n", "
1 | \n", "data/imagenette/val/n03394916/n03394916_69132.... | \n", "French horn | \n", "
2 | \n", "data/imagenette/val/n03394916/n03394916_33771.... | \n", "French horn | \n", "
3 | \n", "data/imagenette/val/n03394916/n03394916_29940.... | \n", "French horn | \n", "
4 | \n", "data/imagenette/val/n03394916/ILSVRC2012_val_0... | \n", "French horn | \n", "
... | \n", "... | \n", "... | \n", "
3920 | \n", "data/imagenette/val/n02979186/n02979186_27392.... | \n", "cassette player | \n", "
3921 | \n", "data/imagenette/val/n02979186/n02979186_2742.JPEG | \n", "cassette player | \n", "
3922 | \n", "data/imagenette/val/n02979186/n02979186_2312.JPEG | \n", "cassette player | \n", "
3923 | \n", "data/imagenette/val/n02979186/n02979186_12822.... | \n", "cassette player | \n", "
3924 | \n", "data/imagenette/val/n02979186/ILSVRC2012_val_0... | \n", "cassette player | \n", "
3925 rows × 2 columns
\n", "\n", " | name | \n", "accuracy | \n", "train_set_size | \n", "valid_set_size | \n", "dataset_size | \n", "num_classes | \n", "model | \n", "pretrained | \n", "loss_fn | \n", "device | \n", "seed | \n", "batch_size | \n", "image_size | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | \n", "cycle-1 | \n", "0.90242 | \n", "80 | \n", "20 | \n", "100 | \n", "10 | \n", "resnet18 | \n", "True | \n", "FlattenedLoss of CrossEntropyLoss() | \n", "mps | \n", "None | \n", "16 | \n", "224 | \n", "
\n", " | filepath | \n", "pred_label | \n", "pred_conf | \n", "probs | \n", "logits | \n", "embeddings | \n", "
---|---|---|---|---|---|---|
0 | \n", "data/imagenette/train/n03394916/n03394916_4437... | \n", "French horn | \n", "0.8815 | \n", "[0.0, 0.8815, 0.1002, 0.0007, 0.0056, 0.0015, ... | \n", "[-4.0315, 6.3779, 4.2033, -0.7827, 1.3138, 0.0... | \n", "[1.5122, 2.9872, -0.0116, -2.0296, -1.1489, -3... | \n", "
1 | \n", "data/imagenette/train/n03394916/n03394916_4241... | \n", "French horn | \n", "0.9981 | \n", "[0.0, 0.9981, 0.0002, 0.0, 0.0001, 0.0003, 0.0... | \n", "[-4.304, 8.3362, -0.0308, -1.64, -0.8373, 0.17... | \n", "[1.8019, -2.0897, -0.1908, -1.2324, 3.1603, -2... | \n", "
2 | \n", "data/imagenette/train/n03394916/n03394916_3880... | \n", "French horn | \n", "0.9605 | \n", "[0.0014, 0.9605, 0.0004, 0.0042, 0.0068, 0.017... | \n", "[-1.2137, 5.3527, -2.4653, -0.0855, 0.398, 1.3... | \n", "[-1.7658, -1.084, 0.1105, 0.6327, -0.3034, -0.... | \n", "
3 | \n", "data/imagenette/train/n03394916/n03394916_2412... | \n", "French horn | \n", "0.9916 | \n", "[0.0, 0.9916, 0.0058, 0.0001, 0.0003, 0.0019, ... | \n", "[-2.7646, 8.6685, 3.5195, -0.3958, 0.423, 2.42... | \n", "[0.5607, -0.0849, -0.0111, -2.5747, 1.7406, -3... | \n", "
4 | \n", "data/imagenette/train/n03394916/n03394916_1128... | \n", "French horn | \n", "0.9345 | \n", "[0.0006, 0.9345, 0.0001, 0.0499, 0.0002, 0.009... | \n", "[-0.7557, 6.6546, -2.7884, 3.7239, -1.8325, 2.... | \n", "[0.0593, -2.8017, -0.8326, 0.0533, 0.3513, -4.... | \n", "
... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "
9364 | \n", "data/imagenette/train/n02979186/n02979186_8089... | \n", "cassette player | \n", "0.9998 | \n", "[0.0, 0.0, 0.9998, 0.0001, 0.0, 0.0, 0.0, 0.0,... | \n", "[0.2201, -0.8615, 11.2814, 2.2068, -2.6583, -2... | \n", "[2.7389, -0.1937, 3.834, 3.7718, -1.3812, 3.20... | \n", "
9365 | \n", "data/imagenette/train/n02979186/n02979186_1944... | \n", "cassette player | \n", "0.9978 | \n", "[0.0003, 0.0002, 0.9978, 0.0014, 0.0, 0.0003, ... | \n", "[1.1453, 0.7587, 9.4202, 2.8624, -1.6734, 1.22... | \n", "[0.8961, 0.8141, 3.2657, -1.6927, -0.944, 1.28... | \n", "
9366 | \n", "data/imagenette/train/n02979186/n02979186_1107... | \n", "cassette player | \n", "0.9976 | \n", "[0.0001, 0.0, 0.9976, 0.002, 0.0002, 0.0, 0.0,... | \n", "[-0.2329, -1.2031, 9.2606, 3.0241, 0.9305, -3.... | \n", "[-0.9728, -0.7958, 2.6238, 0.8788, 0.139, 3.13... | \n", "
9367 | \n", "data/imagenette/train/n02979186/n02979186_2938... | \n", "cassette player | \n", "0.9756 | \n", "[0.0, 0.0026, 0.9756, 0.0212, 0.0005, 0.0, 0.0... | \n", "[-2.3168, 1.9011, 7.8416, 4.0137, 0.2384, -3.5... | \n", "[-0.4059, -0.2213, 1.5756, 3.1359, 0.0702, 1.0... | \n", "
9368 | \n", "data/imagenette/train/n02979186/n02979186_93.JPEG | \n", "cassette player | \n", "0.9247 | \n", "[0.0, 0.0, 0.9247, 0.0745, 0.0001, 0.0, 0.0, 0... | \n", "[-3.7599, -2.0933, 7.9608, 5.4418, -0.9875, -3... | \n", "[-1.5722, 0.8393, 0.0824, 0.3304, -1.0368, 1.8... | \n", "
9369 rows × 6 columns
\n", "\n", " | filepath | \n", "strategy | \n", "score | \n", "pred_label | \n", "pred_conf | \n", "probs | \n", "logits | \n", "embeddings | \n", "
---|---|---|---|---|---|---|---|---|
0 | \n", "data/imagenette/train/n02979186/n02979186_1154... | \n", "least-confidence | \n", "0.7868 | \n", "cassette player | \n", "0.2132 | \n", "[0.0297, 0.0271, 0.2132, 0.086, 0.1707, 0.0837... | \n", "[-0.8746, -0.9678, 1.0962, 0.1883, 0.8735, 0.1... | \n", "[-1.48, -1.1786, -2.0082, 1.7485, -0.2949, 0.9... | \n", "
1 | \n", "data/imagenette/train/n01440764/n01440764_1172... | \n", "least-confidence | \n", "0.7713 | \n", "chain saw | \n", "0.2287 | \n", "[0.0467, 0.0442, 0.0105, 0.2287, 0.17, 0.0001,... | \n", "[-0.4178, -0.4728, -1.9077, 1.1707, 0.8743, -6... | \n", "[-1.3329, -1.4105, 1.748, -2.604, 0.3246, 1.47... | \n", "
2 | \n", "data/imagenette/train/n03888257/n03888257_2944... | \n", "least-confidence | \n", "0.7420 | \n", "garbage truck | \n", "0.2580 | \n", "[0.0041, 0.1435, 0.0333, 0.2493, 0.0242, 0.258... | \n", "[-2.333, 1.2241, -0.2361, 1.7766, -0.5566, 1.8... | \n", "[1.4352, 0.9987, -1.3353, -2.8416, -0.0622, -2... | \n", "
3 | \n", "data/imagenette/train/n01440764/n01440764_1373... | \n", "least-confidence | \n", "0.7331 | \n", "French horn | \n", "0.2669 | \n", "[0.1597, 0.2669, 0.0141, 0.0733, 0.1193, 0.095... | \n", "[2.385, 2.8984, -0.0422, 1.6063, 2.0931, 1.865... | \n", "[3.2229, 1.6883, 0.6658, 1.351, 1.4092, 0.1549... | \n", "
4 | \n", "data/imagenette/train/n03425413/n03425413_1511... | \n", "least-confidence | \n", "0.7290 | \n", "chain saw | \n", "0.2710 | \n", "[0.0507, 0.0071, 0.007, 0.271, 0.0164, 0.1051,... | \n", "[0.381, -1.5785, -1.5974, 2.0568, -0.7466, 1.1... | \n", "[-0.3913, -1.0495, -1.1727, 2.042, -1.0763, -2... | \n", "
5 | \n", "data/imagenette/train/n03445777/n03445777_258.... | \n", "least-confidence | \n", "0.7272 | \n", "cassette player | \n", "0.2728 | \n", "[0.0754, 0.0773, 0.2728, 0.0022, 0.0041, 0.009... | \n", "[1.4243, 1.4483, 2.71, -2.1106, -1.4994, -0.70... | \n", "[-2.4045, 1.845, 0.3447, -1.6225, -0.4469, 2.1... | \n", "
6 | \n", "data/imagenette/train/n03000684/n03000684_3318... | \n", "least-confidence | \n", "0.7246 | \n", "gas pump | \n", "0.2754 | \n", "[0.0127, 0.0766, 0.0056, 0.161, 0.0054, 0.1688... | \n", "[-0.8362, 0.9575, -1.6577, 1.701, -1.6913, 1.7... | \n", "[-1.6686, -0.5197, -1.2409, 0.5714, 2.7902, -1... | \n", "
7 | \n", "data/imagenette/train/n03888257/n03888257_2793... | \n", "least-confidence | \n", "0.7245 | \n", "golf ball | \n", "0.2755 | \n", "[0.1317, 0.1, 0.0025, 0.1613, 0.0339, 0.0605, ... | \n", "[1.1779, 0.9028, -2.8041, 1.3812, -0.1785, 0.3... | \n", "[-2.3253, 1.5071, 1.5362, 0.4531, 2.2692, 1.80... | \n", "
8 | \n", "data/imagenette/train/n03425413/n03425413_1914... | \n", "least-confidence | \n", "0.7244 | \n", "chain saw | \n", "0.2756 | \n", "[0.0053, 0.0945, 0.1301, 0.2756, 0.0263, 0.0, ... | \n", "[-1.9562, 0.9176, 1.237, 1.9876, -0.3615, -6.7... | \n", "[-0.9679, 0.9125, 0.2846, -1.3278, 2.8291, 2.3... | \n", "
9 | \n", "data/imagenette/train/n03000684/n03000684_3003... | \n", "least-confidence | \n", "0.7242 | \n", "chain saw | \n", "0.2758 | \n", "[0.041, 0.0259, 0.16, 0.2758, 0.0104, 0.2444, ... | \n", "[0.2453, -0.2131, 1.6076, 2.1521, -1.1224, 2.0... | \n", "[-0.2207, 0.0917, 3.5599, 0.8497, -0.5765, -2.... | \n", "
10 | \n", "data/imagenette/train/n03000684/n03000684_9113... | \n", "least-confidence | \n", "0.7239 | \n", "gas pump | \n", "0.2761 | \n", "[0.002, 0.0062, 0.2506, 0.1104, 0.0025, 0.002,... | \n", "[-2.5362, -1.3905, 2.3038, 1.4836, -2.3233, -2... | \n", "[0.1616, 1.2885, -3.0482, -1.261, -0.2587, 3.9... | \n", "
11 | \n", "data/imagenette/train/n03425413/n03425413_1459... | \n", "least-confidence | \n", "0.7222 | \n", "French horn | \n", "0.2778 | \n", "[0.0094, 0.2778, 0.0052, 0.1642, 0.022, 0.0331... | \n", "[-1.5272, 1.861, -2.113, 1.3353, -0.6759, -0.2... | \n", "[0.5004, 0.6053, -0.17, -1.9617, 1.2721, -1.23... | \n", "
12 | \n", "data/imagenette/train/n03000684/n03000684_2098... | \n", "least-confidence | \n", "0.7217 | \n", "garbage truck | \n", "0.2783 | \n", "[0.056, 0.2021, 0.0179, 0.2602, 0.0038, 0.2783... | \n", "[1.4888, 2.773, 0.3491, 3.0254, -1.1893, 3.093... | \n", "[1.7679, 0.9733, 0.7182, 2.2253, -1.1576, -2.8... | \n", "
13 | \n", "data/imagenette/train/n03425413/n03425413_1438... | \n", "least-confidence | \n", "0.7216 | \n", "parachute | \n", "0.2784 | \n", "[0.0091, 0.2633, 0.0813, 0.2637, 0.0116, 0.000... | \n", "[-1.1265, 2.2387, 1.0636, 2.2402, -0.887, -5.8... | \n", "[-2.2686, 0.7315, 2.0473, -0.6264, 0.7306, -0.... | \n", "
14 | \n", "data/imagenette/train/n03425413/n03425413_2219... | \n", "least-confidence | \n", "0.7195 | \n", "gas pump | \n", "0.2805 | \n", "[0.0012, 0.0552, 0.0386, 0.1362, 0.2309, 0.000... | \n", "[-3.3461, 0.4593, 0.1, 1.3619, 1.8895, -6.2735... | \n", "[0.2687, -1.6976, -0.3161, -0.5363, 1.1781, 1.... | \n", "
15 | \n", "data/imagenette/train/n03394916/n03394916_2325... | \n", "least-confidence | \n", "0.7194 | \n", "parachute | \n", "0.2806 | \n", "[0.0002, 0.1631, 0.0047, 0.2694, 0.0122, 0.000... | \n", "[-3.7493, 2.8131, -0.7436, 3.3148, 0.2187, -2.... | \n", "[-1.3543, 0.2244, -1.4944, -3.7606, 0.3826, -0... | \n", "
16 | \n", "data/imagenette/train/n03417042/n03417042_5698... | \n", "least-confidence | \n", "0.7193 | \n", "garbage truck | \n", "0.2807 | \n", "[0.0349, 0.1007, 0.064, 0.1788, 0.1128, 0.2807... | \n", "[-0.6681, 0.392, -0.0617, 0.9662, 0.5057, 1.41... | \n", "[-0.4051, -0.7397, -3.2106, 1.1678, 3.0157, 3.... | \n", "
17 | \n", "data/imagenette/train/n03000684/n03000684_1503... | \n", "least-confidence | \n", "0.7158 | \n", "chain saw | \n", "0.2842 | \n", "[0.0193, 0.0178, 0.003, 0.2842, 0.0075, 0.2199... | \n", "[-0.5842, -0.6629, -2.4605, 2.1054, -1.5322, 1... | \n", "[-1.0988, 4.61, 2.2829, 1.96, 2.477, -0.6304, ... | \n", "
18 | \n", "data/imagenette/train/n03425413/n03425413_3144... | \n", "least-confidence | \n", "0.7134 | \n", "garbage truck | \n", "0.2866 | \n", "[0.0096, 0.0519, 0.0721, 0.1285, 0.1201, 0.286... | \n", "[-1.5039, 0.1831, 0.512, 1.09, 1.0222, 1.8924,... | \n", "[1.897, -1.5106, -3.1823, 0.8091, 1.1605, -3.1... | \n", "
19 | \n", "data/imagenette/train/n02102040/n02102040_5983... | \n", "least-confidence | \n", "0.7128 | \n", "English springer | \n", "0.2872 | \n", "[0.2872, 0.0889, 0.011, 0.1836, 0.1843, 0.0035... | \n", "[2.7052, 1.5325, -0.554, 2.2576, 2.2614, -1.69... | \n", "[0.3121, 0.3837, -0.495, -0.3409, 0.8247, -0.9... | \n", "
20 | \n", "data/imagenette/train/n03888257/n03888257_5543... | \n", "ratio-of-confidence | \n", "0.9963 | \n", "church | \n", "0.4892 | \n", "[0.0006, 0.0034, 0.0018, 0.0057, 0.4892, 0.004... | \n", "[-2.3001, -0.4814, -1.1037, 0.0238, 4.4839, -0... | \n", "[1.0376, -0.5689, -0.7547, -0.6402, 3.0029, -1... | \n", "
21 | \n", "data/imagenette/train/n03417042/n03417042_6903... | \n", "ratio-of-confidence | \n", "0.9956 | \n", "garbage truck | \n", "0.4954 | \n", "[0.0026, 0.0005, 0.0002, 0.0011, 0.4932, 0.495... | \n", "[0.0406, -1.6485, -2.7978, -0.864, 5.2682, 5.2... | \n", "[3.218, -0.5888, -2.0572, 2.9177, 0.4033, -1.4... | \n", "
22 | \n", "data/imagenette/train/n03425413/n03425413_1268... | \n", "ratio-of-confidence | \n", "0.9955 | \n", "gas pump | \n", "0.3320 | \n", "[0.0004, 0.1871, 0.1191, 0.3305, 0.0264, 0.000... | \n", "[-2.9714, 3.0666, 2.6146, 3.6355, 1.1079, -3.5... | \n", "[1.5266, 0.3247, 1.064, -0.6718, 1.9302, 1.412... | \n", "
23 | \n", "data/imagenette/train/n03417042/n03417042_2684... | \n", "ratio-of-confidence | \n", "0.9955 | \n", "garbage truck | \n", "0.4902 | \n", "[0.0066, 0.0008, 0.0057, 0.007, 0.0004, 0.4902... | \n", "[0.3548, -1.7464, 0.2096, 0.4099, -2.4527, 4.6... | \n", "[3.4206, -0.3718, -0.3964, 1.7022, 0.4602, -0.... | \n", "
24 | \n", "data/imagenette/train/n03888257/n03888257_7430... | \n", "ratio-of-confidence | \n", "0.9952 | \n", "golf ball | \n", "0.5010 | \n", "[0.0, 0.0, 0.0, 0.0001, 0.0001, 0.0, 0.0, 0.50... | \n", "[-1.9501, -2.6581, -1.7523, -0.7569, -1.1854, ... | \n", "[-1.6041, -2.6862, -0.4968, -3.7274, -0.3238, ... | \n", "
25 | \n", "data/imagenette/train/n03394916/n03394916_2900... | \n", "ratio-of-confidence | \n", "0.9941 | \n", "French horn | \n", "0.3721 | \n", "[0.0007, 0.3721, 0.0, 0.1385, 0.0003, 0.0087, ... | \n", "[-2.4833, 3.7691, -5.3913, 2.7805, -3.4254, 0.... | \n", "[1.8665, -2.0128, 2.1027, -3.7416, -1.5193, 0.... | \n", "
26 | \n", "data/imagenette/train/n03425413/n03425413_1731... | \n", "ratio-of-confidence | \n", "0.9925 | \n", "church | \n", "0.4156 | \n", "[0.0166, 0.0078, 0.0151, 0.0237, 0.4156, 0.071... | \n", "[-0.2679, -1.0225, -0.366, 0.0846, 2.9498, 1.1... | \n", "[-0.3695, -0.1422, -3.6139, 0.3352, -0.2954, 1... | \n", "
27 | \n", "data/imagenette/train/n02979186/n02979186_2351... | \n", "ratio-of-confidence | \n", "0.9908 | \n", "gas pump | \n", "0.3271 | \n", "[0.0007, 0.0483, 0.22, 0.0028, 0.0114, 0.0025,... | \n", "[-3.4812, 0.807, 2.3239, -2.039, -0.6325, -2.1... | \n", "[0.3288, 0.9046, -2.2022, -1.245, 1.349, 0.409... | \n", "
28 | \n", "data/imagenette/train/n01440764/n01440764_1696... | \n", "ratio-of-confidence | \n", "0.9904 | \n", "tench | \n", "0.3759 | \n", "[0.0009, 0.0093, 0.0014, 0.1478, 0.0247, 0.000... | \n", "[-2.3892, -0.0999, -1.984, 2.6632, 0.8738, -4.... | \n", "[-2.2977, -1.5046, 0.6189, -3.0594, 0.6205, 0.... | \n", "
29 | \n", "data/imagenette/train/n03394916/n03394916_3011... | \n", "ratio-of-confidence | \n", "0.9883 | \n", "garbage truck | \n", "0.3082 | \n", "[0.0143, 0.1777, 0.0004, 0.3046, 0.0971, 0.308... | \n", "[-0.5603, 1.9565, -4.1248, 2.4954, 1.3523, 2.5... | \n", "[1.3563, -2.4635, -2.8524, -2.1299, 0.3097, -3... | \n", "
30 | \n", "data/imagenette/train/n03000684/n03000684_5368... | \n", "entropy | \n", "0.8433 | \n", "parachute | \n", "0.2922 | \n", "[0.0375, 0.0399, 0.0015, 0.1428, 0.1145, 0.118... | \n", "[-0.1324, -0.0709, -3.3373, 1.204, 0.9836, 1.0... | \n", "[-0.4185, 1.8171, 0.0212, -0.7361, -1.7408, -0... | \n", "
31 | \n", "data/imagenette/train/n03000684/n03000684_1599... | \n", "entropy | \n", "0.8233 | \n", "garbage truck | \n", "0.3228 | \n", "[0.0605, 0.0334, 0.0598, 0.1211, 0.0053, 0.322... | \n", "[0.7622, 0.169, 0.751, 1.4561, -1.6818, 2.4367... | \n", "[1.3442, 2.557, 0.2429, -1.9658, -0.7566, -1.4... | \n", "
32 | \n", "data/imagenette/train/n03000684/n03000684_3103... | \n", "entropy | \n", "0.8129 | \n", "golf ball | \n", "0.3144 | \n", "[0.0239, 0.0719, 0.0997, 0.2182, 0.011, 0.1636... | \n", "[-0.2995, 0.8013, 1.1277, 1.9113, -1.0769, 1.6... | \n", "[-0.7188, 0.7749, -4.6369, -3.064, 1.9052, -1.... | \n", "
33 | \n", "data/imagenette/train/n03425413/n03425413_9079... | \n", "entropy | \n", "0.7864 | \n", "cassette player | \n", "0.2892 | \n", "[0.0203, 0.034, 0.2892, 0.0837, 0.1193, 0.0007... | \n", "[-1.071, -0.5536, 1.5877, 0.3482, 0.7027, -4.3... | \n", "[-3.1902, 0.5344, -1.028, 0.092, 1.9895, 1.347... | \n", "
34 | \n", "data/imagenette/train/n03028079/n03028079_3835... | \n", "entropy | \n", "0.7857 | \n", "parachute | \n", "0.3484 | \n", "[0.061, 0.0576, 0.0105, 0.0159, 0.2247, 0.0323... | \n", "[0.0473, -0.0099, -1.715, -1.3006, 1.3504, -0.... | \n", "[-2.0185, -1.2173, -1.2625, -1.6554, -0.2798, ... | \n", "
35 | \n", "data/imagenette/train/n03000684/ILSVRC2012_val... | \n", "entropy | \n", "0.7793 | \n", "chain saw | \n", "0.3289 | \n", "[0.1086, 0.0298, 0.0004, 0.3289, 0.046, 0.0109... | \n", "[1.4685, 0.1735, -4.1946, 2.5763, 0.6098, -0.8... | \n", "[-0.822, 2.4415, 0.4211, -0.0497, -2.3272, 2.2... | \n", "
36 | \n", "data/imagenette/train/n03888257/n03888257_1205... | \n", "entropy | \n", "0.7696 | \n", "tench | \n", "0.3003 | \n", "[0.1932, 0.0357, 0.0008, 0.1847, 0.0814, 0.010... | \n", "[2.0675, 0.3785, -3.445, 2.0224, 1.2034, -0.83... | \n", "[0.1323, -0.9154, 0.3553, -0.6168, 0.502, 0.45... | \n", "
37 | \n", "data/imagenette/train/n01440764/n01440764_8589... | \n", "entropy | \n", "0.7687 | \n", "tench | \n", "0.2955 | \n", "[0.1251, 0.147, 0.0012, 0.066, 0.0293, 0.0005,... | \n", "[1.1197, 1.2809, -3.5146, 0.4796, -0.3313, -4.... | \n", "[-5.7497, 0.9306, -0.2185, -1.5692, 2.0429, 0.... | \n", "
38 | \n", "data/imagenette/train/n03888257/n03888257_2762... | \n", "entropy | \n", "0.7670 | \n", "parachute | \n", "0.3022 | \n", "[0.037, 0.1207, 0.0027, 0.0345, 0.0034, 0.2532... | \n", "[-0.3414, 0.8412, -2.9466, -0.4109, -2.7253, 1... | \n", "[-0.0619, 0.3258, 0.089, -0.0403, -1.6754, -2.... | \n", "
39 | \n", "data/imagenette/train/n03425413/n03425413_1654... | \n", "entropy | \n", "0.7662 | \n", "gas pump | \n", "0.3035 | \n", "[0.0233, 0.1564, 0.0434, 0.1933, 0.0093, 0.210... | \n", "[-0.4187, 1.4847, 0.2032, 1.6968, -1.335, 1.78... | \n", "[1.0856, -0.4017, -1.1049, 1.7158, 0.2246, -0.... | \n", "
40 | \n", "data/imagenette/train/n02102040/n02102040_2595... | \n", "model-based-outlier | \n", "1.0000 | \n", "English springer | \n", "0.9786 | \n", "[0.9786, 0.0121, 0.0003, 0.0036, 0.0007, 0.001... | \n", "[7.2205, 2.8313, -0.9539, 1.6166, 0.0282, 0.84... | \n", "[1.305, -2.4159, 0.4358, -1.7312, -0.004, 0.38... | \n", "
41 | \n", "data/imagenette/train/n03445777/n03445777_1386... | \n", "model-based-outlier | \n", "1.0000 | \n", "golf ball | \n", "0.5155 | \n", "[0.0034, 0.0257, 0.0205, 0.1739, 0.0073, 0.045... | \n", "[-1.3996, 0.6301, 0.402, 2.5419, -0.6247, 1.20... | \n", "[0.9203, -0.6261, 0.7931, -0.8476, 0.4564, 0.8... | \n", "
42 | \n", "data/imagenette/train/n02102040/n02102040_539.... | \n", "model-based-outlier | \n", "1.0000 | \n", "English springer | \n", "0.9712 | \n", "[0.9712, 0.015, 0.0005, 0.0051, 0.0007, 0.0003... | \n", "[6.8735, 2.703, -0.7499, 1.6197, -0.4159, -1.2... | \n", "[-3.3191, -1.2588, 6.1337, -3.5114, 2.8639, -0... | \n", "
43 | \n", "data/imagenette/train/n03000684/n03000684_1637... | \n", "model-based-outlier | \n", "1.0000 | \n", "parachute | \n", "0.8370 | \n", "[0.003, 0.012, 0.0008, 0.1107, 0.0142, 0.0131,... | \n", "[-0.8472, 0.5192, -2.1964, 2.7446, 0.694, 0.61... | \n", "[-2.5737, 1.1527, -1.0046, -0.6686, -0.7702, -... | \n", "
44 | \n", "data/imagenette/train/n03000684/n03000684_3268... | \n", "model-based-outlier | \n", "1.0000 | \n", "chain saw | \n", "0.3547 | \n", "[0.0345, 0.063, 0.0021, 0.3547, 0.0815, 0.2783... | \n", "[0.2586, 0.8616, -2.5209, 2.5899, 1.1198, 2.34... | \n", "[-0.3133, -1.8713, -0.4083, -0.5728, -2.0835, ... | \n", "
45 | \n", "data/imagenette/train/n03000684/n03000684_1471... | \n", "random | \n", "0.0000 | \n", "chain saw | \n", "0.7763 | \n", "[0.045, 0.0082, 0.0005, 0.7763, 0.0134, 0.0777... | \n", "[1.0677, -0.6302, -3.3938, 3.9151, -0.1408, 1.... | \n", "[1.6981, 0.2913, 2.1714, 2.7012, -1.3052, 0.22... | \n", "
46 | \n", "data/imagenette/train/n02102040/n02102040_3767... | \n", "random | \n", "0.0000 | \n", "English springer | \n", "0.9997 | \n", "[0.9997, 0.0, 0.0001, 0.0, 0.0001, 0.0, 0.0, 0... | \n", "[11.4268, 1.1271, 2.3459, 1.3793, 2.5168, -2.5... | \n", "[2.1301, -1.6942, 1.1031, 0.1852, 1.049, -0.23... | \n", "
47 | \n", "data/imagenette/train/n03425413/n03425413_1957... | \n", "random | \n", "0.0000 | \n", "gas pump | \n", "0.9993 | \n", "[0.0, 0.0002, 0.0001, 0.0002, 0.0001, 0.0, 0.9... | \n", "[-3.6787, 0.4349, -0.4148, 0.4399, 0.1826, -3.... | \n", "[3.4027, 1.9421, -1.5728, 2.0621, -0.5079, -0.... | \n", "
48 | \n", "data/imagenette/train/n03028079/n03028079_2035... | \n", "random | \n", "0.0000 | \n", "church | \n", "0.9973 | \n", "[0.0001, 0.001, 0.0001, 0.0, 0.9973, 0.0004, 0... | \n", "[-1.6015, 0.9666, -0.9836, -3.0406, 7.8966, 0.... | \n", "[0.1738, -0.9133, -1.6448, -0.2947, 2.0651, -1... | \n", "
49 | \n", "data/imagenette/train/n03028079/n03028079_2268... | \n", "random | \n", "0.0000 | \n", "church | \n", "0.9999 | \n", "[0.0, 0.0, 0.0, 0.0, 0.9999, 0.0, 0.0, 0.0, 0.... | \n", "[-1.1582, 0.0911, -1.2376, -2.258, 10.9708, -1... | \n", "[3.4548, -0.7209, -4.7961, 1.7589, 2.2121, -2.... | \n", "
\n", " | filepath | \n", "label | \n", "
---|---|---|
0 | \n", "data/imagenette/train/n03888257/n03888257_3881... | \n", "parachute | \n", "
1 | \n", "data/imagenette/train/n03417042/n03417042_7047... | \n", "garbage truck | \n", "
2 | \n", "data/imagenette/train/n03028079/n03028079_5956... | \n", "church | \n", "
3 | \n", "data/imagenette/train/n03000684/n03000684_1815... | \n", "chain saw | \n", "
4 | \n", "data/imagenette/train/n01440764/n01440764_1507... | \n", "tench | \n", "
5 | \n", "data/imagenette/train/n03888257/n03888257_2922... | \n", "parachute | \n", "
6 | \n", "data/imagenette/train/n03445777/n03445777_4929... | \n", "golf ball | \n", "
7 | \n", "data/imagenette/train/n02979186/n02979186_2785... | \n", "cassette player | \n", "
8 | \n", "data/imagenette/train/n03888257/n03888257_4289... | \n", "parachute | \n", "
9 | \n", "data/imagenette/train/n03888257/n03888257_2103... | \n", "parachute | \n", "
10 | \n", "data/imagenette/train/n03000684/n03000684_5543... | \n", "chain saw | \n", "
11 | \n", "data/imagenette/train/n03000684/n03000684_1278... | \n", "chain saw | \n", "
12 | \n", "data/imagenette/train/n03888257/n03888257_6468... | \n", "parachute | \n", "
13 | \n", "data/imagenette/train/n03445777/n03445777_1063... | \n", "golf ball | \n", "
14 | \n", "data/imagenette/train/n03445777/n03445777_1641... | \n", "golf ball | \n", "
15 | \n", "data/imagenette/train/n03425413/n03425413_2094... | \n", "gas pump | \n", "
16 | \n", "data/imagenette/train/n02979186/n02979186_2764... | \n", "cassette player | \n", "
17 | \n", "data/imagenette/train/n03394916/n03394916_3318... | \n", "French horn | \n", "
18 | \n", "data/imagenette/train/n03888257/n03888257_7115... | \n", "parachute | \n", "
19 | \n", "data/imagenette/train/n03417042/n03417042_1793... | \n", "garbage truck | \n", "
20 | \n", "data/imagenette/train/n03028079/n03028079_1363... | \n", "church | \n", "
21 | \n", "data/imagenette/train/n02979186/n02979186_4087... | \n", "cassette player | \n", "
22 | \n", "data/imagenette/train/n03417042/n03417042_2143... | \n", "garbage truck | \n", "
23 | \n", "data/imagenette/train/n03000684/n03000684_8799... | \n", "chain saw | \n", "
24 | \n", "data/imagenette/train/n03394916/n03394916_3595... | \n", "French horn | \n", "
25 | \n", "data/imagenette/train/n03417042/n03417042_2594... | \n", "garbage truck | \n", "
26 | \n", "data/imagenette/train/n03425413/n03425413_1124... | \n", "gas pump | \n", "
27 | \n", "data/imagenette/train/n03000684/n03000684_1975... | \n", "chain saw | \n", "
28 | \n", "data/imagenette/train/n02102040/n02102040_5983... | \n", "English springer | \n", "
29 | \n", "data/imagenette/train/n03000684/n03000684_1609... | \n", "chain saw | \n", "
30 | \n", "data/imagenette/train/n03445777/n03445777_2967... | \n", "parachute | \n", "
31 | \n", "data/imagenette/train/n03445777/n03445777_258.... | \n", "golf ball | \n", "
32 | \n", "data/imagenette/train/n02102040/n02102040_1444... | \n", "English springer | \n", "
33 | \n", "data/imagenette/train/n03888257/n03888257_1929... | \n", "parachute | \n", "
34 | \n", "data/imagenette/train/n03888257/n03888257_1770... | \n", "parachute | \n", "
35 | \n", "data/imagenette/train/n03000684/n03000684_9664... | \n", "chain saw | \n", "
36 | \n", "data/imagenette/train/n03417042/n03417042_2236... | \n", "garbage truck | \n", "
37 | \n", "data/imagenette/train/n02102040/n02102040_155.... | \n", "English springer | \n", "
38 | \n", "data/imagenette/train/n03445777/n03445777_9976... | \n", "golf ball | \n", "
39 | \n", "data/imagenette/train/n02979186/n02979186_205.... | \n", "cassette player | \n", "
40 | \n", "data/imagenette/train/n03028079/n03028079_5551... | \n", "church | \n", "
41 | \n", "data/imagenette/train/n02979186/n02979186_966.... | \n", "cassette player | \n", "
42 | \n", "data/imagenette/train/n01440764/n01440764_2043... | \n", "tench | \n", "
43 | \n", "data/imagenette/train/n03417042/n03417042_1869... | \n", "garbage truck | \n", "
44 | \n", "data/imagenette/train/n02102040/n02102040_6763... | \n", "English springer | \n", "
45 | \n", "data/imagenette/train/n01440764/n01440764_1455... | \n", "tench | \n", "
46 | \n", "data/imagenette/train/n03028079/n03028079_2489... | \n", "church | \n", "
47 | \n", "data/imagenette/train/n03425413/n03425413_2110... | \n", "gas pump | \n", "
\n", " | name | \n", "accuracy | \n", "train_set_size | \n", "valid_set_size | \n", "dataset_size | \n", "num_classes | \n", "model | \n", "pretrained | \n", "loss_fn | \n", "device | \n", "seed | \n", "batch_size | \n", "image_size | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | \n", "cycle-1 | \n", "0.886879 | \n", "80 | \n", "20 | \n", "100 | \n", "10 | \n", "resnet18 | \n", "True | \n", "FlattenedLoss of CrossEntropyLoss() | \n", "mps | \n", "None | \n", "8 | \n", "224 | \n", "
0 | \n", "cycle-2 | \n", "0.921783 | \n", "120 | \n", "29 | \n", "149 | \n", "10 | \n", "resnet18 | \n", "True | \n", "FlattenedLoss of CrossEntropyLoss() | \n", "mps | \n", "None | \n", "8 | \n", "224 | \n", "
3 | \n", "cycle-3 | \n", "0.934522 | \n", "156 | \n", "39 | \n", "195 | \n", "10 | \n", "resnet18 | \n", "True | \n", "FlattenedLoss of CrossEntropyLoss() | \n", "mps | \n", "None | \n", "8 | \n", "224 | \n", "
2 | \n", "cycle-4 | \n", "0.945223 | \n", "195 | \n", "48 | \n", "243 | \n", "10 | \n", "resnet18 | \n", "True | \n", "FlattenedLoss of CrossEntropyLoss() | \n", "mps | \n", "None | \n", "8 | \n", "224 | \n", "