Skip to content

armgit / Soup

Public Imported from GitHub
0

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

257 KB
Raw Blame
{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "gS9Rp2w7GjPW"
      },
      "source": [
        "# Fine-tune an 8B model on 4 GB of VRAM — run it yourself\n",
        "\n",
        "[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/MakazhanAlpamys/Soup/blob/main/notebooks/proof-4gb.ipynb)\n",
        "\n",
        "[Soup](https://github.com/MakazhanAlpamys/Soup) trains a model whose weights do not fit\n",
        "in your GPU. The frozen base stays in host RAM and is streamed to the GPU one decoder\n",
        "layer at a time, so peak VRAM is bounded by **one layer** instead of by the model.\n",
        "\n",
        "This notebook does not ask you to believe that. It caps this process to **4 GB** on\n",
        "Colab's free T4 and then measures what actually happens.\n",
        "\n",
        "| Section | What it proves | Time |\n",
        "|---|---|---|\n",
        "| 1–3 | The cap is real, and this GPU has no bf16 | ~2 min |\n",
        "| 4 | A streamed model and a normal one produce **bit-identical** logits | ~3 min |\n",
        "| 5 | Llama-3.1-8B trains with a measured peak under 4 GB | ~20 min |\n",
        "\n",
        "Sections 1–4 are the argument. Section 5 is the headline and is optional.\n",
        "\n",
        "**Runtime → Change runtime type → T4 GPU** before you start.\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "EU3gwmuZGjPY"
      },
      "source": [
        "## 1. Install\n",
        "\n",
        "This notebook is pinned to **soup-cli==0.75.0**, the release this run was verified\n",
        "against. **v0.74.0** was the first release carrying both the T4 precision fix\n",
        "([#385](https://github.com/MakazhanAlpamys/Soup/issues/385),\n",
        "[#387](https://github.com/MakazhanAlpamys/Soup/issues/387)) and the T4 GradScaler fix\n",
        "([#429](https://github.com/MakazhanAlpamys/Soup/issues/429)) that section 5 needs to\n",
        "train at all on this card; 0.75.0 is pinned here only because it is the exact release\n",
        "this run's committed outputs were produced against. Bump the pin only after re-running\n",
        "this notebook end to end on a real T4 and recording the new outputs.\n",
        "\n",
        "The `torchao` line is not incidental either. Colab preinstalls **torchao 0.10.0**, and\n",
        "`peft` does not merely decline to use a version it considers too old — it *raises*\n",
        "`ImportError` from `is_torchao_available()`, several frames inside `get_peft_model`.\n",
        "Nothing here needs torchao, so it is removed rather than upgraded (upgrading risks\n",
        "pulling a wheel built against a different torch).\n",
        "\n",
        "**Colab's default Python can be newer than the pinned release supports.** `soup-cli==0.75.0` declares `>=3.10,<3.13` on purpose (untested torch/bitsandbytes wheels on newer interpreters fail with an opaque loader crash, not a clean error). Soup itself supports 3.11–3.13 from v0.77 (#1805), so the fallback below goes away when the pin moves to v0.77 or later. Colab's hosted runtime does not let you pick an arbitrary kernel the way local Jupyter does, so if you land on Python 3.13+, the next cell falls back to installing with `--ignore-requires-python` — that trades the guarantee for a best-effort install, on the assumption that the `[train]` extras (torch,\n",
        "transformers, peft, bitsandbytes, accelerate) have caught up with a 3.13 wheel by the time you are reading this. If anything below fails with an import or ABI error, that assumption did not hold on this Colab image; open an issue with the\n",
        "traceback rather than treating it as this notebook's bug.\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "pmPJQk1ZGjPY",
        "outputId": "e66c8068-1288-4152-f0b7-3bed5c681bec"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Colab Python: 3.13.15  (soup-cli supports <3.13)\n",
            "Falling back to --ignore-requires-python for the install below;\n",
            "see the note above this cell for what that trades away.\n"
          ]
        }
      ],
      "source": [
        "import sys\n",
        "\n",
        "# The window of the PINNED release (soup-cli 0.75.0 declares >=3.10,<3.13), not of\n",
        "# Soup today: v0.77 and later declare >=3.11,<3.14 (#1805). Re-derive both bounds\n",
        "# when the pin below moves.\n",
        "PY_OK = sys.version_info < (3, 13)\n",
        "print(f\"Colab Python: {sys.version.split()[0]}  (soup-cli supports <3.13)\")\n",
        "if not PY_OK:\n",
        "    print(\"Falling back to --ignore-requires-python for the install below;\")\n",
        "    print(\"see the note above this cell for what that trades away.\")\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 2,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "R2ZoGhWwGjPZ",
        "outputId": "62cb934a-8bf5-4a34-d98b-2efc0fda7768"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "\u001b[2K   \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m2.2/2.2 MB\u001b[0m \u001b[31m29.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K   \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m43.1/43.1 MB\u001b[0m \u001b[31m15.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K   \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m475.8/475.8 kB\u001b[0m \u001b[31m16.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K   \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m531.0/531.0 kB\u001b[0m \u001b[31m16.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[2K   \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m47.4/47.4 kB\u001b[0m \u001b[31m3.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n",
            "\u001b[?25hsoup 0.75.0\n",
            "pre-Ampere fix present: True\n",
            "torchao gone (peft raises on an old one): True\n"
          ]
        }
      ],
      "source": [
        "%pip uninstall -q -y torchao\n",
        "\n",
        "import os\n",
        "\n",
        "# Layer streaming cannot run under nn.DataParallel; default to GPU 0 if unset,\n",
        "# but preserve a caller-selected single card (e.g. CUDA_VISIBLE_DEVICES=1).\n",
        "os.environ.setdefault(\"CUDA_VISIBLE_DEVICES\", \"0\")\n",
        "\n",
        "import sys\n",
        "\n",
        "# Only the pinned 0.75.0 needs this on 3.13; drop it with the pin (see section 1).\n",
        "_extra_flag = \"--ignore-requires-python\" if sys.version_info >= (3, 13) else \"\"\n",
        "# huggingface-hub>=1.32 keeps blobs in a cache-wide store that soup-cli 0.75.0\n",
        "# refuses (#1509); drop this cap when the notebook re-pins to a release that\n",
        "# carries the fix.\n",
        "%pip install -q \"huggingface-hub<1.32.0\" \"soup-cli[train]==0.75.0\" {_extra_flag}\n",
        "\n",
        "import importlib.util  # noqa: E402 (after %pip install)\n",
        "\n",
        "import soup_cli  # noqa: E402\n",
        "import soup_cli.utils.gpu  # noqa: E402\n",
        "\n",
        "print(\"soup\", soup_cli.__version__)\n",
        "print(\"pre-Ampere fix present:\", hasattr(soup_cli.utils.gpu, \"bf16_fp16_flags\"))\n",
        "print(\"torchao gone (peft raises on an old one):\",\n",
        "      importlib.util.find_spec(\"torchao\") is None)\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 3,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "k9_uWtXUGjPZ",
        "outputId": "5a953364-68e2-4093-ace8-b1266d337581"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "torch        2.11.0+cu128\n",
            "transformers 5.16.1\n",
            "peft         0.20.0\n",
            "bitsandbytes 0.50.2\n",
            "soup_cli     0.75.0\n"
          ]
        }
      ],
      "source": [
        "import bitsandbytes\n",
        "import peft\n",
        "import torch\n",
        "import transformers\n",
        "\n",
        "print(\"torch       \", torch.__version__)\n",
        "print(\"transformers\", transformers.__version__)\n",
        "print(\"peft        \", peft.__version__)\n",
        "print(\"bitsandbytes\", bitsandbytes.__version__)\n",
        "print(\"soup_cli    \", soup_cli.__version__)\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "1IEi4wOPGjPZ"
      },
      "source": [
        "## 2. What card did we get, and does it have bf16?\n",
        "\n",
        "Colab's free tier is a **T4** — Turing, sm_75. bf16 hardware arrived with Ampere, so a\n",
        "T4 has none.\n",
        "\n",
        "**Read the two lines below carefully, because they disagree, and the disagreement is\n",
        "the point.** `torch.cuda.is_bf16_supported()` defaults to `including_emulation=True`:\n",
        "when the compute-capability check fails it falls through to *constructing* a bf16\n",
        "tensor, which software emulation satisfies. So a T4 answers **True** to the question\n",
        "everyone asks, and False only to `is_bf16_supported(including_emulation=False)`.\n",
        "\n",
        "Soup asked the permissive question and therefore handed bf16 to a card with no bf16\n",
        "units. The first version of this fix asked it too, and was a no-op on exactly the\n",
        "hardware it was written for — caught by running this notebook on a real T4, not before\n",
        "([#385](https://github.com/MakazhanAlpamys/Soup/issues/385),\n",
        "[#387](https://github.com/MakazhanAlpamys/Soup/issues/387)).\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 4,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ebZmw05TGjPa",
        "outputId": "a348715e-5852-4369-b219-110cc80ecb06"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "GPU                  Tesla T4  (sm_75)\n",
            "VRAM                 15.6 GB\n",
            "bf16, incl. emulation True\n",
            "bf16 IN HARDWARE      False\n",
            "Soup will train in   fp16\n"
          ]
        }
      ],
      "source": [
        "import torch\n",
        "\n",
        "from soup_cli.utils.gpu import bf16_fp16_flags\n",
        "\n",
        "assert torch.cuda.is_available(), \"No GPU. Runtime -> Change runtime type -> T4 GPU.\"\n",
        "\n",
        "name = torch.cuda.get_device_name(0)\n",
        "major, minor = torch.cuda.get_device_capability(0)\n",
        "total = torch.cuda.get_device_properties(0).total_memory\n",
        "\n",
        "print(f\"GPU                  {name}  (sm_{major}{minor})\")\n",
        "print(f\"VRAM                 {total / 1e9:.1f} GB\")\n",
        "print(f\"bf16, incl. emulation {torch.cuda.is_bf16_supported()}\")\n",
        "print(f\"bf16 IN HARDWARE      \"\n",
        "      f\"{torch.cuda.is_bf16_supported(including_emulation=False)}\")\n",
        "\n",
        "bf16, fp16 = bf16_fp16_flags(\"cuda\")\n",
        "print(f\"Soup will train in   {'bf16' if bf16 else 'fp16' if fp16 else 'fp32'}\")\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "l7M_09spGjPa"
      },
      "source": [
        "## 3. Cap this process to 4 GB\n",
        "\n",
        "`set_per_process_memory_fraction` caps PyTorch's allocator. Everything after this cell\n",
        "runs as if the card were a 4 GB laptop GPU — an allocation past the cap raises, exactly\n",
        "as it would on the real thing.\n",
        "\n",
        "**One historical caveat, now closed.** `torch.cuda.mem_get_info()` reports the whole\n",
        "card, so Soup's own pre-flight check used to read that and print a \"free VRAM\" line that\n",
        "belonged to the host card, not to this capped process — it would have allowed a\n",
        "configuration that the allocator then refused. That was\n",
        "[#347](https://github.com/MakazhanAlpamys/Soup/issues/347), closed by\n",
        "`training.stream_vram_override` in v0.73.1: section 5's config below sets it to this\n",
        "notebook's own 4 GB cap, so the pre-flight checks against the same number the allocator\n",
        "enforces.\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 5,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "WerOAXc-GjPa",
        "outputId": "9dea490f-a394-4654-f44a-2fafdceb7571"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "capped at 4.00 GB  (fraction 0.256 of this card)\n",
            "refused, as it should be: CUDA out of memory. Tried to allocate 4.29 GiB. GPU 0 has a total capacity of 14.56 GiB of\n"
          ]
        }
      ],
      "source": [
        "BUDGET_BYTES = 4 * 1000**3  # 4 GB, the card this method was developed on\n",
        "\n",
        "fraction = BUDGET_BYTES / total\n",
        "torch.cuda.set_per_process_memory_fraction(fraction)\n",
        "print(f\"capped at {BUDGET_BYTES / 1e9:.2f} GB  (fraction {fraction:.3f} of this card)\")\n",
        "\n",
        "# Prove the cap bites: ask for 15% more than the budget and expect a refusal.\n",
        "try:\n",
        "    _ = torch.empty(int(BUDGET_BYTES * 1.15), dtype=torch.uint8, device=\"cuda\")\n",
        "    print(\"WARNING: the allocation succeeded — the cap is NOT in force\")\n",
        "except RuntimeError as exc:\n",
        "    print(\"refused, as it should be:\", str(exc).splitlines()[0][:90])\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "OJhzXWHkGjPa"
      },
      "source": [
        "## 4. The claim that matters: streamed == resident, bit for bit\n",
        "\n",
        "A streaming bug is silent. If the base were substituted wrongly, or the autograd path\n",
        "severed, the loss would still fall — the upper layers keep learning — and you would ship\n",
        "a damaged model without an error anywhere.\n",
        "\n",
        "So the check is not \"does it train\". It is: **the same weights, through the same kernels,\n",
        "must produce the same numbers.** Below, one model is streamed layer-by-layer and the\n",
        "other is an ordinary resident model, both carrying identical adapter weights.\n",
        "`torch.equal` is exact equality, not a tolerance.\n",
        "\n",
        "This runs on a small model because the reference has to fit in memory next to the\n",
        "streamed copy — that is the whole reason the headline size cannot be checked this way.\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 6,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 182,
          "referenced_widgets": [
            "5ce8709eb08141b49ec54002daaf6a02",
            "1ade6c23233e4dc8928b74379f919b52",
            "64dac42bdc2948108be4191c0ceda935",
            "703835e267844b2081cc77a980f29a5a",
            "7bcd0e9f66b44345be83558727ea4f73",
            "ea2e2f0858604f8cbb26396a34486582",
            "57d7a95684aa4448a094b483607d8a7b",
            "26c64bed491b40338f08829696b702d2",
            "bf620d6b3d3247c3b885a9b52ed50e72",
            "e2482e92256f4dc3abf1da54bcbd0b4e",
            "611b1dafb25f44bd88803b30c5fb8be2",
            "1eb41dbea62d4d38a15c1861465a89af",
            "653f8a5aec8a4f268ac5131721b95939",
            "909b04d476b64bfeb01e889a31579ec2",
            "319044ab454c41ecafd14d019bd3dae6",
            "8afdfbea52874655b291ad460c7a06ca",
            "c01d30ec7dc943c7b73eee9bab52ff7d",
            "1c2eff1f10744844b12048ee187cd7d5",
            "d609772e7c8a4b92a86dc1e4e381b330",
            "9f1e69eb590248e2b8f3e9f4705d5efa",
            "f086e453790c472cb3f7302d0a9a9c59",
            "5a8439b13e404597ad30f6841c88e503",
            "cf4ec404d5144f7c9d4b333d0a715c2b",
            "9b2b590e6a4b475b8de2ea0408f0431f",
            "a18dada832ec421bbaf389daad3d1dd9",
            "c5dab0b774fa4f32b8837655f217fe87",
            "fbefa341e54f44669cbd6b008d332388",
            "9730f83efe164a26a2f929a2d5389e83",
            "339fabb1f51b435687047788de187438",
            "bf1f2e0942a248bb856bcce5fde22450",
            "c874443864e44b4d96fe173cef76774f",
            "5e7f3e8b868546c8ba1ada9c93690215",
            "a80e7b254bc84ea1aab5cb84c07d5167"
          ]
        },
        "id": "v0m9f-XoGjPa",
        "outputId": "35c5d4e3-cafa-40e3-9121-09c4e539b104"
      },
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Downloading bytes:           |  0.00B            "
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "5ce8709eb08141b49ec54002daaf6a02"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Reconstructing (incomplete total...): |          |  0.00B /  0.00B            "
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "1eb41dbea62d4d38a15c1861465a89af"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Fetching 11 files:   0%|          | 0/11 [00:00<?, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "cf4ec404d5144f7c9d4b333d0a715c2b"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.\n",
            "WARNING:huggingface_hub.utils._http:Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.\n",
            "[transformers] `torch_dtype` is deprecated! Use `dtype` instead!\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "streamed: 30 layers, dtype=float16\n"
          ]
        }
      ],
      "source": [
        "import tempfile\n",
        "from pathlib import Path\n",
        "\n",
        "from peft import LoraConfig, TaskType, get_peft_model\n",
        "from transformers import AutoModelForCausalLM\n",
        "\n",
        "from soup_cli.utils.layer_shard import shard_checkpoint\n",
        "from soup_cli.utils.layer_stream import resolve_stream_dtype\n",
        "from soup_cli.utils.layer_stream_runtime import build_streamed_model\n",
        "from soup_cli.utils.spectrum_scan import resolve_model_weights\n",
        "\n",
        "MODEL = \"HuggingFaceTB/SmolLM2-135M-Instruct\"\n",
        "DTYPE = resolve_stream_dtype(\"cuda\")  # fp16 on a T4, bf16 on an Ampere card\n",
        "LORA = LoraConfig(\n",
        "    r=8, lora_alpha=16, lora_dropout=0.0, bias=\"none\",\n",
        "    target_modules=[\"q_proj\", \"v_proj\"], task_type=TaskType.CAUSAL_LM,\n",
        ")\n",
        "\n",
        "workdir = Path(tempfile.mkdtemp())\n",
        "weights = resolve_model_weights(MODEL)  # downloads on first use\n",
        "index = shard_checkpoint(weights, str(workdir / \"shards\"), dtype=DTYPE, arch=\"llama\")\n",
        "streamed, runtime = build_streamed_model(\n",
        "    model_id=weights, shard_dir=str(workdir / \"shards\"), index=index,\n",
        "    lora_config=LORA, device=\"cuda\", dtype=DTYPE, buffers=2, pin=True, seed=0,\n",
        ")\n",
        "print(f\"streamed: {index.n_layers} layers, dtype={DTYPE}\")\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 7,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 173,
          "referenced_widgets": [
            "16c9123ed8cb4c02b25729e7fe8fb2df",
            "8dd8ccb477cb4da3af7d7511124c9c5d",
            "c0a5556c08e44280a72c0ecc8810f2a6",
            "463038b513e849d19431f12ecb26c8a1",
            "3341a9dac7c64af38c5e479d9a5083f8",
            "7c91ec1827844d05ba8e51ba994d1f7f",
            "c219201c066b41bb84dae9e5c981facb",
            "0aa7563bd4d04e848f32f2782f7717fe",
            "13c5ab409fbb49888ce477f55e1f62af",
            "6dbd72ea2b8846408bb53debf64a756d",
            "9b5d5a1c32624c54b530692430dab2a2"
          ]
        },
        "id": "N_eeBzptGjPa",
        "outputId": "40330dec-5c8b-416e-8441-1a1914664b3b"
      },
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Loading weights:   0%|          | 0/272 [00:00<?, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "16c9123ed8cb4c02b25729e7fe8fb2df"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "/usr/local/lib/python3.13/dist-packages/peft/mapping_func.py:78: UserWarning: The PEFT config's `base_model_name_or_path` was renamed from '/root/.soup/spectrum/weights/HuggingFaceTB__SmolLM2-135M-Instruct' to 'HuggingFaceTB/SmolLM2-135M-Instruct'. Please ensure that the correct base model is loaded when loading this checkpoint.\n",
            "  warnings.warn(\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "max |streamed - resident| = 0.0\n",
            "torch.equal              = True\n",
            "\n",
            "Bit-exact. The streamed model is the same model.\n"
          ]
        }
      ],
      "source": [
        "# PEFT initialises lora_B to zero, so an untrained adapter contributes NOTHING and any\n",
        "# comparison would silently be about the base model alone. Make it load-bearing first.\n",
        "gen = torch.Generator().manual_seed(7)\n",
        "with torch.no_grad():\n",
        "    for pname, param in streamed.named_parameters():\n",
        "        if \"lora_B\" in pname:\n",
        "            param.copy_(torch.randn(param.shape, generator=gen).to(param.device, param.dtype))\n",
        "\n",
        "resident = AutoModelForCausalLM.from_pretrained(\n",
        "    MODEL, dtype=getattr(torch, DTYPE), device_map={\"\": \"cuda\"}\n",
        ")\n",
        "resident = get_peft_model(resident, LORA)\n",
        "\n",
        "# Copy the adapter across. The streamed wrapper inserts an '.inner.' segment in its keys.\n",
        "src = {k.replace(\".inner.\", \".\"): v for k, v in streamed.state_dict().items() if \"lora_\" in k}\n",
        "dst = {k.replace(\".inner.\", \".\"): v for k, v in resident.state_dict().items() if \"lora_\" in k}\n",
        "assert src and set(src) == set(dst)\n",
        "with torch.no_grad():\n",
        "    for key, val in src.items():\n",
        "        dst[key].copy_(val.to(dst[key].dtype))\n",
        "\n",
        "ids = torch.randint(0, 4096, (1, 32), device=\"cuda\")\n",
        "with torch.no_grad():\n",
        "    a = streamed(input_ids=ids).logits\n",
        "    b = resident(input_ids=ids).logits\n",
        "\n",
        "print(\"max |streamed - resident| =\", (a.float() - b.float()).abs().max().item())\n",
        "print(\"torch.equal              =\", torch.equal(a, b))\n",
        "assert torch.equal(a, b), \"NOT bit-exact — please open an issue with this output\"\n",
        "print(\"\\nBit-exact. The streamed model is the same model.\")\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 8,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "5ES65VQSGjPb",
        "outputId": "43f9d542-3a8a-43b1-88d0-00facecf1b6d"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "reset\n"
          ]
        }
      ],
      "source": [
        "import gc\n",
        "\n",
        "# Free the reference before the headline run.\n",
        "runtime.close()\n",
        "del streamed, resident, a, b\n",
        "gc.collect()\n",
        "torch.cuda.empty_cache()\n",
        "torch.cuda.reset_peak_memory_stats()\n",
        "print(\"reset\")\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "xQGpbvi6GjPb"
      },
      "source": [
        "## 5. The headline: Llama-3.1-8B, trained under the 4 GB cap\n",
        "\n",
        "8B parameters. In NF4 the weights alone are about **4.5 GB** — more than the budget this\n",
        "process is allowed, before activations, gradients or the optimizer. It trains anyway,\n",
        "because at any moment only a couple of decoder layers are resident.\n",
        "\n",
        "Expect ~20 minutes, most of it the download. The number to watch is the **peak VRAM**\n",
        "at the end — not the loss. This is a handful of steps on 32 toy rows; over that distance\n",
        "the loss can go up as easily as down, and it would prove nothing either way. What is\n",
        "being demonstrated is that the run *happens at all* inside the budget.\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 9,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "50nv26cMGjPb",
        "outputId": "759fba3c-dbf8-4be0-e084-1102ff6b26f5"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "\n",
            "base: NousResearch/Meta-Llama-3.1-8B-Instruct\n",
            "task: sft\n",
            "data:\n",
            "  train: train.jsonl\n",
            "  max_length: 256\n",
            "training:\n",
            "  epochs: 1\n",
            "  batch_size: 1\n",
            "  lr: 0.0002\n",
            "  logging_steps: 1        # short run — without this nothing gets logged\n",
            "  quantization: 4bit      # NF4 — the store is ~4x smaller than bf16\n",
            "  stream_layers: true     # the feature\n",
            "  stream_buffers: 2\n",
            "  stream_vram_override: 4000000000  # same 4 GB the allocator enforces above (#347)\n",
            "  lora:\n",
            "    r: 8\n",
            "    alpha: 16\n",
            "output: ./out-8b\n",
            "\n"
          ]
        }
      ],
      "source": [
        "import json\n",
        "\n",
        "# Varied on both sides on purpose: 32 copies of one answer drive the loss to 0.000\n",
        "# immediately and the printed curve stops meaning anything.\n",
        "TOPICS = [\n",
        "    (\"streaming\", \"Only a couple of decoder layers are resident at any moment.\"),\n",
        "    (\"NF4\", \"Four-bit weights make the host-side store about four times smaller.\"),\n",
        "    (\"LoRA\", \"The base is frozen, so it is read and never written.\"),\n",
        "    (\"VRAM\", \"Peak memory is bounded by one layer instead of by the model.\"),\n",
        "]\n",
        "rows = [\n",
        "    {\"messages\": [\n",
        "        {\"role\": \"user\", \"content\": f\"Question {i}: tell me about {topic}.\"},\n",
        "        {\"role\": \"assistant\", \"content\": answer},\n",
        "    ]}\n",
        "    for i in range(8)\n",
        "    for topic, answer in TOPICS\n",
        "]\n",
        "Path(\"train.jsonl\").write_text(\"\\n\".join(json.dumps(r) for r in rows), encoding=\"utf-8\")\n",
        "\n",
        "config = \"\"\"\n",
        "base: NousResearch/Meta-Llama-3.1-8B-Instruct\n",
        "task: sft\n",
        "data:\n",
        "  train: train.jsonl\n",
        "  max_length: 256\n",
        "training:\n",
        "  epochs: 1\n",
        "  batch_size: 1\n",
        "  lr: 0.0002\n",
        "  logging_steps: 1        # short run — without this nothing gets logged\n",
        "  quantization: 4bit      # NF4 — the store is ~4x smaller than bf16\n",
        "  stream_layers: true     # the feature\n",
        "  stream_buffers: 2\n",
        "  stream_vram_override: 4000000000  # same 4 GB the allocator enforces above (#347)\n",
        "  lora:\n",
        "    r: 8\n",
        "    alpha: 16\n",
        "output: ./out-8b\n",
        "\"\"\"\n",
        "Path(\"soup.yaml\").write_text(config, encoding=\"utf-8\")\n",
        "print(config)\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "WV-0mv5sGjPb"
      },
      "source": [
        "The cell below runs the trainer **in this process** rather than shelling out to\n",
        "`soup train`. That is deliberate and it is the only reason: `max_memory_allocated()`\n",
        "reports the peak of *the process that calls it*, so a subprocess would train fine and\n",
        "leave us measuring nothing. It is the same code path the CLI runs on the same\n",
        "`soup.yaml` above — the CLI adds argument parsing and the pre-flight panel, neither of\n",
        "which changes what the GPU does.\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 10,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000,
          "referenced_widgets": [
            "35ee497596604617ba94600ad274f67b",
            "e9d3eab7d0c9432f8ba491ad54f70114",
            "a40a14b07135429887a87f9e2f195f0a",
            "45e1fbb311674c4d90997812cd009ca7",
            "e4b6c79bd2b04ccd9c973727fea03b31",
            "ce3cb4ffeaa2483c9b07ddfa67099794",
            "245389ff14d04303b07e2caf74fcd613",
            "ef8cda62d86340a7a8f5eb9fbd5b5379",
            "4be68f8397054652abcf76bcb9c6dd07",
            "83d159c08b1e4cd396456c8efdfe3363",
            "6ead2f696d0242caaafe54134031c85b",
            "f9d81b93d99a4500921e5b7ecb4eaf10",
            "80af22410bd84a2085b101295240e1da",
            "d755dc0ccaba45c686e88cdffb446b03",
            "5c5356b513744719a17b456bf85b02f8",
            "e6e09bde3db84cb5b05ff17979a1c756",
            "c0e7eb7462294f90bc895d4fc35e24a7",
            "71f2bb58ebb4449e96e741cd6a871307",
            "50c77663bb614591955ac0361dca2303",
            "7d5d6a70d69840b58c3074ef51d64e76",
            "8e8b99dba8164613bee68ddbed15939e",
            "8d29bcdabd494acaa2f98c1e8e9b3e91",
            "c686a763c243420284c300807d60608a",
            "6274db24e591412d8d29b28cce60ce33",
            "42d74bf8b23542c3b7c6b9cab6ffe304",
            "816bd5861347404291f3dd7ea97165dd",
            "d34f9a02bbe346f4a975d4ccdd632d7e",
            "29aa7549f9e147439585b07d652bb070",
            "9ba6f453cb204408b7e77922d7208134",
            "93537120d889491e9ea5fad0f1343c6a",
            "6890fc7518b94db48ed087f7128e1aa9",
            "8210fe01d55a4d9e8573559072bfc77f",
            "a3eddcd776754633990da638e1ab1686",
            "88416241eaae466c83f73d29931a20bc",
            "3fd4bdbdff694191be84c113a4ee8d6d",
            "23bb0118c7dc415089538f68691a6ebb",
            "4da521b3b720410abeca6e0982dddb8d",
            "0b327fce5f4449399847d7f1f12746ee",
            "8613547a5d474090a35b08b5281e8a7d",
            "6e5647ac37484373a8b8fa270c977984",
            "60b9a418c0234eb1835162e1cfdaf694",
            "34ffd5006ec74b5993f4d4a87c99ae8e",
            "0374db7ed4ed4d0ebb2336a00e2a86c9",
            "130630254ce64432b24f4f7bdcbd2344",
            "65160c38c03248ea98ffc998b6304b81",
            "a4581c1c8ca0410ebe88a1f44c0376d1",
            "460ae660d82b4b8c98d7b92f361127f2",
            "40b0767205474f0f8212e8af673b8b36",
            "5b6d0637d0f5465f9170a0e88dce8620",
            "e0816fefa70f4fc9b599ce0b12a751cf",
            "95d3abe8e87a48209a6d5b7db1899a3c",
            "e83fa3e9c84b4ac1855bd10e8f636ae3",
            "13457c4fb87649f082787743450ce477",
            "c900cc97b8804caeb1f4da05b9afcd27",
            "2a0bea75275b4c29b5ad4a38b6589eb9",
            "b64e93cc27994aa4a6019128222302e4",
            "7c542b2d56bf4c7dbe690ab888ff3900",
            "f7558f8cc9ab4c2d9f4d5394551ca76c",
            "a668be7526a84398ba637c1d7b3a7517",
            "8b2e5061814845a2af0bbea3ef969bf5",
            "e73005d74e014e018b5ea0093fc9797a",
            "03f2a35c338a494396cf3e8a7294af41",
            "4614dcff59d8438588ba05f78142f3e6",
            "6057cd6ca93c4e3aba06e431bed676bb",
            "1ef6b499144647628881409798a6dc7a",
            "7fc91fc2438a42b28ebb86b6d4561bd5",
            "f80cbd912101453c8be873d807aaf2e8",
            "e84755b2bd364309a189abc658aed7e6",
            "fe1161b83b1f41fcb0b915d74fb1ad85",
            "54bf53b947f546bab6871edee4f42dd0",
            "e9b63850ce1b42079c7c4d4b0af16049",
            "298c737f48ba4b78b18e1bbf5a65f106",
            "efb9f916092347689564d2eb3971a2b3",
            "4cccf7f16fa745a8bbcb5133cdbf50e6",
            "f3506fb615524f0985b84a42f9623c96",
            "4be70f5c998a4002a904d4dcdea8ed8f",
            "0ef32da4b20f4b259c9dc6db37fdf8a8",
            "7bbfaa6685b94518a43751f208d14194",
            "b80fc4b54ac446be9dc9e9684611760e",
            "208d4b88b10941abaac3370d13be017a",
            "83d74109bbff421b922f09a0bfc96731",
            "e49360e10ca64dd49bd34a431b80fdee",
            "a4805fc732ca42da9ef3048c189d8825",
            "dbafadb2a5164b1c81efec284d2eafb1",
            "f03b91976b61427c9226b02864b1a24b",
            "598714ba52c844199123a68c7c05ee23",
            "b37f1aa2034e45608b2e5813f821f608",
            "b34b00154e134af6bdccdfd4ec0319bb",
            "d52de28dd3c5408e9a89a10ec7910215",
            "31137da3af584d33ae9bbc3a322cb5b5",
            "0a003709e02e4285938da4bb2c4ef7f1",
            "7741ea6eaf1d4a6abc722effc1297b88",
            "faf1ddf281784aad91c2c3b4bca6b957",
            "ff466ea4fd094cfeb2b72c4e900f83b1",
            "222a3b9e28b040c9aa615f7a8afd3c16",
            "78b5998326384bd2a3f956b658a6c45a",
            "ff756b7ae2bf45999416d11a11d89565",
            "4b9e7bb47d3f4a87af852c4100b2d0f8",
            "350114c77ee649f0aab61aeb376d08fb",
            "8003bb7941eb4090a1fcf6bcea55c6ea",
            "7d328a3f5a9642388b4aeab3e05c69bd",
            "74dea5b5be6941b997844cb51cbacbd8",
            "d34c375a32a844cdbaa133bd768f19d5",
            "c56e8789c81f492d9520936635415098",
            "68e33220036347d3afa231bd3d2b7865",
            "2cf81a35ef9c4bb1bbcd12a0643a99c4",
            "3ba5e545209245eeac1d44040aca3d6d",
            "b6093fbc34af407895066bf8ce21e6a3",
            "5d98ed609ec745f0868394ea47dd72d3",
            "507014f569ff434395c0be2320e28396",
            "59d99840b2574bae89690e14d8fe26b6",
            "439184a795f042e6b2ac12c4a1217722",
            "a14faf64a126456d9ae482b76752a62c",
            "9752b710bc124934853c5f2e239038fd",
            "16c1d4a11b214f1aa8944820eb9db631",
            "f31373192dce4c1abeb178b229596289",
            "42e486c8f6074ac0ae4a2cb01bd3ac28",
            "2ab53c5552e24c4a93fb02f6ea12831e",
            "f1c0fd3eb8254e22babe007edf3f36b4",
            "ca8e430e28c1420489010799a6a1651b",
            "08fe8e8b9a414dc491c485d95806af93"
          ]
        },
        "id": "hEeldGwuGjPb",
        "outputId": "811f5852-a0f3-477c-fed2-0cfa97383967"
      },
      "outputs": [
        {
          "data": {
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"color: #7f7f7f; text-decoration-color: #7f7f7f\">Auto-detected format: chatml</span>\n",
              "</pre>\n"
            ],
            "text/plain": [
              "\u001b[2mAuto-detected format: chatml\u001b[0m\n"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"color: #7f7f7f; text-decoration-color: #7f7f7f\">Loading tokenizer: NousResearch/Meta-Llama-</span><span style=\"color: #7fbfbf; text-decoration-color: #7fbfbf; font-weight: bold\">3.1</span><span style=\"color: #7f7f7f; text-decoration-color: #7f7f7f\">-8B-Instruct</span>\n",
              "</pre>\n"
            ],
            "text/plain": [
              "\u001b[2mLoading tokenizer: NousResearch/Meta-Llama-\u001b[0m\u001b[1;2;36m3.1\u001b[0m\u001b[2m-8B-Instruct\u001b[0m\n"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "35ee497596604617ba94600ad274f67b",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "config.json:   0%|          | 0.00/855 [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "f9d81b93d99a4500921e5b7ecb4eaf10",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "tokenizer_config.json:   0%|          | 0.00/50.9k [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "c686a763c243420284c300807d60608a",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "tokenizer.json:   0%|          | 0.00/9.09M [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "88416241eaae466c83f73d29931a20bc",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "special_tokens_map.json:   0%|          | 0.00/296 [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "65160c38c03248ea98ffc998b6304b81",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading bytes:           |  0.00B            "
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "b64e93cc27994aa4a6019128222302e4",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Reconstructing (incomplete total...): |          |  0.00B /  0.00B            "
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "f80cbd912101453c8be873d807aaf2e8",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Fetching 11 files:   0%|          | 0/11 [00:00<?, ?it/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "╭──────────────────────────────────────── Layer streaming disk pre-flight ────────────────────────────────────────╮\n",
              "│ HF/local source: 16.06 GB                                                                                       │\n",
              "│ Soup materialized copy: 16.06 GB (write required)                                                               │\n",
              "│ Layer-shard cache: 4.14 GB (write required)                                                                     │\n",
              "│ Projected total on disk: 36.26 GB                                                                               │\n",
              "│ Additional writes before training: 20.20 GB                                                                     │\n",
              "│ Free on target volume (materialized weight copy + layer-shard cache): 52.91 GB                                  │\n",
              "╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯\n"
            ],
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\">╭──────────────────────────────────────── Layer streaming disk pre-flight ────────────────────────────────────────╮\n",
              "│ HF/local source: 16.06 GB                                                                                       │\n",
              "│ Soup materialized copy: 16.06 GB (write required)                                                               │\n",
              "│ Layer-shard cache: 4.14 GB (write required)                                                                     │\n",
              "│ Projected total on disk: 36.26 GB                                                                               │\n",
              "│ Additional writes before training: 20.20 GB                                                                     │\n",
              "│ Free on target volume (materialized weight copy + layer-shard cache): 52.91 GB                                  │\n",
              "╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯\n",
              "</pre>\n"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "\u001b[2mPreparing layer shards -> \u001b[0m\u001b[2;35m/root/.soup/layer-stream/\u001b[0m\u001b[2;95mNousResearch__Meta-Llama-3.1-8B-Instruct\u001b[0m\n"
            ],
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"color: #7f7f7f; text-decoration-color: #7f7f7f\">Preparing layer shards -&gt; </span><span style=\"color: #bf7fbf; text-decoration-color: #bf7fbf\">/root/.soup/layer-stream/</span><span style=\"color: #ff7fff; text-decoration-color: #ff7fff\">NousResearch__Meta-Llama-3.1-8B-Instruct</span>\n",
              "</pre>\n"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "\u001b[33mRe-sharding layer cache:\u001b[0m cache index is missing or unreadable.\n"
            ],
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"color: #808000; text-decoration-color: #808000\">Re-sharding layer cache:</span> cache index is missing or unreadable.\n",
              "</pre>\n"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "\u001b[36m╭─\u001b[0m\u001b[36m───────────────────────────────────────────\u001b[0m\u001b[36m training.stream_layers \u001b[0m\u001b[36m────────────────────────────────────────────\u001b[0m\u001b[36m─╮\u001b[0m\n",
              "\u001b[36m│\u001b[0m \u001b[1mLayer streaming\u001b[0m \u001b[33mBETA\u001b[0m — arch \u001b[36mllama\u001b[0m, tier \u001b[36mram\u001b[0m                                                                     \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m   base store   5.70 GB across 32 layers (pinned)                                                                \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m   VRAM buffers 2 x 113 MB + 1 x 1051 MB large-layer slot = 1276 MB                                              \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m   resident     0 MB extras + adapters                                                                           \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m   peak VRAM    ~1.97 GB at batch 1 x seq 256 (logits 0.46 GB)                                                   \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m   free VRAM    4.00 GB (training.stream_vram_override; driver reports 15.15 GB)                                 \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m   forecast     288-423 tok/s — a compute-bound bound, not a promise                                             \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m                (from 20.39 TFLOPS measured on this card now using float16 @ 525 MHz)                            \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m   \u001b[33m!\u001b[0m accumulating 4x at batch 1: the base is re-read once per micro-batch. Per token that is free, but reaching  \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m effective batch 4 by raising training.batch_size instead measured ~2.5x faster. Accumulation holds peak VRAM    \u001b[36m│\u001b[0m\n",
              "\u001b[36m│\u001b[0m flat, so raise batch_size while the budget above allows, then accumulate for the rest.                          \u001b[36m│\u001b[0m\n",
              "\u001b[36m╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯\u001b[0m\n"
            ],
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"color: #008080; text-decoration-color: #008080\">╭──────────────────────────────────────────── training.stream_layers ─────────────────────────────────────────────╮</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span> <span style=\"font-weight: bold\">Layer streaming</span> <span style=\"color: #808000; text-decoration-color: #808000\">BETA</span> — arch <span style=\"color: #008080; text-decoration-color: #008080\">llama</span>, tier <span style=\"color: #008080; text-decoration-color: #008080\">ram</span>                                                                     <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span>   base store   5.70 GB across 32 layers (pinned)                                                                <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span>   VRAM buffers 2 x 113 MB + 1 x 1051 MB large-layer slot = 1276 MB                                              <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span>   resident     0 MB extras + adapters                                                                           <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span>   peak VRAM    ~1.97 GB at batch 1 x seq 256 (logits 0.46 GB)                                                   <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span>   free VRAM    4.00 GB (training.stream_vram_override; driver reports 15.15 GB)                                 <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span>   forecast     288-423 tok/s — a compute-bound bound, not a promise                                             <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span>                (from 20.39 TFLOPS measured on this card now using float16 @ 525 MHz)                            <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span>   <span style=\"color: #808000; text-decoration-color: #808000\">!</span> accumulating 4x at batch 1: the base is re-read once per micro-batch. Per token that is free, but reaching  <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span> effective batch 4 by raising training.batch_size instead measured ~2.5x faster. Accumulation holds peak VRAM    <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">│</span> flat, so raise batch_size while the budget above allows, then accumulate for the rest.                          <span style=\"color: #008080; text-decoration-color: #008080\">│</span>\n",
              "<span style=\"color: #008080; text-decoration-color: #008080\">╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯</span>\n",
              "</pre>\n"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "\u001b[33mLayer streaming is BETA:\u001b[0m slower than resident training, but this model may not run resident on this card at all.\n"
            ],
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"color: #808000; text-decoration-color: #808000\">Layer streaming is BETA:</span> slower than resident training, but this model may not run resident on this card at all.\n",
              "</pre>\n"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "\u001b[2mexpandable_segments allocator hint not enabled: CUDA was already initialised before Soup could set it — the \u001b[0m\n",
              "\u001b[2mallocator reads PYTORCH_CUDA_ALLOC_CONF once, at context creation\u001b[0m\n"
            ],
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"color: #7f7f7f; text-decoration-color: #7f7f7f\">expandable_segments allocator hint not enabled: CUDA was already initialised before Soup could set it — the </span>\n",
              "<span style=\"color: #7f7f7f; text-decoration-color: #7f7f7f\">allocator reads PYTORCH_CUDA_ALLOC_CONF once, at context creation</span>\n",
              "</pre>\n"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "\u001b[32mLayer streaming ready:\u001b[0m \u001b[1;36m32\u001b[0m layers, \u001b[1;36m5.70\u001b[0m GB pinned RAM store, \u001b[1;36m2\u001b[0m x \u001b[1;36m113\u001b[0m MB decoder buffers + \u001b[1;36m1\u001b[0m x \u001b[1;36m1051\u001b[0m MB large-layer \n",
              "slot\n"
            ],
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"color: #008000; text-decoration-color: #008000\">Layer streaming ready:</span> <span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">32</span> layers, <span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">5.70</span> GB pinned RAM store, <span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">2</span> x <span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">113</span> MB decoder buffers + <span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">1</span> x <span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">1051</span> MB large-layer \n",
              "slot\n",
              "</pre>\n"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "\u001b[32mLoRA applied:\u001b[0m \u001b[1;36m3\u001b[0m,\u001b[1;36m407\u001b[0m,\u001b[1;36m872\u001b[0m trainable \u001b[35m/\u001b[0m \u001b[1;36m8\u001b[0m,\u001b[1;36m030\u001b[0m,\u001b[1;36m261\u001b[0m,\u001b[1;36m248\u001b[0m total \u001b[1m(\u001b[0m\u001b[1;36m0.04\u001b[0m%\u001b[1m)\u001b[0m\n"
            ],
            "text/html": [
              "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"color: #008000; text-decoration-color: #008000\">LoRA applied:</span> <span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">3</span>,<span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">407</span>,<span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">872</span> trainable <span style=\"color: #800080; text-decoration-color: #800080\">/</span> <span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">8</span>,<span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">030</span>,<span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">261</span>,<span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">248</span> total <span style=\"font-weight: bold\">(</span><span style=\"color: #008080; text-decoration-color: #008080; font-weight: bold\">0.04</span>%<span style=\"font-weight: bold\">)</span>\n",
              "</pre>\n"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Map:   0%|          | 0/28 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "7bbfaa6685b94518a43751f208d14194"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "[transformers] return_assistant_tokens_mask==True but chat template does not contain `{% generation %}` keyword.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Map:   0%|          | 0/4 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "d52de28dd3c5408e9a89a10ec7910215"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Truncating train dataset:   0%|          | 0/28 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "8003bb7941eb4090a1fcf6bcea55c6ea"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Truncating eval dataset:   0%|          | 0/4 [00:00<?, ? examples/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "59d99840b2574bae89690e14d8fe26b6"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "[transformers] The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 128009, 'pad_token_id': 128009}.\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<IPython.core.display.HTML object>"
            ],
            "text/html": [
              "\n",
              "    <div>\n",
              "      \n",
              "      <progress value='7' max='7' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
              "      [7/7 00:20, Epoch 1/1]\n",
              "    </div>\n",
              "    <table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              " <tr style=\"text-align: left;\">\n",
              "      <th>Step</th>\n",
              "      <th>Training Loss</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <td>1</td>\n",
              "      <td>4.529099</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>2</td>\n",
              "      <td>4.441022</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>3</td>\n",
              "      <td>3.946751</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>4</td>\n",
              "      <td>4.775282</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>5</td>\n",
              "      <td>4.251106</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>6</td>\n",
              "      <td>4.155877</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <td>7</td>\n",
              "      <td>4.029544</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table><p>"
            ]
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "\n",
            "steps: 7  loss: 4.529 -> 4.030\n"
          ]
        }
      ],
      "source": [
        "from soup_cli.config.loader import load_config_from_string\n",
        "from soup_cli.data.loader import load_dataset\n",
        "from soup_cli.trainer.sft import SFTTrainerWrapper\n",
        "\n",
        "cfg = load_config_from_string(config)\n",
        "dataset = load_dataset(cfg.data)\n",
        "\n",
        "torch.cuda.empty_cache()\n",
        "torch.cuda.reset_peak_memory_stats()\n",
        "\n",
        "wrapper = SFTTrainerWrapper(cfg)\n",
        "wrapper.setup(dataset)   # downloads, shards to NF4, builds the streamed model\n",
        "result = wrapper.train()\n",
        "\n",
        "print(f\"\\nsteps: {result['total_steps']}  loss: {result['initial_loss']:.3f}\"\n",
        "      f\" -> {result['final_loss']:.3f}\")\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 11,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "4YmrBTWkGjPb",
        "outputId": "735ebe34-4229-40dd-89b7-247069af1c30"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "peak VRAM allocated by this process: 1.83 GB\n",
            "budget this process was capped to:   4.00 GB\n",
            "model weights in NF4, for scale:     ~4.5 GB\n",
            "\n",
            "adapter written: True\n",
            "adapter tensors: 128, non-zero: 128\n"
          ]
        }
      ],
      "source": [
        "peak = torch.cuda.max_memory_allocated()\n",
        "print(f\"peak VRAM allocated by this process: {peak / 1e9:.2f} GB\")\n",
        "print(f\"budget this process was capped to:   {BUDGET_BYTES / 1e9:.2f} GB\")\n",
        "print(\"model weights in NF4, for scale:     ~4.5 GB\")\n",
        "\n",
        "adapter = Path(\"out-8b/adapter_model.safetensors\")\n",
        "print(f\"\\nadapter written: {adapter.exists()}\")\n",
        "if adapter.exists():\n",
        "    from safetensors.torch import load_file\n",
        "\n",
        "    tensors = load_file(str(adapter))\n",
        "    live = sum(1 for v in tensors.values() if v.abs().max().item() > 0)\n",
        "    print(f\"adapter tensors: {len(tensors)}, non-zero: {live}\")\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "72bL5REbGjPb"
      },
      "source": [
        "## What this proved, and what it did not\n",
        "\n",
        "**Proved, on your hardware:**\n",
        "\n",
        "- A streamed model returns **bit-identical** logits to an ordinary one (§4).\n",
        "- An 8B model trained with a measured peak below a cap smaller than its own weights (§5).\n",
        "- Both on a GPU with **no bf16** — the case that was broken until recently.\n",
        "\n",
        "**Not proved:**\n",
        "\n",
        "- *Backward* exactness at this size. §4 compares the forward. Gradient exactness is\n",
        "  verified up to 14B against resident references on hardware that can hold them, and\n",
        "  a defect **above** that size was found, named upstream and repaired — see\n",
        "  [`benchmarks/`](https://github.com/MakazhanAlpamys/Soup/tree/main/benchmarks).\n",
        "- Speed. A T4 under an artificial cap is not a throughput benchmark, and this notebook\n",
        "  deliberately does not quote tok/s.\n",
        "\n",
        "Layer streaming is **BETA** and opt-in (`stream_layers: true`).\n",
        "\n",
        "**If any assertion above failed, that is worth an issue** — with the cell output. A\n",
        "reproduction on hardware we do not own is more useful to this project than a star.\n",
        "\n",
        "The method, the correctness protocol and every measurement:\n",
        "[10.5281/zenodo.21771064](https://doi.org/10.5281/zenodo.21771064) ·\n",
        "[measurement records](https://github.com/MakazhanAlpamys/Soup/tree/main/benchmarks)\n"
      ]
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "gpuType": "T4",
      "provenance": []
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "name": "python"
    },
    "widgets": {
      "application/vnd.jupyter.widget-state+json": {
        "version_major": 2,
        "version_minor": 0,
        "state": {
          "5ce8709eb08141b49ec54002daaf6a02": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_1ade6c23233e4dc8928b74379f919b52",
                "IPY_MODEL_64dac42bdc2948108be4191c0ceda935",
                "IPY_MODEL_703835e267844b2081cc77a980f29a5a"
              ],
              "layout": "IPY_MODEL_7bcd0e9f66b44345be83558727ea4f73"
            }
          },
          "1ade6c23233e4dc8928b74379f919b52": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_ea2e2f0858604f8cbb26396a34486582",
              "placeholder": "​",
              "style": "IPY_MODEL_57d7a95684aa4448a094b483607d8a7b",
              "value": "Download complete: : "
            }
          },
          "64dac42bdc2948108be4191c0ceda935": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_26c64bed491b40338f08829696b702d2",
              "max": 1,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_bf620d6b3d3247c3b885a9b52ed50e72",
              "value": 1
            }
          },
          "703835e267844b2081cc77a980f29a5a": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_e2482e92256f4dc3abf1da54bcbd0b4e",
              "placeholder": "​",
              "style": "IPY_MODEL_611b1dafb25f44bd88803b30c5fb8be2",
              "value": "  271MB,  224MB/s  "
            }
          },
          "7bcd0e9f66b44345be83558727ea4f73": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "ea2e2f0858604f8cbb26396a34486582": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "57d7a95684aa4448a094b483607d8a7b": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "26c64bed491b40338f08829696b702d2": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": "20px"
            }
          },
          "bf620d6b3d3247c3b885a9b52ed50e72": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "e2482e92256f4dc3abf1da54bcbd0b4e": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "611b1dafb25f44bd88803b30c5fb8be2": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "1eb41dbea62d4d38a15c1861465a89af": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_653f8a5aec8a4f268ac5131721b95939",
                "IPY_MODEL_909b04d476b64bfeb01e889a31579ec2",
                "IPY_MODEL_319044ab454c41ecafd14d019bd3dae6"
              ],
              "layout": "IPY_MODEL_8afdfbea52874655b291ad460c7a06ca"
            }
          },
          "653f8a5aec8a4f268ac5131721b95939": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_c01d30ec7dc943c7b73eee9bab52ff7d",
              "placeholder": "​",
              "style": "IPY_MODEL_1c2eff1f10744844b12048ee187cd7d5",
              "value": "Reconstruction complete: 100%"
            }
          },
          "909b04d476b64bfeb01e889a31579ec2": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_d609772e7c8a4b92a86dc1e4e381b330",
              "max": 1,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_9f1e69eb590248e2b8f3e9f4705d5efa",
              "value": 1
            }
          },
          "319044ab454c41ecafd14d019bd3dae6": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_f086e453790c472cb3f7302d0a9a9c59",
              "placeholder": "​",
              "style": "IPY_MODEL_5a8439b13e404597ad30f6841c88e503",
              "value": "  272MB /  272MB,  139MB/s  "
            }
          },
          "8afdfbea52874655b291ad460c7a06ca": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "c01d30ec7dc943c7b73eee9bab52ff7d": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "1c2eff1f10744844b12048ee187cd7d5": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "d609772e7c8a4b92a86dc1e4e381b330": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": "20px"
            }
          },
          "9f1e69eb590248e2b8f3e9f4705d5efa": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "f086e453790c472cb3f7302d0a9a9c59": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "5a8439b13e404597ad30f6841c88e503": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "cf4ec404d5144f7c9d4b333d0a715c2b": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_9b2b590e6a4b475b8de2ea0408f0431f",
                "IPY_MODEL_a18dada832ec421bbaf389daad3d1dd9",
                "IPY_MODEL_c5dab0b774fa4f32b8837655f217fe87"
              ],
              "layout": "IPY_MODEL_fbefa341e54f44669cbd6b008d332388"
            }
          },
          "9b2b590e6a4b475b8de2ea0408f0431f": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_9730f83efe164a26a2f929a2d5389e83",
              "placeholder": "​",
              "style": "IPY_MODEL_339fabb1f51b435687047788de187438",
              "value": "Fetching 11 files: 100%"
            }
          },
          "a18dada832ec421bbaf389daad3d1dd9": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_bf1f2e0942a248bb856bcce5fde22450",
              "max": 11,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_c874443864e44b4d96fe173cef76774f",
              "value": 11
            }
          },
          "c5dab0b774fa4f32b8837655f217fe87": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_5e7f3e8b868546c8ba1ada9c93690215",
              "placeholder": "​",
              "style": "IPY_MODEL_a80e7b254bc84ea1aab5cb84c07d5167",
              "value": " 11/11 [00:03&lt;00:00, 13.46it/s]"
            }
          },
          "fbefa341e54f44669cbd6b008d332388": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "9730f83efe164a26a2f929a2d5389e83": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "339fabb1f51b435687047788de187438": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "bf1f2e0942a248bb856bcce5fde22450": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "c874443864e44b4d96fe173cef76774f": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "5e7f3e8b868546c8ba1ada9c93690215": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "a80e7b254bc84ea1aab5cb84c07d5167": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "16c9123ed8cb4c02b25729e7fe8fb2df": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_8dd8ccb477cb4da3af7d7511124c9c5d",
                "IPY_MODEL_c0a5556c08e44280a72c0ecc8810f2a6",
                "IPY_MODEL_463038b513e849d19431f12ecb26c8a1"
              ],
              "layout": "IPY_MODEL_3341a9dac7c64af38c5e479d9a5083f8"
            }
          },
          "8dd8ccb477cb4da3af7d7511124c9c5d": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_7c91ec1827844d05ba8e51ba994d1f7f",
              "placeholder": "​",
              "style": "IPY_MODEL_c219201c066b41bb84dae9e5c981facb",
              "value": "Loading weights: 100%"
            }
          },
          "c0a5556c08e44280a72c0ecc8810f2a6": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_0aa7563bd4d04e848f32f2782f7717fe",
              "max": 272,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_13c5ab409fbb49888ce477f55e1f62af",
              "value": 272
            }
          },
          "463038b513e849d19431f12ecb26c8a1": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_6dbd72ea2b8846408bb53debf64a756d",
              "placeholder": "​",
              "style": "IPY_MODEL_9b5d5a1c32624c54b530692430dab2a2",
              "value": " 272/272 [00:00&lt;00:00, 638.61it/s]"
            }
          },
          "3341a9dac7c64af38c5e479d9a5083f8": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "7c91ec1827844d05ba8e51ba994d1f7f": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "c219201c066b41bb84dae9e5c981facb": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "0aa7563bd4d04e848f32f2782f7717fe": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "13c5ab409fbb49888ce477f55e1f62af": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "6dbd72ea2b8846408bb53debf64a756d": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "9b5d5a1c32624c54b530692430dab2a2": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "35ee497596604617ba94600ad274f67b": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_e9d3eab7d0c9432f8ba491ad54f70114",
                "IPY_MODEL_a40a14b07135429887a87f9e2f195f0a",
                "IPY_MODEL_45e1fbb311674c4d90997812cd009ca7"
              ],
              "layout": "IPY_MODEL_e4b6c79bd2b04ccd9c973727fea03b31"
            }
          },
          "e9d3eab7d0c9432f8ba491ad54f70114": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_ce3cb4ffeaa2483c9b07ddfa67099794",
              "placeholder": "​",
              "style": "IPY_MODEL_245389ff14d04303b07e2caf74fcd613",
              "value": "config.json: 100%"
            }
          },
          "a40a14b07135429887a87f9e2f195f0a": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_ef8cda62d86340a7a8f5eb9fbd5b5379",
              "max": 855,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_4be68f8397054652abcf76bcb9c6dd07",
              "value": 855
            }
          },
          "45e1fbb311674c4d90997812cd009ca7": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_83d159c08b1e4cd396456c8efdfe3363",
              "placeholder": "​",
              "style": "IPY_MODEL_6ead2f696d0242caaafe54134031c85b",
              "value": " 855/855 [00:00&lt;00:00, 19.2kB/s]"
            }
          },
          "e4b6c79bd2b04ccd9c973727fea03b31": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "ce3cb4ffeaa2483c9b07ddfa67099794": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "245389ff14d04303b07e2caf74fcd613": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "ef8cda62d86340a7a8f5eb9fbd5b5379": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "4be68f8397054652abcf76bcb9c6dd07": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "83d159c08b1e4cd396456c8efdfe3363": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "6ead2f696d0242caaafe54134031c85b": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "f9d81b93d99a4500921e5b7ecb4eaf10": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_80af22410bd84a2085b101295240e1da",
                "IPY_MODEL_d755dc0ccaba45c686e88cdffb446b03",
                "IPY_MODEL_5c5356b513744719a17b456bf85b02f8"
              ],
              "layout": "IPY_MODEL_e6e09bde3db84cb5b05ff17979a1c756"
            }
          },
          "80af22410bd84a2085b101295240e1da": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_c0e7eb7462294f90bc895d4fc35e24a7",
              "placeholder": "​",
              "style": "IPY_MODEL_71f2bb58ebb4449e96e741cd6a871307",
              "value": "tokenizer_config.json: 100%"
            }
          },
          "d755dc0ccaba45c686e88cdffb446b03": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_50c77663bb614591955ac0361dca2303",
              "max": 50870,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_7d5d6a70d69840b58c3074ef51d64e76",
              "value": 50870
            }
          },
          "5c5356b513744719a17b456bf85b02f8": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_8e8b99dba8164613bee68ddbed15939e",
              "placeholder": "​",
              "style": "IPY_MODEL_8d29bcdabd494acaa2f98c1e8e9b3e91",
              "value": " 50.9k/50.9k [00:00&lt;00:00, 1.39MB/s]"
            }
          },
          "e6e09bde3db84cb5b05ff17979a1c756": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "c0e7eb7462294f90bc895d4fc35e24a7": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "71f2bb58ebb4449e96e741cd6a871307": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "50c77663bb614591955ac0361dca2303": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "7d5d6a70d69840b58c3074ef51d64e76": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "8e8b99dba8164613bee68ddbed15939e": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "8d29bcdabd494acaa2f98c1e8e9b3e91": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "c686a763c243420284c300807d60608a": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_6274db24e591412d8d29b28cce60ce33",
                "IPY_MODEL_42d74bf8b23542c3b7c6b9cab6ffe304",
                "IPY_MODEL_816bd5861347404291f3dd7ea97165dd"
              ],
              "layout": "IPY_MODEL_d34f9a02bbe346f4a975d4ccdd632d7e"
            }
          },
          "6274db24e591412d8d29b28cce60ce33": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_29aa7549f9e147439585b07d652bb070",
              "placeholder": "​",
              "style": "IPY_MODEL_9ba6f453cb204408b7e77922d7208134",
              "value": "tokenizer.json: 100%"
            }
          },
          "42d74bf8b23542c3b7c6b9cab6ffe304": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_93537120d889491e9ea5fad0f1343c6a",
              "max": 9085657,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_6890fc7518b94db48ed087f7128e1aa9",
              "value": 9085657
            }
          },
          "816bd5861347404291f3dd7ea97165dd": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_8210fe01d55a4d9e8573559072bfc77f",
              "placeholder": "​",
              "style": "IPY_MODEL_a3eddcd776754633990da638e1ab1686",
              "value": " 9.09M/9.09M [00:00&lt;00:00, 22.7MB/s]"
            }
          },
          "d34f9a02bbe346f4a975d4ccdd632d7e": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "29aa7549f9e147439585b07d652bb070": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "9ba6f453cb204408b7e77922d7208134": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "93537120d889491e9ea5fad0f1343c6a": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "6890fc7518b94db48ed087f7128e1aa9": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "8210fe01d55a4d9e8573559072bfc77f": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "a3eddcd776754633990da638e1ab1686": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "88416241eaae466c83f73d29931a20bc": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_3fd4bdbdff694191be84c113a4ee8d6d",
                "IPY_MODEL_23bb0118c7dc415089538f68691a6ebb",
                "IPY_MODEL_4da521b3b720410abeca6e0982dddb8d"
              ],
              "layout": "IPY_MODEL_0b327fce5f4449399847d7f1f12746ee"
            }
          },
          "3fd4bdbdff694191be84c113a4ee8d6d": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_8613547a5d474090a35b08b5281e8a7d",
              "placeholder": "​",
              "style": "IPY_MODEL_6e5647ac37484373a8b8fa270c977984",
              "value": "special_tokens_map.json: 100%"
            }
          },
          "23bb0118c7dc415089538f68691a6ebb": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_60b9a418c0234eb1835162e1cfdaf694",
              "max": 296,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_34ffd5006ec74b5993f4d4a87c99ae8e",
              "value": 296
            }
          },
          "4da521b3b720410abeca6e0982dddb8d": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_0374db7ed4ed4d0ebb2336a00e2a86c9",
              "placeholder": "​",
              "style": "IPY_MODEL_130630254ce64432b24f4f7bdcbd2344",
              "value": " 296/296 [00:00&lt;00:00, 9.14kB/s]"
            }
          },
          "0b327fce5f4449399847d7f1f12746ee": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "8613547a5d474090a35b08b5281e8a7d": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "6e5647ac37484373a8b8fa270c977984": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "60b9a418c0234eb1835162e1cfdaf694": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "34ffd5006ec74b5993f4d4a87c99ae8e": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "0374db7ed4ed4d0ebb2336a00e2a86c9": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "130630254ce64432b24f4f7bdcbd2344": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "65160c38c03248ea98ffc998b6304b81": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_a4581c1c8ca0410ebe88a1f44c0376d1",
                "IPY_MODEL_460ae660d82b4b8c98d7b92f361127f2",
                "IPY_MODEL_40b0767205474f0f8212e8af673b8b36"
              ],
              "layout": "IPY_MODEL_5b6d0637d0f5465f9170a0e88dce8620"
            }
          },
          "a4581c1c8ca0410ebe88a1f44c0376d1": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_e0816fefa70f4fc9b599ce0b12a751cf",
              "placeholder": "​",
              "style": "IPY_MODEL_95d3abe8e87a48209a6d5b7db1899a3c",
              "value": "Download complete: : "
            }
          },
          "460ae660d82b4b8c98d7b92f361127f2": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_e83fa3e9c84b4ac1855bd10e8f636ae3",
              "max": 1,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_13457c4fb87649f082787743450ce477",
              "value": 1
            }
          },
          "40b0767205474f0f8212e8af673b8b36": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_c900cc97b8804caeb1f4da05b9afcd27",
              "placeholder": "​",
              "style": "IPY_MODEL_2a0bea75275b4c29b5ad4a38b6589eb9",
              "value": " 13.8GB, 8.66MB/s  "
            }
          },
          "5b6d0637d0f5465f9170a0e88dce8620": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "e0816fefa70f4fc9b599ce0b12a751cf": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "95d3abe8e87a48209a6d5b7db1899a3c": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "e83fa3e9c84b4ac1855bd10e8f636ae3": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": "20px"
            }
          },
          "13457c4fb87649f082787743450ce477": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "c900cc97b8804caeb1f4da05b9afcd27": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "2a0bea75275b4c29b5ad4a38b6589eb9": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "b64e93cc27994aa4a6019128222302e4": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_7c542b2d56bf4c7dbe690ab888ff3900",
                "IPY_MODEL_f7558f8cc9ab4c2d9f4d5394551ca76c",
                "IPY_MODEL_a668be7526a84398ba637c1d7b3a7517"
              ],
              "layout": "IPY_MODEL_8b2e5061814845a2af0bbea3ef969bf5"
            }
          },
          "7c542b2d56bf4c7dbe690ab888ff3900": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_e73005d74e014e018b5ea0093fc9797a",
              "placeholder": "​",
              "style": "IPY_MODEL_03f2a35c338a494396cf3e8a7294af41",
              "value": "Reconstruction complete: 100%"
            }
          },
          "f7558f8cc9ab4c2d9f4d5394551ca76c": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_4614dcff59d8438588ba05f78142f3e6",
              "max": 1,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_6057cd6ca93c4e3aba06e431bed676bb",
              "value": 1
            }
          },
          "a668be7526a84398ba637c1d7b3a7517": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_1ef6b499144647628881409798a6dc7a",
              "placeholder": "​",
              "style": "IPY_MODEL_7fc91fc2438a42b28ebb86b6d4561bd5",
              "value": " 16.1GB / 16.1GB,  120MB/s  "
            }
          },
          "8b2e5061814845a2af0bbea3ef969bf5": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "e73005d74e014e018b5ea0093fc9797a": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "03f2a35c338a494396cf3e8a7294af41": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "4614dcff59d8438588ba05f78142f3e6": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": "20px"
            }
          },
          "6057cd6ca93c4e3aba06e431bed676bb": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "1ef6b499144647628881409798a6dc7a": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "7fc91fc2438a42b28ebb86b6d4561bd5": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "f80cbd912101453c8be873d807aaf2e8": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_e84755b2bd364309a189abc658aed7e6",
                "IPY_MODEL_fe1161b83b1f41fcb0b915d74fb1ad85",
                "IPY_MODEL_54bf53b947f546bab6871edee4f42dd0"
              ],
              "layout": "IPY_MODEL_e9b63850ce1b42079c7c4d4b0af16049"
            }
          },
          "e84755b2bd364309a189abc658aed7e6": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_298c737f48ba4b78b18e1bbf5a65f106",
              "placeholder": "​",
              "style": "IPY_MODEL_efb9f916092347689564d2eb3971a2b3",
              "value": "Fetching 11 files: 100%"
            }
          },
          "fe1161b83b1f41fcb0b915d74fb1ad85": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_4cccf7f16fa745a8bbcb5133cdbf50e6",
              "max": 11,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_f3506fb615524f0985b84a42f9623c96",
              "value": 11
            }
          },
          "54bf53b947f546bab6871edee4f42dd0": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_4be70f5c998a4002a904d4dcdea8ed8f",
              "placeholder": "​",
              "style": "IPY_MODEL_0ef32da4b20f4b259c9dc6db37fdf8a8",
              "value": " 11/11 [05:58&lt;00:00, 34.98s/it]"
            }
          },
          "e9b63850ce1b42079c7c4d4b0af16049": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "298c737f48ba4b78b18e1bbf5a65f106": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "efb9f916092347689564d2eb3971a2b3": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "4cccf7f16fa745a8bbcb5133cdbf50e6": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "f3506fb615524f0985b84a42f9623c96": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "4be70f5c998a4002a904d4dcdea8ed8f": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "0ef32da4b20f4b259c9dc6db37fdf8a8": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "7bbfaa6685b94518a43751f208d14194": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_b80fc4b54ac446be9dc9e9684611760e",
                "IPY_MODEL_208d4b88b10941abaac3370d13be017a",
                "IPY_MODEL_83d74109bbff421b922f09a0bfc96731"
              ],
              "layout": "IPY_MODEL_e49360e10ca64dd49bd34a431b80fdee"
            }
          },
          "b80fc4b54ac446be9dc9e9684611760e": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_a4805fc732ca42da9ef3048c189d8825",
              "placeholder": "​",
              "style": "IPY_MODEL_dbafadb2a5164b1c81efec284d2eafb1",
              "value": "Map: 100%"
            }
          },
          "208d4b88b10941abaac3370d13be017a": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_f03b91976b61427c9226b02864b1a24b",
              "max": 28,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_598714ba52c844199123a68c7c05ee23",
              "value": 28
            }
          },
          "83d74109bbff421b922f09a0bfc96731": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_b37f1aa2034e45608b2e5813f821f608",
              "placeholder": "​",
              "style": "IPY_MODEL_b34b00154e134af6bdccdfd4ec0319bb",
              "value": " 28/28 [00:00&lt;00:00, 262.68 examples/s]"
            }
          },
          "e49360e10ca64dd49bd34a431b80fdee": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "a4805fc732ca42da9ef3048c189d8825": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "dbafadb2a5164b1c81efec284d2eafb1": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "f03b91976b61427c9226b02864b1a24b": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "598714ba52c844199123a68c7c05ee23": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "b37f1aa2034e45608b2e5813f821f608": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "b34b00154e134af6bdccdfd4ec0319bb": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "d52de28dd3c5408e9a89a10ec7910215": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_31137da3af584d33ae9bbc3a322cb5b5",
                "IPY_MODEL_0a003709e02e4285938da4bb2c4ef7f1",
                "IPY_MODEL_7741ea6eaf1d4a6abc722effc1297b88"
              ],
              "layout": "IPY_MODEL_faf1ddf281784aad91c2c3b4bca6b957"
            }
          },
          "31137da3af584d33ae9bbc3a322cb5b5": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_ff466ea4fd094cfeb2b72c4e900f83b1",
              "placeholder": "​",
              "style": "IPY_MODEL_222a3b9e28b040c9aa615f7a8afd3c16",
              "value": "Map: 100%"
            }
          },
          "0a003709e02e4285938da4bb2c4ef7f1": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_78b5998326384bd2a3f956b658a6c45a",
              "max": 4,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_ff756b7ae2bf45999416d11a11d89565",
              "value": 4
            }
          },
          "7741ea6eaf1d4a6abc722effc1297b88": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_4b9e7bb47d3f4a87af852c4100b2d0f8",
              "placeholder": "​",
              "style": "IPY_MODEL_350114c77ee649f0aab61aeb376d08fb",
              "value": " 4/4 [00:00&lt;00:00, 163.70 examples/s]"
            }
          },
          "faf1ddf281784aad91c2c3b4bca6b957": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "ff466ea4fd094cfeb2b72c4e900f83b1": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "222a3b9e28b040c9aa615f7a8afd3c16": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "78b5998326384bd2a3f956b658a6c45a": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "ff756b7ae2bf45999416d11a11d89565": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "4b9e7bb47d3f4a87af852c4100b2d0f8": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "350114c77ee649f0aab61aeb376d08fb": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "8003bb7941eb4090a1fcf6bcea55c6ea": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_7d328a3f5a9642388b4aeab3e05c69bd",
                "IPY_MODEL_74dea5b5be6941b997844cb51cbacbd8",
                "IPY_MODEL_d34c375a32a844cdbaa133bd768f19d5"
              ],
              "layout": "IPY_MODEL_c56e8789c81f492d9520936635415098"
            }
          },
          "7d328a3f5a9642388b4aeab3e05c69bd": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_68e33220036347d3afa231bd3d2b7865",
              "placeholder": "​",
              "style": "IPY_MODEL_2cf81a35ef9c4bb1bbcd12a0643a99c4",
              "value": "Truncating train dataset: 100%"
            }
          },
          "74dea5b5be6941b997844cb51cbacbd8": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_3ba5e545209245eeac1d44040aca3d6d",
              "max": 28,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_b6093fbc34af407895066bf8ce21e6a3",
              "value": 28
            }
          },
          "d34c375a32a844cdbaa133bd768f19d5": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_5d98ed609ec745f0868394ea47dd72d3",
              "placeholder": "​",
              "style": "IPY_MODEL_507014f569ff434395c0be2320e28396",
              "value": " 28/28 [00:00&lt;00:00, 1403.25 examples/s]"
            }
          },
          "c56e8789c81f492d9520936635415098": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "68e33220036347d3afa231bd3d2b7865": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "2cf81a35ef9c4bb1bbcd12a0643a99c4": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "3ba5e545209245eeac1d44040aca3d6d": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "b6093fbc34af407895066bf8ce21e6a3": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "5d98ed609ec745f0868394ea47dd72d3": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "507014f569ff434395c0be2320e28396": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "59d99840b2574bae89690e14d8fe26b6": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HBoxModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HBoxModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HBoxView",
              "box_style": "",
              "children": [
                "IPY_MODEL_439184a795f042e6b2ac12c4a1217722",
                "IPY_MODEL_a14faf64a126456d9ae482b76752a62c",
                "IPY_MODEL_9752b710bc124934853c5f2e239038fd"
              ],
              "layout": "IPY_MODEL_16c1d4a11b214f1aa8944820eb9db631"
            }
          },
          "439184a795f042e6b2ac12c4a1217722": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_f31373192dce4c1abeb178b229596289",
              "placeholder": "​",
              "style": "IPY_MODEL_42e486c8f6074ac0ae4a2cb01bd3ac28",
              "value": "Truncating eval dataset: 100%"
            }
          },
          "a14faf64a126456d9ae482b76752a62c": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "FloatProgressModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "FloatProgressModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "ProgressView",
              "bar_style": "success",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_2ab53c5552e24c4a93fb02f6ea12831e",
              "max": 4,
              "min": 0,
              "orientation": "horizontal",
              "style": "IPY_MODEL_f1c0fd3eb8254e22babe007edf3f36b4",
              "value": 4
            }
          },
          "9752b710bc124934853c5f2e239038fd": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "HTMLModel",
            "model_module_version": "1.5.0",
            "state": {
              "_dom_classes": [],
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "HTMLModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/controls",
              "_view_module_version": "1.5.0",
              "_view_name": "HTMLView",
              "description": "",
              "description_tooltip": null,
              "layout": "IPY_MODEL_ca8e430e28c1420489010799a6a1651b",
              "placeholder": "​",
              "style": "IPY_MODEL_08fe8e8b9a414dc491c485d95806af93",
              "value": " 4/4 [00:00&lt;00:00, 174.18 examples/s]"
            }
          },
          "16c1d4a11b214f1aa8944820eb9db631": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "f31373192dce4c1abeb178b229596289": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "42e486c8f6074ac0ae4a2cb01bd3ac28": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          },
          "2ab53c5552e24c4a93fb02f6ea12831e": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "f1c0fd3eb8254e22babe007edf3f36b4": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "ProgressStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "ProgressStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "bar_color": null,
              "description_width": ""
            }
          },
          "ca8e430e28c1420489010799a6a1651b": {
            "model_module": "@jupyter-widgets/base",
            "model_name": "LayoutModel",
            "model_module_version": "1.2.0",
            "state": {
              "_model_module": "@jupyter-widgets/base",
              "_model_module_version": "1.2.0",
              "_model_name": "LayoutModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "LayoutView",
              "align_content": null,
              "align_items": null,
              "align_self": null,
              "border": null,
              "bottom": null,
              "display": null,
              "flex": null,
              "flex_flow": null,
              "grid_area": null,
              "grid_auto_columns": null,
              "grid_auto_flow": null,
              "grid_auto_rows": null,
              "grid_column": null,
              "grid_gap": null,
              "grid_row": null,
              "grid_template_areas": null,
              "grid_template_columns": null,
              "grid_template_rows": null,
              "height": null,
              "justify_content": null,
              "justify_items": null,
              "left": null,
              "margin": null,
              "max_height": null,
              "max_width": null,
              "min_height": null,
              "min_width": null,
              "object_fit": null,
              "object_position": null,
              "order": null,
              "overflow": null,
              "overflow_x": null,
              "overflow_y": null,
              "padding": null,
              "right": null,
              "top": null,
              "visibility": null,
              "width": null
            }
          },
          "08fe8e8b9a414dc491c485d95806af93": {
            "model_module": "@jupyter-widgets/controls",
            "model_name": "DescriptionStyleModel",
            "model_module_version": "1.5.0",
            "state": {
              "_model_module": "@jupyter-widgets/controls",
              "_model_module_version": "1.5.0",
              "_model_name": "DescriptionStyleModel",
              "_view_count": null,
              "_view_module": "@jupyter-widgets/base",
              "_view_module_version": "1.2.0",
              "_view_name": "StyleView",
              "description_width": ""
            }
          }
        }
      }
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}