Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
Python calibrationclassificationdecision-modelhuggingfacejevmodernbertmultilingualnlppythonpytorchroutingtyped-decisionszero-shot
chore: update Kaggle 2xT4 notebook
Nandakishorea9f89910321
diff --git a/notebooks/laya_finetune_typed_decisions_2xT4_kaggle.ipynb b/notebooks/laya_finetune_typed_decisions_2xT4_kaggle.ipynbindex 25ad0ad4..c39021e6 100644--- a/notebooks/laya_finetune_typed_decisions_2xT4_kaggle.ipynb+++ b/notebooks/laya_finetune_typed_decisions_2xT4_kaggle.ipynb@@ -12,10 +12,13 @@"\n","This notebook fine-tunes **Laya** (`convaiinnovations/laya`, 421M params) on the **1,200 training cases (6,000 typed decisions)** of the [LocalLLaMA/typed-decisions](https://huggingface.co/datasets/LocalLLaMA/typed-decisions) benchmark using **both NVIDIA T4 GPUs via Distributed Data Parallel (`torchrun --nproc_per_node=2`)**.\n","\n",- "### Setup on Kaggle:\n",- "- **Settings -> Accelerator:** `GPU T4 x2`\n",- "- **Settings -> Internet:** `On`\n",- "- **Output:** `/kaggle/working/laya_finetuned_typed_decisions`\n"+ "---\n",+ "\n",+ "### \u26a0\ufe0f Kaggle Notebook Settings:\n",+ "In the right-hand sidebar panel under **Notebook options**:\n",+ "* **Accelerator:** Select **`GPU T4 x2`** (ensure both GPUs are allocated)\n",+ "* **Internet:** Set to **`On`**\n",+ "* **Output:** Checkpoints and final model are saved to `/kaggle/working/laya_finetuned_typed_decisions`\n"]},{@@ -32,13 +35,21 @@"source": ["!nvidia-smi\n","import os, subprocess, torch\n",+ "\n","n_gpu = torch.cuda.device_count()\n","print(f\"CUDA Available: {torch.cuda.is_available()} | Visible GPUs: {n_gpu}\")\n","for i in range(n_gpu):\n"," p = torch.cuda.get_device_properties(i)\n"," print(f\" GPU {i}: {p.name} ({p.total_memory / 1e9:.1f} GB)\")\n",- "assert n_gpu == 2, \"Please select Accelerator: GPU T4 x2 in Kaggle settings!\"\n",- "os.environ[\"PYTORCH_CUDA_ALLOC_CONF\"] = \"expandable_segments:True\"\n"+ "\n",+ "assert n_gpu >= 2, (\n",+ " f\"Expected 2 GPUs, but detected {n_gpu}!\\n\"\n",+ " \"Please switch your Kaggle Accelerator: on the right sidebar, go to Notebook options -> \"\n",+ " \"Accelerator -> select GPU T4 x2.\"\n",+ ")\n",+ "\n",+ "os.environ[\"PYTORCH_CUDA_ALLOC_CONF\"] = \"expandable_segments:True\"\n",+ "print(\"Both T4 GPUs verified and ready for DDP training!\")\n"]},{@@ -574,14 +585,14 @@}],"metadata": {- "accelerator": "nvidiaGpuT4x2","kaggle": {- "accelerator": "gpuT4x2",- "isInternetEnabled": true,- "isGpuEnabled": true+ "accelerator": "nvidiaTeslaT4",+ "isGpuEnabled": true,+ "isInternetEnabled": true},"kernelspec": {"display_name": "Python 3",+ "language": "python","name": "python3"},"language_info": {