Skip to content

armgit / laya

Public Imported from GitHub
0

Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.

chore: update Kaggle 2xT4 notebook

Nandakishorea9f89910321
diff --git a/notebooks/laya_finetune_typed_decisions_2xT4_kaggle.ipynb b/notebooks/laya_finetune_typed_decisions_2xT4_kaggle.ipynb
index 25ad0ad4..c39021e6 100644
--- a/notebooks/laya_finetune_typed_decisions_2xT4_kaggle.ipynb
+++ b/notebooks/laya_finetune_typed_decisions_2xT4_kaggle.ipynb
@@ -12,10 +12,13 @@
"\n",
"This notebook fine-tunes **Laya** (`convaiinnovations/laya`, 421M params) on the **1,200 training cases (6,000 typed decisions)** of the [LocalLLaMA/typed-decisions](https://huggingface.co/datasets/LocalLLaMA/typed-decisions) benchmark using **both NVIDIA T4 GPUs via Distributed Data Parallel (`torchrun --nproc_per_node=2`)**.\n",
"\n",
- "### Setup on Kaggle:\n",
- "- **Settings -> Accelerator:** `GPU T4 x2`\n",
- "- **Settings -> Internet:** `On`\n",
- "- **Output:** `/kaggle/working/laya_finetuned_typed_decisions`\n"
+ "---\n",
+ "\n",
+ "### \u26a0\ufe0f Kaggle Notebook Settings:\n",
+ "In the right-hand sidebar panel under **Notebook options**:\n",
+ "* **Accelerator:** Select **`GPU T4 x2`** (ensure both GPUs are allocated)\n",
+ "* **Internet:** Set to **`On`**\n",
+ "* **Output:** Checkpoints and final model are saved to `/kaggle/working/laya_finetuned_typed_decisions`\n"
]
},
{
@@ -32,13 +35,21 @@
"source": [
"!nvidia-smi\n",
"import os, subprocess, torch\n",
+ "\n",
"n_gpu = torch.cuda.device_count()\n",
"print(f\"CUDA Available: {torch.cuda.is_available()} | Visible GPUs: {n_gpu}\")\n",
"for i in range(n_gpu):\n",
" p = torch.cuda.get_device_properties(i)\n",
" print(f\" GPU {i}: {p.name} ({p.total_memory / 1e9:.1f} GB)\")\n",
- "assert n_gpu == 2, \"Please select Accelerator: GPU T4 x2 in Kaggle settings!\"\n",
- "os.environ[\"PYTORCH_CUDA_ALLOC_CONF\"] = \"expandable_segments:True\"\n"
+ "\n",
+ "assert n_gpu >= 2, (\n",
+ " f\"Expected 2 GPUs, but detected {n_gpu}!\\n\"\n",
+ " \"Please switch your Kaggle Accelerator: on the right sidebar, go to Notebook options -> \"\n",
+ " \"Accelerator -> select GPU T4 x2.\"\n",
+ ")\n",
+ "\n",
+ "os.environ[\"PYTORCH_CUDA_ALLOC_CONF\"] = \"expandable_segments:True\"\n",
+ "print(\"Both T4 GPUs verified and ready for DDP training!\")\n"
]
},
{
@@ -574,14 +585,14 @@
}
],
"metadata": {
- "accelerator": "nvidiaGpuT4x2",
"kaggle": {
- "accelerator": "gpuT4x2",
- "isInternetEnabled": true,
- "isGpuEnabled": true
+ "accelerator": "nvidiaTeslaT4",
+ "isGpuEnabled": true,
+ "isInternetEnabled": true
},
"kernelspec": {
"display_name": "Python 3",
+ "language": "python",
"name": "python3"
},
"language_info": {