🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org
Python agentai-societiesartificial-intelligencecommunicative-aicooperative-aideep-learninglarge-language-modelsmulti-agent-systemsnatural-language-processing
docs: add Data Deneration with CAMEL and Finetuning with Unsloth (#1278)
Wendong-Fan7e95673fa850
diff --git a/README.md b/README.mdindex e1db31440..9767e7b6f 100644--- a/README.md+++ b/README.md@@ -321,6 +321,7 @@ Practical guides and tutorials for implementing specific functionalities in CAME| **[Track CAMEL Agents with AgentOps](https://docs.camel-ai.org/cookbooks/agents_tracking.html)** | Tools for tracking and managing agents in operations. || **[Create A Hackathon Judge Committee with Workforce](https://docs.camel-ai.org/cookbooks/workforce_judge_committee.html)** | Building a team of agents for collaborative judging. || **[3 Ways to Ingest Data from Websites with Firecrawl](https://docs.camel-ai.org/cookbooks/ingest_data_from_websites_with_Firecrawl.html)** | Explore three methods for extracting and processing data from websites using Firecrawl. |+| **[Data Deneration with CAMEL and Finetuning with Unsloth](https://docs.camel-ai.org/cookbooks/sft_data_generation_and_unsloth_finetuning.html)** | Learn how to generate data with CAMEL and fine-tune models effectively with Unsloth. |## Utilize Various LLMs as Backendsdiff --git a/docs/cookbooks/sft_data_generation_and_unsloth_finetuning.ipynb b/docs/cookbooks/sft_data_generation_and_unsloth_finetuning.ipynbnew file mode 100644index 000000000..3e22ec7b8--- /dev/null+++ b/docs/cookbooks/sft_data_generation_and_unsloth_finetuning.ipynb@@ -0,0 +1,5319 @@+{+ "cells": [+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "8LKIA_qnVKOz"+ },+ "source": [+ "### Data generation with CAMEL and finetuning with Unsloth\n",+ "\n",+ "CAMEL and Unsloth make an excellent pair. In this notebook we will combine the two to train a model to be proficient at content on a page\n",+ "\n",+ "You will learn how to do data generation with CAMEL, how to train, and how to run the model.\n",+ ""+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "2eSvM9zX_2d3"+ },+ "outputs": [],+ "source": [+ "%%capture\n",+ "!pip install unsloth\n",+ "# Install CAMEL-AI with no optional dependencies\n",+ "!pip install git+https://github.com/camel-ai/camel.git@43336c9\n",+ "# Get Unsloth\n",+ "!pip install --upgrade --no-deps \"unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git@0de54572525788d09a6a9ef1efc7611e65dd7547\"\n",+ "!pip install firecrawl"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "r2v_X2fA0Df5"+ },+ "source": [+ "First we will set the OPENAI_API_KEY that will be used to generate the data.\n",+ "\n",+ "CAMEL supports many other models. See [here](https://docs.camel-ai.org/key_modules/models.html) for a list."+ ]+ },+ {+ "cell_type": "code",+ "source": [+ "from getpass import getpass\n",+ "import os\n",+ "\n",+ "openai_api_key = getpass('Enter your OpenAI API key: ')\n",+ "os.environ[\"OPENAI_API_KEY\"] = openai_api_key\n",+ "\n",+ "# Generate an API key at https://www.firecrawl.dev/app/api-keys\n",+ "firecrawl_api_key = getpass('Enter your Firecrawl API key: ')\n",+ "os.environ[\"FIRECRAWL_API_KEY\"] = firecrawl_api_key"+ ],+ "metadata": {+ "id": "gq4Q0u0ZTvGs",+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "outputId": "ca34865e-d226-4e88-e38e-85a85560426c"+ },+ "execution_count": null,+ "outputs": [+ {+ "name": "stdout",+ "output_type": "stream",+ "text": [+ "Enter your OpenAI API key: ··········\n",+ "Enter your Firecrawl API key: ··········\n"+ ]+ }+ ]+ },+ {+ "cell_type": "markdown",+ "source": [+ "Next we will setup our model for training using Unsloth."+ ],+ "metadata": {+ "id": "iP5-hPz-0T6x"+ }+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "QmUBVEnvCDJv",+ "colab": {+ "base_uri": "https://localhost:8080/",+ "height": 441,+ "referenced_widgets": [+ "c2f5dedb6d7048f8996749618a8fc7da",+ "c58d8ee38b524574b20f7d951811358a",+ "077ff4420f754adbaff591980e4883fc",+ "27809521abb9495aa7ed7ad53b6330ff",+ "bf1a1ccc1c1243229936370172bc211d",+ "9eee64214bef41dea2983a99942e1d07",+ "f736ff87672f4d21a76e07b9406aa15f",+ "934f112779ef42a3b63707a83f6ace4f",+ "d3489128b101498780a6a79d5e7311a3",+ "c6fc9d129ce540b8be1feec158156639",+ "e2b60bf0a9da4e099ade1919605b845a",+ "9200d426eaa84df290d47867aca07180",+ "1dd84904e4a24c59b0cd99ccc7da3eda",+ "5cf812aa765744c5b04aebee97610d42",+ "0d28cde614fc448689a157154072bb6f",+ "34ac77acd0b54e6fa704b55a4213934d",+ "01b57c3f271f476ebf99e1464e597acd",+ "9774e84bbf0b4d6ba34a9b053d8593f7",+ "597e5b8b51a0454b86846e6ec79c6270",+ "247b8373563b4acbac4266bfd406dbcd",+ "735ab790fca24d7889691b7e7355d8b0",+ "cc1e3d3af78943bc9a2a7a6db5fb802a",+ "5ca0c390ea4640d8b5c32bc958aa6c69",+ "21acf52242484669950b65e7531894e5",+ "56e26ae0bc324153852d9cb7463f748c",+ "9cb5cd9c7f4a4a97b6912e7ca36960f7",+ "9cb4f22b6fcd4947be55e35323981e96",+ "876621f91aa9427c956c2e1eb9368ae1",+ "63aae38d3baf4d658107e34d29c7f8bc",+ "d3d21f4f7e7d40218bb4f8efef5d665d",+ "25815a7983f84555a7c5b69217001189",+ "9db8bea72009488f9813a6359d52d0f0",+ "0637f9147c0b4304b5cd48e6df081320",+ "e79b960de3c341c1a78c4cc0b0382e4f",+ "3beef7fd0a1e48539e1817aa5b2c4bc7",+ "65a20195fcc249c8968f9f2e8b4403ea",+ "96b8bba380174070aee36ed84e728e64",+ "e41cefdf0e914791b37402549eea3576",+ "64f34f5a961f4b66b85ebb25c4c5ce66",+ "683cfad8c7bd4090831699dd9e05479a",+ "87e109cd08e74cb5aa859a37cc69b4f4",+ "4825c7f64f3148a6a1f69b531389fb54",+ "f92f9bd12abc41f7ab951d71de84cf52",+ "1c02e0bdc1dc48caba342f208b3829bf",+ "01f00ac736d04d2fb33e01f5b8362a2b",+ "0098b6052c6e47a2a76f07a15a163c43",+ "25d87d70ca334429919f90d889ac5a51",+ "e51f99a49413498bbb560a59d7c02a53",+ "a566c087e7a44c4cb6061918c6666c11",+ "abbd462a789d4fe9a3789d10e63aa633",+ "4c8b626f2afa478da87eb7db212b0e0e",+ "e4acdb2efaf34440804a5cc8d268c541",+ "6c2c8e9017524594af1bb4f5c61b8b05",+ "1f1c8336f4ac401e86c31e3fc0df1764",+ "1536c15a33444f77aa54ff35b44d49d2",+ "dedcaa5325bd45349ed57bdd9f594800",+ "d92c6352a43443b1ad0a813b127ad3d1",+ "5cd8c404de584e1c893dec2ef5f29f75",+ "72b6c006bf9e49cc81cc65512d83f2a7",+ "e0c96af74fd4420e9e2dcec6e22460ce",+ "0a1c00592a1e49d4984cdef703c68e30",+ "9e23fb15357b4cc49ef28e11ce99cade",+ "e833a6fccb5c46c6ad8be07989e7842c",+ "fc7924ecd4044b5389f9e377c290e902",+ "7b1ea1b188424a0c8016eaf7584d6cc8",+ "aa4dbea7c24f412bb701e4633e3c4578"+ ]+ },+ "outputId": "004e8a22-a87e-4a1e-d6e8-053302d1ba76"+ },+ "outputs": [+ {+ "output_type": "stream",+ "name": "stdout",+ "text": [+ "🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.\n",+ "🦥 Unsloth Zoo will now patch everything to make training faster!\n",+ "==((====))== Unsloth 2024.11.6: Fast Llama patching. Transformers = 4.46.2.\n",+ " \\\\ /| GPU: Tesla T4. Max memory: 14.748 GB. Platform = Linux.\n",+ "O^O/ \\_/ \\ Pytorch: 2.5.1+cu121. CUDA = 7.5. CUDA Toolkit = 12.1.\n",+ "\\ / Bfloat16 = FALSE. FA [Xformers = 0.0.28.post3. FA2 = False]\n",+ " \"-____-\" Free Apache license: http://github.com/unslothai/unsloth\n",+ "Unsloth: Fast downloading is enabled - ignore downloading bars which are red colored!\n"+ ]+ },+ {+ "output_type": "stream",+ "name": "stderr",+ "text": [+ "Unsloth: unsloth/tinyllama-bnb-4bit can only handle sequence lengths of at most 2048.\n",+ "But with kaiokendev's RoPE scaling of 2.0, it can be magically be extended to 4096!\n"+ ]+ },+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "model.safetensors: 0%| | 0.00/762M [00:00<?, ?B/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "c2f5dedb6d7048f8996749618a8fc7da"+ }+ },+ "metadata": {}+ },+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "generation_config.json: 0%| | 0.00/124 [00:00<?, ?B/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "9200d426eaa84df290d47867aca07180"+ }+ },+ "metadata": {}+ },+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "tokenizer_config.json: 0%| | 0.00/948 [00:00<?, ?B/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "5ca0c390ea4640d8b5c32bc958aa6c69"+ }+ },+ "metadata": {}+ },+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "tokenizer.model: 0%| | 0.00/500k [00:00<?, ?B/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "e79b960de3c341c1a78c4cc0b0382e4f"+ }+ },+ "metadata": {}+ },+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "special_tokens_map.json: 0%| | 0.00/438 [00:00<?, ?B/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "01f00ac736d04d2fb33e01f5b8362a2b"+ }+ },+ "metadata": {}+ },+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "tokenizer.json: 0%| | 0.00/1.84M [00:00<?, ?B/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "dedcaa5325bd45349ed57bdd9f594800"+ }+ },+ "metadata": {}+ },+ {+ "output_type": "stream",+ "name": "stderr",+ "text": [+ "Unsloth 2024.11.6 patched 22 layers with 22 QKV layers, 22 O layers and 22 MLP layers.\n"+ ]+ },+ {+ "output_type": "stream",+ "name": "stdout",+ "text": [+ "Unsloth: Training embed_tokens in mixed precision to save VRAM\n",+ "Unsloth: Training lm_head in mixed precision to save VRAM\n"+ ]+ }+ ],+ "source": [+ "from unsloth import FastLanguageModel\n",+ "import torch\n",+ "max_seq_length = 4096\n",+ "dtype = None\n",+ "load_in_4bit = True\n",+ "\n",+ "model, tokenizer = FastLanguageModel.from_pretrained(\n",+ " model_name = \"unsloth/tinyllama-bnb-4bit\", # \"unsloth/tinyllama\" for 16bit loading\n",+ " max_seq_length = max_seq_length,\n",+ " dtype = dtype,\n",+ " load_in_4bit = load_in_4bit,\n",+ " # token = \"hf_...\", # use one if using gated models like meta-llama/Llama-2-7b-hf\n",+ ")\n",+ "model = FastLanguageModel.get_peft_model(\n",+ " model,\n",+ " r = 32,\n",+ " target_modules = [\"q_proj\", \"k_proj\", \"v_proj\", \"o_proj\",\n",+ " \"gate_proj\", \"up_proj\", \"down_proj\",\n",+ " \"embed_tokens\", \"lm_head\"],\n",+ " lora_alpha = 32,\n",+ " use_gradient_checkpointing = False, # @@@ IF YOU GET OUT OF MEMORY - set to True @@@\n",+ " random_state = 3407,\n",+ " use_rslora = False, # We support rank stabilized LoRA\n",+ " loftq_config = None, # And LoftQ\n",+ ")"+ ]+ },+ {+ "cell_type": "markdown",+ "source": [+ "Now as a control, lets see how this model does with our CAMEL-specific question"+ ],+ "metadata": {+ "id": "RCb9quu7bcGE"+ }+ },+ {+ "cell_type": "code",+ "source": [+ "from camel.messages.conversion import AlpacaItem\n",+ "\n",+ "temp_model = FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",+ "inputs = tokenizer(\n",+ "[\n",+ "\n",+ " AlpacaItem(\n",+ " instruction=\"Explain how can I stay up to date with the CAMEL community.\",\n",+ " input=\"\",\n",+ " output=\"\", # leave this blank for generation!\n",+ " ).to_string()\n",+ "\n",+ "], return_tensors = \"pt\").to(\"cuda\")\n",+ "\n",+ "outputs = temp_model.generate(**inputs, max_new_tokens = 512, use_cache = True)\n",+ "temp_model = None\n",+ "tokenizer.batch_decode(outputs)\n"+ ],+ "metadata": {+ "id": "YqQz8vdrbbrF",+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "outputId": "e88c5a95-78a2-4f34-a3fb-d3fb6261b433"+ },+ "execution_count": null,+ "outputs": [+ {+ "output_type": "execute_result",+ "data": {+ "text/plain": [+ "['<s> ### Instruction:\\nExplain how can I stay up to date with the CAMEL community.\\n\\n### Input:\\n\\n\\n### Response:\\n\\n\\n## Output\\n\\n\\n### Input\\n\\n\\n## Response\\n\\n\\n##\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n']"+ ]+ },+ "metadata": {},+ "execution_count": 4+ }+ ]+ },+ {+ "cell_type": "markdown",+ "source": [+ "Note that it hasn't been trained on this output format, so the output is total junk"+ ],+ "metadata": {+ "id": "JshfcE5kdp2n"+ }+ },+ {+ "cell_type": "markdown",+ "source": [+ "### Data models\n",+ "We want to generate data in the Alpaca format, so we can use CAMEL's built-in AlpacaItem class which has some handy conversion functions for us.\n",+ "\n",+ "We will be using CAMEL's structured output to generate all of these items in one request, which is much faster and cheaper.\n",+ "\n",+ "\n",+ "Here we create a wrapper around the AlpacaItem to help the model know how many have been generated as it's going along, and another wrapper class that represents a list of these."+ ],+ "metadata": {+ "id": "_X_Nydp9K47x"+ }+ },+ {+ "cell_type": "code",+ "source": [+ "from pydantic import BaseModel\n",+ "\n",+ "class NumberedAlpacaItem(BaseModel):\n",+ " number: int\n",+ " item: AlpacaItem\n",+ "\n",+ "\n",+ "class AlpacaItemResponse(BaseModel):\n",+ " \"\"\"\n",+ " Represents an instruction-response item in the Alpaca format.\n",+ " \"\"\"\n",+ " items: list[NumberedAlpacaItem]"+ ],+ "metadata": {+ "id": "TdJnqzXWuAUK"+ },+ "execution_count": null,+ "outputs": []+ },+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "vITh0KVJ10qX"+ },+ "source": [+ "<a name=\"Data\"></a>\n",+ "### Data generation\n",+ "Next we define our data generation function. It takes a source content, and generates a list of instruction-input-response triplets around it.\n",+ "\n",+ "We will use this later to train our model to be proficient with the source content."+ ]+ },+ {+ "cell_type": "code",+ "source": [+ "from typing import List\n",+ "from camel.loaders import Firecrawl\n",+ "from camel.models import ModelFactory\n",+ "from camel.types import ModelPlatformType, ModelType\n",+ "from camel.configs import ChatGPTConfig\n",+ "from camel.agents import ChatAgent\n",+ "import json\n",+ "\n",+ "\n",+ "def generate_alpaca_items(content: str, n_items: int, start_num: int = 1, examples: List[AlpacaItem] = None) -> List[AlpacaItem]:\n",+ " system_msg = \"\"\"\n",+ "You are an AI assistant generating detailed, accurate responses based on the provided content.\n",+ "You will be given a reference content, and you must generate a specific number of AlpacaItems.\n",+ "These are instruction-input-response triplets, where the input is the context or examples.\n",+ "\n",+ "Add a number to the items to keep track of the order. Generate exactly that many.\n",+ "\n",+ "For each instruction, imagine but do not include a real world scenario and real user in that scenario to inform realistic and varied instructions. Avoid common sense questions and answers.\n",+ "\n",+ "Include multiple lines in the output as appropriate to provide sufficient detail. Cite the most relevant context verbatim in output fields, do not omit anything important.\n",+ "\n",+ "Leave the input field blank.\n",+ "\n",+ "Ensure all of the most significant parts of the context are covered.\n",+ "\n",+ "Start with open ended instructions, then move to more specific ones. Consider the starting number for an impression of what has already been generated.\n",+ " \"\"\"\n",+ "\n",+ " examples_str = \"\"\n",+ " if examples:\n",+ " examples_str = \"\\n\\nHere are some example items for reference:\\n\" + \\\n",+ " \"\\n\".join(ex.model_dump_json() for ex in examples)\n",+ "\n",+ " model = ModelFactory.create(\n",+ " model_platform=ModelPlatformType.OPENAI,\n",+ " model_type=ModelType.GPT_4O_MINI,\n",+ " model_config_dict=ChatGPTConfig(\n",+ " temperature=0.6, response_format=AlpacaItemResponse\n",+ " ).as_dict(),\n",+ " )\n",+ "\n",+ " agent = ChatAgent(\n",+ " system_message=system_msg,\n",+ " model=model,\n",+ " )\n",+ "\n",+ " prompt = f\"Content reference:\\n{content}{examples_str}\\n\\n Generate {n_items} AlpacaItems. The first should start numbering at {start_num}.\"\n",+ " response = agent.step(prompt)\n",+ "\n",+ " # Parse the generated JSON to our wrapper class\n",+ " alpaca_items = [n_item.item for n_item in\n",+ " AlpacaItemResponse.\n",+ " model_validate_json(response.msgs[0].content).items]\n",+ "\n",+ " return alpaca_items\n",+ "\n",+ "\n",+ "def save_json(data: List, filename: str):\n",+ " with open(filename, 'w', encoding='utf-8') as f:\n",+ " json.dump([entry.model_dump() for entry in data], f, indent=2,\n",+ " ensure_ascii=False)\n",+ "\n",+ "\n",+ "# Few shot examples to ensure the right amount of detail\n",+ "examples = [\n",+ " AlpacaItem(\n",+ " instruction=\"Explain the process for sprint planning and review in CAMEL.\",\n",+ " input=\"\",\n",+ " output=\"The process for sprint planning and review in CAMEL includes:\\n1. **Sprint Duration**: Each sprint lasts two weeks for development and one week for review.\\n2. **Planning Meeting**: Conducted biweekly, where the founder highlights the sprint goal and developers select items for the sprint.\\n3. **Review Meeting**: Stakeholders review the delivered features and provide feedback on the work completed during the sprint.\"\n",+ " )\n",+ "]\n",+ "\n"+ ],+ "metadata": {+ "id": "mBno-K2rTCfS"+ },+ "execution_count": null,+ "outputs": []+ },+ {+ "cell_type": "markdown",+ "source": [+ "# Point to content and generate data!\n",+ "Now we point to the content that we wish to generate SFT data around and use CAMEL's Firecrawl integration to get this content in a nice markdown format.\n",+ "\n",+ "You can get a Firecrawl API key from [here](https://www.firecrawl.dev/app/api-keys)"+ ],+ "metadata": {+ "id": "AqdoebfqMxb2"+ }+ },+ {+ "cell_type": "code",+ "source": [+ "import random\n",+ "firecrawl = Firecrawl()\n",+ "# Scrape and clean content from a specified URL\n",+ "response = firecrawl.scrape(\n",+ " url=\"https://github.com/camel-ai/camel/blob/master/CONTRIBUTING.md\"\n",+ ")\n",+ "\n",+ "# Generate the items 50 a time up to 300\n",+ "alpaca_entries = []\n",+ "for start in range(1, 301, 50):\n",+ " # Combine default examples with random samples from previous generations\n",+ " current_examples = examples + (random.sample(alpaca_entries,\n",+ " min(5, len(alpaca_entries)))\n",+ " if alpaca_entries else [])\n",+ "\n",+ " batch = generate_alpaca_items(\n",+ " content=response[\"markdown\"],\n",+ " n_items=50,\n",+ " start_num=start,\n",+ " examples=current_examples\n",+ " )\n",+ " print(f\"Generated {len(batch)} items\")\n",+ " alpaca_entries.extend(batch)\n",+ "\n",+ "print(alpaca_entries)\n",+ "save_json(alpaca_entries, 'alpaca_format_data.json')"+ ],+ "metadata": {+ "id": "LxkdPzNVMvmH",+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "outputId": "eedb1280-4086-4a6f-8392-14b824d775ed"+ },+ "execution_count": null,+ "outputs": [+ {+ "output_type": "stream",+ "name": "stderr",+ "text": [+ "/usr/local/lib/python3.10/dist-packages/pydantic/_internal/_fields.py:172: UserWarning: Field name \"schema\" in \"FirecrawlApp.ExtractParams\" shadows an attribute in parent \"BaseModel\"\n",+ " warnings.warn(\n"+ ]+ },+ {+ "output_type": "stream",+ "name": "stdout",+ "text": [+ "Generated 50 items\n",+ "Generated 42 items\n",+ "Generated 50 items\n",+ "Generated 50 items\n",+ "Generated 50 items\n",+ "Generated 50 items\n",+ "[AlpacaItem(instruction='Summarize the guidelines for contributing to the CAMEL project.', input='', output='The guidelines for contributing to the CAMEL project include: \\n- Follow the Fork-and-Pull-Request workflow for community contributors and Checkout-and-Pull-Request workflow for members of CAMEL-AI.org.\\n- Ensure pull requests pass formatting, linting, and testing checks before merging.\\n- If fixing a bug, add relevant unit tests; if improving, update affected examples and documentation; if adding a feature, include unit tests and demo scripts.'), AlpacaItem(instruction='Describe the communication channels available for CAMEL contributors.', input='', output='CAMEL contributors can communicate through several channels:\\n- **Discord**: Join the community on Discord for discussions and updates.\\n- **WeChat**: Available for Chinese speakers.\\n- **Slack**: Another platform for team communication.'), AlpacaItem(instruction='What are the principles for naming variables in CAMEL?', input='', output=\"The naming principle in CAMEL emphasizes avoiding abbreviations to prevent ambiguity. Variable names should be clear and descriptive, improving readability for both developers and AI agents. For example, use 'message_window_size' instead of 'msg_win_sz'.\"), AlpacaItem(instruction='Explain the process for code reviews in CAMEL.', input='', output='The code review process in CAMEL involves:\\n1. Reviewers check the code for functionality, readability, consistency, and compliance with coding standards.\\n2. Provide constructive feedback for necessary changes.\\n3. The contributor addresses feedback and updates the pull request.\\n4. The reviewer re-reviews the updated code.\\n5. Once approved by at least two reviewers, it can be merged by a maintainer.'), AlpacaItem(instruction='Outline the steps to set up the CAMEL development environment.', input='', output='To set up the CAMEL development environment:\\n1. Clone the repository: `git clone https://github.com/camel-ai/camel.git`\\n2. Change to the project directory: `cd camel`\\n3. Activate the virtual environment: `poetry shell`\\n4. Install CAMEL from source: `poetry install --with dev,docs -E all`\\n5. Install pre-commit hooks: `pre-commit install`\\n6. Run pre-commit checks before pushing changes: `pre-commit run --all-files`\\n7. Run unit tests: `pytest test`.'), AlpacaItem(instruction='What is the purpose of code reviews in CAMEL?', input='', output='The purpose of code reviews in CAMEL is to:\\n- Maintain code quality by ensuring the codebase is clean, readable, and maintainable.\\n- Facilitate knowledge sharing among contributors.\\n- Catch potential bugs and issues before merging.\\n- Ensure consistency in style and design patterns across the project.'), AlpacaItem(instruction=\"Describe how to document parameters in CAMEL's docstrings.\", input='', output=\"To document parameters in CAMEL's docstrings:\\n1. Use the `Args:` section for constructor or function parameters.\\n2. Maintain a 79-character limit for each line, indenting continuation lines by 4 spaces.\\n3. Include parameter name, type, description, and default value if applicable.\"), AlpacaItem(instruction='What are the steps for creating a pull request in CAMEL?', input='', output='To create a pull request in CAMEL, follow these steps:\\n1. Go to the GitHub Pulls page and create a new PR.\\n2. Choose the branch and fill in the information, linking the related issue.\\n3. Ensure the PR has a proper title and update the Reviewers, Assignees, Labels, and Milestones.\\n4. Move the PR through stages: Developing, Stuck, Reviewing, and Merged.'), AlpacaItem(instruction='Summarize the guidelines for writing docstrings in CAMEL.', input='', output='The guidelines for writing docstrings in CAMEL include:\\n1. Start with a raw string using `r\"\"\"` to prevent issues with special characters.\\n2. Provide a concise summary of the class or method.\\n3. Document parameters in the `Args:` section with type and description.'), AlpacaItem(instruction='What is the recommended duration for sprints in CAMEL?', input='', output='The recommended duration for sprints in CAMEL is two weeks for development, followed by one week for review.'), AlpacaItem(instruction='Explain the process for issue creation in CAMEL.', input='', output='The process for issue creation in CAMEL involves:\\n1. Going to the GitHub Issues page and creating a new issue.\\n2. Choosing the appropriate category and filling in required information.\\n3. Assigning the issue to yourself and ensuring it has a proper title and relevant labels.'), AlpacaItem(instruction='What are the common actions for maintaining dependencies in CAMEL?', input='', output='Common actions for maintaining dependencies in CAMEL include:\\n- Running `poetry lock` to synchronize dependencies after adding, updating, or deleting any in `pyproject.toml`.'), AlpacaItem(instruction='Describe the coverage measurement process in CAMEL.', input='', output='To measure code coverage in CAMEL:\\n1. Run `coverage erase` to clear previous coverage data.\\n2. Execute `coverage run --source=. -m pytest .` to measure coverage during tests.\\n3. Generate an HTML report with `coverage html` and view it at `htmlcov/index.html`.'), AlpacaItem(instruction='What steps should be taken to update documentation in CAMEL?', input='', output='To update documentation in CAMEL:\\n1. Ensure comprehensive documentation for all classes and methods.\\n2. Use Sphinx to generate documentation automatically from the code.\\n3. Build documentation locally by navigating to the `docs` directory and running `make html`.'), AlpacaItem(instruction='Explain the significance of sprint planning in CAMEL.', input='', output='Sprint planning in CAMEL defines what can be delivered in the sprint and how it will be achieved. It allows the team to set clear goals and prioritize tasks for effective development.'), AlpacaItem(instruction=\"What is the purpose of the CAMEL community's Discord channel?\", input='', output=\"The purpose of the CAMEL community's Discord channel is to facilitate communication among contributors, allowing them to discuss ideas, ask questions, and collaborate effectively.\"), AlpacaItem(instruction='Outline the steps to run unit tests in CAMEL.', input='', output='To run unit tests in CAMEL:\\n1. Ensure you are in the project directory and the virtual environment is activated.\\n2. Execute `pytest .` to run all tests, including those that require the OpenAI API key.'), AlpacaItem(instruction='What should contributors do before submitting a pull request?', input='', output='Before submitting a pull request, contributors should:\\n1. Ensure their code passes formatting, linting, and testing checks.\\n2. Address all feedback provided by reviewers on previous code iterations.'), AlpacaItem(instruction='Describe the role of maintainers in the CAMEL project.', input='', output='Maintainers in the CAMEL project are responsible for merging approved pull requests, overseeing project quality, and providing guidance to contributors.'), AlpacaItem(instruction='What is the significance of logging over printing in CAMEL?', input='', output='Using `logger` instead of `print` in CAMEL is significant because it ensures consistent, configurable, and professional logging, which is crucial for maintaining a clean codebase.'), AlpacaItem(instruction='Explain how to build documentation locally for CAMEL.', input='', output='To build documentation locally for CAMEL, navigate to the `docs` directory and run the command `make html`. This will generate the HTML documentation.'), AlpacaItem(instruction='What are the steps to participate in a developer meeting for CAMEL?', input='', output='To participate in a developer meeting for CAMEL:\\n1. For English speakers, join on Mondays at 5 PM GMT+1 via Discord.\\n2. For Chinese speakers, join on Mondays at 9 PM UTC+8 via Zoom.'), AlpacaItem(instruction='Outline the process for reviewing code in CAMEL.', input='', output='The process for reviewing code in CAMEL includes:\\n1. Checking the code for functionality, readability, and compliance with standards.\\n2. Providing constructive feedback for necessary changes.\\n3. The contributor updates the code based on feedback.'), AlpacaItem(instruction='What are the common pitfalls to avoid during code reviews in CAMEL?', input='', output='Common pitfalls to avoid during code reviews in CAMEL include:\\n- Submitting overly large pull requests.\\n- Ignoring feedback from reviewers.\\n- Rushing through the review process.'), AlpacaItem(instruction='Describe the guidelines for writing clear docstrings in CAMEL.', input='', output='Guidelines for writing clear docstrings in CAMEL include:\\n1. Use raw strings with `r\"\"\"` to avoid issues with special characters.\\n2. Provide concise summaries and document parameters clearly.'), AlpacaItem(instruction=\"What is the CAMEL project's approach to versioning?\", input='', output='The CAMEL project follows the semantic versioning (semver) standard, with a major version of 0 and minor versions incremented as significant changes occur. Even patch releases may contain non-backwards-compatible changes.'), AlpacaItem(instruction='Explain how to handle dependencies in CAMEL.', input='', output='To handle dependencies in CAMEL, contributors should update the `pyproject.toml` file, then run `poetry lock` to synchronize dependencies with the lock file.'), AlpacaItem(instruction='What is the purpose of the `Args:` section in docstrings?', input='', output='The `Args:` section in docstrings is used to document parameters for functions or constructors, detailing their names, types, descriptions, and default values.'), AlpacaItem(instruction='Describe the importance of security during code reviews.', input='', output='Security is crucial during code reviews to ensure that no vulnerabilities are introduced by new code. Reviewers should assess the code for potential security issues before merging.'), AlpacaItem(instruction='What are the recommended practices for sprint reviews?', input='', output='Recommended practices for sprint reviews include:\\n- Allowing stakeholders to review and provide feedback on delivered features.\\n- Identifying areas for improvement based on the work completed.'), AlpacaItem(instruction='Summarize the onboarding process for new contributors in CAMEL.', input='', output=\"The onboarding process for new contributors in CAMEL includes joining the community on Discord, scheduling an introduction call, and familiarizing themselves with the project's guidelines and workflows.\"), AlpacaItem(instruction='What is the significance of maintaining a clean codebase in CAMEL?', input='', output=\"Maintaining a clean codebase in CAMEL is significant for ensuring readability, ease of maintenance, and preventing the introduction of bugs, which ultimately enhances the project's overall quality.\"), AlpacaItem(instruction=\"Explain the role of unit tests in CAMEL's development process.\", input='', output=\"Unit tests in CAMEL's development process play a critical role in verifying that individual components of the code function as intended, helping to catch bugs early and ensuring code quality.\"), AlpacaItem(instruction='What should contributors do if they encounter challenges during the setup process?', input='', output='If contributors encounter challenges during the setup process, they should reach out to a maintainer for assistance to ensure a smooth experience for themselves and future contributors.'), AlpacaItem(instruction='Describe the importance of documentation in the CAMEL project.', input='', output='Documentation is important in the CAMEL project as it provides clear guidance for contributors, helps maintain code quality, and ensures that the functionalities of the project are well understood.'), AlpacaItem(instruction='What is the process for linking issues and pull requests in CAMEL?', input='', output='The process for linking issues and pull requests in CAMEL involves referencing the related issue in the pull request description, ensuring that when the pull request is merged, the linked issue closes automatically.'), AlpacaItem(instruction='Explain how to run pre-commit checks in CAMEL.', input='', output='To run pre-commit checks in CAMEL, execute the command `pre-commit run --all-files` to ensure that all files are formatted and linted before pushing changes.'), AlpacaItem(instruction=\"What is the purpose of the CAMEL project's GitHub Issues page?\", input='', output=\"The purpose of the CAMEL project's GitHub Issues page is to track bugs, improvements, and feature requests, providing a platform for contributors to engage with ongoing development.\"), AlpacaItem(instruction='Summarize the steps for conducting a sprint planning meeting in CAMEL.', input='', output='Steps for conducting a sprint planning meeting in CAMEL include:\\n1. The founder highlights the sprint goal and key points.\\n2. Developers select items from the backlog for the upcoming sprint.'), AlpacaItem(instruction='What are the responsibilities of contributors in CAMEL?', input='', output='Contributors in CAMEL are responsible for adhering to project guidelines, submitting quality code, participating in reviews, and ensuring that their contributions are well-documented.'), AlpacaItem(instruction='Describe the process for generating a coverage report in CAMEL.', input='', output='To generate a coverage report in CAMEL, run the command `coverage run --source=. -m pytest .` followed by `coverage html` to create an HTML report viewable at `htmlcov/index.html`.'), AlpacaItem(instruction='What are the common types of labels used for pull requests in CAMEL?', input='', output='Common types of labels used for pull requests in CAMEL include:\\n- **feat** for new features,\\n- **fix** for bug fixes,\\n- **docs** for documentation updates,\\n- **style** for code style changes,\\n- **refactor** for code refactoring,\\n- **test** for adding or updating tests.'), AlpacaItem(instruction='What steps should be taken to ensure code quality in CAMEL?', input='', output='To ensure code quality in CAMEL, contributors should:\\n1. Write clear and maintainable code.\\n2. Conduct thorough testing with sufficient coverage.\\n3. Participate in code reviews and address feedback.'), AlpacaItem(instruction='Explain the significance of the `pre-commit` hook in CAMEL.', input='', output=\"The `pre-commit` hook in CAMEL is significant as it automatically formats and lints code before commits, ensuring that all contributions adhere to the project's coding standards.\"), AlpacaItem(instruction='What is the goal of the CAMEL community?', input='', output='The goal of the CAMEL community is to foster collaboration, support open-source contributions, and continuously improve the project through collective efforts and shared knowledge.'), AlpacaItem(instruction='Summarize the guidelines for contributing to documentation in CAMEL.', input='', output='The guidelines for contributing to documentation in CAMEL include providing comprehensive documentation for classes and methods, ensuring high-quality coverage, and using Sphinx for automatic documentation generation.'), AlpacaItem(instruction=\"What are the key components of the CAMEL project's structure?\", input='', output=\"Key components of the CAMEL project's structure include the codebase, documentation, testing framework, and community engagement channels such as Discord and GitHub.\"), AlpacaItem(instruction='Describe how to schedule an introduction call for new contributors in CAMEL.', input='', output='New contributors can schedule an introduction call for CAMEL by using the provided Calendly links for English or Chinese speakers, ensuring they understand the project and its community.'), AlpacaItem(instruction=\"What is the role of maintainers in the CAMEL project's pull request process?\", input='', output=\"Maintainers in the CAMEL project's pull request process are responsible for merging approved pull requests, ensuring that contributions meet quality standards, and guiding contributors through the review process.\"), AlpacaItem(instruction='Explain the role of the `logger` in CAMEL instead of using `print`.', input='', output='The role of `logger` in CAMEL is to provide a consistent and configurable logging mechanism that is more professional than using `print`, allowing for better tracking and debugging of application behavior.'), AlpacaItem(instruction='What is the purpose of the CAMEL project?', input='', output='The purpose of the CAMEL project is to provide an open-source initiative in a rapidly evolving and open-ended field, welcoming contributions of all kinds to enhance its features, infrastructure, documentation, and overall functionality.'), AlpacaItem(instruction='How can contributors engage with the CAMEL community?', input='', output='Contributors can engage with the CAMEL community by joining their Discord server for communication, participating in developer meetings, and contributing through GitHub by submitting issues, pull requests, or joining discussions.'), AlpacaItem(instruction='What is the recommended workflow for contributing code to CAMEL?', input='', output='The recommended workflow for contributing code to CAMEL is to follow the Fork-and-Pull-Request model, where contributors fork the repository, make changes, and submit a pull request for review.'), AlpacaItem(instruction='Explain the guidelines for conducting code reviews in CAMEL.', input='', output='The guidelines for conducting code reviews in CAMEL include checking for functionality, readability, and compliance with coding standards, providing constructive feedback, and ensuring that all code is approved by at least two reviewers before merging.'), AlpacaItem(instruction='What should be included in a pull request for CAMEL?', input='', output='A pull request for CAMEL should include a proper title, link to the related issue, updates for Reviewers, Assignees, Labels, Projects, and Milestones, and should be moved through stages: Developing, Stuck, Reviewing, and Merged.'), AlpacaItem(instruction='How can contributors ensure their code meets quality standards?', input='', output='Contributors can ensure their code meets quality standards by running formatting, linting, and testing checks locally before submitting a pull request, as well as addressing all feedback provided during code reviews.'), AlpacaItem(instruction='What is the significance of the `Args:` section in docstrings?', input='', output='The `Args:` section in docstrings is significant because it documents the parameters of a function or method, specifying their names, types, descriptions, and any default values, thus enhancing code readability and usability.'), AlpacaItem(instruction='Describe the process for updating dependencies in CAMEL.', input='', output='To update dependencies in CAMEL, contributors should modify the `pyproject.toml` file as needed, then run `poetry lock` to synchronize the changes with the lock file.'), AlpacaItem(instruction='What steps should be taken to run unit tests in CAMEL?', input='', output='To run unit tests in CAMEL, navigate to the project directory and execute `pytest .` to ensure all tests pass successfully, including those that require an OpenAI API key.'), AlpacaItem(instruction='What are the communication channels available for CAMEL contributors?', input='', output='The available communication channels for CAMEL contributors include Discord for real-time chat, WeChat for Chinese speakers, and Slack for team collaboration.'), AlpacaItem(instruction='How can someone schedule an introduction call with CAMEL?', input='', output='To schedule an introduction call with CAMEL, English speakers can use the provided Calendly link for English speakers, and Chinese speakers can use the link for Chinese speakers to book their calls.'), AlpacaItem(instruction='What is the importance of documentation in the CAMEL project?', input='', output='Documentation is important in the CAMEL project as it provides comprehensive guidelines for usage, contributes to the understanding of the code, and ensures that all classes and methods are well-documented for future contributors.'), AlpacaItem(instruction='What is the process for building documentation locally for CAMEL?', input='', output='To build documentation locally for CAMEL, navigate to the `docs` directory and run `make html` to generate the HTML version of the documentation.'), AlpacaItem(instruction='What are the primary goals during sprint planning in CAMEL?', input='', output='The primary goals during sprint planning in CAMEL are to define what can be delivered in the sprint, determine how it will be achieved, and allow developers to select items to work on during the sprint.'), AlpacaItem(instruction='What should contributors do before submitting a pull request?', input='', output='Before submitting a pull request, contributors should ensure their code passes all tests, adheres to coding standards, runs formatting and linting checks, and addresses any feedback from previous reviews.'), AlpacaItem(instruction='How does CAMEL handle issues reported by contributors?', input='', output='CAMEL handles issues reported by contributors by regularly updating the GitHub issues page, categorizing them with labels, and encouraging contributors to assign themselves to issues they are working on.'), AlpacaItem(instruction=\"What is the significance of the `logger` in CAMEL's coding practices?\", input='', output=\"The significance of using `logger` in CAMEL's coding practices is to ensure consistent, configurable, and professional logging instead of using `print`, which can lead to unstructured output.\"), AlpacaItem(instruction='How can contributors ensure their contributions are recognized?', input='', output='Contributors can ensure their contributions are recognized by informing the maintainers of their Twitter account if they would like to be mentioned when their contributions are included in a release.'), AlpacaItem(instruction=\"What is the purpose of the 'Common Actions' section in CAMEL?\", input='', output=\"The purpose of the 'Common Actions' section in CAMEL is to provide contributors with quick references for performing routine tasks such as updating dependencies, linting, formatting, and running tests.\"), AlpacaItem(instruction=\"Explain the importance of naming conventions in CAMEL's codebase.\", input='', output=\"The importance of naming conventions in CAMEL's codebase lies in avoiding abbreviations that can lead to ambiguity, promoting clear and descriptive names that enhance code readability and comprehension.\"), AlpacaItem(instruction='What steps should be taken to run the pre-commit hooks in CAMEL?', input='', output='To run the pre-commit hooks in CAMEL, contributors should install the pre-commit hook into their local git repository using the command `pre-commit install`, and run `pre-commit run --all-files` before pushing changes.'), AlpacaItem(instruction='What are the criteria for merging a pull request in CAMEL?', input='', output='The criteria for merging a pull request in CAMEL include passing all formatting, linting, and testing checks, as well as receiving approval from at least two reviewers.'), AlpacaItem(instruction='How does CAMEL define sprint review?', input='', output='CAMEL defines sprint review as a meeting where stakeholders review the work completed during the sprint and provide feedback on the delivered features.'), AlpacaItem(instruction='What is the role of the maintainer in the CAMEL project?', input='', output='The role of the maintainer in the CAMEL project includes overseeing the project, managing contributions, conducting code reviews, merging pull requests, and guiding the development direction.'), AlpacaItem(instruction='What are the steps for adding a new feature in CAMEL?', input='', output='The steps for adding a new feature in CAMEL include designing the feature, implementing it, ensuring unit tests are included, updating documentation, and submitting a pull request for review.'), AlpacaItem(instruction='What is the significance of the `pre-commit` setup in CAMEL?', input='', output='The significance of the `pre-commit` setup in CAMEL is to automate code formatting and linting checks before commits, helping maintain code quality and consistency across the codebase.'), AlpacaItem(instruction='Describe the process for fixing a bug in CAMEL.', input='', output='The process for fixing a bug in CAMEL involves identifying the issue, modifying the code to resolve it, adding relevant unit tests, updating documentation if necessary, and submitting a pull request.'), AlpacaItem(instruction='What is the purpose of the `test` directory in CAMEL?', input='', output='The purpose of the `test` directory in CAMEL is to contain unit tests that validate the functionality of the code, ensuring that changes do not introduce new bugs.'), AlpacaItem(instruction='How can contributors provide feedback on the development process in CAMEL?', input='', output='Contributors can provide feedback on the development process in CAMEL by participating in discussions during developer meetings and sharing their experiences through GitHub issues or pull requests.'), AlpacaItem(instruction='What should contributors do if they encounter challenges during setup?', input='', output='If contributors encounter challenges during setup, they should reach out to a maintainer for assistance to ensure a smooth setup experience.'), AlpacaItem(instruction='What are the key components of the CAMEL contribution guidelines?', input='', output='The key components of the CAMEL contribution guidelines include following the Fork-and-Pull-Request workflow, ensuring code quality through testing and reviews, and maintaining comprehensive documentation.'), AlpacaItem(instruction='What is the role of the `chore` label in pull requests?', input='', output='The role of the `chore` label in pull requests is to categorize maintenance tasks that do not add new features or fix bugs, such as updating dependencies or improving documentation.'), AlpacaItem(instruction='What are the best practices for writing documentation in CAMEL?', input='', output='Best practices for writing documentation in CAMEL include providing clear, concise, and structured information, using Sphinx for generation, and ensuring all classes and methods are thoroughly documented.'), AlpacaItem(instruction='How can contributors ensure that their code is secure?', input='', output='Contributors can ensure that their code is secure by reviewing for potential vulnerabilities, adhering to best practices, and including security checks during the code review process.'), AlpacaItem(instruction='What is the significance of the `coverage` tool in CAMEL?', input='', output='The significance of the `coverage` tool in CAMEL is to measure the extent of unit test coverage over the codebase, helping identify areas that need more testing and ensuring robustness.'), AlpacaItem(instruction='What should be included in the `Common Actions` section of the CAMEL documentation?', input='', output='The `Common Actions` section of the CAMEL documentation should include routine tasks such as updating dependencies, running tests, linting, formatting, and building documentation.'), AlpacaItem(instruction=\"Explain the purpose of the `License` section in CAMEL's documentation.\", input='', output=\"The purpose of the `License` section in CAMEL's documentation is to inform contributors and users about the licensing terms under which the source code is made available, specifically that it is licensed under Apache 2.0.\"), AlpacaItem(instruction='How can contributors manage their contributions effectively in CAMEL?', input='', output='Contributors can manage their contributions effectively in CAMEL by keeping track of issues they are working on, regularly updating their pull requests, and communicating with maintainers and other contributors.'), AlpacaItem(instruction='What are the steps to participate in sprint planning for CAMEL?', input='', output='To participate in sprint planning for CAMEL, join the biweekly meeting, review the sprint goals, and select items from the backlog to work on during the upcoming sprint.'), AlpacaItem(instruction='What is the importance of having a clear project roadmap in CAMEL?', input='', output='The importance of having a clear project roadmap in CAMEL is to guide the development process, align the team on goals, and prioritize features and improvements based on community feedback and project needs.'), AlpacaItem(instruction='What should contributors do after their pull request is merged?', input='', output='After their pull request is merged, contributors should celebrate their contribution, monitor for any feedback from users, and continue to engage with the community for future contributions.'), AlpacaItem(instruction='How can contributors ensure their feature is well-received during review?', input='', output='Contributors can ensure their feature is well-received during review by providing thorough documentation, including tests, and addressing any related issues that may arise during the review process.'), AlpacaItem(instruction='What are the main types of contributions welcomed by CAMEL?', input='', output='CAMEL welcomes various types of contributions, including:\\n1. Introducing new features.\\n2. Enhancing infrastructure.\\n3. Improving documentation.\\n4. Reporting issues.\\n5. Adding more examples.\\n6. Implementing state-of-the-art research ideas.\\n7. Fixing bugs.'), AlpacaItem(instruction='Describe the process for joining the CAMEL community.', input='', output='To join the CAMEL community, you can:\\n1. Join their Discord server for communication.\\n2. Participate in scheduled introduction calls for English or Chinese speakers.\\n3. Attend developer meetings held weekly.'), AlpacaItem(instruction='What should contributors do before submitting a pull request?', input='', output='Before submitting a pull request, contributors should:\\n1. Follow the Fork-and-Pull-Request workflow if from the community.\\n2. Ensure their code passes formatting, linting, and testing checks.\\n3. Mention any related issues and tag relevant maintainers.'), AlpacaItem(instruction='Explain the importance of code reviews in CAMEL.', input='', output='Code reviews in CAMEL are important for:\\n1. Maintaining code quality by ensuring the codebase remains clean and readable.\\n2. Facilitating knowledge sharing among contributors.\\n3. Catching potential bugs before code is merged.\\n4. Ensuring consistency in style and architecture.'), AlpacaItem(instruction='What are the guidelines for writing docstrings in CAMEL?', input='', output='The guidelines for writing docstrings in CAMEL include:\\n1. Use triple-quoted raw strings (r\"\"\") to prevent issues with special characters.\\n2. Provide a brief description of the class or method.\\n3. Document parameters in the Args section, including type, description, and default values.'), AlpacaItem(instruction='Outline the steps for building documentation locally for CAMEL.', input='', output='To build documentation locally for CAMEL, follow these steps:\\n1. Navigate to the docs directory.\\n2. Run the command `make html` to generate the HTML documentation.'), AlpacaItem(instruction='What is the role of the `logger` in CAMEL?', input='', output='The role of the `logger` in CAMEL is to provide a consistent and configurable way of logging messages, replacing the use of print statements to ensure professional logging practices.'), AlpacaItem(instruction='Describe the process for managing issues in CAMEL.', input='', output='The process for managing issues in CAMEL includes:\\n1. Regularly updating the issues page on GitHub with bugs and feature requests.\\n2. Assigning issues to yourself when you start working on them.\\n3. Keeping issues focused on specific tasks and linking related issues.'), AlpacaItem(instruction='What is the significance of the `pre-commit` hook in the CAMEL project?', input='', output='The `pre-commit` hook in the CAMEL project is significant because it ensures that code is automatically formatted and linted before each commit, helping maintain code quality and consistency.'), AlpacaItem(instruction='How does CAMEL handle pull requests?', input='', output='CAMEL handles pull requests by:\\n1. Creating a new PR and linking it to a related issue.\\n2. Updating reviewers, assignees, and labels appropriately.\\n3. Moving the PR through stages until it is merged.'), AlpacaItem(instruction='What are the common pitfalls to avoid when submitting a pull request in CAMEL?', input='', output='Common pitfalls to avoid when submitting a pull request in CAMEL include:\\n1. Submitting large PRs; instead, break them down into smaller ones.\\n2. Ignoring feedback from reviewers.\\n3. Rushing through the review process.'), AlpacaItem(instruction='Explain the guidelines for contributing to the code in CAMEL.', input='', output='The guidelines for contributing to the code in CAMEL include:\\n1. Following the appropriate workflow based on your contributor status.\\n2. Ensuring your code passes all necessary checks.\\n3. Providing relevant documentation and tests for your contributions.'), AlpacaItem(instruction='What is the purpose of the `coverage` tool in CAMEL?', input='', output='The purpose of the `coverage` tool in CAMEL is to measure the extent to which unit tests cover the code, helping identify areas of the codebase that are well-tested and those that may need additional testing.'), AlpacaItem(instruction='Describe the sprint planning and review process in CAMEL.', input='', output='The sprint planning and review process in CAMEL involves:\\n1. Conducting biweekly planning meetings to define sprint goals and select items.\\n2. Reviewing completed work with stakeholders to gather feedback.'), AlpacaItem(instruction='What are the responsibilities of code reviewers in CAMEL?', input='', output='The responsibilities of code reviewers in CAMEL include:\\n1. Reviewing code promptly to maintain project momentum.\\n2. Providing clear and constructive feedback.\\n3. Collaborating with contributors to address issues.'), AlpacaItem(instruction='How can contributors ensure their code adheres to style guidelines?', input='', output='Contributors can ensure their code adheres to style guidelines by:\\n1. Running formatting checks using tools like Ruff.\\n2. Following the Google Python Style Guide as a reference.'), AlpacaItem(instruction='What is the significance of unit tests in CAMEL?', input='', output='Unit tests in CAMEL are significant because they help ensure that the code functions as intended, catching bugs early in the development process and providing confidence in code changes.'), AlpacaItem(instruction='Outline the steps for installing CAMEL from source.', input='', output='To install CAMEL from source, follow these steps:\\n1. Clone the GitHub repository.\\n2. Change into the project directory.\\n3. Activate the virtual environment and install with Poetry using `poetry install --with dev,docs -E all`.'), AlpacaItem(instruction='What are the guidelines for writing effective commit messages in CAMEL?', input='', output='The guidelines for writing effective commit messages in CAMEL include:\\n1. Using a clear and concise subject line.\\n2. Providing a detailed description of the changes made, including context and rationale.'), AlpacaItem(instruction='Explain how to update dependencies in CAMEL.', input='', output='To update dependencies in CAMEL, after adding, updating, or deleting any dependencies in `pyproject.toml`, run the command `poetry lock` to synchronize the dependencies with the lock file.'), AlpacaItem(instruction='What steps should be taken if a contributor encounters issues during the setup process?', input='', output='If a contributor encounters issues during the setup process, they should reach out to a maintainer for assistance to ensure a smooth experience.'), AlpacaItem(instruction='What is the CAMEL project’s approach to versioning and releases?', input='', output='The CAMEL project follows the semantic versioning standard (semver), where the major version is 0, indicating active development and potential non-backwards-compatible changes in even patch releases.'), AlpacaItem(instruction='How does CAMEL ensure high-quality documentation?', input='', output='CAMEL ensures high-quality documentation by automatically generating it using Sphinx and requesting comprehensive documentation for all classes and methods from contributors.'), AlpacaItem(instruction='What are the communication channels available for CAMEL contributors?', input='', output='The communication channels available for CAMEL contributors include:\\n1. Discord for real-time communication.\\n2. WeChat for Chinese speakers.\\n3. Slack for team collaboration.'), AlpacaItem(instruction='What is the importance of maintaining a clean codebase in CAMEL?', input='', output=\"Maintaining a clean codebase in CAMEL is important for ensuring readability, ease of maintenance, and preventing the introduction of bugs, which ultimately enhances the project's overall quality.\"), AlpacaItem(instruction='How can contributors effectively engage with issues in CAMEL?', input='', output='Contributors can effectively engage with issues in CAMEL by:\\n1. Creating new issues focused on specific tasks.\\n2. Linking related issues instead of merging them.\\n3. Keeping issues up to date and communicating any outdated issues.'), AlpacaItem(instruction='What are the key aspects of the CAMEL project’s guidelines for code reviews?', input='', output=\"The key aspects of CAMEL's guidelines for code reviews include:\\n1. Maintaining code quality and ensuring functionality.\\n2. Providing timely and constructive feedback.\\n3. Ensuring consistency in style and design patterns.\"), AlpacaItem(instruction='Explain the significance of having a dedicated testing strategy in CAMEL.', input='', output='Having a dedicated testing strategy in CAMEL is significant because it helps identify bugs early, ensures the reliability of new features, and maintains overall code quality.'), AlpacaItem(instruction='What are the principles governing naming conventions in CAMEL?', input='', output='The principles governing naming conventions in CAMEL emphasize avoiding abbreviations to prevent ambiguity and using clear, descriptive names that enhance readability.'), AlpacaItem(instruction=\"Describe the purpose of the `chore` label in CAMEL's pull request process.\", input='', output=\"The `chore` label in CAMEL's pull request process is used for maintenance tasks that do not add functionality or fix bugs, such as updating dependencies.\"), AlpacaItem(instruction='What is the role of community engagement in the CAMEL project?', input='', output='Community engagement in the CAMEL project plays a crucial role in fostering collaboration, gathering diverse input, and enhancing the project through collective contributions and feedback.'), AlpacaItem(instruction='How does CAMEL handle feedback from sprint reviews?', input='', output='CAMEL handles feedback from sprint reviews by discussing delivered features with stakeholders and identifying areas for improvement.'), AlpacaItem(instruction='What are the best practices for writing unit tests in CAMEL?', input='', output='Best practices for writing unit tests in CAMEL include:\\n1. Ensuring sufficient test coverage for all new features.\\n2. Writing tests in the `test` directory.\\n3. Keeping tests isolated from external APIs.'), AlpacaItem(instruction='How can contributors provide credit for their work in CAMEL?', input='', output='Contributors can provide credit for their work in CAMEL by letting the maintainers know if they would like to be mentioned on Twitter when their contributions are included in a release.'), AlpacaItem(instruction='What steps should be taken if a contributor wants to add a new feature to CAMEL?', input='', output='If a contributor wants to add a new feature to CAMEL, they should:\\n1. Propose the feature through an issue.\\n2. Implement the feature following coding guidelines.\\n3. Include relevant tests and documentation.'), AlpacaItem(instruction=\"Explain the significance of the `test` label in CAMEL's pull request process.\", input='', output=\"The `test` label in CAMEL's pull request process is significant for indicating that the pull request includes adding or updating tests, ensuring that new features are adequately validated.\"), AlpacaItem(instruction=\"What is the purpose of the `docs` label in CAMEL's pull request process?\", input='', output=\"The `docs` label in CAMEL's pull request process is used for pull requests that involve updates to documentation, ensuring that changes to documentation are tracked and reviewed.\"), AlpacaItem(instruction='How does CAMEL encourage contributions from new developers?', input='', output='CAMEL encourages contributions from new developers by providing clear guidelines, offering support through maintainers, and creating a welcoming community environment for collaboration.'), AlpacaItem(instruction='What is the CAMEL project’s approach to handling outdated issues?', input='', output='The CAMEL project’s approach to handling outdated issues involves contributors notifying maintainers about outdated issues so they can be reviewed and addressed promptly.'), AlpacaItem(instruction='Describe how the CAMEL team ensures timely code reviews.', input='', output='The CAMEL team ensures timely code reviews by encouraging reviewers to prioritize PRs, providing constructive feedback promptly, and maintaining a collaborative atmosphere.'), AlpacaItem(instruction='What is the purpose of conducting introduction calls for new contributors in CAMEL?', input='', output='The purpose of conducting introduction calls for new contributors in CAMEL is to familiarize them with the project, provide guidance on how to contribute, and answer any questions they may have.'), AlpacaItem(instruction='How does CAMEL promote knowledge sharing among contributors?', input='', output='CAMEL promotes knowledge sharing among contributors through code reviews, community discussions on Discord, and collaborative meetings that encourage sharing best practices and experiences.'), AlpacaItem(instruction='What are the key components of the CAMEL project’s code review checklist?', input='', output='The key components of the CAMEL project’s code review checklist include:\\n1. Functionality and correctness of the code.\\n2. Code readability and maintainability.\\n3. Documentation and comment quality.'), AlpacaItem(instruction='Explain how CAMEL handles security vulnerabilities in contributions.', input='', output='CAMEL handles security vulnerabilities in contributions by reviewing code for potential security issues during the code review process and addressing any identified vulnerabilities promptly.'), AlpacaItem(instruction='What is the significance of maintaining a modular code structure in CAMEL?', input='', output='Maintaining a modular code structure in CAMEL is significant because it enhances code readability, facilitates easier testing and maintenance, and allows for better scalability of the project.'), AlpacaItem(instruction='Describe the role of maintainers in the CAMEL project.', input='', output='The role of maintainers in the CAMEL project includes overseeing contributions, ensuring adherence to guidelines, managing code reviews, and facilitating community engagement.'), AlpacaItem(instruction='How does CAMEL ensure that contributions are well-documented?', input='', output='CAMEL ensures that contributions are well-documented by requiring contributors to provide comprehensive documentation for their code, including detailed docstrings and external documentation when necessary.'), AlpacaItem(instruction=\"What are the advantages of using GitHub for CAMEL's project management?\", input='', output=\"The advantages of using GitHub for CAMEL's project management include:\\n1. Version control for tracking changes in code.\\n2. An effective issue tracking system.\\n3. Facilitating collaboration through pull requests and reviews.\"), AlpacaItem(instruction='What is the CAMEL project’s policy on licensing for contributions?', input='', output='The CAMEL project’s policy on licensing for contributions is that all contributed code is licensed under Apache 2.0 by default, ensuring a clear and open-source licensing framework.'), AlpacaItem(instruction='How does CAMEL maintain a balance between innovation and stability in its development process?', input='', output='CAMEL maintains a balance between innovation and stability in its development process by encouraging new feature development while ensuring that all changes go through rigorous testing and review processes.'), AlpacaItem(instruction='Explain how to get started with CAMEL.', input='', output='To get started with CAMEL, follow these steps:\\n1. **Clone the GitHub Repository**: Run `git clone https://github.com/camel-ai/camel.git`.\\n2. **Change Directory**: Navigate into the project directory with `cd camel`.\\n3. **Activate Virtual Environment**: Use `poetry shell` to activate the CAMEL virtual environment.\\n4. **Install CAMEL from Source**: Execute `poetry install --with dev,docs -E all` to install all necessary dependencies for development and documentation.\\n5. **Set Up Pre-commit Hook**: Run `pre-commit install` to set up a pre-commit hook for automatic formatting and linting on each commit.\\n6. **Run Pre-commit**: Before pushing, run `pre-commit run --all-files` to ensure code quality.\\n7. **Run Unit Tests**: Finally, use `pytest test` to execute the unit tests and verify everything is set up correctly.'), AlpacaItem(instruction=\"What is the purpose of the `docs` label in CAMEL's pull request process?\", input='', output=\"The `docs` label in CAMEL's pull request process is used for documentation updates, indicating that the changes made in the pull request pertain to the project's documentation rather than code changes.\"), AlpacaItem(instruction='Describe the guidelines for contributing to the code in CAMEL.', input='', output='The guidelines for contributing to the code in CAMEL include:\\n1. **Fork-and-Pull-Request Workflow**: Contributors from the community should follow the Fork-and-Pull-Request workflow when opening pull requests.\\n2. **Checkout-and-Pull-Request for Members**: Members of CAMEL-AI.org should use the Checkout-and-Pull-Request workflow to ensure PRs pass all tests that require GitHub Secrets.\\n3. **Mention Related Issues**: Always mention any related issues in your pull request and tag relevant maintainers.'), AlpacaItem(instruction='Explain the significance of the `pre-commit` hook in the CAMEL project.', input='', output=\"The significance of the `pre-commit` hook in the CAMEL project lies in its ability to automatically format and lint code before it is committed. This ensures that all code adheres to the project's style guidelines and quality standards, helping maintain a clean and consistent codebase.\"), AlpacaItem(instruction='What are the steps to build documentation locally for CAMEL?', input='', output='To build documentation locally for CAMEL, follow these steps:\\n1. Navigate to the `docs` directory: `cd docs`.\\n2. Run the command to build HTML documentation: `make html`.\\n3. For more guidelines on building and hosting documentation locally, refer to `README.md` in the `docs` directory.'), AlpacaItem(instruction='What is the process for managing issues in CAMEL?', input='', output=\"The process for managing issues in CAMEL includes:\\n1. **Regular Updates**: The issues page on GitHub is regularly updated with bugs, improvements, and feature requests.\\n2. **Assigning Issues**: When a contributor starts working on an issue, they should assign it to themselves to indicate that it's being addressed.\\n3. **Creating New Issues**: New issues should be focused on specific bugs, improvements, or features, and related issues should be linked instead of merged.\"), AlpacaItem(instruction=\"Describe the importance of unit tests in CAMEL's codebase.\", input='', output=\"The importance of unit tests in CAMEL's codebase lies in their ability to cover modular logic and ensure functionality without requiring calls to outside APIs. They help identify bugs early in the development process and ensure that new features do not break existing functionality.\"), AlpacaItem(instruction=\"What is the role of the `logger` in CAMEL's logging practices?\", input='', output=\"The role of the `logger` in CAMEL's logging practices is to provide a consistent and configurable way to log messages instead of using `print`. This approach allows for better management of log levels and formats, facilitating easier debugging and monitoring of the application.\"), AlpacaItem(instruction='Explain the significance of code reviews in the CAMEL project.', input='', output='The significance of code reviews in the CAMEL project includes:\\n1. **Maintaining Code Quality**: Code reviews help ensure that the codebase remains clean, readable, and maintainable.\\n2. **Knowledge Sharing**: They facilitate knowledge sharing among contributors and help new contributors learn best practices.\\n3. **Bug Prevention**: Code reviews catch potential bugs and issues before they are merged into the main branch.'), AlpacaItem(instruction='What are the guidelines for writing docstrings in CAMEL?', input='', output='The guidelines for writing docstrings in CAMEL include:\\n1. Use triple-quoted raw strings with `r\"\"\"` to prevent issues with special characters.\\n2. Provide a brief class or method description starting with a concise summary.\\n3. Document parameters in the `Args` section, including parameter name, type, description, and default value if applicable.'), AlpacaItem(instruction='Describe the process for sprint planning in CAMEL.', input='', output='The process for sprint planning in CAMEL involves:\\n1. **Sprint Duration**: Each sprint lasts two weeks for development and one week for review.\\n2. **Planning Meeting**: Conducted biweekly, where the founder outlines the sprint goal and developers select items for the sprint.\\n3. **Item Selection**: Developers choose items from the backlog that align with the sprint goal.'), AlpacaItem(instruction=\"What is the purpose of the `fix` label in CAMEL's pull request process?\", input='', output=\"The `fix` label in CAMEL's pull request process is used for pull requests that address and resolve bugs in the code, indicating that the changes made are aimed at correcting issues.\"), AlpacaItem(instruction=\"Explain the importance of modularity in CAMEL's code contributions.\", input='', output=\"The importance of modularity in CAMEL's code contributions lies in the ability to create self-contained and manageable code units. This makes future changes easier, enhances code reusability, and helps avoid unnecessary duplication in the codebase.\"), AlpacaItem(instruction='What is the role of the `coverage` tool in the CAMEL project?', input='', output='The role of the `coverage` tool in the CAMEL project is to measure the extent to which unit tests cover the code. This helps identify areas of the codebase that are well-tested and those that may require additional testing, ensuring overall code quality and reliability.'), AlpacaItem(instruction='Describe the communication channels available for CAMEL contributors.', input='', output='The communication channels available for CAMEL contributors include:\\n1. **Discord**: A platform for real-time communication and discussions. [Join here](https://discord.camel-ai.org/).\\n2. **WeChat**: For Chinese-speaking contributors, available via a QR code.\\n3. **Slack**: A platform for team collaboration. [Join here](https://join.slack.com/t/camel-ai/shared_invite/zt-2g7xc41gy-_7rcrNNAArIP6sLQqldkqQ).'), AlpacaItem(instruction='What are the common pitfalls to avoid in code reviews for CAMEL?', input='', output=\"Common pitfalls to avoid in code reviews for CAMEL include:\\n1. **Large PRs**: Submitting overly large pull requests; it's better to break them into smaller, manageable pieces.\\n2. **Ignoring Feedback**: Contributors should address all feedback from reviewers, discussing any disagreements instead of ignoring them.\\n3. **Rushed Reviews**: Taking the time to thoroughly review code is critical to maintaining quality.\"), AlpacaItem(instruction=\"Explain the significance of the `style` label in CAMEL's pull request process.\", input='', output=\"The `style` label in CAMEL's pull request process indicates that the changes made are focused on code style adjustments, such as formatting and adherence to style guidelines, rather than functional changes or bug fixes.\"), AlpacaItem(instruction='Describe the importance of documentation in the CAMEL project.', input='', output='The importance of documentation in the CAMEL project lies in providing clear and comprehensive information about the codebase, functionalities, and usage. High-quality documentation enhances user understanding, facilitates onboarding for new contributors, and ensures that the project remains accessible and maintainable.'), AlpacaItem(instruction='What are the steps to update dependencies in CAMEL?', input='', output='To update dependencies in CAMEL, follow these steps:\\n1. Modify the `pyproject.toml` file to add, update, or delete dependencies.\\n2. Run `poetry lock` to synchronize the dependencies with the lock file, ensuring all changes are properly reflected.'), AlpacaItem(instruction='Explain the sprint review process in CAMEL.', input='', output='The sprint review process in CAMEL involves:\\n1. **Feedback Session**: Stakeholders review the features delivered during the sprint and provide feedback.\\n2. **Identifying Improvements**: The team discusses areas of improvement based on the feedback received.'), AlpacaItem(instruction='What is the process for merging pull requests in CAMEL?', input='', output='The process for merging pull requests in CAMEL includes:\\n1. **Approval Requirement**: A pull request must be approved by at least two reviewers before it can be merged.\\n2. **Merging by Maintainers**: Only maintainers or authorized contributors are allowed to merge pull requests into the main branch.'), AlpacaItem(instruction=\"Describe the significance of the `test` label in CAMEL's pull request process.\", input='', output=\"The `test` label in CAMEL's pull request process signifies that the changes include adding or updating tests, highlighting the contributor's commitment to maintaining code quality and ensuring that new features are adequately tested.\"), AlpacaItem(instruction='What are the guidelines for conducting code reviews in CAMEL?', input='', output=\"The guidelines for conducting code reviews in CAMEL include:\\n1. **Functionality Check**: Reviewers should verify that the code performs the intended task and handles edge cases.\\n2. **Readability and Style**: Ensure the code is easy to read and follows the project's style guidelines.\\n3. **Constructive Feedback**: Provide clear and constructive feedback to help contributors improve their code.\"), AlpacaItem(instruction='Explain how to run unit tests in the CAMEL project.', input='', output='To run unit tests in the CAMEL project, execute the command `pytest .` in the terminal. This command will run all tests, including those that require an OpenAI API key for integration testing.'), AlpacaItem(instruction=\"What is the significance of the `chore` label in CAMEL's pull request process?\", input='', output=\"The `chore` label in CAMEL's pull request process is used for maintenance tasks that do not introduce new features or fix bugs, such as updating dependencies or making minor adjustments to the project.\"), AlpacaItem(instruction='Describe the purpose of the `guidelines` section in the CAMEL documentation.', input='', output='The purpose of the `guidelines` section in the CAMEL documentation is to provide contributors with clear instructions on how to contribute effectively, including coding standards, documentation practices, and the process for submitting pull requests.'), AlpacaItem(instruction='What is the process for creating a new issue in CAMEL?', input='', output=\"The process for creating a new issue in CAMEL involves:\\n1. Visiting the GitHub Issues page and clicking on 'New Issue'.\\n2. Filling in the required information with a clear title and description of the issue.\\n3. Assigning labels and milestones as necessary to categorize the issue.\"), AlpacaItem(instruction='Explain the importance of keeping issues updated in CAMEL.', input='', output='Keeping issues updated in CAMEL is important because it ensures that contributors have accurate information about the current status of bugs, improvements, and feature requests. This helps prevent duplication of effort and allows contributors to prioritize their work effectively.'), AlpacaItem(instruction='What are the steps to run coverage reports in CAMEL?', input='', output='To run coverage reports in CAMEL, follow these steps:\\n1. To include all source files, execute:\\n ```\\n coverage erase\\n coverage run --source=. -m pytest .\\n coverage html\\n ```\\n This generates a report in `htmlcov/index.html`.\\n2. To include only tested files, run:\\n ```\\n pytest --cov --cov-report=html\\n ```'), AlpacaItem(instruction='Describe the significance of the `maintainer` role in CAMEL.', input='', output=\"The significance of the `maintainer` role in CAMEL lies in their responsibility to oversee the project's direction, manage pull requests, ensure code quality, and facilitate communication within the community. Maintainers play a critical role in maintaining the integrity and health of the project.\"), AlpacaItem(instruction='What is the purpose of the `pull request` template in CAMEL?', input='', output='The purpose of the `pull request` template in CAMEL is to provide contributors with a structured format for submitting their changes. This helps ensure that all necessary information is included, such as descriptions of changes, related issues, and any relevant testing notes.'), AlpacaItem(instruction='Explain the role of the `contributor` in the CAMEL project.', input='', output='The role of the `contributor` in the CAMEL project is to actively engage in improving the codebase by submitting new features, fixing bugs, enhancing documentation, and participating in discussions. Contributors are essential for the growth and sustainability of the open-source project.'), AlpacaItem(instruction='What are the best practices for writing commit messages in CAMEL?', input='', output=\"Best practices for writing commit messages in CAMEL include:\\n1. **Keep it concise**: Summarize the changes in a clear and brief manner.\\n2. **Use the imperative mood**: Write commit messages as if you are giving commands (e.g., 'Add feature' instead of 'Added feature').\\n3. **Reference issues**: Include references to related issues or pull requests to provide context.\"), AlpacaItem(instruction='Describe the importance of using version control in CAMEL.', input='', output=\"The importance of using version control in CAMEL lies in its ability to track changes over time, facilitate collaboration among multiple contributors, and provide a history of the project's development. Version control helps manage code effectively, enabling easy rollback to previous versions if needed.\"), AlpacaItem(instruction='What is the process for linking a pull request to an issue in CAMEL?', input='', output=\"The process for linking a pull request to an issue in CAMEL involves:\\n1. In the pull request description, mention the issue number using keywords such as 'Fixes' or 'Closes' followed by the issue number (e.g., 'Fixes #123').\\n2. This automatically links the pull request to the specified issue, closing it when the pull request is merged.\"), AlpacaItem(instruction='Explain the significance of issue labels in CAMEL.', input='', output='The significance of issue labels in CAMEL lies in their ability to categorize and prioritize issues, making it easier for contributors to identify what needs attention. Labels help streamline the workflow by allowing contributors to filter issues based on type, status, or area of focus.'), AlpacaItem(instruction='What are the guidelines for writing clear and effective documentation in CAMEL?', input='', output='The guidelines for writing clear and effective documentation in CAMEL include:\\n1. **Be concise**: Use clear and straightforward language without unnecessary jargon.\\n2. **Organize content**: Structure documentation logically, with headings and subheadings for easy navigation.\\n3. **Include examples**: Provide practical examples to illustrate concepts and usage.'), AlpacaItem(instruction='Describe the role of testing in the CAMEL development process.', input='', output='The role of testing in the CAMEL development process is to ensure that the code functions as intended, identify and fix bugs early, and maintain overall code quality. Comprehensive testing helps build confidence in the codebase and supports the introduction of new features without compromising existing functionality.'), AlpacaItem(instruction='What is the significance of maintaining a code style guide in CAMEL?', input='', output=\"The significance of maintaining a code style guide in CAMEL lies in promoting consistency across the codebase, making it easier for contributors to read and understand each other's code. A style guide helps reduce variability in coding practices, which enhances collaboration and simplifies code reviews.\"), AlpacaItem(instruction='Explain the importance of community engagement in the CAMEL project.', input='', output=\"The importance of community engagement in the CAMEL project lies in fostering a collaborative and inclusive environment where contributors feel valued and motivated to participate. Active engagement helps attract new contributors, encourages knowledge sharing, and strengthens the project's overall development.\"), AlpacaItem(instruction='What are the best practices for submitting a pull request in CAMEL?', input='', output='Best practices for submitting a pull request in CAMEL include:\\n1. **Ensure code quality**: Run tests and linting checks before submitting.\\n2. **Provide a clear description**: Explain the changes made and their purpose in the pull request description.\\n3. **Link related issues**: Reference any related issues to give context to reviewers.'), AlpacaItem(instruction='Describe the significance of using the `pytest` framework in CAMEL.', input='', output='The significance of using the `pytest` framework in CAMEL lies in its ability to simplify the testing process, providing a powerful and flexible testing environment. `pytest` supports a variety of testing styles and features, making it easier to write and maintain tests, thus enhancing overall code quality.'), AlpacaItem(instruction='What are the guidelines for maintaining security in the CAMEL project?', input='', output='The guidelines for maintaining security in the CAMEL project include:\\n1. **Review dependencies**: Regularly check for vulnerabilities in third-party libraries.\\n2. **Secure coding practices**: Avoid introducing security vulnerabilities in the code, such as improper handling of user input.\\n3. **Monitor and respond**: Stay vigilant for security issues and respond promptly to any identified vulnerabilities.'), AlpacaItem(instruction='Explain the importance of performance testing in CAMEL.', input='', output='The importance of performance testing in CAMEL lies in ensuring that the application meets performance expectations under various conditions. Performance testing helps identify bottlenecks, optimize resource usage, and ensure a smooth user experience, which is critical for the success of any software project.'), AlpacaItem(instruction='What are the steps to implement a new feature in CAMEL?', input='', output=\"The steps to implement a new feature in CAMEL include:\\n1. **Identify the feature**: Clearly define the feature's purpose and requirements.\\n2. **Create an issue**: Document the feature request in an issue on GitHub.\\n3. **Develop the feature**: Implement the feature following coding standards and guidelines.\\n4. **Test thoroughly**: Ensure the feature is well-tested with appropriate unit tests.\\n5. **Submit a pull request**: Open a pull request linking it to the original issue for review.\"), AlpacaItem(instruction='Describe the role of feedback in the CAMEL development process.', input='', output='The role of feedback in the CAMEL development process is crucial for continuous improvement and learning. Feedback from code reviews, sprint reviews, and community discussions helps identify areas for enhancement, fosters collaboration, and guides contributors in refining their skills and contributions.'), AlpacaItem(instruction=\"What is the purpose of the `license` section in CAMEL's documentation?\", input='', output=\"The purpose of the `license` section in CAMEL's documentation is to inform contributors and users about the licensing terms under which the code is distributed. This ensures that everyone understands their rights and responsibilities when using or contributing to the project.\"), AlpacaItem(instruction='Explain the significance of having a clear contribution process in CAMEL.', input='', output='The significance of having a clear contribution process in CAMEL lies in providing guidelines that help new contributors understand how to get involved and make meaningful contributions. A well-defined process reduces confusion, streamlines collaboration, and encourages more people to participate in the project.'), AlpacaItem(instruction='What are the guidelines for effective communication within the CAMEL community?', input='', output='The guidelines for effective communication within the CAMEL community include:\\n1. **Be respectful**: Maintain a respectful tone in all interactions.\\n2. **Be clear and concise**: Communicate ideas clearly and avoid unnecessary jargon.\\n3. **Encourage collaboration**: Foster a collaborative environment by welcoming diverse opinions and encouraging discussion.'), AlpacaItem(instruction='Describe the importance of maintaining an active project roadmap in CAMEL.', input='', output=\"The importance of maintaining an active project roadmap in CAMEL lies in providing a clear vision for the project's future direction. An updated roadmap helps align contributors' efforts, prioritize development tasks, and communicate goals to the community, ensuring that everyone is working towards shared objectives.\"), AlpacaItem(instruction='What should a contributor do before their pull request can be merged?', input='', output='Before a pull request can be merged, it must pass the formatting, linting, and testing checks. Contributors should mention any related issues and tag the relevant maintainers as well.'), AlpacaItem(instruction='Explain how to write effective docstrings in CAMEL.', input='', output='To write effective docstrings in CAMEL:\\n1. Use triple-quoted strings with `r\"\"\"` to avoid issues with special characters.\\n2. Provide a brief class or method description, keeping lines under 79 characters.\\n3. Document parameters in the `Args:` section, including parameter names, types, descriptions, and default values.'), AlpacaItem(instruction='What is the purpose of the `Coverage` section in the documentation?', input='', output='The purpose of the `Coverage` section is to measure the extent to which unit tests cover the code, helping to identify both robust and less robust areas of the codebase.'), AlpacaItem(instruction='How can a contributor ensure that their code follows project style guidelines?', input='', output='A contributor can ensure their code follows project style guidelines by using `Ruff` for formatting checks and adhering to the Google Python Style Guide.'), AlpacaItem(instruction='Describe the process to build documentation locally for CAMEL.', input='', output='To build documentation locally for CAMEL, navigate to the `docs` directory and run the command `make html`. This will generate the HTML documentation.'), AlpacaItem(instruction='What communication channels are available for contributors to CAMEL?', input='', output='The communication channels available for contributors to CAMEL include:\\n- **Discord**: Join via the provided link.\\n- **WeChat**: Connect using the QR code.\\n- **Slack**: Join the dedicated Slack workspace.'), AlpacaItem(instruction='What is the significance of the `test` directory in CAMEL?', input='', output='The `test` directory in CAMEL contains unit tests that validate the functionality of the code, ensuring that modifications do not introduce new bugs and that existing functionality remains intact.'), AlpacaItem(instruction='What steps should a contributor take when creating a new issue on GitHub for CAMEL?', input='', output='When creating a new issue on GitHub for CAMEL, a contributor should:\\n1. Go to the GitHub Issues page and create a new issue.\\n2. Choose the appropriate category and fill in the required information.\\n3. Provide a proper title, update assignees, labels, projects, and milestones.'), AlpacaItem(instruction='How does CAMEL handle code reviews?', input='', output='CAMEL handles code reviews by ensuring that reviewers check for functionality, readability, consistency, and compliance with coding standards. Constructive feedback is provided, and the contributor addresses this feedback before the code can be merged.'), AlpacaItem(instruction='What are the guidelines for writing effective commit messages?', input='', output=\"Guidelines for writing effective commit messages include:\\n1. Use the imperative mood in the subject line (e.g., 'Fix bug' instead of 'Fixed bug').\\n2. Keep the subject line concise, ideally under 50 characters.\\n3. Provide a detailed body explaining the rationale for the change.\"), AlpacaItem(instruction='What is the `Fork-and-Pull-Request` workflow?', input='', output='The `Fork-and-Pull-Request` workflow involves contributors forking the repository, making changes in their fork, and then submitting a pull request to the original repository for review.'), AlpacaItem(instruction='What are the responsibilities of a code reviewer in CAMEL?', input='', output='The responsibilities of a code reviewer in CAMEL include:\\n- Conducting timely reviews of pull requests.\\n- Providing clear and constructive feedback.\\n- Collaborating with contributors to address issues and ensure code quality.'), AlpacaItem(instruction=\"Explain the role of sprint planning in CAMEL's development process.\", input='', output=\"Sprint planning in CAMEL's development process defines what can be delivered in the sprint and how it will be achieved. It involves selecting items for the sprint and setting a sprint goal.\"), AlpacaItem(instruction='How should contributors document improvements made in the code?', input='', output='Contributors should document improvements made in the code by updating affected example console scripts, Gradio demos in the `apps` directory, and relevant documentation in the `docs` directory.'), AlpacaItem(instruction='What is the purpose of the `chore` label in pull requests?', input='', output='The `chore` label in pull requests is used to categorize maintenance tasks that do not add new features or fix bugs, such as updating dependencies or improving documentation.'), AlpacaItem(instruction='What steps should a contributor take to ensure their code passes all tests?', input='', output='To ensure their code passes all tests, a contributor should:\\n1. Run unit tests using `pytest`.\\n2. Verify that all tests pass successfully.\\n3. Configure necessary API keys as environment variables.'), AlpacaItem(instruction='Describe the importance of logging in CAMEL.', input='', output='Logging in CAMEL is important because it provides a consistent and configurable mechanism for tracking application behavior, which aids in debugging and monitoring.'), AlpacaItem(instruction='What are the guidelines for contributing to documentation in CAMEL?', input='', output='Guidelines for contributing to documentation in CAMEL include providing comprehensive documentation for all classes and methods to ensure high-quality coverage.'), AlpacaItem(instruction='What is the process for updating dependencies in CAMEL?', input='', output='To update dependencies in CAMEL, contributors should modify the `pyproject.toml` file, then run `poetry lock` to synchronize the changes with the lock file.'), AlpacaItem(instruction='Explain the purpose of the `Args:` section in docstrings.', input='', output='The `Args:` section in docstrings is used to document parameters for functions or constructors, detailing their names, types, descriptions, and default values.'), AlpacaItem(instruction='What is the significance of the `Coverage` section in the documentation?', input='', output='The `Coverage` section is significant as it measures the extent to which unit tests cover the code, helping identify both robust and less robust areas of the codebase.'), AlpacaItem(instruction='How can contributors ensure they are following coding standards during development?', input='', output=\"Contributors can ensure they are following coding standards by running linters, such as `Ruff`, and adhering to the project's style guidelines, including the Google Python Style Guide.\"), AlpacaItem(instruction='What is the purpose of the `Pull Request Item Stage` in CAMEL?', input='', output='The `Pull Request Item Stage` in CAMEL is to manage the lifecycle of pull requests, ensuring they are properly reviewed, categorized, and merged into the main branch.'), AlpacaItem(instruction='How should contributors handle feedback received during code reviews?', input='', output='Contributors should address all feedback provided during code reviews, discussing any disagreements rather than ignoring the feedback, and updating the pull request accordingly.'), AlpacaItem(instruction='What is the purpose of the `Common Actions` section in the documentation?', input='', output='The `Common Actions` section provides guidelines and commands for common tasks that contributors may need to perform, such as updating dependencies and running tests.'), AlpacaItem(instruction='How does CAMEL define sprint reviews?', input='', output='CAMEL defines sprint reviews as meetings where stakeholders review and provide feedback on the features delivered during the sprint.'), AlpacaItem(instruction='What are the guidelines for writing effective commit messages?', input='', output='Guidelines for writing effective commit messages include using the imperative mood, keeping the subject line concise, and providing detailed explanations in the body.'), AlpacaItem(instruction='What should contributors do if they encounter issues during the setup process?', input='', output='If contributors encounter issues during the setup process, they should reach out to a maintainer for assistance to ensure a smooth experience.'), AlpacaItem(instruction='What is the purpose of the `test` directory in CAMEL?', input='', output='The `test` directory in CAMEL is designated for unit tests that validate the functionality of the code, ensuring that changes do not introduce new bugs.'), AlpacaItem(instruction='How can contributors document improvements made in the code?', input='', output='Contributors should document improvements by updating affected example scripts, Gradio demos, and relevant documentation to reflect changes.'), AlpacaItem(instruction='What is the significance of the `logger` in CAMEL?', input='', output='The significance of the `logger` in CAMEL lies in its ability to provide a consistent, configurable logging mechanism that enhances debugging and monitoring capabilities.'), AlpacaItem(instruction='What is the role of the `fix` label in pull requests?', input='', output='The role of the `fix` label in pull requests is to categorize changes that resolve bugs or issues in the codebase.'), AlpacaItem(instruction='What should contributors do when creating new issues on GitHub?', input='', output='When creating new issues on GitHub, contributors should provide a clear title, detailed description, and categorize the issue appropriately to facilitate tracking and resolution.'), AlpacaItem(instruction='What are the responsibilities of a code reviewer in CAMEL?', input='', output='The responsibilities of a code reviewer in CAMEL include conducting thorough reviews, providing constructive feedback, and ensuring the code meets project standards.'), AlpacaItem(instruction='How does CAMEL handle code reviews?', input='', output='CAMEL handles code reviews by ensuring reviewers check for functionality, readability, and compliance with coding standards, providing constructive feedback.'), AlpacaItem(instruction='What is the purpose of the `chore` label in pull requests?', input='', output='The purpose of the `chore` label in pull requests is to categorize maintenance tasks that do not add new features or fix bugs, such as updating dependencies.'), AlpacaItem(instruction='What steps should a contributor take to ensure their code passes all tests?', input='', output='To ensure their code passes all tests, contributors should run unit tests using `pytest`, verify all tests pass, and configure necessary API keys.'), AlpacaItem(instruction='Explain the importance of logging in CAMEL.', input='', output='Logging in CAMEL is important because it provides a means to track application behavior, aiding in debugging and monitoring.'), AlpacaItem(instruction='What are the guidelines for contributing to documentation in CAMEL?', input='', output='Guidelines for contributing to documentation include providing thorough documentation for all classes and methods to ensure high-quality coverage.'), AlpacaItem(instruction='What is the process for updating dependencies in CAMEL?', input='', output='The process for updating dependencies involves modifying the `pyproject.toml` file and running `poetry lock` to synchronize changes.'), AlpacaItem(instruction='Explain the purpose of the `Args:` section in docstrings.', input='', output='The `Args:` section in docstrings documents parameters for functions, detailing names, types, descriptions, and default values.'), AlpacaItem(instruction='What is the significance of the `Coverage` section in the documentation?', input='', output='The `Coverage` section measures unit test coverage, identifying robust and less robust areas of the codebase.'), AlpacaItem(instruction='How can contributors ensure they are following coding standards during development?', input='', output='Contributors can ensure coding standards are followed by running linters and adhering to project style guidelines.'), AlpacaItem(instruction='What is the purpose of the `Pull Request Item Stage` in CAMEL?', input='', output='The `Pull Request Item Stage` manages the lifecycle of pull requests, ensuring proper review and categorization before merging.'), AlpacaItem(instruction='How should contributors handle feedback received during code reviews?', input='', output='Contributors should address all feedback and discuss disagreements rather than ignoring it, updating the pull request as necessary.'), AlpacaItem(instruction='What is the purpose of the `Common Actions` section in the documentation?', input='', output='The `Common Actions` section provides commands and guidelines for common tasks that contributors may need to perform.'), AlpacaItem(instruction='How does CAMEL define sprint reviews?', input='', output='CAMEL defines sprint reviews as meetings for stakeholders to review and provide feedback on delivered features.'), AlpacaItem(instruction='What are the guidelines for writing effective commit messages?', input='', output='Guidelines for writing effective commit messages include using the imperative mood, keeping the subject line concise, and providing detailed explanations.'), AlpacaItem(instruction='What should contributors do if they encounter issues during the setup process?', input='', output='If contributors encounter issues during setup, they should reach out to a maintainer for assistance.'), AlpacaItem(instruction='What is the purpose of the `test` directory in CAMEL?', input='', output='The `test` directory is designated for unit tests that validate the functionality of the code.'), AlpacaItem(instruction='What should a contributor do if they encounter issues during the setup process?', input='', output='If a contributor encounters any challenges during the setup process, they should reach out to a maintainer for assistance. The CAMEL team aims to make the developer setup straightforward and is willing to provide support to ensure a smooth experience.'), AlpacaItem(instruction='Outline the steps for running unit tests in CAMEL.', input='', output='To run unit tests in CAMEL, follow these steps:\\n1. Ensure that the necessary dependencies and environment are set up.\\n2. Use the command `pytest .` to run all tests, including those that interact with the OpenAI API.\\n3. For local isolated unit and integration tests, use `pytest --fast-test-mode .`.'), AlpacaItem(instruction='Explain the purpose of code reviews in CAMEL.', input='', output='The purpose of code reviews in CAMEL includes:\\n1. **Maintain Code Quality**: Ensuring the codebase remains clean, readable, and maintainable.\\n2. **Knowledge Sharing**: Facilitating knowledge sharing among contributors and helping new contributors learn best practices.\\n3. **Bug Prevention**: Catching potential bugs and issues before they are merged into the main branch.'), AlpacaItem(instruction='What are the consequences of ignoring feedback during code reviews?', input='', output=\"Ignoring feedback during code reviews can lead to the introduction of bugs, inconsistencies in the codebase, and potential security vulnerabilities. It can also hinder the contributor's learning process and reduce the overall quality of the project.\"), AlpacaItem(instruction='Describe the guidelines for contributing to documentation in CAMEL.', input='', output='The guidelines for contributing to documentation in CAMEL include:\\n1. Providing comprehensive documentation for all classes and methods to ensure high-quality coverage.\\n2. Following the structure and style guidelines outlined in the project to maintain consistency.'), AlpacaItem(instruction='What is the significance of using `logger` instead of `print` in CAMEL?', input='', output='Using `logger` instead of `print` is significant in CAMEL because it ensures consistent, configurable, and professional logging. This practice enhances the maintainability of the code and allows for better control over the logging output.'), AlpacaItem(instruction='How does CAMEL handle versioning and releases?', input='', output='CAMEL follows the semantic versioning (semver) standard. Currently, the major version is 0, and the minor version is incremented. Releases are made when maintainers feel that a significant body of changes has accumulated, and even patch releases may contain non-backwards-compatible changes.'), AlpacaItem(instruction='What are the steps for cloning the CAMEL repository?', input='', output='To clone the CAMEL repository, follow these steps:\\n1. Use the command `git clone https://github.com/camel-ai/camel.git`.\\n2. Change directory into the project with `cd camel`.'), AlpacaItem(instruction='Explain the process of issue management in CAMEL.', input='', output='The issue management process in CAMEL includes:\\n1. Regularly updating the issues page on GitHub with bugs, improvements, and feature requests.\\n2. Assigning issues to oneself when starting work on them to avoid duplication of efforts.\\n3. Keeping issues focused and linking related or blocking issues instead of merging them.'), AlpacaItem(instruction='What should contributors do before their pull request can be merged?', input='', output='Before a pull request can be merged in CAMEL, it must pass formatting, linting, and testing checks. Contributors should ensure that all relevant issues are mentioned and that the PR is reviewed and approved by at least two reviewers.'), AlpacaItem(instruction=\"Describe how to document parameters in a function's docstring in CAMEL.\", input='', output=\"To document parameters in a function's docstring in CAMEL, include an `Args:` section. Each parameter should specify the name, type, a brief description, and indicate the default value using the format `default: :obj:<default_value>`.\"), AlpacaItem(instruction='What is the recommended way to engage with issues in CAMEL?', input='', output='To engage with issues in CAMEL effectively:\\n1. Visit the GitHub Issues page and create a new issue, selecting the appropriate category.\\n2. Ensure the issue has a proper title and fill in the required information.\\n3. Discuss the issue during team meetings and update its status accordingly.'), AlpacaItem(instruction='What are the practices for sprint planning in CAMEL?', input='', output='The practices for sprint planning in CAMEL include:\\n1. Conducting biweekly planning meetings to define what can be delivered in the sprint.\\n2. Developers selecting items for the sprint based on the sprint goal highlighted by the founder.'), AlpacaItem(instruction='How do contributors receive credit for their contributions in CAMEL?', input='', output='Contributors receive credit for their contributions in CAMEL if their work is included in a release. They can request recognition on Twitter, provided they are comfortable with it, by mentioning their Twitter account in the pull request.'), AlpacaItem(instruction='What is the purpose of the `pre-commit` hook in CAMEL?', input='', output=\"The purpose of the `pre-commit` hook in CAMEL is to automatically format and lint code before each commit, ensuring that all contributions adhere to the project's coding standards and maintain code quality.\"), AlpacaItem(instruction='Explain the importance of maintaining documentation in an open-source project like CAMEL.', input='', output='Maintaining documentation in an open-source project like CAMEL is crucial for several reasons:\\n1. It helps new contributors understand the project quickly.\\n2. It ensures that all users can effectively utilize the features and functionalities provided by the project.\\n3. Good documentation fosters community engagement and collaboration.'), AlpacaItem(instruction='What are the key components of a well-structured pull request in CAMEL?', input='', output='Key components of a well-structured pull request in CAMEL include:\\n1. A proper title that clearly describes the changes.\\n2. Linked related issues for context.\\n3. Updated reviewers, assignees, labels, and milestones.'), AlpacaItem(instruction='How should contributors approach code review feedback?', input='', output='Contributors should approach code review feedback constructively by addressing all feedback provided, discussing any disagreements instead of ignoring them, and making necessary updates to their pull request based on the review comments.'), AlpacaItem(instruction='What tools are recommended for code linting and formatting in CAMEL?', input='', output='For code linting and formatting in CAMEL, the recommended tools include `Ruff` for formatting checks and following the Google Python Style Guide for coding standards.'), AlpacaItem(instruction='How does CAMEL define its sprint review process?', input='', output='CAMEL defines its sprint review process as a biweekly meeting where stakeholders review the delivered features and provide feedback on the work completed during the sprint.'), AlpacaItem(instruction='What is the significance of the `Args:` section in a docstring?', input='', output=\"The `Args:` section in a docstring is significant because it provides clear documentation of the function's parameters, including their names, types, descriptions, and default values. This clarity enhances code readability and usability.\"), AlpacaItem(instruction='What should contributors do if they want to introduce new features to CAMEL?', input='', output='If contributors want to introduce new features to CAMEL, they should follow the Fork-and-Pull-Request workflow, ensuring to document their changes and provide relevant unit tests.'), AlpacaItem(instruction=\"Describe the importance of testing in CAMEL's development process.\", input='', output=\"Testing is essential in CAMEL's development process as it helps ensure that the code functions as intended, prevents bugs from being introduced, and maintains the overall quality and reliability of the project.\"), AlpacaItem(instruction='What practices should be avoided when submitting pull requests?', input='', output='Practices to avoid when submitting pull requests include submitting large PRs that are difficult to review, ignoring feedback from reviewers, and rushing through the review process.'), AlpacaItem(instruction='How should contributors handle security considerations during code contributions?', input='', output='Contributors should handle security considerations by reviewing their code for potential vulnerabilities, ensuring that no security flaws are introduced, and adhering to best practices for secure coding.'), AlpacaItem(instruction='What are the roles of maintainers in the CAMEL project?', input='', output=\"Maintainers in the CAMEL project are responsible for overseeing the project's progress, reviewing pull requests, merging approved contributions, and ensuring that the project adheres to its coding standards and guidelines.\"), AlpacaItem(instruction='What is the process for updating dependencies in CAMEL?', input='', output='The process for updating dependencies in CAMEL involves modifying the `pyproject.toml` file and running `poetry lock` to synchronize the dependencies with the lock file.'), AlpacaItem(instruction='How can contributors ensure their code is well-documented?', input='', output='Contributors can ensure their code is well-documented by following the documentation guidelines provided in the project, writing clear and concise docstrings, and including examples where appropriate.'), AlpacaItem(instruction='What is the significance of the `make html` command in the documentation process?', input='', output='The `make html` command in the documentation process is significant because it builds the HTML version of the documentation, allowing contributors to view and verify the documentation locally before publishing.'), AlpacaItem(instruction='What steps should be taken to ensure code quality in CAMEL?', input='', output=\"To ensure code quality in CAMEL, contributors should:\\n1. Follow the project's coding standards and guidelines.\\n2. Conduct thorough testing and provide sufficient test coverage.\\n3. Participate in code reviews and address feedback constructively.\"), AlpacaItem(instruction='Explain how the CAMEL community communicates effectively.', input='', output='The CAMEL community communicates effectively through various channels, including Discord for real-time discussions, WeChat for Chinese speakers, and Slack for team collaboration.'), AlpacaItem(instruction='What are the benefits of using a structured workflow for project management in CAMEL?', input='', output='The benefits of using a structured workflow for project management in CAMEL include improved clarity in tasks, efficient tracking of progress, better collaboration among team members, and enhanced accountability for contributions.'), AlpacaItem(instruction='How does CAMEL ensure that contributions are diverse and inclusive?', input='', output='CAMEL ensures that contributions are diverse and inclusive by welcoming contributors from various backgrounds, encouraging diverse opinions, and fostering a collaborative environment.'), AlpacaItem(instruction='What is the role of documentation in maintaining open-source projects like CAMEL?', input='', output=\"Documentation plays a crucial role in maintaining open-source projects like CAMEL by providing essential information to users and contributors, facilitating onboarding, and ensuring the project's functionalities are well understood.\"), AlpacaItem(instruction='How should contributors prepare for a developer meeting in CAMEL?', input='', output='Contributors should prepare for a developer meeting in CAMEL by reviewing the agenda, gathering updates on their tasks, and being ready to discuss any challenges or questions they may have.'), AlpacaItem(instruction='What is the importance of maintaining a clean codebase in CAMEL?', input='', output='Maintaining a clean codebase in CAMEL is important because it enhances readability, facilitates easier maintenance, reduces the likelihood of bugs, and improves collaboration among contributors.'), AlpacaItem(instruction='What should be included in the title of a pull request?', input='', output='The title of a pull request should include a clear and concise description of the changes made, potentially prefixed with labels such as `feat`, `fix`, or `docs` to indicate the nature of the contribution.'), AlpacaItem(instruction='How can contributors effectively test their code before submitting it?', input='', output='Contributors can effectively test their code before submitting it by running unit tests using `pytest`, ensuring all tests pass, and checking for any linting or formatting issues with the pre-commit hook.'), AlpacaItem(instruction='What is the role of the CAMEL community in guiding new contributors?', input='', output='The role of the CAMEL community in guiding new contributors includes providing support through communication channels, offering onboarding calls, and sharing best practices and guidelines for contributions.'), AlpacaItem(instruction='Describe the process of scheduling an introduction call for new contributors in CAMEL.', input='', output='New contributors in CAMEL can schedule an introduction call by selecting the appropriate link for either English or Chinese speakers, as provided in the contributing guidelines.'), AlpacaItem(instruction='What is the significance of following a consistent coding style in CAMEL?', input='', output='Following a consistent coding style in CAMEL is significant because it enhances code readability, fosters collaboration among contributors, and ensures that the codebase remains maintainable over time.'), AlpacaItem(instruction='How does CAMEL facilitate knowledge sharing among its contributors?', input='', output='CAMEL facilitates knowledge sharing among its contributors through code reviews, discussions in community channels, and documentation that outlines best practices and project guidelines.'), AlpacaItem(instruction='What should contributors do if they find outdated issues on the CAMEL GitHub page?', input='', output='If contributors find outdated issues on the CAMEL GitHub page, they should notify the maintainers so that the issues can be addressed and updated accordingly.'), AlpacaItem(instruction='What are the key aspects of effective sprint reviews in CAMEL?', input='', output='Key aspects of effective sprint reviews in CAMEL include gathering feedback from stakeholders, discussing delivered features, and identifying areas for improvement in future sprints.'), AlpacaItem(instruction='How can contributors ensure their pull requests are reviewed in a timely manner?', input='', output='Contributors can ensure their pull requests are reviewed in a timely manner by clearly communicating the importance of their changes, tagging relevant reviewers, and being responsive to feedback.'), AlpacaItem(instruction='What role does testing play in the development lifecycle of CAMEL?', input='', output='Testing plays a critical role in the development lifecycle of CAMEL by validating that new features work as expected, preventing bugs from being introduced, and ensuring the overall stability of the project.'), AlpacaItem(instruction='How can contributors make their code contributions more impactful?', input='', output=\"Contributors can make their code contributions more impactful by thoroughly documenting their code, including relevant tests, and ensuring their changes align with the project's goals and standards.\"), AlpacaItem(instruction='What are the common pitfalls to avoid during code reviews in CAMEL?', input='', output='Common pitfalls to avoid during code reviews in CAMEL include submitting overly large pull requests, neglecting to address reviewer feedback, and rushing through the review process without thorough examination.'), AlpacaItem(instruction='How does CAMEL manage its project through structured workflows?', input='', output='CAMEL manages its project through structured workflows by organizing tasks into clearly defined stages for issue creation, pull requests, sprint planning, and reviews, ensuring clarity and efficiency.'), AlpacaItem(instruction='What is the significance of community engagement in the CAMEL project?', input='', output='Community engagement in the CAMEL project is significant as it fosters collaboration, encourages diverse contributions, and enhances the overall development and sustainability of the project.')]\n"+ ]+ }+ ]+ },+ {+ "cell_type": "markdown",+ "source": [+ "Now to define how each row is formatted"+ ],+ "metadata": {+ "id": "-va4lzdi0eYj"+ }+ },+ {+ "cell_type": "markdown",+ "source": [],+ "metadata": {+ "id": "6jGOhVcFTMh7"+ }+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "LjY75GoYUCB8",+ "colab": {+ "base_uri": "https://localhost:8080/",+ "height": 81,+ "referenced_widgets": [+ "e5fea2af8ffc4c65b3332210f714f858",+ "ac03a36acce44bc29a830c1a0831681e",+ "de4be1105e49406988bbfd3f5f0d2e0d",+ "02bd7ebe65fb433396111a092a0f0838",+ "1d1962b262e74ab3927dff5ce3642d37",+ "d784c497ede34b30acd904e5c8b6dadc",+ "c7135fcebfe440c68eee05d960828a16",+ "77352906db83466c94c661f5326b1bfa",+ "0ff58f4d66f94b6cb4ebaf2f3cd809ac",+ "b2caaf8f67314e82b3cea7fa8f114412",+ "5380979bd65844f49d7e21208ddd00ed",+ "8034da0355d541dcad60df382b341f5f",+ "aee1efe5c0394129ad39fdd375c045a6",+ "d4b90baa5c7045109bff94fe4c21b82e",+ "b0501d20e9574af5ab17f6a13cf75c50",+ "ff8b818b9da648f994462c097100569c",+ "3e383dc72f1d4e9c830b944d21c0350c",+ "d06ef4078c2945b79c0163ace4e56433",+ "2899d6b880494158a0f4d682e35d2c9e",+ "e3929f83d33d46a59169d2ade6b9672d",+ "7f7a994f97054f4b98c58a6a8f655939",+ "df42b455d7d54dbca7fa88ba845157d0"+ ]+ },+ "outputId": "d93aa6b5-eff5-4b81-9d39-678efd76d16d"+ },+ "outputs": [+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "Generating train split: 0 examples [00:00, ? examples/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "e5fea2af8ffc4c65b3332210f714f858"+ }+ },+ "metadata": {}+ },+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "Map: 0%| | 0/292 [00:00<?, ? examples/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "8034da0355d541dcad60df382b341f5f"+ }+ },+ "metadata": {}+ }+ ],+ "source": [+ "EOS_TOKEN = tokenizer.eos_token\n",+ "\n",+ "# Provide function showing how to convert dataset row into inference text\n",+ "def formatting_prompts_func(dataset_row):\n",+ " return {\n",+ " \"text\": [\n",+ " AlpacaItem(instruction=inst, input=inp, output=out)\n",+ " .to_string() + EOS_TOKEN # Use handy to_string method\n",+ " for inst, inp, out in zip(\n",+ " dataset_row[\"instruction\"],\n",+ " dataset_row[\"input\"],\n",+ " dataset_row[\"output\"]\n",+ " )\n",+ " ]\n",+ " }\n",+ "pass\n",+ "\n",+ "from datasets import load_dataset\n",+ "dataset = load_dataset(\"json\", data_files=\"alpaca_format_data.json\", split=\"train\")\n",+ "dataset = dataset.map(formatting_prompts_func, batched = True,)"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "idAEIeSQ3xdS"+ },+ "source": [+ "Train the model"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "95_Nn-89DhsL",+ "colab": {+ "base_uri": "https://localhost:8080/",+ "height": 49,+ "referenced_widgets": [+ "a8190e62c36240c592674a9726737b3d",+ "7fce007e91904bc79a8c07f7778f34f7",+ "fc9dd8841ed64650b4266fa02c6046af",+ "d787f82c251444f8aa5b42a3e1839af7",+ "96aa0818bf5d4843be46b8d6864aa06d",+ "d4caaada771e4aaabc53a7160c6ae063",+ "4d2d550d6bb34042be75c83a55fc9463",+ "7afe5b5a759d48d7a926ce20d6032758",+ "5d17cd9ebc724de3805e438136233136",+ "37f940152afd4252a2229646ffe0609c",+ "cb7764bc39914b7da7847787db02d3c0"+ ]+ },+ "outputId": "05c421b4-36da-4e3b-e89b-05d58d91fae5"+ },+ "outputs": [+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "Generating train split: 0 examples [00:00, ? examples/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "a8190e62c36240c592674a9726737b3d"+ }+ },+ "metadata": {}+ }+ ],+ "source": [+ "from trl import SFTTrainer\n",+ "from transformers import TrainingArguments\n",+ "from unsloth import is_bfloat16_supported\n",+ "trainer = SFTTrainer(\n",+ " model = model,\n",+ " tokenizer = tokenizer,\n",+ " train_dataset = dataset,\n",+ " dataset_text_field = \"text\",\n",+ " max_seq_length = 512,\n",+ " dataset_num_proc = 2,\n",+ " packing = True, # Packs short sequences together to save time!\n",+ " args = TrainingArguments(\n",+ " per_device_train_batch_size = 2,\n",+ " gradient_accumulation_steps = 4,\n",+ " warmup_ratio = 0.1,\n",+ " num_train_epochs = 40,\n",+ " learning_rate = 2e-3,\n",+ " fp16 = not is_bfloat16_supported(),\n",+ " bf16 = is_bfloat16_supported(),\n",+ " logging_steps = 1,\n",+ " optim = \"adamw_8bit\",\n",+ " weight_decay = 0.1,\n",+ " lr_scheduler_type = \"linear\",\n",+ " seed = 3407,\n",+ " output_dir = \"outputs\",\n",+ " report_to = \"none\", # Use this for WandB etc\n",+ " ),\n",+ ")\n",+ "# Ensure model is fully back in training mode\n",+ "model = FastLanguageModel.for_training(model)"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "yqxqAZ7KJ4oL",+ "colab": {+ "base_uri": "https://localhost:8080/",+ "height": 1000,+ "referenced_widgets": [+ "005b1016805e4f4a8b9f0c09a9dd590c",+ "8cbf1c6ef1934147b20ec0079aae6f90",+ "a3da6b99fdb047fe9ed334cb86e29da6",+ "f05711d3db1c40dbbe9b7dede69459b4",+ "27e3a5962aea4386931750ad2754ebe6",+ "4a8d9a9a5cbb4381b574206412a68b87",+ "637eeba9e5ba4059ac455a1cd2c9bbae",+ "8186ab6f728f4e38bea3b86a5fa77811",+ "e95504e8554e4010b191eb1b622cd40b",+ "652cebdce10d46d8a25d2d4125721b50",+ "902c87fc400746d9a6b8a301d590c96a"+ ]+ },+ "outputId": "ea2210cb-58ac-4be5-dad4-0c79331aa46e"+ },+ "outputs": [+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "Counting untrained tokens: 0%| | 0/48 [00:00<?, ? examples/s]"+ ],+ "application/vnd.jupyter.widget-view+json": {+ "version_major": 2,+ "version_minor": 0,+ "model_id": "005b1016805e4f4a8b9f0c09a9dd590c"+ }+ },+ "metadata": {}+ },+ {+ "output_type": "stream",+ "name": "stdout",+ "text": [+ "Unsloth: Setting embed_tokens & lm_head untrained tokens to mean(trained) to counteract NaNs during training.\n"+ ]+ },+ {+ "output_type": "stream",+ "name": "stderr",+ "text": [+ "==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1\n",+ " \\\\ /| Num examples = 48 | Num Epochs = 40\n",+ "O^O/ \\_/ \\ Batch size per device = 2 | Gradient Accumulation steps = 4\n",+ "\\ / Total batch size = 8 | Total steps = 240\n",+ " \"-____-\" Number of trainable parameters = 156,303,360\n"+ ]+ },+ {+ "output_type": "display_data",+ "data": {+ "text/plain": [+ "<IPython.core.display.HTML object>"+ ],+ "text/html": [+ "\n",+ " <div>\n",+ " \n",+ " <progress value='240' max='240' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",+ " [240/240 09:32, Epoch 40/40]\n",+ " </div>\n",+ " <table border=\"1\" class=\"dataframe\">\n",+ " <thead>\n",+ " <tr style=\"text-align: left;\">\n",+ " <th>Step</th>\n",+ " <th>Training Loss</th>\n",+ " </tr>\n",+ " </thead>\n",+ " <tbody>\n",+ " <tr>\n",+ " <td>1</td>\n",+ " <td>4.124200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>2</td>\n",+ " <td>4.029200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>3</td>\n",+ " <td>4.090100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>4</td>\n",+ " <td>3.342900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>5</td>\n",+ " <td>2.615600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>6</td>\n",+ " <td>2.070200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>7</td>\n",+ " <td>1.514300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>8</td>\n",+ " <td>1.281300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>9</td>\n",+ " <td>1.174400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>10</td>\n",+ " <td>0.986300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>11</td>\n",+ " <td>0.865100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>12</td>\n",+ " <td>0.810100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>13</td>\n",+ " <td>0.590800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>14</td>\n",+ " <td>0.552800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>15</td>\n",+ " <td>0.565700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>16</td>\n",+ " <td>0.571900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>17</td>\n",+ " <td>0.584200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>18</td>\n",+ " <td>0.583200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>19</td>\n",+ " <td>0.337200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>20</td>\n",+ " <td>0.362300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>21</td>\n",+ " <td>0.332500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>22</td>\n",+ " <td>0.402300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>23</td>\n",+ " <td>0.398700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>24</td>\n",+ " <td>0.443000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>25</td>\n",+ " <td>0.293200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>26</td>\n",+ " <td>0.311400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>27</td>\n",+ " <td>0.275800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>28</td>\n",+ " <td>0.297800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>29</td>\n",+ " <td>0.319100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>30</td>\n",+ " <td>0.310600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>31</td>\n",+ " <td>0.180100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>32</td>\n",+ " <td>0.192000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>33</td>\n",+ " <td>0.222800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>34</td>\n",+ " <td>0.256100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>35</td>\n",+ " <td>0.290200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>36</td>\n",+ " <td>0.309400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>37</td>\n",+ " <td>0.214100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>38</td>\n",+ " <td>0.166800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>39</td>\n",+ " <td>0.185900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>40</td>\n",+ " <td>0.249900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>41</td>\n",+ " <td>0.212000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>42</td>\n",+ " <td>0.224900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>43</td>\n",+ " <td>0.163600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>44</td>\n",+ " <td>0.139300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>45</td>\n",+ " <td>0.173300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>46</td>\n",+ " <td>0.209100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>47</td>\n",+ " <td>0.188900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>48</td>\n",+ " <td>0.207800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>49</td>\n",+ " <td>0.115100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>50</td>\n",+ " <td>0.203500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>51</td>\n",+ " <td>0.189200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>52</td>\n",+ " <td>0.278300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>53</td>\n",+ " <td>0.246700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>54</td>\n",+ " <td>0.317100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>55</td>\n",+ " <td>0.482900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>56</td>\n",+ " <td>0.366400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>57</td>\n",+ " <td>0.195900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>58</td>\n",+ " <td>0.189500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>59</td>\n",+ " <td>0.373500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>60</td>\n",+ " <td>0.278600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>61</td>\n",+ " <td>0.132900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>62</td>\n",+ " <td>0.133800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>63</td>\n",+ " <td>0.132800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>64</td>\n",+ " <td>0.103100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>65</td>\n",+ " <td>0.107800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>66</td>\n",+ " <td>0.130400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>67</td>\n",+ " <td>0.083100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>68</td>\n",+ " <td>0.129500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>69</td>\n",+ " <td>0.124100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>70</td>\n",+ " <td>0.142300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>71</td>\n",+ " <td>0.139600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>72</td>\n",+ " <td>0.103800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>73</td>\n",+ " <td>0.063500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>74</td>\n",+ " <td>0.086100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>75</td>\n",+ " <td>0.083300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>76</td>\n",+ " <td>0.077200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>77</td>\n",+ " <td>0.127800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>78</td>\n",+ " <td>0.106900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>79</td>\n",+ " <td>0.060100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>80</td>\n",+ " <td>0.041300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>81</td>\n",+ " <td>0.059400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>82</td>\n",+ " <td>0.076400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>83</td>\n",+ " <td>0.076200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>84</td>\n",+ " <td>0.082500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>85</td>\n",+ " <td>0.068500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>86</td>\n",+ " <td>0.053800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>87</td>\n",+ " <td>0.110100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>88</td>\n",+ " <td>0.070700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>89</td>\n",+ " <td>0.293700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>90</td>\n",+ " <td>0.139600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>91</td>\n",+ " <td>0.073000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>92</td>\n",+ " <td>0.061000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>93</td>\n",+ " <td>0.043800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>94</td>\n",+ " <td>0.077300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>95</td>\n",+ " <td>0.107800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>96</td>\n",+ " <td>0.713100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>97</td>\n",+ " <td>0.113700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>98</td>\n",+ " <td>0.220500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>99</td>\n",+ " <td>0.124600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>100</td>\n",+ " <td>0.054300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>101</td>\n",+ " <td>0.035700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>102</td>\n",+ " <td>0.044200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>103</td>\n",+ " <td>0.030300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>104</td>\n",+ " <td>0.045400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>105</td>\n",+ " <td>0.029000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>106</td>\n",+ " <td>0.055200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>107</td>\n",+ " <td>0.042100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>108</td>\n",+ " <td>0.034600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>109</td>\n",+ " <td>0.015400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>110</td>\n",+ " <td>0.023200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>111</td>\n",+ " <td>0.029000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>112</td>\n",+ " <td>0.025700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>113</td>\n",+ " <td>0.031700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>114</td>\n",+ " <td>0.030200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>115</td>\n",+ " <td>0.009300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>116</td>\n",+ " <td>0.021900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>117</td>\n",+ " <td>0.018800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>118</td>\n",+ " <td>0.020900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>119</td>\n",+ " <td>0.019800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>120</td>\n",+ " <td>0.030500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>121</td>\n",+ " <td>0.006400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>122</td>\n",+ " <td>0.021000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>123</td>\n",+ " <td>0.017200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>124</td>\n",+ " <td>0.012400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>125</td>\n",+ " <td>0.025900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>126</td>\n",+ " <td>0.019200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>127</td>\n",+ " <td>0.004000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>128</td>\n",+ " <td>0.011300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>129</td>\n",+ " <td>0.011300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>130</td>\n",+ " <td>0.016800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>131</td>\n",+ " <td>0.006200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>132</td>\n",+ " <td>0.022300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>133</td>\n",+ " <td>0.003900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>134</td>\n",+ " <td>0.005400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>135</td>\n",+ " <td>0.005700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>136</td>\n",+ " <td>0.005300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>137</td>\n",+ " <td>0.017900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>138</td>\n",+ " <td>0.020600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>139</td>\n",+ " <td>0.004400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>140</td>\n",+ " <td>0.002500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>141</td>\n",+ " <td>0.002600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>142</td>\n",+ " <td>0.010700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>143</td>\n",+ " <td>0.007600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>144</td>\n",+ " <td>0.006400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>145</td>\n",+ " <td>0.002400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>146</td>\n",+ " <td>0.002000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>147</td>\n",+ " <td>0.002400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>148</td>\n",+ " <td>0.003300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>149</td>\n",+ " <td>0.003200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>150</td>\n",+ " <td>0.003600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>151</td>\n",+ " <td>0.002100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>152</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>153</td>\n",+ " <td>0.004700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>154</td>\n",+ " <td>0.003400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>155</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>156</td>\n",+ " <td>0.004100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>157</td>\n",+ " <td>0.002600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>158</td>\n",+ " <td>0.001200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>159</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>160</td>\n",+ " <td>0.001400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>161</td>\n",+ " <td>0.003300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>162</td>\n",+ " <td>0.003400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>163</td>\n",+ " <td>0.001200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>164</td>\n",+ " <td>0.000500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>165</td>\n",+ " <td>0.001900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>166</td>\n",+ " <td>0.001700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>167</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>168</td>\n",+ " <td>0.001400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>169</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>170</td>\n",+ " <td>0.000800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>171</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>172</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>173</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>174</td>\n",+ " <td>0.002900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>175</td>\n",+ " <td>0.001400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>176</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>177</td>\n",+ " <td>0.001400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>178</td>\n",+ " <td>0.001900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>179</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>180</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>181</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>182</td>\n",+ " <td>0.000200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>183</td>\n",+ " <td>0.000900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>184</td>\n",+ " <td>0.001200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>185</td>\n",+ " <td>0.001800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>186</td>\n",+ " <td>0.001400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>187</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>188</td>\n",+ " <td>0.001300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>189</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>190</td>\n",+ " <td>0.000300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>191</td>\n",+ " <td>0.002100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>192</td>\n",+ " <td>0.000200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>193</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>194</td>\n",+ " <td>0.001300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>195</td>\n",+ " <td>0.001300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>196</td>\n",+ " <td>0.000400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>197</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>198</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>199</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>200</td>\n",+ " <td>0.000400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>201</td>\n",+ " <td>0.000900</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>202</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>203</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>204</td>\n",+ " <td>0.001100</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>205</td>\n",+ " <td>0.000500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>206</td>\n",+ " <td>0.001200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>207</td>\n",+ " <td>0.001300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>208</td>\n",+ " <td>0.000800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>209</td>\n",+ " <td>0.001000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>210</td>\n",+ " <td>0.000200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>211</td>\n",+ " <td>0.001200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>212</td>\n",+ " <td>0.000500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>213</td>\n",+ " <td>0.000200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>214</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>215</td>\n",+ " <td>0.001800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>216</td>\n",+ " <td>0.000500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>217</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>218</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>219</td>\n",+ " <td>0.001800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>220</td>\n",+ " <td>0.000400</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>221</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>222</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>223</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>224</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>225</td>\n",+ " <td>0.000800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>226</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>227</td>\n",+ " <td>0.001200</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>228</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>229</td>\n",+ " <td>0.000800</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>230</td>\n",+ " <td>0.000500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>231</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>232</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>233</td>\n",+ " <td>0.001000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>234</td>\n",+ " <td>0.001000</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>235</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>236</td>\n",+ " <td>0.001300</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>237</td>\n",+ " <td>0.000500</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>238</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>239</td>\n",+ " <td>0.000600</td>\n",+ " </tr>\n",+ " <tr>\n",+ " <td>240</td>\n",+ " <td>0.000700</td>\n",+ " </tr>\n",+ " </tbody>\n",+ "</table><p>"+ ]+ },+ "metadata": {}+ }+ ],+ "source": [+ "dtrainer_stats = trainer.train()"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "ekOmTR1hSNcr"+ },+ "source": [+ "<a name=\"Inference\"></a>\n",+ "### Inference\n",+ "Let's run the model! You can change the instruction and input - leave the output blank!"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "kR3gIAX-SM2q",+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "outputId": "5fe1ad98-7715-4b3d-abec-30c037b6228c"+ },+ "outputs": [+ {+ "output_type": "execute_result",+ "data": {+ "text/plain": [+ "['<s> ### Instruction:\\nExplain how can I stay up to date with the CAMEL community.\\n\\n### Input:\\n\\n\\n### Response:\\nTo can update with the CAMEL community, contributors should:\\n1. Join the community on Discord by mentioning their Twitter account.\\n2. Participate in scheduled introduction calls for English or Chinese speakers.\\n3. Attend developer meetings held weekly.</s>']"+ ]+ },+ "metadata": {},+ "execution_count": 11+ }+ ],+ "source": [+ "FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",+ "inputs = tokenizer(\n",+ "[\n",+ "\n",+ " AlpacaItem(\n",+ " instruction=\"Explain how can I stay up to date with the CAMEL community.\",\n",+ " input=\"\",\n",+ " output=\"\", # leave this blank for generation!\n",+ " ).to_string()\n",+ "\n",+ "], return_tensors = \"pt\").to(\"cuda\")\n",+ "\n",+ "outputs = model.generate(**inputs, max_new_tokens = 512, use_cache = True)\n",+ "tokenizer.batch_decode(outputs)"+ ]+ },+ {+ "cell_type": "markdown",+ "source": [+ "**Summary**\n",+ "\n",+ "\n",+ "We have generated realistic user queries and responses from a real page and trained on them to produce a model that understands the underlying content."+ ],+ "metadata": {+ "id": "xSepmhPrgOct"+ }+ }+ ],+ "metadata": {+ "accelerator": "GPU",+ "colab": {+ "provenance": []+ },+ "kernelspec": {+ "display_name": "Python 3",+ "name": "python3"+ },+ "language_info": {+ "name": "python"+ },+ "widgets": {+ "application/vnd.jupyter.widget-state+json": {+ "c2f5dedb6d7048f8996749618a8fc7da": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_c58d8ee38b524574b20f7d951811358a",+ "IPY_MODEL_077ff4420f754adbaff591980e4883fc",+ "IPY_MODEL_27809521abb9495aa7ed7ad53b6330ff"+ ],+ "layout": "IPY_MODEL_bf1a1ccc1c1243229936370172bc211d"+ }+ },+ "c58d8ee38b524574b20f7d951811358a": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_9eee64214bef41dea2983a99942e1d07",+ "placeholder": "",+ "style": "IPY_MODEL_f736ff87672f4d21a76e07b9406aa15f",+ "value": "model.safetensors: 100%"+ }+ },+ "077ff4420f754adbaff591980e4883fc": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "danger",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_934f112779ef42a3b63707a83f6ace4f",+ "max": 762453544,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_d3489128b101498780a6a79d5e7311a3",+ "value": 762453472+ }+ },+ "27809521abb9495aa7ed7ad53b6330ff": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_c6fc9d129ce540b8be1feec158156639",+ "placeholder": "",+ "style": "IPY_MODEL_e2b60bf0a9da4e099ade1919605b845a",+ "value": " 762M/762M [00:09<00:00, 85.7MB/s]"+ }+ },+ "bf1a1ccc1c1243229936370172bc211d": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "9eee64214bef41dea2983a99942e1d07": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "f736ff87672f4d21a76e07b9406aa15f": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "934f112779ef42a3b63707a83f6ace4f": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "d3489128b101498780a6a79d5e7311a3": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "c6fc9d129ce540b8be1feec158156639": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "e2b60bf0a9da4e099ade1919605b845a": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "9200d426eaa84df290d47867aca07180": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_1dd84904e4a24c59b0cd99ccc7da3eda",+ "IPY_MODEL_5cf812aa765744c5b04aebee97610d42",+ "IPY_MODEL_0d28cde614fc448689a157154072bb6f"+ ],+ "layout": "IPY_MODEL_34ac77acd0b54e6fa704b55a4213934d"+ }+ },+ "1dd84904e4a24c59b0cd99ccc7da3eda": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_01b57c3f271f476ebf99e1464e597acd",+ "placeholder": "",+ "style": "IPY_MODEL_9774e84bbf0b4d6ba34a9b053d8593f7",+ "value": "generation_config.json: 100%"+ }+ },+ "5cf812aa765744c5b04aebee97610d42": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "success",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_597e5b8b51a0454b86846e6ec79c6270",+ "max": 124,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_247b8373563b4acbac4266bfd406dbcd",+ "value": 124+ }+ },+ "0d28cde614fc448689a157154072bb6f": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_735ab790fca24d7889691b7e7355d8b0",+ "placeholder": "",+ "style": "IPY_MODEL_cc1e3d3af78943bc9a2a7a6db5fb802a",+ "value": " 124/124 [00:00<00:00, 8.71kB/s]"+ }+ },+ "34ac77acd0b54e6fa704b55a4213934d": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "01b57c3f271f476ebf99e1464e597acd": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "9774e84bbf0b4d6ba34a9b053d8593f7": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "597e5b8b51a0454b86846e6ec79c6270": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "247b8373563b4acbac4266bfd406dbcd": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "735ab790fca24d7889691b7e7355d8b0": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "cc1e3d3af78943bc9a2a7a6db5fb802a": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "5ca0c390ea4640d8b5c32bc958aa6c69": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_21acf52242484669950b65e7531894e5",+ "IPY_MODEL_56e26ae0bc324153852d9cb7463f748c",+ "IPY_MODEL_9cb5cd9c7f4a4a97b6912e7ca36960f7"+ ],+ "layout": "IPY_MODEL_9cb4f22b6fcd4947be55e35323981e96"+ }+ },+ "21acf52242484669950b65e7531894e5": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_876621f91aa9427c956c2e1eb9368ae1",+ "placeholder": "",+ "style": "IPY_MODEL_63aae38d3baf4d658107e34d29c7f8bc",+ "value": "tokenizer_config.json: 100%"+ }+ },+ "56e26ae0bc324153852d9cb7463f748c": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "success",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_d3d21f4f7e7d40218bb4f8efef5d665d",+ "max": 948,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_25815a7983f84555a7c5b69217001189",+ "value": 948+ }+ },+ "9cb5cd9c7f4a4a97b6912e7ca36960f7": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_9db8bea72009488f9813a6359d52d0f0",+ "placeholder": "",+ "style": "IPY_MODEL_0637f9147c0b4304b5cd48e6df081320",+ "value": " 948/948 [00:00<00:00, 66.8kB/s]"+ }+ },+ "9cb4f22b6fcd4947be55e35323981e96": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "876621f91aa9427c956c2e1eb9368ae1": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "63aae38d3baf4d658107e34d29c7f8bc": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "d3d21f4f7e7d40218bb4f8efef5d665d": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "25815a7983f84555a7c5b69217001189": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "9db8bea72009488f9813a6359d52d0f0": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "0637f9147c0b4304b5cd48e6df081320": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "e79b960de3c341c1a78c4cc0b0382e4f": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_3beef7fd0a1e48539e1817aa5b2c4bc7",+ "IPY_MODEL_65a20195fcc249c8968f9f2e8b4403ea",+ "IPY_MODEL_96b8bba380174070aee36ed84e728e64"+ ],+ "layout": "IPY_MODEL_e41cefdf0e914791b37402549eea3576"+ }+ },+ "3beef7fd0a1e48539e1817aa5b2c4bc7": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_64f34f5a961f4b66b85ebb25c4c5ce66",+ "placeholder": "",+ "style": "IPY_MODEL_683cfad8c7bd4090831699dd9e05479a",+ "value": "tokenizer.model: 100%"+ }+ },+ "65a20195fcc249c8968f9f2e8b4403ea": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "success",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_87e109cd08e74cb5aa859a37cc69b4f4",+ "max": 499723,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_4825c7f64f3148a6a1f69b531389fb54",+ "value": 499723+ }+ },+ "96b8bba380174070aee36ed84e728e64": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_f92f9bd12abc41f7ab951d71de84cf52",+ "placeholder": "",+ "style": "IPY_MODEL_1c02e0bdc1dc48caba342f208b3829bf",+ "value": " 500k/500k [00:00<00:00, 16.5MB/s]"+ }+ },+ "e41cefdf0e914791b37402549eea3576": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "64f34f5a961f4b66b85ebb25c4c5ce66": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "683cfad8c7bd4090831699dd9e05479a": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "87e109cd08e74cb5aa859a37cc69b4f4": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "4825c7f64f3148a6a1f69b531389fb54": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "f92f9bd12abc41f7ab951d71de84cf52": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "1c02e0bdc1dc48caba342f208b3829bf": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "01f00ac736d04d2fb33e01f5b8362a2b": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_0098b6052c6e47a2a76f07a15a163c43",+ "IPY_MODEL_25d87d70ca334429919f90d889ac5a51",+ "IPY_MODEL_e51f99a49413498bbb560a59d7c02a53"+ ],+ "layout": "IPY_MODEL_a566c087e7a44c4cb6061918c6666c11"+ }+ },+ "0098b6052c6e47a2a76f07a15a163c43": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_abbd462a789d4fe9a3789d10e63aa633",+ "placeholder": "",+ "style": "IPY_MODEL_4c8b626f2afa478da87eb7db212b0e0e",+ "value": "special_tokens_map.json: 100%"+ }+ },+ "25d87d70ca334429919f90d889ac5a51": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "success",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_e4acdb2efaf34440804a5cc8d268c541",+ "max": 438,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_6c2c8e9017524594af1bb4f5c61b8b05",+ "value": 438+ }+ },+ "e51f99a49413498bbb560a59d7c02a53": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_1f1c8336f4ac401e86c31e3fc0df1764",+ "placeholder": "",+ "style": "IPY_MODEL_1536c15a33444f77aa54ff35b44d49d2",+ "value": " 438/438 [00:00<00:00, 33.9kB/s]"+ }+ },+ "a566c087e7a44c4cb6061918c6666c11": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "abbd462a789d4fe9a3789d10e63aa633": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "4c8b626f2afa478da87eb7db212b0e0e": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "e4acdb2efaf34440804a5cc8d268c541": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "6c2c8e9017524594af1bb4f5c61b8b05": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "1f1c8336f4ac401e86c31e3fc0df1764": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "1536c15a33444f77aa54ff35b44d49d2": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "dedcaa5325bd45349ed57bdd9f594800": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_d92c6352a43443b1ad0a813b127ad3d1",+ "IPY_MODEL_5cd8c404de584e1c893dec2ef5f29f75",+ "IPY_MODEL_72b6c006bf9e49cc81cc65512d83f2a7"+ ],+ "layout": "IPY_MODEL_e0c96af74fd4420e9e2dcec6e22460ce"+ }+ },+ "d92c6352a43443b1ad0a813b127ad3d1": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_0a1c00592a1e49d4984cdef703c68e30",+ "placeholder": "",+ "style": "IPY_MODEL_9e23fb15357b4cc49ef28e11ce99cade",+ "value": "tokenizer.json: 100%"+ }+ },+ "5cd8c404de584e1c893dec2ef5f29f75": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "success",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_e833a6fccb5c46c6ad8be07989e7842c",+ "max": 1842795,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_fc7924ecd4044b5389f9e377c290e902",+ "value": 1842795+ }+ },+ "72b6c006bf9e49cc81cc65512d83f2a7": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_7b1ea1b188424a0c8016eaf7584d6cc8",+ "placeholder": "",+ "style": "IPY_MODEL_aa4dbea7c24f412bb701e4633e3c4578",+ "value": " 1.84M/1.84M [00:01<00:00, 1.70MB/s]"+ }+ },+ "e0c96af74fd4420e9e2dcec6e22460ce": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "0a1c00592a1e49d4984cdef703c68e30": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "9e23fb15357b4cc49ef28e11ce99cade": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "e833a6fccb5c46c6ad8be07989e7842c": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "fc7924ecd4044b5389f9e377c290e902": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "7b1ea1b188424a0c8016eaf7584d6cc8": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "aa4dbea7c24f412bb701e4633e3c4578": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "e5fea2af8ffc4c65b3332210f714f858": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_ac03a36acce44bc29a830c1a0831681e",+ "IPY_MODEL_de4be1105e49406988bbfd3f5f0d2e0d",+ "IPY_MODEL_02bd7ebe65fb433396111a092a0f0838"+ ],+ "layout": "IPY_MODEL_1d1962b262e74ab3927dff5ce3642d37"+ }+ },+ "ac03a36acce44bc29a830c1a0831681e": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_d784c497ede34b30acd904e5c8b6dadc",+ "placeholder": "",+ "style": "IPY_MODEL_c7135fcebfe440c68eee05d960828a16",+ "value": "Generating train split: "+ }+ },+ "de4be1105e49406988bbfd3f5f0d2e0d": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "success",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_77352906db83466c94c661f5326b1bfa",+ "max": 1,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_0ff58f4d66f94b6cb4ebaf2f3cd809ac",+ "value": 1+ }+ },+ "02bd7ebe65fb433396111a092a0f0838": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_b2caaf8f67314e82b3cea7fa8f114412",+ "placeholder": "",+ "style": "IPY_MODEL_5380979bd65844f49d7e21208ddd00ed",+ "value": " 292/0 [00:00<00:00, 3164.84 examples/s]"+ }+ },+ "1d1962b262e74ab3927dff5ce3642d37": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "d784c497ede34b30acd904e5c8b6dadc": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "c7135fcebfe440c68eee05d960828a16": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "77352906db83466c94c661f5326b1bfa": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": "20px"+ }+ },+ "0ff58f4d66f94b6cb4ebaf2f3cd809ac": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "b2caaf8f67314e82b3cea7fa8f114412": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "5380979bd65844f49d7e21208ddd00ed": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "8034da0355d541dcad60df382b341f5f": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_aee1efe5c0394129ad39fdd375c045a6",+ "IPY_MODEL_d4b90baa5c7045109bff94fe4c21b82e",+ "IPY_MODEL_b0501d20e9574af5ab17f6a13cf75c50"+ ],+ "layout": "IPY_MODEL_ff8b818b9da648f994462c097100569c"+ }+ },+ "aee1efe5c0394129ad39fdd375c045a6": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_3e383dc72f1d4e9c830b944d21c0350c",+ "placeholder": "",+ "style": "IPY_MODEL_d06ef4078c2945b79c0163ace4e56433",+ "value": "Map: 100%"+ }+ },+ "d4b90baa5c7045109bff94fe4c21b82e": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "success",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_2899d6b880494158a0f4d682e35d2c9e",+ "max": 292,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_e3929f83d33d46a59169d2ade6b9672d",+ "value": 292+ }+ },+ "b0501d20e9574af5ab17f6a13cf75c50": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_7f7a994f97054f4b98c58a6a8f655939",+ "placeholder": "",+ "style": "IPY_MODEL_df42b455d7d54dbca7fa88ba845157d0",+ "value": " 292/292 [00:00<00:00, 9653.48 examples/s]"+ }+ },+ "ff8b818b9da648f994462c097100569c": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "3e383dc72f1d4e9c830b944d21c0350c": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "d06ef4078c2945b79c0163ace4e56433": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "2899d6b880494158a0f4d682e35d2c9e": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "e3929f83d33d46a59169d2ade6b9672d": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "7f7a994f97054f4b98c58a6a8f655939": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "df42b455d7d54dbca7fa88ba845157d0": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "a8190e62c36240c592674a9726737b3d": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_7fce007e91904bc79a8c07f7778f34f7",+ "IPY_MODEL_fc9dd8841ed64650b4266fa02c6046af",+ "IPY_MODEL_d787f82c251444f8aa5b42a3e1839af7"+ ],+ "layout": "IPY_MODEL_96aa0818bf5d4843be46b8d6864aa06d"+ }+ },+ "7fce007e91904bc79a8c07f7778f34f7": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_d4caaada771e4aaabc53a7160c6ae063",+ "placeholder": "",+ "style": "IPY_MODEL_4d2d550d6bb34042be75c83a55fc9463",+ "value": "Generating train split: "+ }+ },+ "fc9dd8841ed64650b4266fa02c6046af": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "success",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_7afe5b5a759d48d7a926ce20d6032758",+ "max": 1,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_5d17cd9ebc724de3805e438136233136",+ "value": 1+ }+ },+ "d787f82c251444f8aa5b42a3e1839af7": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_37f940152afd4252a2229646ffe0609c",+ "placeholder": "",+ "style": "IPY_MODEL_cb7764bc39914b7da7847787db02d3c0",+ "value": " 48/0 [00:00<00:00, 447.66 examples/s]"+ }+ },+ "96aa0818bf5d4843be46b8d6864aa06d": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "d4caaada771e4aaabc53a7160c6ae063": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "4d2d550d6bb34042be75c83a55fc9463": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "7afe5b5a759d48d7a926ce20d6032758": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": "20px"+ }+ },+ "5d17cd9ebc724de3805e438136233136": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "37f940152afd4252a2229646ffe0609c": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "cb7764bc39914b7da7847787db02d3c0": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "005b1016805e4f4a8b9f0c09a9dd590c": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HBoxModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HBoxModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HBoxView",+ "box_style": "",+ "children": [+ "IPY_MODEL_8cbf1c6ef1934147b20ec0079aae6f90",+ "IPY_MODEL_a3da6b99fdb047fe9ed334cb86e29da6",+ "IPY_MODEL_f05711d3db1c40dbbe9b7dede69459b4"+ ],+ "layout": "IPY_MODEL_27e3a5962aea4386931750ad2754ebe6"+ }+ },+ "8cbf1c6ef1934147b20ec0079aae6f90": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_4a8d9a9a5cbb4381b574206412a68b87",+ "placeholder": "",+ "style": "IPY_MODEL_637eeba9e5ba4059ac455a1cd2c9bbae",+ "value": "Counting untrained tokens: 100%"+ }+ },+ "a3da6b99fdb047fe9ed334cb86e29da6": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "FloatProgressModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "FloatProgressModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "ProgressView",+ "bar_style": "success",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_8186ab6f728f4e38bea3b86a5fa77811",+ "max": 48,+ "min": 0,+ "orientation": "horizontal",+ "style": "IPY_MODEL_e95504e8554e4010b191eb1b622cd40b",+ "value": 48+ }+ },+ "f05711d3db1c40dbbe9b7dede69459b4": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "HTMLModel",+ "model_module_version": "1.5.0",+ "state": {+ "_dom_classes": [],+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "HTMLModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/controls",+ "_view_module_version": "1.5.0",+ "_view_name": "HTMLView",+ "description": "",+ "description_tooltip": null,+ "layout": "IPY_MODEL_652cebdce10d46d8a25d2d4125721b50",+ "placeholder": "",+ "style": "IPY_MODEL_902c87fc400746d9a6b8a301d590c96a",+ "value": " 48/48 [00:00<00:00, 1197.93 examples/s]"+ }+ },+ "27e3a5962aea4386931750ad2754ebe6": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "4a8d9a9a5cbb4381b574206412a68b87": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "637eeba9e5ba4059ac455a1cd2c9bbae": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ },+ "8186ab6f728f4e38bea3b86a5fa77811": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "e95504e8554e4010b191eb1b622cd40b": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "ProgressStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "ProgressStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "bar_color": null,+ "description_width": ""+ }+ },+ "652cebdce10d46d8a25d2d4125721b50": {+ "model_module": "@jupyter-widgets/base",+ "model_name": "LayoutModel",+ "model_module_version": "1.2.0",+ "state": {+ "_model_module": "@jupyter-widgets/base",+ "_model_module_version": "1.2.0",+ "_model_name": "LayoutModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "LayoutView",+ "align_content": null,+ "align_items": null,+ "align_self": null,+ "border": null,+ "bottom": null,+ "display": null,+ "flex": null,+ "flex_flow": null,+ "grid_area": null,+ "grid_auto_columns": null,+ "grid_auto_flow": null,+ "grid_auto_rows": null,+ "grid_column": null,+ "grid_gap": null,+ "grid_row": null,+ "grid_template_areas": null,+ "grid_template_columns": null,+ "grid_template_rows": null,+ "height": null,+ "justify_content": null,+ "justify_items": null,+ "left": null,+ "margin": null,+ "max_height": null,+ "max_width": null,+ "min_height": null,+ "min_width": null,+ "object_fit": null,+ "object_position": null,+ "order": null,+ "overflow": null,+ "overflow_x": null,+ "overflow_y": null,+ "padding": null,+ "right": null,+ "top": null,+ "visibility": null,+ "width": null+ }+ },+ "902c87fc400746d9a6b8a301d590c96a": {+ "model_module": "@jupyter-widgets/controls",+ "model_name": "DescriptionStyleModel",+ "model_module_version": "1.5.0",+ "state": {+ "_model_module": "@jupyter-widgets/controls",+ "_model_module_version": "1.5.0",+ "_model_name": "DescriptionStyleModel",+ "_view_count": null,+ "_view_module": "@jupyter-widgets/base",+ "_view_module_version": "1.2.0",+ "_view_name": "StyleView",+ "description_width": ""+ }+ }+ }+ }+ },+ "nbformat": 4,+ "nbformat_minor": 0+}\ No newline at end of filediff --git a/docs/index.rst b/docs/index.rstindex d17dc1b84..ec80d6881 100644--- a/docs/index.rst+++ b/docs/index.rst@@ -69,6 +69,7 @@ Main Documentationcookbooks/agents_tracking.ipynbcookbooks/workforce_judge_committee.ipynbcookbooks/ingest_data_from_websites_with_Firecrawl.ipynb+ cookbooks/sft_data_generation_and_unsloth_finetuning.ipynb.. toctree:::maxdepth: 1