DSPy: The framework for programming—not prompting—language models
Python
Restructure navigation and update documentation (#1703)
Amir Mehre76dd6ac015f
diff --git a/docs/docs/community/community-resources.md b/docs/docs/community/community-resources.mdnew file mode 100644index 000000000..1eb79ee11--- /dev/null+++ b/docs/docs/community/community-resources.md@@ -0,0 +1,56 @@+# Resources++This is the list of tutorials and blog posts on DSPy. If you would like to add your own tutorial, please make a PR.+++## A Few Blogs & Videos on using DSPy++++### Blogs++| **Name** | **Link** |+|---|---|+| **Why I bet on DSPy** | [Blog](https://blog.isaacbmiller.com/posts/dspy) |+| **Not Your Average Prompt Engineering** | [Blog](https://jina.ai/news/dspy-not-your-average-prompt-engineering/) |+| **Why I'm excited about DSPy** | [Blog](https://substack.stephen.so/p/why-im-excited-about-dspy) |+| **Achieving GPT-4 Performance at Lower Cost** | [Link](https://gradient.ai/blog/achieving-gpt-4-level-performance-at-lower-cost-using-dspy) |+| **Prompt engineering is a task best left to AI models** | [Link](https://www.theregister.com/2024/02/22/prompt_engineering_ai_models/) |+| **What makes DSPy a valuable framework for developing complex language model pipelines?** | [Link](https://medium.com/@sujathamudadla1213/what-makes-dspy-a-valuable-framework-for-developing-complex-language-model-pipelines-edfa5b4bcf9b) |+| **DSPy: A new framework to program your foundation models just by prompting** | [Link](https://www.linkedin.com/pulse/dspy-new-framework-program-your-foundation-models-just-prompting-lli4c/) |+| **Intro to DSPy: Goodbye Prompting, Hello Programming** | [Link](https://medium.com/towards-data-science/intro-to-dspy-goodbye-prompting-hello-programming-4ca1c6ce3eb9) |+| **DSPyGen: Revolutionizing AI** | [Link](https://www.linkedin.com/pulse/launch-alert-dspygen-20242252-revolutionizing-ai-sean-chatman--g9f1c/) |+| **Building an AI Assistant with DSPy** | [Link](https://www.linkedin.com/pulse/building-ai-assistant-dspy-valliappa-lakshmanan-vgnsc/) |+++### Videos+| **Name** | **Link** |+|---|---|+| **DSPy Explained! (60K views)** | [Link](https://www.youtube.com/watch?v=41EfOY0Ldkc) |+| **DSPy Intro from Sephora (25K views)** | [Link](https://www.youtube.com/watch?v=D2HurSldDkE) |+| **Structured Outputs with DSPy** | [Link](https://www.youtube.com/watch?v=tVw3CwrN5-8) |+| **DSPy and ColBERT - Weaviate Podcast** | [Link](https://www.youtube.com/watch?v=CDung1LnLbY) |+| **SBTB23 DSPy** | [Link](https://www.youtube.com/watch?v=Dt3H2ninoeY) |+| **Optimization with DSPy and LangChain** | [Link](https://www.youtube.com/watch?v=4EXOmWeqXRc) |+| **Automated Prompt Engineering + Visualization** | [Link](https://www.youtube.com/watch?v=eAZ2LtJ6D5k) |+| **Transforming LM Calls into Pipelines** | [Link](https://www.youtube.com/watch?v=NoaDWKHdkHg) |+| **NeurIPS Hacker Cup: DSPy for Code Gen** | [Link](https://www.youtube.com/watch?v=gpe-rtJN8z8) |+| **MIPRO and DSPy - Weaviate Podcast** | [Link](https://www.youtube.com/watch?v=skMH3DOV_UQ) |+| **Getting Started with RAG in DSPy** | [Link](https://www.youtube.com/watch?v=CEuUG4Umfxs) |+| **Adding Depth to DSPy Programs** | [Link](https://www.youtube.com/watch?v=0c7Ksd6BG88) |+| **Programming Foundation Models with DSPy** | [Link](https://www.youtube.com/watch?v=Y94tw4eDHW0) |+| **DSPy End-to-End: SF Meetup** | [Link](https://www.youtube.com/watch?v=Y81DoFmt-2U) |+| **Monitoring & Tracing DSPy with Langtrace** | [Link](https://langtrace.ai/blog/announcing-dspy-support-in-langtrace) |+| **Teaching chat models to solve chess puzzles using DSPy + Finetuning** | [Link](https://raw.sh/posts/chess_puzzles) |+++### Podcasts++Weaviate has a directory of 10 amazing notebooks and 6 podcasts!+Huge shoutout to them for the massive support ❤️. See the [Weaviate DSPy directory](https://weaviate.io/developers/weaviate/more-resources/dspy).+++TODO: This list in particular is highly incomplete. There are dozens of other good ones. To allow space, divide into opintionated blogs / podcasts / interviews vs. tutorials & talks.++Credit: Some of these resources were originally compiled in the [Awesome DSPy](https://github.com/ganarajpr/awesome-dspy/tree/master) repo.+diff --git a/docs/docs/community/how-to-contribute.md b/docs/docs/community/how-to-contribute.mdnew file mode 100644index 000000000..2a404a62c--- /dev/null+++ b/docs/docs/community/how-to-contribute.md@@ -0,0 +1,12 @@+## Development Setup++We are working on a development setup guide. If you're interested in contributing, please reach out to us on Discord.++## Contributing++**What if I have a better idea for prompting or synthetic data generation?** Perfect. We encourage you to think if it's best expressed as a module or an optimizer, and we'd love to merge it in DSPy so everyone can use it. DSPy is not a complete project; it's an ongoing effort to create structure (modules and optimizers) in place of hacky prompt and pipeline engineering tricks.++**How can I add my favorite LM or vector store?**++Check out these walkthroughs on setting up a [Custom LM client](/deep-dive/language_model_clients/custom-lm-client) and [Custom RM client](/deep-dive/retrieval_models_clients/custom-rm-client).+diff --git a/docs/docs/community/use-cases.md b/docs/docs/community/use-cases.mdnew file mode 100644index 000000000..bbdf3fbe4--- /dev/null+++ b/docs/docs/community/use-cases.md@@ -0,0 +1,107 @@+# Use Cases++We often get questions like "How are people using DSPy in practice?", both in production and for research. This list was created to collect a few pointers and to encourage others in the community to add their own work below.++This list is ever expanding and highly incomplete (WIP)! We'll be adding a bunch more. If you would like to add your product or research to this list, please make a PR.++## A Few Company Use Cases++| **Name** | **Use Cases** |+|---|---|+| **[JetBlue](https://www.jetblue.com/)** | Multiple chatbot use cases. [Blog](https://www.databricks.com/blog/optimizing-databricks-llm-pipelines-dspy) |+| **[Replit](https://replit.com/)** | Synthesize diffs using code LLMs using a DSPy pipeline. [Blog](https://blog.replit.com/code-repair) |+| **[Databricks](https://www.databricks.com/)** | Research, products, and customer solutions around LM Judges, RAG, classification, and other applications. [Blog](https://www.databricks.com/blog/dspy-databricks) [Blog II](https://www.databricks.com/customers/ddi) |+| **[Sephora](https://www.sephora.com/)** | Undisclosed agent usecases; perspectives shared in [DAIS Session](https://www.youtube.com/watch?v=D2HurSldDkE). |+| **[Zoro UK](https://www.zoro.co.uk/)** | E-commerce applications around structured shopping. [Portkey Session](https://www.youtube.com/watch?v=_vGKSc1tekE) |+| **[VMware](https://www.vmware.com/)** | RAG and other prompt optimization applications. [Interview in The Register.](https://www.theregister.com/2024/02/22/prompt_engineering_ai_models/) [Business Insider.](https://www.businessinsider.com/chaptgpt-large-language-model-ai-prompt-engineering-automated-optimizer-2024-3) |+| **[Haize Labs](https://www.haizelabs.com/)** | Automated red-teaming for LLMs. [Blog](https://blog.haizelabs.com/posts/dspy/) |+| **[Plastic Labs](https://www.plasticlabs.ai/)** | Different pipelines within Honcho. [Blog](https://blog.plasticlabs.ai/blog/User-State-is-State-of-the-Art) |+| **[PingCAP](https://pingcap.com/)** | Building a knowledge graph. [Article](https://www.pingcap.com/article/building-a-graphrag-from-wikipedia-page-using-dspy-openai-and-tidb-vector-database/) |+| **[Salomatic](https://langtrace.ai/blog/case-study-how-salomatic-used-langtrace-to-build-a-reliable-medical-report-generation-system)** | Enriching medical reports using DSPy. [Blog](https://langtrace.ai/blog/case-study-how-salomatic-used-langtrace-to-build-a-reliable-medical-report-generation-system) |+| **[Truelaw](https://www.youtube.com/watch?v=O0F3RAWZNfM)** | How Truelaw builds bespoke LLM pipelines for law firms using DSPy. [Podcast](https://www.youtube.com/watch?v=O0F3RAWZNfM) |+| **[Moody's](https://www.moodys.com/)** | Leveraging DSPy to optimize RAG systems, LLM-as-a-Judge, and agentic systems for financial workflows. |+| **[Normal Computing](https://www.normalcomputing.com/)** | Translate specs from chip companies from English to intermediate formal languages |+| **[Procure.FYI](https://www.procure.fyi/)** | Process messy, publicly available technology spending and pricing data via DSPy. |+| **[RadiantLogic](https://www.radiantlogic.com/)** | AI Data Assistant. DSPy is used for the agent that routes the query, the context extraction module, the text-to-sql conversion engine, and the table summarization module. |+| **[Raia](https://raiahealth.com/)** | Using DSPy for AI-powered Personal Healthcare Agents. |+| **[Hyperlint](https://hyperlint.com)** | Uses DSPy to generate technical documentation. DSPy helps to fetch relevant information and synthesize that into tutorials. |+| **[Starops](https://staropshq.com/) & [Saya](https://heysaya.ai/)** | Building research documents given a user's corpus. Generate prompts to create more articles from example articles. |+| **[Tessel AI](https://tesselai.com/)** | Enhancing human-machine interaction with data use cases. |+| **[Dicer.ai](https://dicer.ai/)** | Uses DSPy for marketing AI to get the most from their paid ads. |+| **[Howie](https://howie.ai)** | Using DSPy to automate meeting scheduling through email. |+| **[Isoform.ai](https://isoform.ai)** | Building custom integrations using DSPy. |+| **[Trampoline AI](https://trampoline.ai)** | Uses DSPy to power their data-augmentation and LM pipelines. |+| **[Pretrain](https://pretrain.com)** | Uses DSPy to automatically optimize AI performance towards user-defined tasks based on uploaded examples. |++WIP. This list mainly includes companies that have public posts or have OKed being included for specific products so far.+++## A Few Papers Using DSPy++| **Name** | **Description** |+|---|---|+| **[STORM](https://arxiv.org/abs/2402.14207)** | Writing Wikipedia-like Articles From Scratch. |+| **[PATH](https://arxiv.org/abs/2406.11706)** | Prompts as Auto-Optimized Training Hyperparameters: Training Best-in-Class IR Models from Scratch with 10 Gold Labels |+| **[WangLab @ MEDIQA](https://arxiv.org/abs/2404.14544)** | UofT's winning system at MEDIQA, outperforms the next best system by 20 points |+| **[UMD's Suicide Detection System](https://arxiv.org/abs/2406.06608)** | Outperforms 20-hour expert human prompt engineering by 40% |+| **[IReRa](https://arxiv.org/abs/2401.12178)** | Infer-Retrieve-Rank: Extreme Classification with > 10,000 Labels |+| **[Unreasonably Effective Eccentric Prompts](https://arxiv.org/abs/2402.10949v2)** | General Prompt Optimization |+| **[Palimpzest](https://arxiv.org/abs/2405.14696)** | A Declarative System for Optimizing AI Workloads |+| **[AI Agents that Matter](https://arxiv.org/abs/2407.01502v1)** | Agent Efficiency Optimization |+| **[EDEN](https://arxiv.org/abs/2406.17982v1)** | Empathetic Dialogues for English Learning: Uses adaptive empathetic feedback to improve student grit |+| **[ECG-Chat](https://arxiv.org/pdf/2408.08849)** | Uses DSPy with GraphRAG for medical report generation |+| **[DSPy Assertions](https://arxiv.org/abs/2312.13382)** | Various applications of imposing hard and soft constraints on LM outputs |+| **[DSPy Guardrails](https://boxiyu.github.io/assets/pdf/DSPy_Guardrails.pdf)** | Reduce the attack success rate of CodeAttack, decreasing from 75% to 5% |+| **[Co-STORM](https://arxiv.org/pdf/2408.15232)** | Collaborative STORM: Generate Wikipedia-like articles through collaborative discourse among users and multiple LM agents |++## A Few Repositories (or other OSS examples) using DSPy++| **Name** | **Description/Link** |+|---|---|+| **Stanford CS 224U Homework** | [Github](https://github.com/cgpotts/cs224u/blob/main/hw_openqa.ipynb) |+| **STORM Report Generation (10,000 GitHub stars)** | [Github](https://github.com/stanford-oval/storm) |+| **DSPy Redteaming** | [Github](https://github.com/haizelabs/dspy-redteam) |+| **DSPy Theory of Mind** | [Github](https://github.com/plastic-labs/dspy-opentom) |+| **Indic cross-lingual Natural Language Inference** | [Github](https://github.com/saifulhaq95/DSPy-Indic/blob/main/indicxlni.ipynb) |+| **Optimizing LM for Text2SQL using DSPy** | [Github](https://github.com/jjovalle99/DSPy-Text2SQL) |+| **DSPy PII Masking Demo by Eric Ness** | [Colab](https://colab.research.google.com/drive/1KZR1sGTp_RLWUJPAiK1FKPKI-Qn9neUm?usp=sharing) |+| **DSPy on BIG-Bench Hard Example** | [Github](https://drchrislevy.github.io/posts/dspy/dspy.html) |+| **Building a chess playing agent using DSPy** | [Github](https://medium.com/thoughts-on-machine-learning/building-a-chess-playing-agent-using-dspy-9b87c868f71e) |+| **Ittia Research Fact Checking** | [Github](https://github.com/ittia-research/check) |+| **Strategic Debate via Tree-of-Thought** | [Github](https://github.com/zbambergerNLP/strategic-debate-tot) |+| **Sanskrit to English Translation App**| [Github](https://github.com/ganarajpr/sanskrit-translator-dspy) |+| **DSPy for extracting features from PDFs on arXiv**| [Github](https://github.com/S1M0N38/dspy-arxiv) |+| **DSPygen: DSPy in Ruby on Rails**| [Github](https://github.com/seanchatmangpt/dspygen) |+| **DSPy Inspector**| [Github](https://github.com/Neoxelox/dspy-inspector) |+| **DSPy with FastAPI**| [Github](https://github.com/diicellman/dspy-rag-fastapi) |+| **DSPy for Indian Languages**| [Github](https://github.com/saifulhaq95/DSPy-Indic) |+| **Hurricane: Blog Posts with Generative Feedback Loops!**| [Github](https://github.com/weaviate-tutorials/Hurricane) |+| **RAG example using DSPy, Gradio, FastAPI, and Ollama**| [Github](https://github.com/diicellman/dspy-gradio-rag) |+| **Synthetic Data Generation**| [Github](https://colab.research.google.com/drive/1CweVOu0qhTC0yOfW5QkLDRIKuAuWJKEr?usp=sharing) |+| **Self Discover**| [Github](https://colab.research.google.com/drive/1GkAQKmw1XQgg5UNzzy8OncRe79V6pADB?usp=sharing) |++TODO: This list in particular is highly incomplete. There are a couple dozen other good ones.++## A Few Providers, Integrations, and related Blog Releases++| **Name** | **Link** |+|---|---|+| **Databricks** | [Link](https://www.databricks.com/blog/dspy-databricks) |+| **Zenbase** | [Link](https://zenbase.ai/) |+| **LangWatch** | [Link](https://langwatch.ai/blog/introducing-dspy-visualizer) |+| **Gradient** | [Link](https://gradient.ai/blog/achieving-gpt-4-level-performance-at-lower-cost-using-dspy) |+| **Snowflake** | [Link](https://medium.com/snowflake/dspy-snowflake-140d6d947d73) |+| **Langchain** | [Link](https://python.langchain.com/v0.2/docs/integrations/providers/dspy/) |+| **Weaviate** | [Link](https://weaviate.io/blog/dspy-optimizers) |+| **Qdrant** | [Link](https://qdrant.tech/documentation/frameworks/dspy/) |+| **Weights & Biases Weave** | [Link](https://weave-docs.wandb.ai/guides/integrations/dspy/) |+| **Milvus** | [Link](https://milvus.io/docs/integrate_with_dspy.md) |+| **Neo4j** | [Link](https://neo4j.com/labs/genai-ecosystem/dspy/) |+| **Lightning AI** | [Link](https://lightning.ai/lightning-ai/studios/dspy-programming-with-foundation-models) |+| **Haystack** | [Link](https://towardsdatascience.com/automating-prompt-engineering-with-dspy-and-haystack-926a637a3f43) |+| **Arize** | [Link](https://docs.arize.com/phoenix/tracing/integrations-tracing/dspy) |+| **LlamaIndex** | [Link](https://github.com/stanfordnlp/dspy/blob/main/examples/llamaindex/dspy_llamaindex_rag.ipynb) |+| **Langtrace** | [Link](https://docs.langtrace.ai/supported-integrations/llm-frameworks/dspy) |+| **Langfuse** | [Link](https://langfuse.com/docs/integrations/dspy) |++Credit: Some of these resources were originally compiled in the [Awesome DSPy](https://github.com/ganarajpr/awesome-dspy/tree/master) repo.diff --git a/docs/docs/faqs.md b/docs/docs/faqs.mdindex 5f38a74c9..2379b714d 100644--- a/docs/docs/faqs.md+++ b/docs/docs/faqs.md@@ -165,11 +165,3 @@ with dspy.context(backoff_time = ..):```At times, DSPy may have hard-coded arguments that are not relevant for your compatible, in which case, please free to open a PR alerting this or comment out these default settings for your usage.--## Contributing--**What if I have a better idea for prompting or synthetic data generation?** Perfect. We encourage you to think if it's best expressed as a module or an optimizer, and we'd love to merge it in DSPy so everyone can use it. DSPy is not a complete project; it's an ongoing effort to create structure (modules and optimizers) in place of hacky prompt and pipeline engineering tricks.--**How can I add my favorite LM or vector store?**--Check out these walkthroughs on setting up a [Custom LM client](/deep-dive/language_model_clients/custom-lm-client) and [Custom RM client](/deep-dive/retrieval_models_clients/custom-rm-client).diff --git a/docs/docs/intro.md b/docs/docs/intro.mdindex 690734b6a..a4bbe2b54 100644--- a/docs/docs/intro.md+++ b/docs/docs/intro.md@@ -1,8 +1,12 @@---sidebar_position: 1+hide:+ - toc+ - navigation+----# About DSPy+# DSPydiff --git a/docs/mkdocs.yml b/docs/mkdocs.ymlindex b0970381b..7e503ff9c 100644--- a/docs/mkdocs.yml+++ b/docs/mkdocs.yml@@ -6,47 +6,47 @@ repo_name: stanfordnlp/dspyedit_uri: edit/main/docs/docs/docs_dir: 'docs/'nav:- - About DSPy: intro.md- - Getting Started:- - Quick Start:- - Installation: quick-start/installation.md- - Getting Started I: quick-start/getting-started-01.md- - Getting Started II: quick-start/getting-started-02.md- - Building Blocks:- - DSPy in 8 Steps: building-blocks/solving_your_task.md- - Language Models: building-blocks/1-language_models.md- - Signatures: building-blocks/2-signatures.md- - Modules: building-blocks/3-modules.md- - Data: building-blocks/4-data.md- - Metrics: building-blocks/5-metrics.md- - Optimizers: building-blocks/6-optimizers.md- - Assertions: building-blocks/7-assertions.md- - Typed Predictors: building-blocks/8-typed_predictors.md+ - Home:+ - intro.md+ - Quick Start:+ - Installation: quick-start/installation.md+ - Quick Start: quick-start/getting-started-01.md+ - Build your first pipeline: quick-start/getting-started-02.md- Tutorials:- Retrieval Augmented Generation: tutorials/rag.md- Multi-Hop QA: tutorials/simplified-baleen.md- Summarization: tutorials/summarization.md- Additional Resources: tutorials/other_tutorial.md- Examples: tutorials/examples.md- - Concepts:+ - Components:+ - Overview: building-blocks/solving_your_task.md+ - Signatures:+ - Overview: building-blocks/2-signatures.md+ - Understanding Signatures: deep-dive/signature/understanding-signatures.md+ - Executing Signatures: deep-dive/signature/executing-signatures.md- Data Handling:+ - Overview: building-blocks/4-data.md- Examples in DSPy: deep-dive/data-handling/examples.md- Utilizing Built-in Datasets: deep-dive/data-handling/built-in-datasets.md- Creating Custom Dataset: deep-dive/data-handling/loading-custom-data.md- - Signatures:- - Understanding Signatures: deep-dive/signature/understanding-signatures.md- - Executing Signatures: deep-dive/signature/executing-signatures.md- Modules:+ - Overview: building-blocks/3-modules.md- Predict: deep-dive/modules/predict.md+ - Typed Predictors: building-blocks/8-typed_predictors.md- ChainOfThought: deep-dive/modules/chain-of-thought.md- ChainOfThoughtwithHint: deep-dive/modules/chain-of-thought-with-hint.md- ReAct: deep-dive/modules/react.md- MultiChainComparison: deep-dive/modules/multi-chain-comparison.md- ProgramOfThought: deep-dive/modules/program-of-thought.md- # - Assertions: deep-dive/modules/assertions.md+ - Assertions: deep-dive/modules/assertions.md- Retreive: deep-dive/modules/retrieve.md- Modules Guide: deep-dive/modules/guide.md- - Optimizers (formerly Teleprompters):+ - Metrics and Assertions:+ - Overview: building-blocks/7-assertions.md+ - Metrics: building-blocks/5-metrics.md+ - Assertions: deep-dive/assertions.md+ - Optimizers:+ - Overview: building-blocks/6-optimizers.md- LabeledFewShot: deep-dive/optimizers/LabeledFewShot.md- BootstrapFewShot: deep-dive/optimizers/bootstrap-fewshot.md- BootstrapFinetune: deep-dive/optimizers/BootstrapFinetune.md@@ -54,8 +54,8 @@ nav:- BFRS: deep-dive/optimizers/bfrs.md- CoPro: deep-dive/optimizers/copro.md- MIProV2: deep-dive/optimizers/miprov2.md- - Assertions: deep-dive/assertions.md- Language Model Clients:+ - Overview: building-blocks/1-language_models.md- Local Language Model Clients:- HFClientTGI: deep-dive/language_model_clients/lm_local_models/HFClientTGI.md- HFClientVLLM: deep-dive/language_model_clients/lm_local_models/HFClientVLLM.md@@ -81,16 +81,24 @@ nav:- WatsonDiscovery: deep-dive/retrieval_models_clients/WatsonDiscovery.md- WeaviateRM: deep-dive/retrieval_models_clients/WeaviateRM.md- YouRM: deep-dive/retrieval_models_clients/YouRM.md- - FAQ: faqs.md++ - Community:+ - Community Resources: community/tutorials.md+ - Use Cases: community/related-projects.md+ - Contributing:+ - Roadmap: roadmap.md+ - How to get involved: community/how-to-contribute.md+ - FAQ & Troubleshooting: faqs.md- Cheatsheet: cheatsheet.md- - DSPy Usecases: dspy-usecases.mdtheme:name: materialcustom_dir: overridesfeatures:- navigation.tabs- - toc.integrate+ - navigation.path+ - navigation.indexes+ - toc.follow- navigation.top- search.suggest- search.highlight@@ -133,12 +141,12 @@ plugins:'docs/intro.md': 'intro.md''docs/intro/index.md': 'intro.md'-+# Quick Start redirects'docs/quick-start/installation.md': 'quick-start/installation.md''docs/quick-start/getting-started-01.md': 'quick-start/getting-started-01.md''docs/quick-start/getting-started-02.md': 'quick-start/getting-started-02.md'-+# Building Blocks redirects'docs/building-blocks/solving_your_task.md': 'building-blocks/solving_your_task.md''docs/building-blocks/1-language_models.md': 'building-blocks/1-language_models.md'@@ -160,7 +168,7 @@ plugins:'docs/building-blocks/optimizers.md': 'building-blocks/6-optimizers.md''docs/building-blocks/assertions.md': 'building-blocks/7-assertions.md''docs/building-blocks/typed_predictors.md': 'building-blocks/8-typed_predictors.md'-+# Tutorials redirects'docs/tutorials/rag.md': 'tutorials/rag.md''docs/tutorials/simplified-baleen.md': 'tutorials/simplified-baleen.md'@@ -185,6 +193,8 @@ plugins:'docs/deep-dive/modules/react.md': 'deep-dive/modules/react.md''docs/deep-dive/modules/multi-chain-comparison.md': 'deep-dive/modules/multi-chain-comparison.md''docs/deep-dive/modules/program-of-thought.md': 'deep-dive/modules/program-of-thought.md'+ 'docs/deep-dive/modules/assertions.md': 'building-blocks/7-assertions.md'+ 'deep-dive/modules/assertions.md': 'building-blocks/7-assertions.md''docs/deep-dive/modules/retrieve.md': 'deep-dive/modules/retrieve.md''docs/deep-dive/modules/guide.md': 'deep-dive/modules/guide.md'@@ -214,10 +224,10 @@ plugins:'docs/deep-dive/retrieval_models_clients/WatsonDiscovery.md': 'deep-dive/retrieval_models_clients/WatsonDiscovery.md''docs/deep-dive/retrieval_models_clients/WeaviateRM.md': 'deep-dive/retrieval_models_clients/WeaviateRM.md''docs/deep-dive/retrieval_models_clients/YouRM.md': 'deep-dive/retrieval_models_clients/YouRM.md'-+# Assertions'docs/deep-dive/assertions.md': 'deep-dive/assertions.md'-+# Teleprompters'docs/deep-dive/optimizers/LabeledFewShot.md': 'deep-dive/optimizers/LabeledFewShot.md''docs/deep-dive/optimizers/bootstrap-fewshot.md': 'deep-dive/optimizers/bootstrap-fewshot.md'@@ -226,12 +236,13 @@ plugins:'docs/deep-dive/optimizers/bfrs.md': 'deep-dive/optimizers/bfrs.md''docs/deep-dive/optimizers/copro.md': 'deep-dive/optimizers/copro.md''docs/deep-dive/optimizers/miprov2.md': 'deep-dive/optimizers/miprov2.md'-+# Additional pages redirects'docs/faqs.md': 'faqs.md''docs/cheatsheet.md': 'cheatsheet.md''docs/dspy-usecases.md': 'dspy-usecases.md'+extra:social:- icon: fontawesome/brands/github@@ -262,4 +273,4 @@ markdown_extensions:emoji_generator: !!python/name:materialx.emoji.to_svgcopyright: |- © 2024 <a href="https://github.com/stanfordnlp" target="_blank" rel="noopener">Stanford NLP</a>\ No newline at end of file+ © 2024 <a href="https://github.com/stanfordnlp" target="_blank" rel="noopener">Stanford NLP</a>