DSPy: The framework for programming—not prompting—language models
Python
Make blog formatting easier to read and add usecases
Isaac Miller59a1ec192e95
diff --git a/docs/docs/dspy-usecases.md b/docs/docs/dspy-usecases.mdindex 7f43f3e2a..639936f9f 100644--- a/docs/docs/dspy-usecases.md+++ b/docs/docs/dspy-usecases.md@@ -4,62 +4,58 @@ This list is ever expanding and highly incomplete (WIP)! We'll be adding a bunch## Company Use Cases-| **Name** | **Use Cases** | **Link** |-|--------------------|----------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-| **Normal Computing** | Language specs from chip companies to intermediate languages | [https://www.normalcomputing.com/](https://www.normalcomputing.com/) |-| **Replit** | Synthesize diffs using large pre-trained code LLMs with a few-shot prompt pipeline implemented with DSPy. | [https://blog.replit.com/code-repair](https://blog.replit.com/code-repair) |-| **Haize Labs** | Automated red-teaming for LLMs. | [https://blog.haizelabs.com/posts/dspy/](https://blog.haizelabs.com/posts/dspy/) |-| **Jetblue + Databricks** | Multiple Chatbot Use Cases | [https://www.databricks.com/blog/optimizing-databricks-llm-pipelines-dspy](https://www.databricks.com/blog/optimizing-databricks-llm-pipelines-dspy) |-| **PingCAP** | Building a knowledge graph | [https://www.pingcap.com/article/building-a-graphrag-from-wikipedia-page-using-dspy-openai-and-tidb-vector-database/](https://www.pingcap.com/article/building-a-graphrag-from-wikipedia-page-using-dspy-openai-and-tidb-vector-database/) |-| **Plastic Labs** | Different pipelines within Honcho | [https://blog.plasticlabs.ai/blog/User-State-is-State-of-the-Art](https://blog.plasticlabs.ai/blog/User-State-is-State-of-the-Art) |--TODO: Add--* RadiantLogic AI Data Assistant-* Starops & Saya-* Procure.FYI-* Cybersecurity (Stealth)-* etc+| **Name** | **Use Cases** |+|---|---|+| **[Normal Computing](https://www.normalcomputing.com/)** | Language specs from chip companies to intermediate languages |+| **[Replit](https://replit.com/)** | Synthesize diffs using large pre-trained code LLMs with a few-shot prompt pipeline implemented with DSPy. [Blog](https://blog.replit.com/code-repair) |+| **[Haize Labs](https://www.haizelabs.com/)** | Automated red-teaming for LLMs. [Blog](https://blog.haizelabs.com/posts/dspy/) |+| **[Jetblue](https://www.jetblue.com/) + [Databricks](https://www.databricks.com/)** | Multiple Chatbot Use Cases. [Blog](https://www.databricks.com/blog/optimizing-databricks-llm-pipelines-dspy) |+| **[PingCAP](https://pingcap.com/)** | Building a knowledge graph. [Article](https://www.pingcap.com/article/building-a-graphrag-from-wikipedia-page-using-dspy-openai-and-tidb-vector-database/) |+| **[Plastic Labs](https://www.plasticlabs.ai/)** | Different pipelines within Honcho. [Blog](https://blog.plasticlabs.ai/blog/User-State-is-State-of-the-Art) |+| **[Procure.FYI](https://www.procure.fyi/)** | Process messy, publicly available technology spending and pricing data via DSPy. |+| **[Tessel AI](https://tesselai.com/)** | Enhancing human-machine interaction with data use cases. |+| **[RadiantLogic](https://www.radiantlogic.com/)** | AI Data Assistant. DSPy is used for the agent that routes the query, the context extraction module, the text-to-sql conversion engine, and the table summarization module. |+| **[Starops](https://staropshq.com/) & [Saya](https://heysaya.ai/)** | Building research documents given a user's corpus. Generate prompts to create more articles from example articles. |## Providers and Integrations-| **Name** | **Link** |-|--------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------|-| **Databricks** | [https://www.databricks.com/blog/dspy-databricks](https://www.databricks.com/blog/dspy-databricks) |-| **Zenbase** | [https://zenbase.ai/](https://zenbase.ai/) |-| **Langwatch** | [https://langwatch.ai/blog/introducing-dspy-visualizer](https://langwatch.ai/blog/introducing-dspy-visualizer) |-| **Gradient** | [https://gradient.ai/blog/achieving-gpt-4-level-performance-at-lower-cost-using-dspy](https://gradient.ai/blog/achieving-gpt-4-level-performance-at-lower-cost-using-dspy) |-| **Snowflake** | [https://medium.com/snowflake/dspy-snowflake-140d6d947d73](https://medium.com/snowflake/dspy-snowflake-140d6d947d73) |-| **Langchain** | [https://python.langchain.com/v0.2/docs/integrations/providers/dspy/](https://python.langchain.com/v0.2/docs/integrations/providers/dspy/) |-| **Weaviate** | [https://weaviate.io/blog/dspy-optimizers](https://weaviate.io/blog/dspy-optimizers) |--## Papers, Repos, and Blogs Using DSPy--| **Name** | **Usecase** | **Link** |-|-------------------------|-------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------|-| **SToRM** | Wikipage generation | [https://arxiv.org/abs/2402.14207v1](https://arxiv.org/abs/2402.14207v1) |-| **IReRa** | Extreme reranking | [https://arxiv.org/abs/2401.12178](https://arxiv.org/abs/2401.12178) |-| **Optimizing LM for Text2SQL using DSPy** | Text2SQL | [https://github.com/jjovalle99/DSPy-Text2SQL](https://github.com/jjovalle99/DSPy-Text2SQL) |-| **DSPy PII Masking Demo by Eric Ness** | PII Masking | [https://colab.research.google.com/drive/1KZR1sGTp_RLWUJPAiK1FKPKI-Qn9neUm?usp=sharing](https://colab.research.google.com/drive/1KZR1sGTp_RLWUJPAiK1FKPKI-Qn9neUm?usp=sharing) |-| **The Unreasonable Effectiveness of Eccentric Automatic Prompts** | General Prompt Optimization | [https://arxiv.org/abs/2402.10949v2](https://arxiv.org/abs/2402.10949v2) |--TODO: Add--* Palimpzest-* Agent efficiency optimization from Princeton-* PATH-* EDEN-* etc--## Blogs/Repos about DSPy--| **Name** | **Link** |-|------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------|-| **Why I bet on DSPy** | [https://blog.isaacbmiller.com/posts/dspy](https://blog.isaacbmiller.com/posts/dspy) |--TODO: Add--* Stephen Bryan's-* Content from Weaviate-* Stanford CS 224U material-* etc+| **Name** | **Link** |+|---|---|+| **Databricks** | [https://www.databricks.com/blog/dspy-databricks](https://www.databricks.com/blog/dspy-databricks) |+| **Zenbase** | [https://zenbase.ai/](https://zenbase.ai/) |+| **Langwatch** | [https://langwatch.ai/blog/introducing-dspy-visualizer](https://langwatch.ai/blog/introducing-dspy-visualizer) |+| **Gradient** | [https://gradient.ai/blog/achieving-gpt-4-level-performance-at-lower-cost-using-dspy](https://gradient.ai/blog/achieving-gpt-4-level-performance-at-lower-cost-using-dspy) |+| **Snowflake** | [https://medium.com/snowflake/dspy-snowflake-140d6d947d73](https://medium.com/snowflake/dspy-snowflake-140d6d947d73) |+| **Langchain** | [https://python.langchain.com/v0.2/docs/integrations/providers/dspy/](https://python.langchain.com/v0.2/docs/integrations/providers/dspy/) |+| **Weaviate** | [https://weaviate.io/blog/dspy-optimizers](https://weaviate.io/blog/dspy-optimizers) |++## Papers Using DSPy++| **Name** | **Usecase** |+|---|---|+| **[SToRM](https://arxiv.org/abs/2402.14207v1)** | Wikipage generation |+| **[IReRa](https://arxiv.org/abs/2401.12178)** | Extreme reranking |+| **[The Unreasonable Effectiveness of Eccentric Automatic Prompts](https://arxiv.org/abs/2402.10949v2)** | General Prompt Optimization |+| **[Palimpzest](https://arxiv.org/abs/2405.14696)** | A Declarative System for Optimizing AI Workloads |+| **[AI Agents that Matter](https://arxiv.org/abs/2407.01502v1)** | Agent efficiency optimization |+| **[Prompts as Auto-Optimized Training Hyperparameters (PATH)](https://arxiv.org/abs/2406.11706)** | Training Best-in-Class IR Models from Scratch with 10 Gold Labels |+| **[Empathetic Dialogues for English learning (EDEN)](https://arxiv.org/abs/2406.17982v1)** | Uses adaptive empathetic feedback to improve student grit |++## Repositories about DSPy++| **Name** | **Link** |+|---|---|+| **DSPy PII Masking Demo by Eric Ness** | PII Masking [Colab](https://colab.research.google.com/drive/1KZR1sGTp_RLWUJPAiK1FKPKI-Qn9neUm?usp=sharing) |+| **Optimizing LM for Text2SQL using DSPy** | Text2SQL [Github](https://github.com/jjovalle99/DSPy-Text2SQL) |+| **Homework from Stanford CS 224U** | [Github](https://github.com/cgpotts/cs224u/blob/main/hw_openqa.ipynb) |++## Blogs about DSPy++| **Name** |+|---|+| **[Why I bet on DSPy](https://blog.isaacbmiller.com/posts/dspy)** |+| **[Why I'm excited about DSPy](https://substack.stephen.so/p/why-im-excited-about-dspy)** |++### Weaviate has a directory of 10 amazing notebooks and 6 podcasts!++Huge shoutout to them for the massive support <3. See the [Weaviate DSPy directory](https://weaviate.io/developers/weaviate/more-resources/dspy).