Skip to content

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

Add SageMaker as a LLM provider (#1947)

Bobby Lindseye27a15023c81
diff --git a/docs/concepts/llms.mdx b/docs/concepts/llms.mdx
index 851e93085..261a1fdd8 100644
--- a/docs/concepts/llms.mdx
+++ b/docs/concepts/llms.mdx
@@ -243,6 +243,9 @@ There are three ways to configure LLMs in CrewAI. Choose the method that best fi
# llm: bedrock/amazon.titan-text-express-v1
# llm: bedrock/meta.llama2-70b-chat-v1
+ # Amazon SageMaker Models - Enterprise-grade
+ # llm: sagemaker/<my-endpoint>
+
# Mistral Models - Open source alternative
# llm: mistral/mistral-large-latest
# llm: mistral/mistral-medium-latest
@@ -506,6 +509,21 @@ Learn how to get the most out of your LLM configuration:
)
```
</Accordion>
+
+ <Accordion title="Amazon SageMaker">
+ ```python Code
+ AWS_ACCESS_KEY_ID=<your-access-key>
+ AWS_SECRET_ACCESS_KEY=<your-secret-key>
+ AWS_DEFAULT_REGION=<your-region>
+ ```
+
+ Example usage:
+ ```python Code
+ llm = LLM(
+ model="sagemaker/<my-endpoint>"
+ )
+ ```
+ </Accordion>
<Accordion title="Mistral">
```python Code