The agent engineering platform.
Python agentsaiai-agentsanthropicchatgptdeepagentsenterpriseframeworkgeminigenerative-ailangchainlanggraphllmmultiagentopen-sourceopenaipydanticpythonragtypescript
docs[patch]: update AWS integration docs (#25631)
ccurme67b6e6c2e3a2
diff --git a/docs/docs/integrations/chat/bedrock.ipynb b/docs/docs/integrations/chat/bedrock.ipynbindex f20196029e..28083f0434 100644--- a/docs/docs/integrations/chat/bedrock.ipynb+++ b/docs/docs/integrations/chat/bedrock.ipynb@@ -95,7 +95,7 @@},{"cell_type": "code",- "execution_count": 4,+ "execution_count": 1,"id": "cb09c344-1836-4e0c-acf8-11d13ac1dbae","metadata": {},"outputs": [],@@ -223,34 +223,28 @@"id": "d1ee55bc-ffc8-4cfa-801c-993953a08cfd","metadata": {},"source": [- "## ***Beta***: Bedrock Converse API\n",+ "## Bedrock Converse API\n","\n",- "AWS has recently recently the Bedrock Converse API which provides a unified conversational interface for Bedrock models. This API does not yet support custom models. You can see a list of all [models that are supported here](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html). To improve reliability the ChatBedrock integration will switch to using the Bedrock Converse API as soon as it has feature parity with the existing Bedrock API. Until then a separate [ChatBedrockConverse](https://api.python.langchain.com/en/latest/chat_models/langchain_aws.chat_models.bedrock_converse.ChatBedrockConverse.html#langchain_aws.chat_models.bedrock_converse.ChatBedrockConverse) integration has been released in beta for users who do not need to use custom models.\n",+ "AWS has recently released the Bedrock Converse API which provides a unified conversational interface for Bedrock models. This API does not yet support custom models. You can see a list of all [models that are supported here](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html). To improve reliability the ChatBedrock integration will switch to using the Bedrock Converse API as soon as it has feature parity with the existing Bedrock API. Until then a separate [ChatBedrockConverse](https://python.langchain.com/v0.2/api_reference/aws/chat_models/langchain_aws.chat_models.bedrock_converse.ChatBedrockConverse.html) integration has been released.\n",+ "\n",+ "We recommend using `ChatBedrockConverse` for users who do not need to use custom models.\n","\n","You can use it like so:"]},{"cell_type": "code",- "execution_count": 8,+ "execution_count": 3,"id": "ae728e59-94d4-40cf-9d24-25ad8723fc59","metadata": {},"outputs": [- {- "name": "stderr",- "output_type": "stream",- "text": [- "/Users/bagatur/langchain/libs/core/langchain_core/_api/beta_decorator.py:87: LangChainBetaWarning: The class `ChatBedrockConverse` is in beta. It is actively being worked on, so the API may change.\n",- " warn_beta(\n"- ]- },{"data": {"text/plain": [- "AIMessage(content=\"Voici la traduction en français :\\n\\nJ'aime la programmation.\", response_metadata={'ResponseMetadata': {'RequestId': '122fb1c8-c3c5-4b06-941e-c95d210bfbc7', 'HTTPStatusCode': 200, 'HTTPHeaders': {'date': 'Mon, 01 Jul 2024 21:48:25 GMT', 'content-type': 'application/json', 'content-length': '243', 'connection': 'keep-alive', 'x-amzn-requestid': '122fb1c8-c3c5-4b06-941e-c95d210bfbc7'}, 'RetryAttempts': 0}, 'stopReason': 'end_turn', 'metrics': {'latencyMs': 830}}, id='run-0e3df22f-fcd8-4fbb-a4fb-565227e7e430-0', usage_metadata={'input_tokens': 29, 'output_tokens': 21, 'total_tokens': 50})"+ "AIMessage(content=\"Voici la traduction en français :\\n\\nJ'aime la programmation.\", response_metadata={'ResponseMetadata': {'RequestId': '4fcbfbe9-f916-4df2-b0bd-ea1147b550aa', 'HTTPStatusCode': 200, 'HTTPHeaders': {'date': 'Wed, 21 Aug 2024 17:23:49 GMT', 'content-type': 'application/json', 'content-length': '243', 'connection': 'keep-alive', 'x-amzn-requestid': '4fcbfbe9-f916-4df2-b0bd-ea1147b550aa'}, 'RetryAttempts': 0}, 'stopReason': 'end_turn', 'metrics': {'latencyMs': 672}}, id='run-77ee9810-e32b-45dc-9ccb-6692253b1f45-0', usage_metadata={'input_tokens': 29, 'output_tokens': 21, 'total_tokens': 50})"]},- "execution_count": 8,+ "execution_count": 3,"metadata": {},"output_type": "execute_result"}@@ -268,6 +262,87 @@"llm.invoke(messages)"]},+ {+ "cell_type": "markdown",+ "id": "4da16f3e-e80b-48c0-8036-c1cc5f7c8c05",+ "metadata": {},+ "source": [+ "### Streaming\n",+ "\n",+ "Note that `ChatBedrockConverse` emits content blocks while streaming:"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": 6,+ "id": "7794b32e-d8de-4973-bf0f-39807dc745f0",+ "metadata": {},+ "outputs": [+ {+ "name": "stdout",+ "output_type": "stream",+ "text": [+ "content=[] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': 'Vo', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': 'ici', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': ' la', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': ' tra', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': 'duction', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': ' en', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': ' français', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': ' :', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': '\\n\\nJ', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': \"'\", 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': 'a', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': 'ime', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': ' la', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': ' programm', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': 'ation', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'type': 'text', 'text': '.', 'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[{'index': 0}] id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[] response_metadata={'stopReason': 'end_turn'} id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8'\n",+ "content=[] response_metadata={'metrics': {'latencyMs': 713}} id='run-2c92c5af-d771-4cc2-98d9-c11bbd30a1d8' usage_metadata={'input_tokens': 29, 'output_tokens': 21, 'total_tokens': 50}\n"+ ]+ }+ ],+ "source": [+ "for chunk in llm.stream(messages):\n",+ " print(chunk)"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "0ef05abb-9c04-4dc3-995e-f857779644d5",+ "metadata": {},+ "source": [+ "An output parser can be used to filter to text, if desired:"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": 8,+ "id": "2a4e743f-ea7d-4e5a-9b12-f9992362de8b",+ "metadata": {},+ "outputs": [+ {+ "name": "stdout",+ "output_type": "stream",+ "text": [+ "|Vo|ici| la| tra|duction| en| français| :|\n",+ "\n",+ "J|'|a|ime| la| programm|ation|.||||"+ ]+ }+ ],+ "source": [+ "from langchain_core.output_parsers import StrOutputParser\n",+ "\n",+ "chain = llm | StrOutputParser()\n",+ "\n",+ "for chunk in chain.stream(messages):\n",+ " print(chunk, end=\"|\")"+ ]+ },{"cell_type": "markdown","id": "3a5bb5ca-c3ae-4a58-be67-2cd18574b9a3",@@ -297,7 +372,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.11.9"+ "version": "3.10.4"}},"nbformat": 4,diff --git a/docs/docs/integrations/platforms/aws.mdx b/docs/docs/integrations/platforms/aws.mdxindex 601ef5c75d..da22219b0a 100755--- a/docs/docs/integrations/platforms/aws.mdx+++ b/docs/docs/integrations/platforms/aws.mdx@@ -34,6 +34,15 @@ See a [usage example](/docs/integrations/chat/bedrock).from langchain_aws import ChatBedrock```+### Bedrock Converse+AWS has recently released the Bedrock Converse API which provides a unified conversational interface for Bedrock models. This API does not yet support custom models. You can see a list of all [models that are supported here](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html). To improve reliability the ChatBedrock integration will switch to using the Bedrock Converse API as soon as it has feature parity with the existing Bedrock API. Until then a separate [ChatBedrockConverse](https://python.langchain.com/v0.2/api_reference/aws/chat_models/langchain_aws.chat_models.bedrock_converse.ChatBedrockConverse.html) integration has been released.++We recommend using `ChatBedrockConverse` for users who do not need to use custom models. See the [docs](/docs/integrations/chat/bedrock/#bedrock-converse-api) and [API reference](https://python.langchain.com/v0.2/api_reference/aws/chat_models/langchain_aws.chat_models.bedrock_converse.ChatBedrockConverse.html) for more detail.++```python+from langchain_aws import ChatBedrockConverse+```+## LLMs### Bedrock