Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
Python agentagentopsagents-sdkaianthropicautogencost-estimationcrewaievalsevaluation-metricsgroqlangchainllmmistralollamaopenaiopenai-agents
fix: Updated examples and relevant integrations & examples in the documentation pages (#1029)
Pratyush Shukla92c621e11e7d
diff --git a/.github/workflows/add-notebook-examples-to-docs.yml b/.github/workflows/add-notebook-examples-to-docs.ymlindex 176f2d6c..f54ad092 100644--- a/.github/workflows/add-notebook-examples-to-docs.yml+++ b/.github/workflows/add-notebook-examples-to-docs.yml@@ -4,11 +4,11 @@ on:push:branches:- main+ # TODO: Remove this branch once the workflow is stable+ - fix/examples-cleanuppaths:- 'examples/**'- - 'docs/v1/examples/**'- - '.github/workflows/add-notebook-examples-to-docs.yml'-+ - 'docs/v2/examples/**'workflow_dispatch:permissions:@@ -21,6 +21,8 @@ jobs:steps:- name: Checkout repositoryuses: actions/checkout@v3+ with:+ fetch-depth: 0- name: Set up Pythonuses: actions/setup-python@v4@@ -28,42 +30,109 @@ jobs:python-version: '3.x'- name: Install dependencies- run: |- pip install jupyter nbconvert+ run: pip install jupyter nbconvert- - name: Convert notebooks to markdown and add to docs+ - name: Detect and process notebooks+ id: processrun: |- set -x # Enable debug mode- for file in docs/v1/examples/*.mdx; do- echo "Processing file: $file"- source_file=$(grep -oP '(?<=\{/\* SOURCE_FILE: ).*(?= \*/\})' "$file" || true)- if [[ -z "$source_file" ]]; then- continue+ # Determine comparison range+ case "${{ github.event_name }}" in+ "push")+ BASE_SHA="${{ github.event.before }}"+ [[ "$BASE_SHA" == "0000000000000000000000000000000000000000" ]] && BASE_SHA="$(git hash-object -t tree /dev/null)"+ HEAD_SHA="${{ github.event.after }}"+ ;;+ "pull_request")+ BASE_SHA="${{ github.event.pull_request.base.sha }}"+ HEAD_SHA="${{ github.event.pull_request.head.sha }}"+ ;;+ "workflow_dispatch")+ git fetch origin "${{ github.event.repository.default_branch }}" --depth=50+ BASE_SHA="origin/${{ github.event.repository.default_branch }}"+ HEAD_SHA="HEAD"+ ;;+ *)+ exit 1+ ;;+ esac++ # Get changed files and filter in one pass+ CHANGED_FILES=$(git diff --name-only "$BASE_SHA" "$HEAD_SHA")++ # Use arrays for better performance+ declare -A notebooks_set++ # Process notebooks directly from changed files+ while IFS= read -r file; do+ if [[ "$file" =~ ^examples/.*\.ipynb$ ]]; then+ notebooks_set["$file"]=1+ elif [[ "$file" =~ ^docs/v2/examples/.*\.mdx$ ]] && [[ -f "$file" ]]; then+ # Extract source notebook from MDX file+ source_notebook=$(grep -oP '(?<=SOURCE_FILE: )[^ ]+' "$file" 2>/dev/null || true)+ if [[ -n "$source_notebook" && -f "$source_notebook" ]]; then+ notebooks_set["$source_notebook"]=1+ fifi- echo "Source file: $source_file"- if [[ -f "$source_file" ]]; then- echo "Converting notebook to markdown"- jupyter nbconvert --to markdown "$source_file" || { echo "Error: Failed to convert $source_file" >&2; continue; }- markdown_file="${source_file%.ipynb}.md"- echo "Removing existing content after {/* SOURCE_FILE: ... */}"- sed -i '\#{/\* SOURCE_FILE:#,$d' "$file"- echo "Appending markdown to $file"- echo -e "{/* SOURCE_FILE: $source_file */}\n" >> "$file"- cat "$markdown_file" >> "$file" || { echo "Error: Failed to append markdown to $file" >&2; continue; }- rm "$markdown_file" || { echo "Error: Failed to remove $markdown_file" >&2; continue; }+ done <<< "$CHANGED_FILES"++ # Exit if no notebooks found+ [[ ${#notebooks_set[@]} -eq 0 ]] && exit 0++ # Process each notebook and track results+ failed_count=0+ processed_notebooks=""+ for notebook in "${!notebooks_set[@]}"; do+ if python examples/generate_documentation.py "$notebook"; then+ processed_notebooks="$processed_notebooks$notebook"$'\n'else- echo "Error: Source file not found: $source_file" >&2+ ((failed_count++))fidone++ [[ $failed_count -gt 0 ]] && exit 1++ # Get modified files for PR description+ modified_files=$(git status --porcelain | grep -E '^\s*[AM]' | awk '{print $2}' | sort)++ # Save outputs for PR+ echo "processed_notebooks<<EOF" >> $GITHUB_OUTPUT+ echo "$processed_notebooks" >> $GITHUB_OUTPUT+ echo "EOF" >> $GITHUB_OUTPUT++ echo "modified_files<<EOF" >> $GITHUB_OUTPUT+ echo "$modified_files" >> $GITHUB_OUTPUT+ echo "EOF" >> $GITHUB_OUTPUT- name: Create Pull Requestuses: peter-evans/create-pull-request@v7with:- committer: Howard Gil <[email protected]>- commit-message: GitHub Action - Update examples in docs from notebooks- title: GitHub Action - Update examples in docs from notebooks- body: Changes detected in examples/** or docs/v1/examples/** triggered an update of the docs/v1/examples/**.mdx files to incorporate markdown from the corresponding notebook in examples/**.- branch: update-examples-in-docs-from-notebooks+ token: ${{ secrets.GITHUB_TOKEN }}+ committer: github-actions[bot] <github-actions[bot]@users.noreply.github.com>+ author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>+ commit-message: "docs: update examples from notebooks"+ title: "docs: update examples from notebooks"+ body: |+ Updates documentation examples from their source notebooks.++ **Triggered by:** @${{ github.actor }}+ **Event:** ${{ github.event_name }}+ ${{ steps.process.outputs.processed_notebooks && format('++ ## Processed Notebooks+ ```+ {0}+ ```', steps.process.outputs.processed_notebooks) || '' }}+ ${{ steps.process.outputs.modified_files && format('++ ## Modified Files+ ```+ {0}+ ```', steps.process.outputs.modified_files) || '' }}+ branch: update-examples-docsdelete-branch: true- assignees: HowieG,siyangqiu,bboynton97,areibman- reviewers: HowieG,siyangqiu,bboynton97,areibman+ # TODO: Uncomment for production use+ # assignees: the-praxs,bboynton97,areibman+ # reviewers: the-praxs,bboynton97,areibman+ # TODO: Remove this once the workflow is stable+ assignees: the-praxs+ reviewers: the-praxsdiff --git a/.github/workflows/test-notebooks.yml b/.github/workflows/test-notebooks.ymldeleted file mode 100644index 38657cff..00000000--- a/.github/workflows/test-notebooks.yml+++ /dev/null@@ -1,103 +0,0 @@-name: Test Notebooks-on:- pull_request:- types: [closed]- branches:- - main- paths:- - "agentops/**"- - "examples/**"- - "tests/**"- - ".github/workflows/test-notebooks.yml"- workflow_dispatch:-jobs:- test-notebooks:- runs-on: ubuntu-latest- strategy:- matrix:- python-version: ['3.11']- fail-fast: false- steps:- - uses: actions/checkout@v4- - name: Set up Python ${{ matrix.python-version }}- uses: actions/setup-python@v4- with:- python-version: ${{ matrix.python-version }}- - name: Install dependencies- run: |- python -m pip install --upgrade pip- pip install -U jupyter- - name: Create .env file- run: |- echo "AGENTOPS_API_KEY=${{ secrets.AGENTOPS_API_KEY }}" >> .env- echo "OPENAI_API_KEY=${{ secrets.OPENAI_API_KEY }}" >> .env- echo "ANTHROPIC_API_KEY=${{ secrets.ANTHROPIC_API_KEY }}" >> .env- echo "CO_API_KEY=${{ secrets.CO_API_KEY }}" >> .env- echo "GROQ_API_KEY=${{ secrets.GROQ_API_KEY }}" >> .env- echo "MULTION_API_KEY=${{ secrets.MULTION_API_KEY }}" >> .env- echo "SERPER_API_KEY=${{ secrets.SERPER_API_KEY }}" >> .env- - name: Install AgentOps from main branch and remove agentops install from notebooks- run: |- pip install git+https://github.com/AgentOps-AI/agentops.git@main- find . -name '*.ipynb' -exec sed -i '/^%pip install.*agentops/d' {} +- - name: Run notebooks and check for errors- run: |- mkdir -p logs- exit_code=0-- exclude_notebooks=(- "./examples/crewai_examples/job_posting.ipynb"- "./examples/demos/agentchat_agentops.ipynb"- )-- for notebook in $(find . -name '*.ipynb'); do-- skip=false- for excluded in "${exclude_notebooks[@]}"; do- if [[ "$notebook" == "$excluded" ]]; then- skip=true- echo "Skipping excluded notebook: $notebook"- break- fi- done-- $skip && continue-- notebook_name=$(basename "$notebook" .ipynb)- notebook_path=$(realpath "$notebook")- notebook_dir=$(dirname "$notebook_path")-- # Run the notebook- jupyter execute "$notebook_path" || true-- # Check if agentops.log was created- if [ -f "${notebook_dir}/agentops.log" ]; then- dest_log="logs/agentops-${notebook_name}.log"- mv "${notebook_dir}/agentops.log" "$dest_log"-- # Check agentops log for errors or warnings- if grep -E "ERROR|WARNING" "$dest_log"; then- echo "Errors or warnings found in $dest_log for Python ${{ matrix.python-version }}"- exit_code=1- else- echo "No errors or warnings found in $dest_log for Python ${{ matrix.python-version }}"- fi- else- echo "No agentops.log generated for $notebook_name"- fi- done-- # Check if any logs were found- if [ $(find logs -name 'agentops-*.log' | wc -l) -eq 0 ]; then- echo "No agentops.log files were generated for any notebook"- fi-- exit $exit_code-- - name: Upload logs as artifacts- uses: actions/upload-artifact@v4- if: always()- with:- name: notebook-logs-${{ matrix.python-version }}- path: logs/agentops-*.log- if-no-files-found: warn\ No newline at end of filediff --git a/README.md b/README.mdindex 40a8e16b..ba2ef2cf 100644--- a/README.md+++ b/README.md@@ -222,7 +222,7 @@ Build multi-agent systems with tools, handoffs, and guardrails. AgentOps nativelpip install openai-agents```-- [AgentOps integration example](https://docs.agentops.ai/v1/integrations/agentssdk)+- [AgentOps integration example](https://docs.agentops.ai/v1/integrations/agents_sdk)- [Official OpenAI Agents SDK documentation](https://openai.github.io/openai-agents-python/)### CrewAI 🛶diff --git a/docs/images/external/autogen/ag2.svg b/docs/images/external/ag2/ag2-logo.svgsimilarity index 100%rename from docs/images/external/autogen/ag2.svgrename to docs/images/external/ag2/ag2-logo.svgdiff --git a/docs/images/external/autogen/autogen-logo.svg b/docs/images/external/autogen/autogen-logo.svgnew file mode 100644index 00000000..9402bbdc--- /dev/null+++ b/docs/images/external/autogen/autogen-logo.svg@@ -0,0 +1 @@+<svg width="720" height="720" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" xml:space="preserve" overflow="hidden"><defs><clipPath id="clip0"><rect x="280" y="0" width="720" height="720"/></clipPath><clipPath id="clip1"><rect x="0" y="0" width="6858000" height="6858000"/></clipPath><image width="1080" height="1080" xlink:href="data:image/jpeg;base64,/9j/4AAQSkZJRgABAQEAYABgAAD/2wBDAAMCAgMCAgMDAwMEAwMEBQgFBQQEBQoHBwYIDAoMDAsKCwsNDhIQDQ4RDgsLEBYQERMUFRUVDA8XGBYUGBIUFRT/2wBDAQMEBAUEBQkFBQkUDQsNFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBQUFBT/wAARCAQ4BDgDASIAAhEBAxEB/8QAHwAAAQUBAQEBAQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAAAgEDAwIEAwUFBAQAAAF9AQIDAAQRBRIhMUEGE1FhByJxFDKBkaEII0KxwRVS0fAkM2JyggkKFhcYGRolJicoKSo0NTY3ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqDhIWGh4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5usLDxMXGx8jJytLT1NXW19jZ2uHi4+Tl5ufo6erx8vP09fb3+Pn6/8QAHwEAAwEBAQEBAQEBAQAAAAAAAAECAwQFBgcICQoL/8QAtREAAgECBAQDBAcFBAQAAQJ3AAECAxEEBSExBhJBUQdhcRMiMoEIFEKRobHBCSMzUvAVYnLRChYkNOEl8RcYGRomJygpKjU2Nzg5OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6goOEhYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3uLm6wsPExcbHyMnK0tPU1dbX2Nna4uPk5ebn6Onq8vP09fb3+Pn6/9oADAMBAAIRAxEAPwD433qVBXIA65GaiPy7W3HueQf8ahWRdpIAA79fpTZG8xiOMZxyD3oKGsd25dvXHb+v1puwDnBIxSfeyR1BJyRxwaRW3Y5GefrTEOHyj5+TjH4HpTtv8OCefpmm7T5YHVSAenvjFOGGYsxHBz19ulMBwU/NnkdlzSN82B27Hr701vu45xj0ozuXp1GQe3FMQrLnbjqeuBSt8y8Bjg4B6n+dNLNtU55zjPanLu67tuccgfy/KgB23LZDYz+FLuKjAHTrjk/hUe1icjpnjPp60Dkcck/xD9KAJNv59B2NMGdxGM46d6dsKq2GLAHGfxpoGeeuD1oACP3Z59MZHP8AnrTQNrFevrk/0p23auA3B5x7HrTBncd3ODk0ALt2qpJ6A9RyPam7cDGCfx9f6VIqsI87vf1/CmFT93PIx25+lAAI9qgNkc5zjil27Mk++Tux/nrQp2F8nOcgZ9KSTJITJY/T9KYD1U7CD69xxRt+bOdw5x74pFB2nB+8cbaacrnJJHP8qQD2wqsrZyRnp/hSbOnOOfSmsG29DjAzxSLkk/N1PPt70DH5DMeOvPGPzoZfTK5+8Mc1HyFyAenfn/PSnDcW+9kdPekA/gtuwPQYJHb/ABpOq7QDjjIpMn5c56Y/Dj/61IpOCCR06f0oAfjnrhcHjqaaT8pXbtx75x7UElmAzu+YY9vrTRnaCPlGOuOfrQIkJH3hwffgU5flXH3gMjGKhOfm/u5Gd3cetGTzwR1GT2oAmZgWBz0A7Gjnayjr0zgVD8wBPUkelGTz3Oc9OfrQBKudoIOfXFMCrwRu4HpTFy38QyM5pfu+pBxQA5lx32nJ9c0ZAyTyQKj8w8bj0LY5pd2Rnd9cUDH5+b26AH/PrTtnzKMMF6cgZqPhchgMfMOfwxSllyeeT6c496BD8LtxjBPGQ360v3iPl7fdx+tM3AMu4cZz9fSlzsIJ5IP8NAxzDbzk8HP3sUP83GGG3PvTJMnr9047UjE7Sv8AFkn86AHOvJxnHGeKUYZk7c+nFRybtxOewyKNwXGRxnOcH+VAEvy7eDnPt70ZBUjbgZ7g1HjH3gM4Pfv2o3DAHT69KAJuFJGN2Mjr2zSHCjDA4/z2FR8uoHfJO0fhSr947Rk99x/OgB5w24DOO3ej2OScn2qJfm2hsAZOBR0xk5OP6UASd1ODgn+lJxwMcY6e/Sm7gMjJ/wAim7iepHOP/wBdAEoypHU89Bx9aExwADjqdxz3qPlSB15xnPP1pV98HI2/hmgB/wB3OfQ4yKGUY2jrnAbPSowwPOQD60uCoJIyOPloEPwGyCrKCeuelHbJyeOCDio+5BJUrTiS2SCcEYOOeKYD9xOQcE5Jzn3pu7uSTkd+3vTWyG5G/Pp6dh/OmtuYHkdMbe1ADz8pyDlR7Z707I3Lx8vTpUHVvvAHIAP5/wBakVVGAeB+VAEhG1D24zg0Mc9RgZxytR5wucZ4/KlLYXhcDtQA7A7cn0zik7njK5444HvTMkd/pu7Ufd5wSOOfXNADuNoYdSPfml75XsOB1+tR7ucDp2pexOCe3rSAfnHy88Hqc0u0dRwevSmD6c5J6Umd2OQT02rzQMeDuyCM59uPpSbgGGf5frTeVxx1xTVJxnI9SDSAe33cjKnmncegJPH/ANaoTuXgMGwDz69wKVQd2Mc9QrfzpgSrjncO/VhSbQPcY9eRSbu275j69hSclueCSTj+n6UALgfMCRxx0/rQY8MRyw+tJ2xnbjk80jZyytwDnr1PFIQ7H3g2c49OKFUZH8RH4cU3HDBhgYBpoHzr8x5OG9qYyTODz82Rnp2zS8KCN2V6ck4pgVtuAflA+71o5zknYMgdKBEijaSTyBj7uOPalZVbhSMd6YuWABOwBuc8ZpWzn5sA9aYC/wASk/8AoPApu0FcgH1x260bdv8ADjoCc+2abx90sMYx160AOwFznkYx+NLxubAPP4/X6U0Dd269BjkUgYBfmPfv3zQA/bxjPPHQ+/WkP3cAc9c4pnUcNnA4xSbgM449wfxzQA8bSMk9eQQMGkbnnqeelI2cnO8HHTH5UpwvDYw2BikMUqFbPJ6YxxTOGOdp6nOKB8x6qDnNIRt68Ar0xg0AL/q9oJxx9Oe1GckgKwPbnNNyGbgquStC4XaScEUgJGY8nB6cDd+tLI7bhndgHA55PrUXr2+U0vy7iGOeRn8qAJAw3DsMelIfu7QeBj37U1ccYJznqeaQ5ySSvUdPpQA71PQ9x0FObA4x8v51G7r6YHU+9C59e+enJyD/AJ/GmIk27GPXAGMZ5pOAvC/N6ZJphznBGcEjOc0fOVwBtzgfN3oAlwFYnII+uOc/ypQPm69+gH61Ft3FjgYYk8+ntThvK8ELx+dADwFYMw+Uk/d/Lmg/eBz9QBwaTp2HTafUdMmjcewzjpt6YpgO4Y9ckDHy8fhTRluMYPX1pNxZc4BAzn34ob/WfN8xAwAOB070ALjdgdG67elHJYFeOcA5zmkO5TkHoM59Pao+FO04IGOfakA/jceGyDn2p4Zt+QeeMfMcjmozhGbDdsYzQo+YHDDGMg/ypjHKx+UsMjGD2FBcNuBBxjp6Uz5WUcc4/X0p20n7vU8EY/rSAUt0GMhTyvWj5TzzjnPPFITubd8rckflTSw3cFRjmkMeOMAgngjgcf56U7aOT0I4x0pmwAYPr26dKTcGYHBwfyoAlLbTkjPp/n86Nox/EBnHPv8Azpm0bcELyOpOO9N3hs9O3U0gJQSo5OEz6Z6fSlb5VLAMM/3uaYqhRn5SOec0N3+XO3pzxigB5wTkZz0G09fSo1Q7lx1JOTjAp5ymWB+63PHHNM9PvZHynb+eaAG4HlnAbO7A5pFUkEe/JxTwGChQeQc80zgtkfMTnOOxpiHhgwUrnAXpnA69KF4LKRk565zijy2CgMAAE7UKm9uoJ4J45+tMBy/MoByMZP046/59alVSWLDOahVTwoGAc4OO1PBHPc8HK/zpAWVCFeflYgD3opiseWPI6e/+cZopDK6yELhif93fxxTs55O4ccfODUMZygPtgZAqTliDgcD2NAEW4MuG5UE5Jbn9KXO7nOBn7oejopBLZye3v3p3sMquc/d7UwAsu0Yxs69efzp3DHIIHPTJIowu1T8xOMfKMZ56UrEHoeB3I4piGy/KpQ5VSO2enpTGbzMkbRkAgFiRUjKOSP4QNpzUfHQc9+nIpiAOi9yDnG3PFKAGOzavDcANjAFCsBlTnBPdcflRnKlSCWPJJ9aQDs7CRj5AeSSTmkbn5Mr6Yzj9akVlfomUxxUS/dA/iPHsKBjvmDEqcoPbjHvSbj0Bzz60p+Y5UEKRg8/pScKw+XJ/kKAFwY8/Ip9GHT/69MbDNk4LHJOc4PsOKcWwRjrjANN2iPJ28A4piHhSY1+XB/vZ4zRuVlIAwBnoOc55pPl24xluwA9RTvu5yN3UCgYgO4AKvyjnPc01mDcNknkZzwD608YUL2B5IB61G3DZPJYZz1wM0CHYDKWIyp6Y+9/Khe/y8k8bj26Zpw+7wPm6NmkILcnjr/8AWoAZt2qARgg4ILUgUFTjPXsacFGckMOT3603avGB/FQMNqE5wyn+7jp/nNP3DJGDycdh+FN+Rhyx7YI+nSj5cYHJ9aQBtCqQc5xkbjjv14+lKzKxJU4445FISuWw3y8fnk0KF9Ofp3pgOHy4ycH0Ldfembg2QAAeON3pxjNPVQ0gDMuSeSV6/T9Ki424DH5hwPTBpAPzsbgbfUk5FN3KDgbt3ToSeeTT2TPAXhhjNM+XrhiATx7f5NACttBIKsOOq9KBls4VsA4LH0x9aAp3Fc9Rjr0oztYZ3NzwMUwDcX2kLnjgZwaNwYY2ZHbcKF7YAViPSgqF6HCjHSgBDmMAlc5Gev5fzpWJ43Aue4BFJtRQ2QR6DOelJheQCVFIADRo2Acjn7x4qVfnGSSQoyfmHNR/KTkMRyScj6U7gd92B0xTAezAEFu3I5OPxNIOcHP/AI91/Ol2/dHOGOB+XXFG4cHkcY/+vQA1iFLbgeOi7qYq78Y7HJ+bnp2qR924k5646UmB8oxlh26UgGFgwYYG3vz1o2hsnAHf7x4/+vmnEbVDbdu0Z6UeWCp6nHP15oAQsdvAKj0JBBpwzjPQcdCfzo24zwVIBPvRwMgjJ459KAHMWVhnn+Hd2pq4LcgYXjjqP8acACV6H1Zu5xSbvlPr0GRxQAKxXh8r7H0pq/Nxjg8dRS8sVHHPp/Kg9lOQvWmABic4HRs9f8KTzOh65A4zmgYyCOB9Pelb5VGBgY5FIBMguOG6855/lSKyDJwA2B1JGeec09QeMqM7hzTM8HORwO/XmgYqufU8A9GyTSt3yAemc+lIy9evXmjjgnnI+X/69AheNwz8uPfOT70J8xBx3xxxgUbflB+9/d9qOOedo/OmIRpD1OQevzfl2pqgNkYXp64p7AfQ5xkcYGP/AK9IcE8Oc5xnH6UhhvI9zwQf64pyseuM+uDn8MGm7QykkZ6dsHrSqy5BBwMntQA5mO3+6pByMc00sOC3HTocHpRztODnAJ4pflXA7Zx0pgN3Hk/+PZB/PNO5yep249v0oVdo6jPPak46ndnGePoaAE+VgAvGOPvEUjfOCPlIx26Uq4AHPbmlUL13ZORntxQAq+v3Qck4BH4UN8x4GRgcM1ICMcHk5Occ804EKN5wQPagBrMeAOfUpj161GG442npj1qY9SOnPPY00qu33xjB9qQxu3HGF9BtODzQzBcj5RnrzwcUoUbhyQFOeB04o2hOvHGTgdT9KBDlztz0Gf4W5zSb9vPU8jJ7Z9aFCs+Dxu5xnHNNK85Pysw+Y0DDgr1wMevH60bl3kgA7Dxu6/4Uow0nPcfxUkhLdf4mwf6UCEVQ244AA64ORmgMG+U4/wBo44xS8Fwcbux+tOZ9vJGB0bj3FADFIG0sOQMHFO3DqAD245208YVRgAsPvDpQuTwuARyNvT60wGH5+WIJJByeucdhTgflyVxjrlfWhduRjovt3zSfN7HjOKAFXPG4ZOMjaSBntSZYqB+OOlOC7srgDjPB9qaMbjjI68dKAELbVJx69M5pMgHjGMnC7jmnYVuN+CccAU3OAMtyc80AKzBVIL85xk4NN3YbPyjLDHrR/CQSB07e9IcepOemee5oAceoCrkd8HJ/Wk3BQ2Bhc59CaEA3H1yQB2peF24LHsvpQAq4CjPqQPn5ppbjgcMMfe6U9cepGMduPrSMqD9SeOM0DEA3clcjAH3h9fzpm4bQSqgAYwTTvlbGcn29xStGvmNxjPOVpANX5ckKM9/m5pfu4PJwejckfjSKF4yccYPYmgBeCDk7RyvB96BDlG7sOM4O40bj1wV53YIoGOCO3GehIpxjXtzjgdjigBiHcfvDGefmI/T0pGc/xEjJ69utSNjOBk46cUgUNlRyc5pgRqevCZAB3cihmV2cMM5HFSSEMQSMH6CmrGrFMjbjkn+lADeFkCsqhgOhJzkdKUyBuWUEY54PFLtG0BcsCMfjT9w6E7l7+1ADc8kBeMfLgcj296eSMYXGPQdT7UmcsW3fN29ePSkYDdwV/rQAuCzFsEDGcE0Fyp2/KCDkjnHPYUMQG5GBjGe+O9C7lYDJ3AcL26UAMK7VUFcj+6pyaNxxs7nhs46Zp+3y++ExnI9aY21flkPPXpz60ACs3Qgg/hn6Uu4FtoXuBtz1pzKVZ2L5J447mhT84O/GBzxnHIpAMH3gQDjHUjkmheG5Xbxzt60uAuATyowf8aWNRkE5wCeV4oGNV+33QOCOlKrHnPHH9+gf6sANnkjHTvRx19DjIFIBGkbIBLA+uRg0vmBSf03Nx+lH8OA2TwelHO4jPXqSKAE3c7cMz8Y6nvT2O1hnpngscfyob724tkMAOlNVeB2OMcj9aYClhzuBPBxnlaeV2ru2cAY6n+VHyrjJJXlRxjn1pF9vmbHJb+VABtwBuBKY5K5yKRgfLHyADpt5+pNSbVaMADjOWJ/lTODwCQf4mPamIby2McrjGMHj35pFyygqFIPcjr7VL5aGNgeH7N2xTdq7+Tu549qAGKNoTAJBHPOOfrTlJKnK8cetL5YVCuDvzywpw2qfmG44zj0pANzs5KkA5+6e9PVsDoW6Ac9KI8Kc9CMjgdc96cfmBBO8AnkcfjQAuSMgE7gcDGT+popf4cxkg9+cZzRSYFVNpXjgnnaDxn3zTspv6qq98qaagyAwwT0+UYp24spVemOm7FAxnyttywJOc8ngU8uMY3YP93PFDSMuQOCM5G7vQu5uM9Tn73SgBd+7ac4boSD/AFxTw4XAzx2w2B+tM3HgEsRxhc5HXrRuLdWyfXOMfhTJEkbLNk5PY9RSSHoBwc53DkAd+ac2dxBOFGKYpbjHO7GR19e9MBQw2g78bTwO596XcMABSTweOgNJu25PALcelBkO0AYI4O3t/wDrpAPyVUA5YE/eA/pSSMOSpGewUHJoXKsTgKSfXApyyHcrggtnqe3sKAEbIXDcjs2OKWRSq84C9fWgnoB065HGaayqufu59KYAp+UknIx1xg01fmUfMMfXp+FSy5dvmUFumQeeuajfO7dnd830oARGI+bG5O/HIoXGwDq3ULnBqTczZJwwz8vPTNRN23M3IGP8aAHbcMQdyjrhiOab94ABcgg9CMnpjGKkkzxks2egqLcCSGZTz3GRj0FAEq71Uv19AR60i455x/vD0pR8yg4AwMcZ6Uv8WGOOpC9Rk0ARMwYvtyq54z0NEa/MPkPXnAqRmJULjBJ5OeTUa7Q2DtBBz+NAwU7lbKlegCkilTHKhlQL1/rSfMwyAFPbvn60hbGcLlQe3WkArEdcnd90KB168078AvruPJ/CjlBwOegBb3zn9ab8xXn5l6nNACqxXG7jbnDdabuyoxwMZLE9KcvyZGACRzzjjt+tIzN0zu4GV6CgBGY855XoDjn8qVsLx949thzRyrA4G3r1pM7BhACeQSvFAA2RkOcjH3sUfLt9WJO0LwaXO1txAGMfnTuckqvzfeLZ9aYDG3Lww+UjJ55FJ5gGedzYx0/KnKpOB8wGcAN0pzSHqpDH8uaAI2UfL/Fxk8c9KcrfLnaSVx/EKTaDlsYAH60u7KkbifUYxSATn+INjkYH86kXnr90jIwMcfnTeRgkLgtkADjpTuNvRM47igA3dG4wTx659KFIL4/Hgg0bPlG1dvuD7GnLhsAnKd9woAjyd5HTn+LFIvzYwCABnrmlfLNtxgZ9elG0SEE5JOfm6kUANZzgMwwcf3f5U9sySY+7z60m4rjPyggY5P8ASgZbAKhhkkc+tAC7g2B/Fzy1KT5e08Fv9k5x70Y2qUOPQ8/rTVyrKBtBzzimANhWOSevDH0FK3y5bjcfxBpGzlWIA4xjoBS+YecHczjHNAhHbapL8EcDHSjI6blAB6Y5oVRweVzx1oLHseem3+tAC8PFlRj+IdM8U1WVuc46/M3FKjNyT2454xQ37vcASB/OgYfexk4JPQNTQR82X468gc8mnr8zL93qPmP6UnIB+70BpAI3B5YD5uGPH50fe3EyAH/Pt+lG3kkAAdyDT2Y9G+cDHHTPvQA1eckgKPX+Gl3Feh7fL6Uqrt475z83NN3Zxzg845/SgQrLtY5xgHPXn/PWkwdpPzLj0wRTuw+Ybc4zjPbt6c5pigDAXC8YHv8AhQMCSxKjv3J6exo4zwcDPRucUpUc5ztz0PIP/wBagE8AbsL1pgOaTf8AdbIIxnOPxpF65U7cn5uQQKTBxgEn5eQMc+lLvJBAOVzkj196AELHduPzA9+2KVspjbkcBSwzjnPrSAbWYH5SeDgYwKVW+YbRu6Ac+/pQAhBjzwxA75FHzKpBycjnDDp1pu0dwAcZ+7QGX5TtU846c9CKAHBiMc5JOOPQUpbcQQQ3t0J/Okj7HGWxnA4JpS5OR17YJoAUY+X5gG/3uf8APFIAWZWI3gjsRxS8KMqRhenHNJtB7DOMcCgYkjZ4LdMjDZ6etBx5jAMrHscnFIoIYLxw3LdKRnZupHQc5J4pAOXDHC5Y5wVBBo/2seuSeMj1pdpZQSAeTj1+tIWLd8DqDnPWgBP9Znq2PcZ/HNIMrJ/CBkdD26U9lH3iAwPQn71NkJZiGOD6H0oENDfd27So5w3Wjd8w3cLkHBzTucBsZHI3HuaHJzgjaOO5GKACNxlQSOB/Fz/SnBjgkggAZ29B+lCA7QDjgEjPWgMzAgDHy9MY/lTGKrBpAN2F6/K3GTSDdu6Hn8vrShuG5yDwCTyKTiPAI7YORn86BAQFbI68KTuFIV2sDncf8inrjjjdkj5T+dNGe3TJ4Hc0ANZ14+6vH3lYetNUH73T/ePpUnOCNxzt7801sqwDbWIJpAN3FlByOT0yKMAcEn73Yjp/hTcjbkJz34z3oVRuH1ye3egYuQyj51PPGWNO4DHawBHTn8zS7sZJXAJ5yaPqy8nGMmmIXO7OGXHTDHqaTgkjK4x/E3f1pd26QHb82c8Dk0bi3Rs8c8foKABhlxtbPruNM+Zsg7c/735Uq/My5CnBHX8sUcpvGFIBxuFIYmTtGAc9do70u5SwJf5s/dxj86bgtjcSBjhgeaexKs2G2enJOBTEOUjoSUHpnOaXdkqXYK+MHdnr7/hTclvUjBw3Q05W2gqSMg56k/gKABWGRhuP4ccCmDPyZ2gZ+8D9fSnFmZgCVPXHf8aTliTnA4HPPT2oAYp29Du9Oegz60NtVjtOSejAgjmneY3I+bjt1peQMBizYxgAdKAGcoc/MEJwMHP40qqCoCx7+OF70rMyttwuV4Ax+gpCd2dxJZqBCbTt5Dbc9f7v4fhStIGwO3qev5UrA7SuSzDjnikZmYjLHOeB0AoAVm64bcuOhIobKklsqQTu5A69jStlc54Y+gGM02PG4MTtPc45z/hQAfeRRjd7A0u4YKrk45Y4H0odiuQcqSCSc/5xRyfmbAOBnnkd8UDDdGzMVOT2BBHNOVgvfoefm/CkaV8kEHpzzRtIbLKp4BPHHUUAJgI+zfuA688Uc5+ZgMDcMN19qXcRhcqBghsCk/1hClVPGMf/AFqAAkB8FgSTuOP5UrEY/ut6bu1G5uMEZ3EnFJlm7sc8Z4JpALIDwM54Gfn6ZOetI2f4dobPI3DFDOQcZOWwcdv8/wCFJ8zD1z78j3oGLJnBI3EkdBn8+nSlkyuWXAH94nk++BQ3VwWI3Djkmgs3zYwSw5OefpQIU4RQQ27bwAOTTv4V+6MdWLc/WkJZWHOzK8D0pPMLOSPm9Mgcj0piHKynBMg29T/jTeWAK4cknhmwaUEqSCSqrxhTkUK77zg5xwOmPpQA5eEJ3BiwJK9D7VGWZozjaOcjc2PwoGfL7gYBxjGfrS+dyG3ep6cUDEQjYQzAluqk4xQrDzAFyzKOMnAoG5eoAABXOaRmfd94rnoP/r0AOaUMqru3McnAIyPpT8jPKtv78EAfWofmxyzDn5V4p6ybdw3c/wAZxQInDFshlB28BlPFFNX7p/1akdwOvtRSYECLu4wyDqRjr+FPYBSo+UHrypBpqgKu75S3QYB/PrTlxuBDMQBydxGaRQxdzYGWycj7o/OlOeQMkfSk4CD5UJ5zyfyoUAsSAm7oev8AKgQp3YGO/wAoGc5BNKg27sfNt46c00qNpPyqOCQV5pSpxsxkL2HGP8+1UIRmBPD5/wBnHOKXYdxHtlmUYFPZS2O5UZO4cVEoLKB95cZOBge1AC5+7g7dvZqVcGTCnfn2yM+tCxkDA4J46Y20ZZlwSCM/dAx07/yoAXlt3OGzyCMUE7mBXc+ePX8aX5iCM5bjPA4pQSqkDHuAPegAAKrncM8jntRuwoxksOfl5oVf7oUDrx2GcU05XOWX6AYJ9KAHfeUZ43cg5ximqNwOfx5FK33cgfPjGcdOeaYGIYAMvXH3etADuW2lSQpGOlJyyl1DDnpj9Keu1GVgBnnsF5+tR7QVBYqe/A5b9aBiiTbyDlj2JxTXU7eOCP4cZJHUmntldobBzyBjgCo2B/jON3J+ueP5U0IlRgVxu6j5RmlUFihLKOSSQQKaN23cMhjgnjNKzbcFsHk9uB9aQDVbdldu0qMg9zTQ33ckNz931/yaex+XDLyRjP0+lIoG4nYpO7gZPWgY1Wzw4x6EHrQrD5fmGPpzRt3DADKeo2kY60NHgAYHuFJzSELhg3XHJwG57dKVVJBO0txzxim9edoAz37/AOeKXaNpxtH0JApgJu+bAdT7Hr1pduT8v7zjJ+v1p6qzLtPOTwBimsSVUMoOP4V4AoGMZgflPyj9DSbiGIDBvVjx+VOKlVGz5T33dKGwyhQPlxjHdvfNAhNwOFU7T/td/elBxg8N64P5cUixlWPG4duMn8c0uOq7fou0ZOe9ACscMOfm9CeKGUquSQHzgcZWmeWY+FAfnGWHNOXCuMfLID1bjPFAwZvlDOuC3Q+ntRkbcluegwcn64o27QP4x2/GhiejEjJ5Y9PwoEKrZXlsKp7jHNOB+Unbg579zSBW3HPzgd2HOaTlsDIzjJZloAfn5lK85OQtAX5goGWX16/WkYdztXP8LDnA75oGBlcHaByM5APpQAsnzck4Hr9O1JlmPv1PGNoNL918LlF6Fe1Jj5Qd2RnnqeaAGspVQegHRlOc07aVYgLx/exik2nC9eV/iPFO8teOBjOfl54xSGN524I6egyKR/lUd+M9MU/AYEJ75BHSmqNvC4Ddsfy6UADZ79/4sikXcmTyccEYyaJANqlAAOQeBS7eThQcjG4CmA3DIhDDAA/Cnr93IUEY/IUxcHOVA9//AK9O27QAVwe3P65oEG1sHG7PHIH+c0bgdpHU9PfNIq7WLFPmHPDce1L8yqRj5h3P1oAXcFbGS3bHpTc4H3t23pgjn3/z6U5cjBA6Z4zRkrkKQQB2AyeOlIYgZcDGCe3ajaeTzuz93HWlC9mZwPw6+lIsfqq4zt6cmmArfdznHrS8q3I5xkLmk8sfMQMdznvRw2cEIfcY/GgQ1lDc8+gxwc0v3Pvqc9NxFOZcsWABXHVuce/86YwHBKY28HA7+vWgA5OFz7Ag9s0o+STBBIY8U5gdvQE5wCGPGf60xFIG0KvHvk0APYMeQMFfyNMT5cLg5wCOAetPKbsEYCemM9KbGQ3YEZ3DCjjNAA2QxVjnHJ7ZpEDbtuQexLDFOfKKPnJHTpShV+YhVAxgHb7UDIud235u4HFHJhIx/wAB4B4p3ljaDuGNvHXP86d5YMe/ZuOQff6CgBoU9/mJP0pwPTZg9uvel2pngD0yo5xgU9/u4K8Y9OBQBG2WIILeucfpSFSq8jccZ3Adqk5RsjAPTlenFMRedwCgdM45oAY2dykFgNw6igZwQAw4xj8aFX5+irJ/CuOD+NIynccquQORjIxQA/qvXbg8L0oKtuUBcFQSQMUR/dBypHuvTNNKkffUNg8EevvQA9SzHg57EnpTWBLHadrdd3XdTtw57KehCj8qa2VZgGZVz8uAOT6UAIGIyc7Qv3sjilbLf7zY79s0u33BHcAYApmOc7N6tyePzFIByhuCWIA5+YZpQ/OQMgcketKq7mG1gSPrwc0bSc42gj7zEflTASPdwSNy9T2x7e9LuzkD5T120gw642BQT79ffFLJuxgDd/e28Z+lAhFDL8wO3nBbtml3ZbP3N3NOXAJZVyQQNq9vw70jN8oGMjHPr/8AWoATIbYM7U5Gf8ajwxyRuIyctjJx2qTay5bPIHPU8UnIxwCOy7ecUDGZDKeSDnpjn60KrHI688KQKcVBhI35HZQKRo+oZFOPTvzQA1cs5wSM9FYdfxp3zM5ccjGCDihVUfeUkD1GaVlKcFFzjoKAEUttzwh6jPPf1pMNwFG5epVT3pyqqrwqkZwO/PrSeWVXkhlz6YOO9ABkhgp+XHfHIPv+FJ95iAd4xz7GnJhWGAwHYdc/54pGyisCAwLfewPyoASPLfeOAD6Y5okHC/NtY8EHFLtDMdwVCP5Y9MUN+7ySqhMDAYUAOjX5TuGxemQc5o2s2ASFOMDPOKRlO4FlwR3BwKXjaQMbc4Py4Dd+1ACBjuUY2H3GPypu7cwBXcScf4VJtO3aFDE9BnIFDMeRjKk5+UUAN53ntjr/APrpke/zAowAT36/nUjRlsDGVU8r1zSKqliNuDjhRgcflQABsN8oYr1AyM0z5ow5UNk9yRS/exgfPn+JR+PShFU7sBQOuSnSgBdxzgMrZ5Ck0nO4MmWA68/0pdzcA49CWHbsBTVVgvXBHA3DLCgQ9mDNw+T0wT3ppJ3b8YQnhR2p7KdoDAYx+ZqMAFlHAK9cDH/66YDyxkUBTuc/eOaRwDk4J3cFu2aPujBQFwM4A49qI1GOCuemNo+960hi/eZlDM4HA460jcKcsVx944peRnO1dvXjqadGoDqxOwYBY4680CGbT5mNxK9TgZ5pw3Z7rjkttwcUeSynDbeG6sKPL3YJ2gf3gOg+lAxpVlbbncoP1BpQrYJAJPcbegpTH95gVVCTgMKQRjAAG7nGOeaBCMr43DAOduO2KT5lyNh9OxpfLXbu2hSOCT/L9aXy1X5di/LxndjmkMGDLyWxgAjAz+FKUKsgAUnselAULINmAAuWZuQKRUC4Kpk4ydvamIVlZ1xnaTzkHn6Ug3bd23een93FBiDYIGMLncwzS4DFiSHyeBz/AC/KgARSyH5uOre1JyqDKq3OF7fnT0XOSV+bHKg8YpgXaW+6WPGdvagByqzKWyTk4Iz0+lR8lyQSDnGSOMU5VXyzlSMDHc4oGOcgbDztCgZ9qAE37SRjI5yff6Uj5DDGXIHf+VKiqy9cAfLt28Z7U8Lt2nYobOexNADNp2ryQ5PA7Ck2/e2kg9xjg0/yx8wUbT0y3J6+lKmY+ybs4xjmmAob5c7cKOMj1opytjIxt+ueaKkCFflQDcQO2BjipNzA4VyV45GKYvZvmK9iccGkkVCMbe3Ze/50DAof7x74X1pc9Bv6U1QF2kIWPPXjFJt3YYR/Tnj65oAev8JHIx2NOwE4HOPxNMJwuNuGPO7b1GfUUL+8ycNjPJ6fz60xDznJwOB603jcwGDx3pWK/wAX3lBCqeMemaTljhun8RU//W47UAIuDnHD465pwI3HJJbH4fSk/hAKcE5XJyPzpcnaob5R6bu/5UAKHAwAcN2P96gANtydxHBwOD7Ui5YBfl3Y6Z4H6U7kFQ2MY/hPSgBNwjYFsDJ5I6fShl+UBsliOOOlEeflB6dckYH1o5j7KDnGc8mgBzNsUDIGRn8aiYEcscAHg461L0R8Da2cH2pqjyycBcA49SaADdjaQPkGcE9vehtpxkksp4x1xUnDNuyAn90dQPTmmDOQQByc5JIPsKAE8xl6jdngcc01kCqVY4Pv+JqTP3iQGxz1z/Oo1b5if4v4t3SgBwcsoySCf7tIvQnbk442+vr/ADpRhjjPTkL7UkiqGOBt5zjYfxxTAaJAVIJ59Ae9GQvAYhs460KCrEMrY69eKTcFPVSB823HPBpALx5ZO8YPAGOfpSHO07lXgc805VOMhRkH5iAf60iqpbnI9gOf1oAdnumML60iqVHzr+JGc+1G1pFB2hge+6j5W+UqcHtnnigBfm7kLzjkdB3prFdv8OznANO2Kf4Dnk/N+QHNNy20DC8jk7uvsKBjmbkA9xj/AGfpTBlQcYfaf4uAKF+7tBAzjjJ4oCnADADqNoJoExTgqo2EDruHeiRipwg8w4+bP6ClUbQPlIOPwoDbc4ViAcgdfzxQAvXYckuT2PahgVXglnI6YzimMu0kKAEHOCTz+FOzsXPyjnnBIoAXnYuQdx64H3aYcFj8xzjnjrSs2ASMck9yaRTt6BRgYODQA5vmxwDz/B2pVYeu8DovUGmdwc4+f1P6ZpwUsDhF4HBzQA7bu652n2z+VIABwRz1K9KU4VRtGSOh6URqCVI3Y6bhQAMwzjPBwTQxB525I6jOMClbGT2yepODikJI7t/tZXPJFIYsjHg5zkdzmm8biBtOOmRSso67PmUDtjNKxLcdD1G3nPHSgAZj83r0Kikb5iDgjtjGOfWjbkcj5u2c8fjSe7ADsAWzQAMduFXhh1FIpIUnB6YzjpSyZ2pjHPXmncKGU4xjoOhoAbghVHXA4FGd3I3Y7baASy9DxxwefxpVwAM/jnqaYgbsc4Hds9TSMSzDJ+YHkY70ozkA5PXPAYYo3nbwCf070AGQGDY3fNy3pTcD1yQeMDqfWnRgblJyAe2DQMqM4HPJIpDEzt68gD6/jRwcAHcc8HHQetKhz6jjGSKVQVXO0ZPAApiADK7sYGOADmnZ2qMHOf8APFN3BumPlPvwP60u3d3I9e39KAGyDI5zuB4x+FBUng/KPQDjNKzBvm6kD7oPA96Zt3kEKGOeQGNADt2XO045wcdqNvzADoeSSOtDSApwd+ex4H+f8aRcsQDhlzgqc8UALuLEhQQxBwBSLjecfd6/L1pzcBhkHj7w7UL90nZnjgbeB/8AXoGIWHJHGemaWPhiB/ujB4x3pP4RjIz1YmljUZBJ24B6gf07UAAzu4BI6Bj6UjfKrfNgZxn9aM9tuc8DHSlPyqwKlvTOD2NADto4PQ980pO3IIz9OmaacljwQCcDGDRwuTncM457n0oAUDcMHJ3dQe9MORywye2P4adySACp2/jSHuRkevXPPagBnYgNy2Md+aGjI5O3k8kGn7n2noSvPynO0ev1psnysdvy7R948UCBcquQNwzj3pNu4kZYr69c05cspYn5gMhu/wCVI33hhM9QOP160hiqwyCD9V9KaGDPu7fe6UKo2liGAyMe59aYcBzt+XPGcYH1/nTAevPQ5HU+9OVtzY37R1x6UwY254I9QMA05WDHPytjnk4pALt8zBB2J9etIzb9oxg9hSclVyMN29OtOU4xg5P5Y9qYC7d0h24OTyzfSkZuCG+UHoR0oUngdWzn5eg9qViVfJJY9B/kUAKp+UYPP8R9qORndzjpSAbsbl3DoM//AK+lIuQTlQxzgnHU0xBtaNz/AAntg8UMV8zCkjHr60KD1xgHhuAcUhbKjj5QeMHOaQCnG44xk8bulN+78zfNg49zSspZWBVjnkZUGmlgSNoAGMDGNxoGPztYAyeuc01SOm4HucjtTvugE9euCMc0bjk4+Udxn/61ACbhjLN8ucADp2pOCp+fmjkZY4Geueo59MUjbV52Db39TQAvHOAA4wMdhScsD83yjoB60YLMMBd2edpPB7CkL7WPGeclzxz6UDEwVVWOG5yBjk05fmbhsLkggjpQvQZBGenAx+dBb5dpUFs/xHv3oEPX5eBt3dhjkiiNtvRmAPOO44ppJYdSDj14/Gnbh90HOP4v0xn8KAD5djYyv+z3zSJlcDIA6e+KXopyRk88/wCetNb5v4CT1PGT6YzSAXqQB/CcHB/WggBiA3zHklqMAckZ56FegpvIYFSFPULzj8aYwVztB3ZJ/iAxSDapLckn+HrT3Uj72PXC/rSJ8uV27MDp1/PNAhNx3AFtrEfgaHblDkl8dcdKcnGBwzEk4I4HFIGJIwOAOoJJNAhxHaTnIx8tMZvmDDgHqw6ipO2DndjjJ6496jZuSWypJzg/pigY5mzEF3Z96SQj5iTu9+ymnPlMnG7v0pij5j6dPpn36GgQ+TDbm3bl4I9c0rKFAwu4dSB1qIMqg9Mk4GV4Ap2AykZZR/tdADQA7hmKg/KcAnNBUfNgjj0pCw3cIqtk9eOKRfmZWblRzux278UAOb7x5BBOAKQZC5D5A4Az1oX7obbuOSc7R/nNIM7uQc59M/XmgYEBcEMNuBnvmgYPAzkDOMUq45O3cF5zxk5FIcnk/wAXOVagQFiDyQAOSp/rQu1WAU7vQY6ilb52OV6YLHjPsKGZmwSG7dMA0AKW3DO7GO3oKRPvcNgtg49qRlBbG3BAyehNBYjOQAPTPHSgBVPYEFgOppGkG7O7PYt2o4XA+8OgyMf1pqjbt+XhT0xkt+tMB6sdrOSCcYPr1pN7IckgB+gPIpqoFUcFuwxkDrTtpVvmPydznOaQDjIfk3feIwcDtSHOc5yo9RxTLdjuGFAZhwT0NPb5Vfjj0AJoAVm2x+pByWXtSMoxu+Y5429eKXb8o2+uOB/M07buJPlnsfSgBVYsvBKhRwDRSNtDElmB7j1opDIY/wB2vBBX1PX/AOvUqBs4A3cZ+XgfjUUagYBJKgYGRTmQKuQSvGc0AR/MoyMEEnr608Kc/dHHPWhlHIBZs9P8/wCelDYOOSD2yOtACBt3UEBhg4NKxDKT37Dtijb8pyF+YdencU7Y27Gct0yMUxCHLNtAJY/xZpduGJJ3EdO2aX+FxkHjHy/WmhTu5GPUe1ABzyVPBGCCe9PbPy4OPocCjDZUFcck9v5U0qcdPfGDxzQBJuxj72PamoMNkZHPbFKQH5A/Q/hSBfvADHb5etABxtwDyFA+lAXuCfTOaXhW5GMHBB7Uh5Uk8KTxzQA/J8vp1z068UxV3A5OPqMYp7KfLByTk+n0ppZQSDgZPcmgA2fMDhSScA+9BxJznoOrdxSqpXlSSecYGfpSblLjB7DPUmgBQR945Kj8RUUi7cHAIUYzUoG3IyeT92o2+bBPTsvf8RQgY5ctuGMMf4vShicbh0JwBnAoxtBxnK9T2pejYJUjtgEnp0pgMbMakDGMcmjceDnHI+bNLsG0Ekr8vTHAo8tezcZznBIpDBmzkAKR6H+dN3Hb/dHXK0BN3zZz1Ocdu9KFHPOD22g9KYhH+ZjgZHT73JFHKhvlbB7ZoKlhnrjJ4HvSuCf73T0pABYtggHORyD60zkKM/eH8OcU7ZuXI5bBxgEU3jHA3cdRzigYu793t6H8/wAKQD5icYLHG0Eg8d6VR3UsW7Ad/rS42ggjPB6n26/WgBzH5dp+pwaTd8w7lhyM9BSKvfO/bx05oG3acgn5gT8tADj3AyA3Hzcmmj7uT8o6Bc4oVflxnfk5GBR6kcgjoAc/SgQbj+HTIOe9ID1GDj0J6mhVO0kLhdxPf1pDt2/w4xjnNADs7VJy3J5Oc0L94YHI9T0pVQZI45Yd+aXZuXgE8dl60DEX7yAIcg84PFKp+YDG7uc96UA8YzyRkY9qFBwoC5x7UgEk5JG7jNDfL24Y9M5/GnFS2SAeuOMUnO4tjnJ980AI5B5OPf0pvTAJy3T5T+lLtCr6EADAPNKx+UjdsOcnkflQAeYWUkfKSeR1percNlu/pmmngdSjd8dwKTllBwcZ70wHs33cjH+zjFNUbV4B9qJG3Hhud3bP5UNnkbec5HakAoX5VJ+Ygd+opu7JJxgZzk/0pdp5wv6HFOUY6DJ79/w4piDbhc9s/nRkKck7h9O/+cUFDu55Hb5TQvCgBsEDk498UAH3Wxj3PHWkRc59Vpyj95wx644HNMIO3q3TnigBc+2c9+uaVvmbjrxkikUEDJOATx8tDc4B49M5HegBy5UA/wBc0m7cSTx26flScjgjIPXIx+FOAKghc+oz0oAayl5CQM7s96QttOM9OORyKVs59DgD17ULznDEjr70AJ/EqgncOMenXmkGVUcZweuP1o4bcDu3Nz79KQc7SM56YHQUALIwPUdPm5HWlUbGX3/nSMw75JPTJ5JoXLMDkk9+RSGOaQFcdTgkj1NJHkSNxk4/hPQelDY28k7vcc0q43cn5uB+hoGNUDdwcnHccUbhsYkYXHrx0xR/CANw446c07b8sgXngHkYNAhVyEGACc8c9BSbstyfofxoOFYjPsBjGTS9F+YEkdAO3vTAQ8cHhSeMf1pT8zH5cZxR905J4+nt/jSMMDGSTgdutACcsRgdTjOOpozukOMj8OtLtHmcHktjofSmsuCQ/JHA6igBy9RwBuOAQMGmYWTkgep9hjgVIqnHzFsZ59uKYWMjHjGeemeM8UgEQ/OuVH/Ae9I3Mnyhic4PPQU9R0Hv37U3aVRvvA57c45/+vQIN27K/eAPA70p/eMScHkcdqRV6spHoMH+dOVDgEjoueOlAw37iSMbiOVxRxI3Tc3p6ULnH+0Bg46A/WhschQQc5z/AEoAA37w5IUjp3/Ggkbjxg4xj3oXGAOxbAUj2pWO5eCScZzxxTASM+XKflxx0HX3pMK7DnjnHtSx44IxnoBnBPHPWkPPAGR0GDQITcdyg5AJ+71P40u7fl+QM5I9PaiMhdp3E5PXFJ8oQbTwSe1ACkFVJC5OeBmhg3Bzx3X2oXcvHTkcU3BOSflGcfjzQMdkbSFAx/d7n60nybSR9w8Y9aVW2tg53Y5yOlNGWVQVIwO3NIBfur8o9ie/0+lBx/u8fxcinbuGB5JPRf50jK23ABI2+lMBuPmA7Hoc8/jSoTsYAEAZxSrkcYAxgZbtSNk4AIyOeD+lACAALlflzjLUdgNrZ3dulKuQAeWGD8uKXLZGBjheccDikMTdsBGBznt+lL1Y4A3LgY7fWkTI2ndg5OCwxTl6gZycZYn3piD+ByBjnk9RRuC/MQQv14pOSnXOB0Helf8AjHPt3pACn5cMOvX3FMOdo3DIABxnIp/MgGGyTnt0ph4XB/u84HvQMkON3I5xwKYFHylvmPU57U52xuB4525xTSvoSA2celMQv3mO4YyeSeo9qSQfMWK5B6ZOTxTmKqTkE9f5ZpFBGd2QepPtQAu7KnPQ8A9OKTdmQvxjnNKpIjztPC8D601f9YANxGMcEUCHbtuHG4k/pUbZZcA5QAHb6k1KcJs3Lx25601CC3ORyGxtOBQAzzS/GzkDAz2pN79Secdxx1HH6U/y1beQ3zc8YoWNGkBMoAyuf8/jQBGuN3G0HGTzkCnqxZlPI74A60qx7Y1Hln2JHWnIjDIK4OOWoAi5PIGVzgZ9fWnc7mbAJPPJzT9jLlepUge3SkWErj5fmHPTPFADN393JAODg/59qPmUtgYOf8in+Wy5B4buAMjpikWNm5wc54wOlADMkMuFzxxg459aEY8leAT1xyKl2tHy2C2Ontmk8sYOWK7eP1oAj3MvG7cM5POKE3bn2ADj0/On7UJOB5rNnAxSsN2Bh1yMFR1AHegBm75Rlxk84x0peShGwH0Ocn6Uv3WyevYcZ6dKTadoUru9FHBoAezbl5wOcBe2fWm/MvLhTgHGB/SnHceMZJOMmkbcZAuTkfLnFAxGdgmCBk8Hb/SmDfkAgEDHtT2wmOAoB6Zyev8A+qn7PlCNnOOTjGPxoARG3oCSAq9iPzpcZXoo5yB2xR842kqdvQYI6+v5U8ptUE5HPC4wDQApbauCCoPPrRQzEBuMj88elFSx2K0a7Y1A+YH1PSphuVs5z6ZXJFRQ/KoOAc075RuGT/vYoEg2naMN8vLcjGaUbgvBA56Y6U3jb90sDnB68UqsEbkk/wC8P0pgKd38Sbx93k+9G0JnKAkH7340NjcFBKgjPzdvf86TJ+YsAcn/ADxTAc+P4923PHIxS5Me7kA4/hGT9KRT8xYLyB3pqqG+7k4x7HrQIUfd7lTyE45NKzHg4ZSOntSbgMjGWII60gXdkAjrndSAk3HoCRjjn/PWjPQ4GW4BZRTGIb+E+1IGPXGSO1AEqn5sdPTAxikwPmxwc+v86TjkYOB1NC/NtBB65FAD/wCFcenoPU03PYE7vY4NJuzGMHPTtTehYfwjHagZLu3LtI9txUUwtuUckn+7n9aRWG1gc46/4Ufd3BhnPX5f0FAD2YquSoG3gMeTUTYUkDqDw2elOZ9uAASM5C/40jL0Uc5ycdaYhVB+9kK35mnqW3D5ju7DOQeO9NRwuSBnjGc0KuWHHfHP060AIzsoKj5we+cUAnacYB7sQc0qspYcgHp0/SmnoxGQ1AxDlWYj5snq1JHu+9tUd+nWnBV3spGXznHTFBYbgejdf/rUAObcOrbh3xzTfm6kcdOOtLtRFXcOTxtx7k0Mqk+g6DmgAZmBU5GOflFJyWJC7fRj2obbznG05Gd1N/hGThSOc96QxWYKSSdpzR8vRuWz0xSKwVlzz39jS/3ckjdkdaBCM3zEMVBxyc8U4fLgheAc9T+dGQUQAKxHXmm56E5POMgZ2imAu7aQQe2Du7YGKB8y5Kk98dRScbe7bvakOGU7c5P4gUCAs2ckKSfvFTjmnqx5b5vSmD95v2nBB6Y6U7hmwG+mDQAvLcYXK8gml6Ae46rnNNDfKCOp6cZoXpyRt6cGgY/eWYEkMeCGIoX5cbRkD04+ppDtC/LuAB52854o5weO3K4oAVuPbnpjPNHzKc7fnzgbh370YO7IA6+lIzdcNt78jr60AIzMVPznkZJzwTQdwOQN27jkdaRh8oHyk4/KkfuQ20ikA7eQuBn1AHpQxb5Tjn3AxSHA4OCxA/lSbdynHTpnNACs3GMkDOMdzxScngpkUrFdxJ7NySMUik8knbxzxQMVWPDEfXBPTNLuDMflxjp/9emdcr932x70q4T7x2DrgGmSSZJ3YK+m0DihmLMPTuT2pu0E4zx9fbrQB90YIGOwoAeGPr39ajxkYxnHqAe9Lt5GOBkdqQsccFenp70gF3DP144GM05RtyOmcfdJzTPutww6+tLt+UDJI4JOaAF27mPClu1HHB25Pr0pOjHknnHI9qbjkdAfrzQMfu+Yc56D9O9NPy4Jye4BWlbqCD+v1/8ArVH9cE46ZoAc2Wwe/A2jmlBK4AXPYZphwuOmcg0KGbHfrnvQAMxZScjBHSnHqPunnvTTjy8dz74pAdxDA55AoAf1yc8jJ4NKpZfl5AyOvXpTWxxwN3QcGhRnv78H86AFXsp4XGOO9J95DjgY/vH+tJgdB2zxTmUsrZcDjP8An86AHBj15PUDvxmmkhfl+UA+nf2pT948jjPbikH3uWAY4zzx1oAf90ZDbeW6kmm/ez8ufUdRQcY+bbxnjNHO4imA4sWb738QzTVB6dTjjjOKOWYE7eSP8/zpCR0BG3HUcUgHL82MY+92GKRcbQG4yvbp1pfuqQRnJxx9Kbnfk8N0PXjigBF69BnP8X1o24Y4y24kHafen8Dbg9ucGo+zgYU9CCKAFZm3ZxuK8cjBobH3sDAIwBRn7zcHORmk+hVenNAD2YrhcKSOaFwSPm5yDk9RTfvc57EnI5FLuHzAcN249qAHIzbhk5Pbtjg44pu7dzxntmlVdzg8dcfXik3DcM4HGMZoAepbf8rZbI61F/Fnb2wfT3pyqWZTnB4HX8abkbQpPbA5xQA/Pzg7c4GOT0piqRsIApNhxnBwR60p+U46YPUmmIcrFeFyuf1FIpZcYIAzxxTeGAztHTnPvSMfmxxnPHX1pDHkkcBzt6fdBNHTJJIHA64pMjBB28DOenftSd23E+pwO3rQA9FZepJA47Unc4x0x6UmR90898Dr7Gj72ARzxyR1oAdj5gwGeM9/ypq/My4G04PPNOVgSu7v3B60z05yfXPagYucc8Z24zzQwG7IHzZAPzdeKaWCqRgE7T3pWxuyMZ3Hqc0gFO7j5R1+pHvSqN3UKuCMAdhim8Kw4GcHH/16Xjgjg8e+OKYCsxYLxuPPfpSqO5AIJ9OTzTNoVedppzfNzwvI6dKBDmZm5znk9OBTMBVyR8u3pnJp2Plydo5OMGmnLqecNjp+NAx6t0Ldz0J6UwEsnHzAjq3PenNjO3OOo6c03gR/MOccUCHc+YcYX5skn6dBSLhcDoOu3tQzFpMEchu30oVQwA/rQApzz/EFHdRgHFOUAZBOSxznHNNVtoXK98ilVemPmOeeeRxQAM2VyWGNuAPxprLtOwcKOg6U6QAcYbAH5UjfMzZBx1P5fpQAjNuzhApxg8/macr7VHB6gjB/I1GVUepXk460Ko8wZC4JAHWgB4kbI+70z6Um7coABzng7utMVVCoR8wwAOacMKpXAzjHB96AHBydp6vnIGePfikDE4yrcdTn9KQrhjgYKscZHX/OaFAAx8q49D3piFdvvFRkjGFyQMUjZPBTOD1BoZm3c8dCD7f5NIuFUKQB680ASFst02+m0kU1Wk24O9SR/CR+VNPzMPlxwOevelVtqc4UnaevXikMkMh3A5YEj25+pqPJkX/V5weDml2hl4wCSe9JgFVHCnGAPp3oAXzCyjHyAHjHPPrTd3VWXIHoefrSBc4Pyhs9M9eKdGvyjovXnPU0AOZt6YI2p39c0hk+baVUrjHJpVU7VHBJOevXikVe7Djd1HegASV13LtC+vPJHpSLIY/Rw3949aAhVSDnhc5+ppyx7pMMnO4dKAF3FlJ2qsff+tKGKqVVVIxjmm4baoY4yWbOaVV6nGR0GDzQA7cFUYVlB6n+lFKVZmY4yP5dKKljIUGVBblgMdCKd+828Og45GacMttBXlR1/Ohojt4LEFelUIYzMxO1c8YGOB+P605WIO7c/wBMd6FUNgsThcjp6cUq7uFw2c/dx0oEN3Pt5YZPJGOo9KVZDwXVgTyabt244+7g4/GnFuBgkhewGAPSgYpY7i25VJ6qBTFYsoOBtHG1Wx/n/wCvSt97IPGAxyf5Uo+XBznnHX8eKABWMmAMdwTz/LFJuzsL9enHQcevrQoJUgjAycfNSf8ALME9OOnT/wCvSAUBumct1x/ntSKwbbnoenv9T2FObbnI9ePb2pOdxDf3hxTAWNjxyGxwM8jPrSg8ng5/i7CkVR8oCkHbx7Uqk4wOef8AOaAHfwnAbOB29qj5LEHt2NP2grnA9AevemhuWA4HtQAu4eWQQc9wBnP50biwAyB7cij7yOMMeoz6Uu7DZDHGAT7UALz/ANc14Xnn9KQ5BIUYGfoPel55P8Ofxo4XGAMkHkfWmA1flx1wOm0c05QGY57j05oX1U8ZxSblP3uPXn16UCDlsKVz2AAFCfKQo/VT+dC/NnPygDluhzSrxwR35+bP4UDGgBVOFyw43EdTSKQMDJHtg/zNKV6BiSOoB4zS7juYAYOOg6CgARvL+VQAd3fn9aTIXnawJH3iKGTP8Xyseg9Oc0E9xx04zyaADlgNrDPPO39f/r03IGxlzyM/h6U4q3B2nAz8vc0xstuXOcHnHpQAcchlwf7uMil5/P5cAAD1oYhiSCVOD9enFAUZ5XAIz/8AXoATgFj1GSPu0uV4BHsecD2pOVyvy5PHWkVTsPGOB35HNAAxL4DHd77f5UoyD9DgYB+9+dLt+XDcf/ro3E5AJI7Y+tAgZugAOPu5/wAaNzbTggBuOeaRkI3A9en69frzQc/7wyB9aADcQSMkA8Lj9fpTt444OcY2qcg0i5Vsj3HX8acFOW+UE9c5oGByrLkgnJx8tCsozgHaO/Tv0pW3LwBjB5H4U1WHU5wec56j0oAduI5zgdcL2/Gk8xVbJPynnHIP0pDkkcHLdFp24cct15J5/CgBu5sdAFJyQOTSK21gSCRnI4x+lI3OP7xHNOLZZSecHgDmkAgYlM5wOpyM/lS5Vz84YD+7j8qThVGMjsPSlYlvmOTjr7e9MA2ncpBI6nd1z7AUmeMnjvjbg/Q05sbsnPHQ470YwzEjk449aAD7uCOhJ4OfWkGWbk4br0/lSKp2kDdzml+8AcnHQn1oELnK4BOT6DNDbWIIDZPXtQAe/Izj68U5QQq4LYxwD6e9ADWK84OO+M5pGIXeN44+tOOcNyBwec8CmsSNykgD2NACbu+4Y7cUYHI2swIx0GKO2Tkc0gwo6+vPT3oAXPzZJxzxkYp5YKnBOMdM/wCNIAdxb72D2PtS7Sy9M8YNACbtpGc4yB93/Cm7wM87R65PWn4IIIBHQ4+o6UmOeSSDxzQA12PXJCZxt659KTdk8ZI9+CPwp20ryCSe2e+OKUD5lJAY9B3oAYThN2SMDJ5xSqdsnOTg4w2BT9m0j5sk4/8Ar00KW65JHPuDmgY3nBA4x1O6nZGHDcjjBUdKPL+bv0POO9CrubcRzx1NAArdcHj1z3NBUMpJOBjnt2PpQykqMnJxng07gDBXOD36dP8A69ADTINpyeATjrSrleRgjqeaNrFhnp0xn8KXYygDbkDnr0oAASehbcAR26+9Ix6qM+/GP1FP2My4YrtPJP4f/WoYNubn647UCELndgevc/p0+tM59DjHHyj86eqncuOTnsfbFNaPBxt4IHJpDEU9M5yD6EZoD7ecsTt6Y4Ap6phBnlS2OKYudoxkrjmgAHX7xHvnrQegweScEKcjnv8A596djbnAYHGcimsuGzjnd39MUANY9SwLDt1/X1o+Yfd9gGY9/wDCnbNvI5GOnTFMMe1sk8dRzQA5mw2Bu7j5s4znrQB1ADH0+bFIFCqCcg44/rTuqjJ9T81MBWYrIMnjPUDP50ink4Lc9Mc/rTowFZeh7YU+g/8Ar0jEtyDjC9GoAVRlwMsAeflHf/IqPgY3ZBbkDbmpFX049se1IEZcLgDAIz2NAhCokO3BbIxgDFM3YUdVVvbrUqxFeoA4OD9aYq9B8oA4oARs7dvzN3A20m4ruBZupGefTNL5Z2Y2be2c+9CgqMAd88GkMbu25Hy5xnnPH0obd8wJ47nB/lTljPITIzk9eKayFc847lh9KYDtx29jnrkECkDNyAcHGOh6UNG27AVvvdc+1G3pkYJHQ80hDkO0g8A/7pGB/jRv3cZUt+Rowd3JOG5Ge/NCr5e3B4IzigYm4bQuOeRnGcnHvS7juGckbieRihFbd8py3ue54o8lk3AhcZ4Y0ACvjJxlR6j3pVP0IJB4H/16UL1IO4AetLgnBC5HTkfWgBq53AHIGD/D0FEbfMAFGOMDHpS+Xuj24AGB1NG0fLufHP8AD6dqAEVsgn5hjOcYoY4xu3dieKd5OOpGcY20FM889jkUAIfvD055yfXpSZ+UEluR1AxTmj+bBOPmxz2pF/1eAeTwMZpgJuEhzyq55/D60h+bJ7YyduBS7dzdcEEAA9uuaNuVA6DHbjNIAZgegcDHPOPwqQcAnoM4AXnt602SNo+vylQM9weaTbyQDxnqPpTAG24U7CCRtHOAaTcfmXHPsc/zpxVox0JPQf401kb5jnK9jn2JoAYzKGbaHAPABo80xsACdwPVhmnNGycbvlxn3pqq+4dDjHGev+c0AN80qw5U9cHHWneceoZS+MDtxSeW0e3aF6dqFU7gQcs3B5FIBQ7cgY3ZPQnHrTt7LhujA8deabsyyk7T8xpcbmU5HBwMHHFMAZ2yQQAWUAjB96NzMCTgbuxWiSIgZPAwG2ZprENnB6dOaBC+azNuzycDp1/WkXO3Jzj1B/Kh1Ks+SrKMHk/jSlTx8wLZzgcUAL5sh5xnGeM5yKTc3TGQBjdyMUvllvmyo4PQ9abj5QucKQP4u9IY9pm44UbT8o9aTc27ON236jAoCllU5AOT/FTRgKB06/xd/WgB3mtt6DoNu7n8OlHmc92OT8q54pQpMYxgEEd/amx56Zxzyd1AwWQ7dm35R1JJPrSNIc7XXGOSFoVSyAFONp5z70LuVmGdo9R2oAPMO0/L14GW7d6czPgggMBxkE1GysV+6SuTjI+tP2/KcDHQ5FICQMVX5RkHJO79KKYepXfjB9T6UUholCt5YJxwB+PNDKR/CehwAaFb5cAcY6Uu0bSM87c84/OmIjb5htVcAknvx/hRuPJX6lm60vlltuAAuW4JPNISQ2ck8A8HiqENMmVyDtTAYk80btzFse+Dn/IoJ75YfKOmPWjbjd1bk4pAPZwwYkAkAfd7fWmSHauSMDGPU/WkYMrdcg4HPbvRn77ZJ98+/emBMxyqtkYzgnFNX5gBuGCB83vnjFM3Ex53gnOMgfzpeG25OVHp0HP60gH7iCD1UZJK9DmgKBxj5SOdo5FJty2OOSQF9KB8yj5jjk896BDlx833iOjcdaUnnPQMT/8AqpvLkE/NnA2n6c0Llio3bSOOOg+lMY5djx/KDkMScc49qY2WyR1yAMinbv3a8jPQ5Gc5NN6HGdrHgtnt9KAFLDaRn5hyMHnNHAyR8pAHXGOaTaE3H+Jc/MOpo2ncMnkY4B4oAd5i/OCRnPrgn0o3fJu/ixn3/wA/40bscNnOD1xTdxZieSTnvx2oAeJF2kkqV6gKaarYUZHBPHOSMg80Z287fmOPmwMUkYG4dSCTjbxQAvmE5yN5Xqc9KRWO7IHTkbhQzBVPGSQCTTVB4xkAtgBTj86BjjIcHPzMVz9BSBuhxuXsT3NJxuJztXk4zkUbdvAbB7c8UAOyRu3AA4+YnoMdv1oznHy5yMcEY/CmNn5iOh+mTT2XcT9clc8UCA5CjBO3OD7+ufwpCweMkHI/2eMCjaG+uDjvjNI+W3cDjH4fSgYowcYz97gn9KTdu+8xGdw3YxigjLEnHH9KO3J3DbgDHGaABT91hyM5zSHK9vy7cilbJbpxnAx0oCjjLdP8QaAG7sZ3HJBxx1pdxHUewzjg0m5iPUcd+KXt1OQevFAC/ejA7ZPb+VG09cAHjGV/wo+bbjtk/SjaFY543EHINAg3FTjg/ewKXIbgMo9SKarbW69iPvUrPuZh649KAHlgWUH+9yScjp0pPMPynIww4J4/SmlfmAz365wT7Glycnnt36ZzQA/jJGSAcHJGKQyjnf8AL0bGcc01l+b72VB698+lG7ax+YHOT6j8aAFaTzAxOSx/AU3d6tgZwG7CkYblPHy45JNO53LkkDd39MUgF6MRyR2OKTce/Ix1UcUjBioJxu6k5xgUvG0EE5Az9BTAdwxXDMQB9/oAcU3fuUqG3cfn70snLEg454CnrijdgN82e4BJ4+lACK3fj/aZRnvwKdu3PncwOPSmfIc8bQffmhVC984HP+HFAh/LDdjb/CM9fWgybiMHnGCqmk2l8YDHPY9vpSg/LlmYnOOmMCgBR8wPyjP+164pjOWzkHJx0H9aVstuHHTHI4xScfNg7Q3C7Tj8KBibinBID46EcYp24jJwB24Pr0pq4bqP1pTjcArbRjOWOT9aBC7u4U8dCvWl3BQO/sp5pq/KwOcEcHHFKW+XG7I69qQD2znHXkDLDHam7wBtyFB/zihvvHBwAc8HFIG2seTn+7xTAcvzKD83YbiOnPNKrBV6hSRgdgKZjDA/xA/3vSl53AbiAfcHNAwOBnjcVHH4d6TcVIAOfTtkAkUrfeBz1xhd1IpA7BtpwO/agBNvUbcjnA9f1p+SpJO0cqMr2pmep5757ZoC8nnB4Bx09qABWOByQPWlZwylt2Q2Oi96bu6MW5HSl9yx4HI9uaBDxIOeQOSefTNLxkNg4z94Gmjju23v3xSt8249scBv50AOZvVioHVTyAe39KRcDqPl68HNLG235d2MYPHqRTPvEcnOOu7vQMk48zheSSR1xnBxUeByuMHGMHPFDMV+YbSR3xz0PNL91ioI/D0pALG3IAYZ68HGTSbvukfeA798HpR8rMfnyOOe9N3DcCzYPZsdR3piFD7uN+09vX8qGy2Ox3fxdOnSlX+9u/3QelNbhyQ3APDf0oABJuIBPJ9xmlLbd2Bjbzub2HSg4UlST7DFMXIxyM5wMcfWgBwYmQ+aMADI9D70rktzyS3Tp+VIvyxn5dxI4JOfxpFzu+Ug7eu4UDHM21iw2qoO4HoB60ZDHODs6D0oUfvN27eFOMdvwpAfmGAOOTuHegQudrHGAMAj0/OlBVSGHzA+h/zmk+9gB8ADd+tJkZY/dU9c8jIp2Ak3Z6Nj5fXjrTNxbHc8ntSjJPUYxyuTxzTVxtBySc4IzSAXoOCpGeB3zTNxZs/j06f5zTju8vn+HA6fpSHoo34bOcLx3/z+dAC5wpX5eOeVIpuehC8Y+nGaAfMOQcEHjd1/GjG1WClcEdB3xQA4tu+Uu27vjtSbmPfnB5BzS8ybSSc5/iAFIvHzEgZGODSGG4xtjADZ6ZzgUuOcBenXb3+lAwzLhcdMep4HekXPygYYY5Y0wFYbcArx7fzzStnjO5hn+Lj6ZzSFduCEG0DIGaXnIJGTx374oAdu2jLYKt7UpbcxI+YFvvMBTVJ3bvfhhjnmgrh3Ofl3Y96AGtg9MBcZPbFP3bTnBPOdoA6U1l2rgt/wHOT+tJu3MCdvPJJ59qAH7zyx579aRm24J+UD8aaqhe+0HmlyfmwOTjOOTQIfvzl8k57g96b8w4GeRzmg/M2B8v8As44z6UfeG0DC4zjPegBDMGx0Y56jgUn8JbHQ8saRk5yONzY2446UYPA/i6H0BpgOzvwwJbHUg/jSe49cHI7f0pxBUDs2ABxwc96TA+VSOQemc/8A6qQCFg7DBIPQhewpfMHJ2dSPvdcUO2M7R27jr75pu05xuAIK845oAbuVskE9Og65p28LwAFGP4h2GOaC3zMcjJHPr+tNOS208dgcDHagYbl3DhV4PCn8sUZEfXaMckNSKT8oGz7vLdKNxIAGPlyc4x260CFbHmFcKPmPGOTQrCP5gVz6YpN3zBg4AycYGPqaUsWA+9tHGSBjNACs2duNvynAIODjr/j+lJjZyQQp/vcjFIVKtj5CoIPI6kigZVm/iGcEqBQAFl4wFJxgsp4696OmcYHq3XvSSA5GSpBA+8Pely2H7j0wMYoGOkYNkALnPbgjikHA3HOMYzwRn1prfdONh3A546ClweuOSudqjtSAUsNpxtbB5IHIpoyyg54Gc4HX26UbS3A2g59PahclQc5PIUA0DHeYChAKngHimr8xByrYbmlX5lxkqeOlIv3gNxHOPTmgAVww2gjoTtx+maax3bio546jOKBllByFK8AfU05sKwVmxzyKAEDeYpCuTznA/KngDkru6DGR1pvzLtz8uM89c07yyvUru9u+aAHMu7hgeuT04opCFJIzls9hRUgSqzcHnAGM4obBQ5/un+Go42UxnAxz82Rk0/ZhSSq5PTrVAJIpycfMBkZB4/zzTVULyTjpkGntgsAqLjdnP9aYy7WJ28dRx1piEX2KkbePzpCq5bGOvenEKoOEB9MZ475pcEtwABu6Y7UDGEjcAOcAk80jKFUEjC5xgCpvlXpjDdc0gx5mZGPr6CgQir8ikKw6gc4z74pdu3C4JCso5YYz60Nzt55PbGQKdtxhjtAPGcdPpQAeWDlxwMnHPJpvynJyQF4HHrTnAbLdAW7dvwo/iBJ3DGPmHGaBCbVYn+EDgc56UABiMDgcg5xSMMkFeDjbxx070qgbRySPp1oAOGUAcYOeOT/nrTWYZyBuOc56Zp2RwfuMRggdz/nFCqVbr8x7YHX1oAbtGw5JBPJPoOP1pWzgZGSTyfpTuNgwTxk7sY59KSP5eQwzjhj1+nSgYMu7f0H40ZHYqeDR8i8rndnk4pO+ScZPqMY/KgAUb8cYBxjmgZXqQD254A9Kdxtz0c9ML0pq9uFVjwMr39aAEXcynOQOO3f0pDhW+Y8g557c9afgctyx+6W/rSL7MpHTGM5oAYqjK8jbuICg9qUYGCffB45pdxHyvg7h6dPalVguOFzjsvOKBjdgyM4BI5z68U5VzuyrNz060wDGAAMdScc4+n409kCD5uPoMY/KgQoUArzjLdjTdowBjdxjA+vJpcZyVYgYyQBn8hQ2Mjcfl6AAdfyoGDY3N8uQRjApFUnoBnGV56e/6UudnIbI6gdf8mgbQMHBBbPzA9fWgQLgYIOe/XpTfYDHB298kjrTmBY5J289OMLQoDYyQ2eAcdvagBAOuQDg8Z6cUiruKkA4PXbS5DYJGPp0z60uMZBOWx69aAEVRtBBHOePrSHLdFxk44pSy8cYAJOO3WhV6jPTnC+tABt27s5OOM49aNhbPHfHQdaRsLlfu++TzThx82R6njFACFtuAVzgk4P+fSkC8/N0HOc8UrDkdwMHoMD3o4VeuDzztwTzQAozj5Rv/iHpmkC7sf3WHX175o7gkhh/ePWlwQeOWb0HT86AG7fu5VjntTeMfMOhySacyrxySCOnWlbg5wN3QbRjt3pDA4jHPpjJFJuLEgDGaXHUrn0OMdfak4IUA+3PIxQA7AD8ZwvX8fSjcVJJGCo5HH4U1sbgcDaefm5x+FBwo3EKxByeOfpTEG3btyOfT1oChsttZfXjH50u7kgEqBzjrSrnjYcZ/Ee9AhOPmCk7qVlC8gKCOMZzTgGGGzu7n5RzQrLtIUdcHOMUAJuCqcMOnPpTSpPP3vp2Gf8A61SLuYNjaWI67aawAzkAhsDLL7cf1oGN+7n06DgcUg246EtjjC1J8pwAAp78/l1p275dpYg569OO9AETL8u4/McDJPT6CnKu4HAJ/wBnbSpnJJbnvlRnPtQu0MVxkDoFHP50CGSEbmLD5+T83v0owG64VfftTzu4G5QDz0yRSN97GN2RkNjj60DGbgvB6dgcEkA07ad3QAHrwKCxGCJMscc4pdqqQNmV/p60CDGc84UD24FN3Fw2Fx6/jSsBk5bjpyOaVl+Y7huOe2elAxrd8jBxwvQ0m7kheT1475HpQe+W4689RT41XqwDKvA96BDAAvJG0D3HNKy/I6YJHUn6UvCqCowe/BNKo+Uf3s9hwaAD72cKQDyPYGj1I45+bPf2oVMqeSCD1UAZpCAVbB2FRkZ/nTAXd82NvuAOhpv3ugHpxT/4T8u5c46+9MMe7ax2soGCGFIAbbk4UtjnjjjB/wAaU4Zn4Yg8jjJpoG7B+UqCT932p4+VsEqCf4hkZFAxN3HJwcYBx+tIcqwBXO3jn0JzTwFUddo3ckr+oNMVRuHII5I+p6UCHIQuGYE4OMetI2EJJKtj5mH14o2jcCQXGMc+tKuFkC5wFGSG59M0AG0se68evpSFhnsD1XcelIY124JOc5wCSKPlbAyoPTDDigBdu0DnC/dGD15pGXYSOCOmCeaFAiwCCGIwBngUcqQW2nHQ45zQAqj5i5yBn+VK2VY5J9TzjApNoV1Z+dvBPvScFsbgMcnIpgCN5bHauCVwPp60pVfulxgdfaiRRtwfmAwMCkYjqGwOwx7dKACPJYEBgB7ds00Y2jB3f5zTjGGUEOwOOcdD9aRnVsLhRt6UwDcrY2kZz17UH733SAevHvzQw+4ThiD2/n1pCqhsAru6gkfXrSAGYLwC271AzxQcdAvDduM5pzKF/iOOuR0NM2qSFYAnrt2ikA4bR1OWzxjtQWAw2Ae2BS7ePvKxzuOFH0o4bDcHJ9OKBgoVV+bnHJ+v+c0DG3jkgdFNAUbiCVIxjik3fuwDtB/3etAC7Qy4I7diDnt/M05sK2T03eoP40hUGMruXb1Ixjj/ABpNu1snBXPTANADuvUAd+1KyjPTbuOQAc/jSqv7zJUHPoo60hQJ8meOB0HFADSD1I+U9ycmlwOQeMMO3b0pWjRQfkyOmF9KaQhYkt05/H2oAT+Hdgd89PypdvT5euBzx+NAG3qM+p2jP16UbV/i+YFgOR/hQAoB55OAcYxSFRtyqkDpjOOKCo6byRkgDrigoFU/Tqufy60CFaPuMnsDn0700YLEDgfXk0pVDtGMA9m5zR98Bm2uBxtPAHvTAXaoUEN8oOASaB833QS27OcdaQsOCPl/hHvQsYZQMhueDnpxzigAZflC4LEddvbnik3Z46NkE5I45pTt8sjO0jk7uvsKVVLM2CCDg8gY+lADdpXcrLkhfSm7lVgSGyMEe9O4bB+62euP6Uqr8pwwJYYz6etICMrHtXI5A6dRSsq+WzY4we3fFLuLKcgL2+Xv+FPA2/MwXAGMAEfnQAxmCkggEZ4z39qFUYBIyhpy8qegPcBRjIpU+8BlQe3BNAxvyshbaxUnj8qQKDk4IGfTpSsSrD5vlHKlh/n2peuNxwv+0KAGbVbO1SynCnH1owGJ2qSfQcVI2fM3EjDAYGOOvSmrjPLcHrkc/SgBSBzhSFXio1C87Q3HoKe2FYgHaG56dKdnDEkk/wCye9ADGVVycEAEDJPWkVc4ABA9dvWpN204UgDGfmGeaFVWADfMeflYdTSGN2jacZ3YGccUgjOcAHKnP3etSKdiAjAOCSMZ79qPlXGArEnPTFMCNFHAxkkcgjGO9NaMYDKSx/iGOcVKp44bZ7e1KuDtB+ZemGoAijh+Xo2MnDZpRjjHIIB3ccU7cMLxs254UdadtCnGd3Y/KO9IBu07SDySciil2qM4LAjgdelFSxkagttBOWxnjvT1kCt8y9uFbrTEYiHIbJz1NO+ZuNyllHG3BqyBZB+6C/MHb09qTgBsLtbsDz+NKp25GSGAxk9AfSkbO3nC8fwnn6UAN4XB4HP59f0p2VVSMBV7cUo2hipy3GMn1ojO4E/Lt7nPWgA+XawAwTwBR8oI2jg9sUqnyy2VOcdiTSbctjIUrz3JNAAzDcB83l9Dx1NG7cc4HX5uemKPMO4Y25HI6jj+tJj5RuO7cMnH+eTQApI6jc4BycetAbqBy4zk0M3PHA7Ag8Ubf4j8x9c9aABlHQA+uD6Um7aVJA9eTTmAkDnIJHvxTD/eAx05BBoAk2/u8YyOTn2z/wDWpn3ZCMfMeSe9S4KoD0HPG3piomCknvkj60gJOQuR19u3vSdeV4GCc496Bgqw+XO71x+dD5GSTuBP0pgNX5lLLux2B4GabKQMnGe2emBnn+lPZg2PQe9JIu5eDu78DPXoM0AP5bJGRn8KY3DEkZZhjP8An6U5ccqeG6DJ7fjTW7kHgHjnj2H86AHnEmzHAJ/pTd3l4LcD+HNDMFTGcEjjd/KmjcV6Y59e/bFAxP8AlngDn2/nTcrG2QMKDxmpFyM5YkrwBjv68U3lmwdrHuB/OgAYjqRgrklfrSoCvBG5+pIo5LFScqOpxjrSom7O44XOc4/rQAuSuQM8evUUnG7C8duOhpw24OMMMfNz1/Gme4PJ6sOV+tACv8vbBXnH1oyGHIwGGAPSlVRsDAqP7xzwaaAY8FTgsTnuPrQIUsFbgc45HelyGPHzH06fUUbRsBH3j/FikA3bjjcD7Y596YA3yk/3hwP6UNz1Xnp9D6044kXgrhepPemNjcc8kjqMikAN6D5sc8dzSMwwBz7nrS7g0S8gHqR+XFNUbWPOCOTtx+tADvuqAMdc/hxn9aVpF253E+nFG75WOcn/AKaccULztJYg465HX0xQAFRu5XJz9KBhhuJxxkt0x3pc7tpbGV54NHG3kqxxnBPvQMTdhc/eUHNIwDbhxnO7nintkN1zyOOnJpGIXqOR78kUANbG3AGePlOKTjkYxz0/rT5Og5AwO3P/AOqkJVWG4YHXA4pAK6jaOMjPy5Pc96YGDZG329eafJxnLDnPpTOm04AzwDzj60AEnDJjJI/n9KOMlj9eR19qGBaTPy4YZPPIFC/KuAPrz0pgIMrt475xj8qdx/CpLY5OKNuflztDDsDTvM6DgdttAhFwwGBkgYPtSgb2J+9zgAjj60m0ZLnle7ds0juG6Hjp1xmgBc/KwAAwDk5oAw3K9+x9e1H3eD83PHQA01mHfkt3/kOlAx/L7ie3XPX2oXPK9GPVT0o2/LxnPuM/iDSu27GWIUdcjg0AJ2yRnbz17mnDOckZA654P0pMELkrhh1xzzQ2FyOpxwM/nQAjf7uGI+b6/wD6qafmwAcZ9qVsR9eBn5c/401jyW4yO570CFHX5QAccAdz05pY8HHy8dzjNNXDnKuDx93FPj2q27gKP7poGH3WLdgMbj296B9MNgDNIzdOQVJz1o+UbWOM926fzoAST5SCRuHbPrQrcseD3/H2pZB1O7aTznPShPlUEqc9vxGelAgwcEjJOOSf5U4HcFUgAZBqNecbTwOBz2p6jauTkjGQePzoAb0XJDDJwDmnY34wWIJ4GKVc7jlhuJ7jH1NG75uDg9MYzmgBN4Zju65BI9KQxlmLBcknGKVeuT82Bzj29eKbuHCg4HoTQAqvuYZUMR+hxSbdrkgbjjjNGN7DGGHQntn60jSBuTj0x2x2oAeG+TBz7nPakydpJB9Dk+3al3AKFBxu5wMHFMyepK8cY2nv1oAVGVVzyMe3ekUtHk9s5J7mlyFYjHbAwaa2Vk7HaOmOB7fqKAHLhoyeh6CiPcDypG3uemKVV+Xgj8BxSMc9CpwOVxxQAqsu3kdc80gBVsgYXqGx096cmBz15J2ikySMZwCeuM59qBgxBVsDlsdKTdtOQPk9/WhSqlc8Z4KjHT1pMkk8gjH40CFVl3gsDkc5HfBprKVb7uR356CnIFDbScLjHTBP4UjfMxGR8x556imAscmWyck9Bt6UzbtUEHOetKq7eo4HTjH4UcHGDtHTr2oAezDaMr8/8PoAKZhmGcbmOTmnqhDLkfyxikZhu44JOeef0oARSvIcdsDHb2oVS24qO+PpT1G8NycZ7U0v8oI464B+lACDHy/L8uOV6UMvLHZ/wHNO29Mjcc449PWiQjI6r2OaQDUYowDDnHI/kaAOig59qcudwBPoMnr/AJ6U1SEVhgqex4oAXlWAAC84Pp+NLgNg7VBJGB1FH8JXPUZwOcY9aXcVBBwMYP40DHR434I9zjvQuVJ+Ukn5h7e9IjDGe2D0HIpGz3YdOuOtABuG0gdehPtQ6hVIUZAORTsgABgVA5wBxTOV6kAj0/PGKAFkwzvgknGADx+VNb5MrjnOTz1pWynr79zSfwHJOB6LzSAcf3nABIz+Z70iZIJPyf7tKzHcTuXaDwT2poyq5x16MccUwFYKy7TjHU89/SmBumV2nGNp9KcF3MwB4yMccCkxjHOec8nBoEHLElBg/wBMUu7zMEAFf9nqKDmRVJIOeME/1o4ZwSeWGPT+VADmXzORyeABTQ2cKwzjqv8AWnOp2gdcde1Iw6ljkdCuOp9qYhHVfMYrztHFIpO4Ky45yw9f8/0pzBguSOPUH9KT7vzM2AAOo6Z96ADCux2oWVRxu6037v3lOPT8KfjoPQYPYE/WhQ0hAy2eg3DHNAxpUMwwvysSQG9KXcdvIOOw/pSrlsn7pHG4nI/CgLuOMhW+nFIBPlbAVTjjcCKG2rkbcelOzzkHv+Gccd6SPnjPBONvXNAwYnnBABwMY75ob5crt2jHTrR1dhnGON3GPwpF/eZHJPB445oAd8uSdpA27dtJuAGAMDPTPBNIwI4+8cds/rSr8uOM44LcdqBC7d0cYONvpnrRu+YfLg9MelIoG0Ecj0wenrmgZZfl+Zuh7/SgB23EYC/U+9DMMgEAAdFpFARSP4s9s8/Sm9WbGSc89+KAFLD73/fX+FKfmYFhkn0pGw7HLBjjhgf50NgNgnO70b+VAx75Axwc8Ek/oaRwMHbkr0wvagKc5x3/AIeucUu7bg5xnnpzQAqncPkOQo5zRTv4j908+vSioYyBcbhkAcc89aMjoCMkc7v8aarYQHccnjnFO+8vAX5QcZIx/OmAMfmAViWxy3bH0o3De2H6dG9DSsWCt0Iycn8eKFDNuA64I+lMQgbhjkkDpt4zTs/MSCcDpxSbj0OT34HHSkRgOn+f8mgBWxk54GMg9CTSN98gE5xk8/1pSrDkg7cE9j7UjMPmz94888UCEVflI3DjjmlVt7AAbe420jR/LuIUHd1NOXc7NgqT908dOKYxEbd8+Mjpg96UMeAMjHH6UnzIoBzg8j2py4DKQfmzkjvQAJ6Dk/e2kdPrScDGe/v+lHz7doHGAD270uDuBPfI4oAX+BWyWH15GfSk9SOvscUvysikHHHr70jMuSMHnnHb8KQC524Oe3pnFJjauCMnP+c0LjBzkjByM/lS48vhz0OT3/OgA55UsxX2oduSPToTS5K7gvIxScjk5xyx4z3FMBSx8sYyecdf1pFyG6/L2wR6UdTwCME846cU1iNvGfujnFABvYZ3EgkZPelLfdIBGR0xkD3pNpVuWx0+nSmFlYjDcnNACtiM9Dnj2zxQwXkDqRjrnmlOeSGBwBnAzjimqcEDbnkY7E0CH7vMO3fwwIJxwMU7zTx3/wAKTcQEG0HhgD+dL93PAGfXj8KBhuCsvz578dqZuK4+UjaMYFPbcF37V+U559OKYwCqSQWx1yevvQINpXjbx7Uu4564XAGD6GkLbeoYBjg8cgUgO0jB3OeAOwoAcqbS21chemaNw5xnOQx96QttyvK+4PX1FJx1B/h447e9ADjkMeeT0BFDN8vp0zg0u4qScbQDkjPrTPfvxzng0AHmbV253ckjn0oVvlHzbR3460pyy9uhPTnrSb/lxwTjPtQMdu2sCcglsbewx3pV+b+Lg80zguedmV53ep5pzFdvOB8uBz/SgQ7AXarcc44NHzMwweM8jOaOuD2J2jHPag7eAAc4xjGM/hQANhQCeR7jkUi5bOD3JyD+lKy7GLHKjp8pzSN2xk44I6cetAxrH5SccH1FKpLk4PUjkHpQynrjLBexo47HOD1HHFIA+6MgEA/rSK25j3z6HFKVK9Q3AyOR+VHDcZJPfsRQAMNrEZ4z9485oUBeeG9CR0pCpyoxgZJOTTlY7Ww3J4+Y0wE+6o2nJ96VcbfQdBjrSbtqqWzgjIHrSd8Zwf8APSgQ7cNwGccfSk27lXJz6d6cuTg9/cZOMUmSrdMHH50AI3zZycsR09KQdMZJbqOfwzT9vzDO4c9xTdxwcnrg5ApDFHzcA8569qVB14GMH6U0Y5OCF9PX6U9vm6gkdPl6CgBGC+/T1px+6Bn6jORSAZPXPqeopFy3TH06UxCOdrZJ5/2ucU3buViCQcfezzT3UMc7mBxjPf6kUw4ZgAc8crQAMx2gHP6d6UHBwvQ8U1l+XlMHAzzSt97GNzd+eaBinPp+NG/exI6N703kY9VGev4Uox6ZOeex60gHHIy3OfpSK3mMcY+bGMdcUgOWIBzz+lKrEZAOTkKdw70xBy2G6gUnLbuDjGc8dKANzHCMCev0pwHQ4bPy5GO2aABn+XIP1OcUjN1Ocg9qXdleSO/GMClycccZI5xQAM3UZ7/T8KZwzE7iARzzxT/4vmyMAYJGKaT047Dt1oGJk7gBjPbnpSRt/iFzijbliDnqcHHse9G4dSTnHUdMUCHD5htBJ5x1603zNuD04IHtSx43AggYI70nG0c8Hqf0/pQALnC/3cd+cUbgjAnkA7h/jQuGYHBZScYFN6MeDySo6HFADlX5ieuBk96duxgkZHXjrTNw3cZx3A/rTlPO4KR0wB9euKAHli3+0efxzTRlOOh7cdPakUglQPm4I44P1oGWUABsgdP60hgWZmBBwc8c9qTJZicnJH40vyhl4+UHr+FJ8wHfp2OTQA7cW6AgcAdsUZO7B6KcZxQNo9c5Cn6f40n8QwSSc49cUwEZvlOMAAcFetLkMvJ46gnqaF+9jG5iCOeKYvzYxu+nuKBEnqQVz1zSZ3A4YjsAfSl7E/dz2xzSNIdx453cZ/HigBdxOOBz1+lNy23kcdevalVcc7NwwfejcNp+UjgAGgY75tvTJamhvlzn/axTvvSHhgc8gCm7RjPJ464oAU84AbA9z69aRPvYz9SDwfSlGWYZX2+7Td3yg859xSAVm67WyOo56+1GCjcnAzjIoxuUjn7pzxSvjzCNrKN3TimIX5t4weg6ZpeRntjoce2ajZhyO/PQfpTzwx+91Hbpx1+lADd2QWyfUEHmgtjHO498npQ2AMDnj8aXk9gfmBwcc0DGKp6DnuMHpSMxGQOAPfH40D7uQrfdpcDP3TjIDZpAO5zz06596OWzj04I60bgzNncPm5x0/8A1UbgFz1OOQaYBJnoTuA5De/pRgx8j8BgUmNucbs56Hsf8kUBQzL8uR0+Uk0CF49R0xTgdq49/wCGhWDKMDH4Zpu7rlvfH4UAGQxDELwMk4p3zYIIyeBhue/Wh/kw2MD6U1sSH743MP4e5oAPUMDjOMZ/Wjj7uzP8PNDcE5OCB3o2qGHzbR/ESR7UAIvMg4LevoDSrnd97HODk5pW+VuWwSScCiMbmHAbHft0oAb8rKzj72eB7U5Vy2CQG6H0pQAysP4uuRjvQpHyrjcfTPWgAyWZiuVXjkdDSMcYO4H+lKVK4BGB1O0/h/jSHvhWKnnpQMa3yscElgAOp7nrSt90jll6HJz+NOZR5jZ46d/u4pgG4cAsSOPm6/SgBzcLsbnjp2oP3u5K8daXYqYIU7unXn8qXbhieWYk+35UCEb5WI3EKOuO9MI3DZ0ySMenGakKjbnDdORnk/8A16TZyTk7j93J/SgBI9wGD8u7k8cUjNiPByq5z9aAgbkBuKOOo3Z6gH0oAVSycHcT7en9KF3Y4BPsetJt4yQytwDup7bQflzjqcf0NAxPl6dB0J+lPDFeGyGxn2pAny5+bgdO59OKdjIyQzcZJB60gG5PTdgj9fWinN3JUkHkGipYyvHhV43BT70v38hSfxWo41DKMDAPPTPNKzDu+eOOMZoAcygMTlsggE5P50uATgA9M7tuaT74ADKrEnkfl/SgY/vZ7cUwA9V5II4DA+vtTsBZCABheikfnSON2NxwuAvrRjsMcH7oNMQjk7TyDgY6nvQduDt+f5vrj3pX5ccchc5zUbKUXliTnkgYxzTEO+RVB3DrhuDk09cbR95lbj5jkYoXcMBuRyemKBuaMDdvzjjHFAxWG3cMfJnqpwMUbdyjJyWODuI49qd8p5JCgDB+tJjKleD68cfjQADAHQjJxyc498UnpngeoJ/lTuduNudxH60KoUjGB220ADfdXAOduQSaYo3bj1A5GDxSj7oUEA4x/LP+fajHzEKflzjjtQAE4UFcf7vHANKqgg8Mc8e/1JpuCVzj5uTnr0FHO3G4gtyTjAoEOGNhJVSc4wAMkUm7PBPB9zmg5k3Zyv0Hb1pT8ykA47ADkmgA+9GSSc/5701lHGQd2ccjmlB3buTjPakzzxwSO/HfrQAhCtkHcHGfrQu7aeGxjuRjp0p7Z3SMGAP+eabxuG4r9WGOaAInzzxJnGD3p46nBYn3GcelEihskNxnAYHvSL8vAbnPJHFABuwCC+WII6U9tq8ZJ7dAab8oXC89RyO/rShflwCpHGMd6Bi5+YEgN1zkYNJlY88nIxzuzk0u0+WQQccnn6UEFc52hSR90Z/CgA55b5gGGTg5pv8AsocoRgkf3u5NK2drHdgZ9PWm89CVC9eP4sdaBCsAvAB4OdwPb2pvmHoCz92Xjr2obd045GRxwPSkBdjn5VbBH6UALwoDArux3pxYbclunOM+1Jgp1PGBj0FI2evPI/CgYpb5AQMHJ6HpTkwPvEhenUimbRjnByTng80KTyAASTxu9KAH+Z8o9MgAr3pynkk59dwWmLnAAIxuwMjkUuG8sADgDqDjNADmYtIMHv689KULtUZGVXjtk/jTcfL9/ABJ5GePWl3dMfKo+UEHjFAgZvmBGAfTpilYBWAAzuzzjnHvSSLtYktheobGaaTwCCwOcZ64JHSgAZg6jpxwB0zTtoZ8EfKTjPX9aTO44Gc4G09setGCzLjJ+bGcdKBg2No6AdBnijghSefTv+VIW3DJbsMcUH5uM7sfzpAOb5ZGx8ozngYo42Zx7jH9aGP3cgdTnnvRz2O7B7UxCFvlODgj3zkU5WCrwSCOp3HimL3Y4UHJyBSbTyB93OOBkUAOJHPOTjgnJyaBs2nG0nP60m1sYyoJxkgUsgPOMEduOB7UAL8rYJHfAyDTFUdsgcD5T3+lOX5pFK7Tz60mNuSMdAOmTnNAx27aRgMG6Y6496Fw24gknHA6A/WmqD8xzjb97JpWV1OeHPUelAh7HaAfmx1HH5ml5VWySQO+f6VGo25Unbt44PX6UpH3cnBHU9zQAmcttzxnHXt/k01m7EleOKVm/wBrBzn0+v5UYLdDjg474oAb1wNxIwPY9acAcA/OB6k5/wD10bWZcjCjovHp3NIcjbuJGeRjvQAv+sxu3KMde1Io3Fflxk8k8innLKVJHH6mkDH5iTk529KAFLZ6twO4OKb95yeVPHRuP1pRhvu9ByTjPNKoO1wWzwOnrigBnykZzubFGFZTuzg9eD/ntR93kHBx9PzpVU5TGSCc4zx/nrQAqnaoO4g8k4INI21W5+Y8dRQNw44J6cL0pMAMCOh4C5xQA5juU9x1HB9vf3prc5XJ+mP60rN3HJ5PrSfebJxkHHJoGJyGGN5wfXnp9aAu3gliccAetPVFWQHAbnPXHY03YV5GBn0PNAh247Tzkg4wcU0Dc2PXJ5IB56fyp4xuyAxA65HU0m3aq+rcgAd6AG9TwTv9eOKTPmN/cB65bHtxTj9478AtzjofpSYLZY439cYz9KAE3DB3ZAxxuwSaEOWU856EetG4quGI+b1Gce1OZWYckDPCtjgUwBRtVR8wXH3ielKrNwT0xwwPFKG+6Gfb7EdKBkbl3DjuewpAM2qHHG3nrkHr70Z9u/VTinc7iDkZHB7U2TO4gfNx6dTQA5VJYnOM43EcjOaRmO49WyTk4o55Bw3zDpxxQM7hzu78ngCmAzpghiCoznH6U7A6FssOnHalX5ioZsdfmHSmKrHoMnnr2FAB8rYyfY8nFOVhz85zk457UoX1wPQZ601s7s4UEkZGf0oAF+6WDjPpj3px27j8/wDPFDKF6rk4xuGMZp3O4YUdePekMbxtyX79CKNq5wG7epxT1UrtBUKOg9T701iWzngAdMUAJtV2AzgcYyefrQoHBzs455Apy9VJ2sOCPy70bWbjAxz8w5oAa3OcE7cc9D6UrKBgbsgkZ5welL/CxKrhh/nNK6hVGNu3P3utADRxwHOMHn+lN3FsEZyccbj68mnDIYFio9D6U5lO0EgYbgL6CgQ3aMhcnHqxBpi/vGX5Of7o4/Knbt2clcZwRj+VDdMBsJ3brj2oABjd0J6Z9aGjG4gnaOvDUi/NgbcEn5eaccE4CdOeeD1oAaGzt+fAxk89/figqXXjg4/vZB+tSbdxyNp6HAHU/wCFJkqpDZKdSy0ANOVfDHccYDL2pjIG+6p45J9akKnaFX7/AFB/2f8AOaNq8Bsp6HGaYDRhcY+cY+hpd2cEseOB+VIyBQSQAnTOKdtzJ8vB6bf60ANJHAOQQevWnSAyKx7Edz/Kl/hJU5ZRg8fypu3LcFQW5545pAByVGWLjrnOKXBXacDJzngUbTjqCuM4FJjawy20dQ1AAqqSq/M3GSW9ad95fmZjng88igDdg7l+Yc45oRSzAbOewzjtQA04kwOrE/ePHFOZsK3LH03Y/SgkN8xbB6dOBg0vzSYxyc5HNADdyhSF3MD8u09PrS7SrH7w+h4/ClK/LjcNynAB/nSFScrnnPGaBiTMD0B3gcY6UrEqx3M20ckjnJpWxuwWyVGR2yfSkOWUruBHY9KBBuT0KkDPy96FXbgnI3Dcdh4/+t0pWU/dJKEjOc0m4BmwRjHT69KAF8wMwzkZHfnP1qPO3JG7bk4XOfz4qRI3XjOGx7HiowQpDAjGcDngdaAH+aflAZmXpyRTGUeYcHIz94HBB9BTljPl5GSc8Lj9aTYytnGOcBf60APjbKiTk8FfpSLlGJXhV/XPtSoh2kg5JP3ccUcqxOeQfuk0DFD/AC7sbm3YZhwR7UNjjg7hyW6GlClWZuM/z96P9WwwSe+7rQA7PHXdgdP60UnXOQM9PeipYyrGMrkAA+39akVegZtgGehBqOJV428A8ncKkVTu6KcjsKAE/h3biq54GOT705lDMcuAM9cdacqv93d6k5HSnKSq4Byc45NMRGw6bcbz2HH+elH3s57n16UrD92V4GW4O2lZT5nO0HJ+tADSo3EOcAgYz0piquCxwBjBAXPFO3EZJzuIPUdaUqcfKQTkEdqYhFWMLuyyjOdxJ/KnphcHO0k5Ax1x/Wl2k8cZBJ/GkAZVCFtx3EEg47UAO+VoywYj5snikX5mDEZH8Xue1KrdSxyOgpv3cD07Dr+dACthFyCCBg/KOvFJt3ZJ5Hcg0YC7cktjkc9aTnd7fe+tAx7H5uBgEc4HTrj+dRhRtwxUgde1SplUb5MEHnA60wj5zjhfQCgQh+6NoIByMAZpF+YDLYUHJ3EEj24p/O0HcMkEZxzTCrIoCkL6j6UAOXKsc7j6L7UmAeSys2eRj/69G5myA2OO9IVwcjA28Hd796YDz8qjI2t1/wAjFJ833CxU/wAuaFJIbJOAfr+NNwSfQknd70gFwGxg5IGB2pFX+HblQcsd3BNLlm27sFV5HNNAXcMj8/rQAfLhm+6AcfKOO9Iqqey7V5B3Y5/KlVm6K3HTntg0i5XJz7deKAHfLtBBHqzf06Up2bc9M9MZ/pTWJ5CNjaemPenFipxu+8KAHMEC8kEn+LPSmYVeWKjPQZzmhc7TwADgZHemljkgsCM46cUDFz8xAYk46AHNHC9TyO+3IHrQ2TuUn34/pQcqwIIJxnJ/GgQ3aqjnhPUHv+VL8qpnruPL470pXaoz0IztxxTVVtx54xjDf0oAXaMbiSB6jgfXBo5VSfuj680bdvJOS3JpApwuOOv3ulABtLbmDZGSTx+lKrBlPzDPc46e1LyY8sOc4pv8JbOFxigBWVt2CwBPzdO/9aco+6zDjP3QlJ8wXI5J4z6UL94lcjdzjNADmU7Q3VGOcAYP4U0r5fAI9M46e1G0lQudx6c+/ShWOQRx39j60wHbdzDqrLzggmmj5SQRhueQBildTuLg5c859qRWO5cEjj/9VACtgbdzcfqaNoVs7dp+968elJt4POTj5c/rSn26ZGMenvSAV88cfNjJORTdo+XIwe3T+VG0bSCAO/40MdpxnOBnIHekArMflOeCTgk8fypeik5BNDZbAIySOvYU0Nu6Ybd0zxTAXoCMjHqf6UgUD5sDP1OB+FLyFIyMA5JH4Um1skZZhQAoxwSQFzggnOaauGUFf4eo54OaDlVyW+Xr81KrFhnAcj075FACllLAkkncCcjpTdoJJAyAT2IP/wBenfMqk9cdAR1prfMW/wDZhx0pAO2hdvy5x0TuPr60q4YLtAds89sGmqwZiRjH8Q65pzfIdzck/wB3tmmAvy7ueqn+LuTQyncQPlz15GMUi7m+8dx6buKYVbGc5YdMnP41Qgz8o42jHcc+xpAFzu6jqSBk5oYHdxj0O4cEf/Wpct93OCOuDSGBxktv24yMdD/nrSqu1AcMmeOTxQIywj6Keu496XczOATtJ529QKAA5baPu+nGFPtQwIZeoc8Hjpz1pMl+MlvT+tC/KzDhhjHyigBWJZwOTz+BpdoTBbac+namt97a2cDtSRoYwcD5sjoc8GkAoAXLdPfPP0+lNAH3QVweA2MfrQMxsdp2/UUrchFVcEnOT0oAMKrfNjZj15/GnA8DoM8bsf1pAx2kbg3c8Y/Gl2sV+bJ75IzQAqqdpwdw9QP85pNw7N14Ge31pVUtjZwuOo45puMtg7Scche9AAijuVI64znPtj8KcUzu4AX1BB/DFJIh4G3PPKg/mKXYGPC+hPNACryPlOCOAH4NNwvOzIXqDnoP/r05cM2WP8XJzTGAwMYyAevc56UAJnHRtqnnPqfShl+b5uGPCgH8s0KTuHcY6N2pq/38sCTzj2oAcc/cBOT1HXmnqvTqpXgK1MXLMecY54603aJOmC/HegB4bbgKOcfN7c07d5iqAVYZ7jikQMwUcKq5x6UmNoJXBx144zTAMGQgqCAPl+fpQSP90noegpV3ZCg8MeSp49qbyTyfmAyMDge1ABgDnCtkfLgd6CArYIXPfsPanNuEZAK+pwOBSbeSpPT1oAQrtViQAw9Oc0H5lPK8dhx+FKobcrAYI6nFN25w2MnOOV/KgBdo2jGC2chc5oDAjIHzYx83UmjBjwcfL1xikVd/OASOF3D3pAOCrg7hgddoOc0m5VyTghupHYf5/lScBsjaFPtTiu1eij2oGLH8w5cY789PTmkDDj5dvOd/rSuPlzhSRzSYO75h/tD60CHKTkZGewwBz703IxgglR8uSTkUgXdIuNpPfH07UKSQSQPcmgY+MjcDwdvP3vwxSKVXkMOPQ8H6Um75RjnAPbPFHPABGd38Q9aBDi23rnLc4Pc/jSKwjO0uQF4HHXPak3NuC8Eg9+lHLYwdu35Qw5FMBGbaMZwSMBTxikzuYgsoYHof60rZbCl8qelGG54Az39OD/hQAqlfmwRg8egWl3HpwSwx8p6U3adpBGOf4RxTlLQqMYAJ/hHakA3PG1sKV4B7Gn/LkDpt5BY8fSk439AcZHT/ADzTWboPlXHoKYDtzBmBJ+U8qP5Z7UD5YzjOD02kc0becg4T09SDz/n2oX922cDOcUgF+Xah5PrzzTR94pgZ4JPWnfw5AwCMdetCsCueducfpjrQArrtxnKcdSKZwyMcZ/u5B47U7+EFeeD8v9aTcMFsjpgg0DB8OBt4AH3iccelEe1fmIwB2HI696VsMxOAVx+VJu/eAbtoBHU5z70AIzFQV9+oHNOwBk4VAeMjIpiN82NwAI/E05SzSLtOc8cmgB27duCDAbj0AFJu3ABvqfSk+8wYtgZ28egpXYnjAXnA3DtQIFAVQBgoRgAn73vSKOCCByf0+uKWRSzAOMbRjKjpk0jMcFSgAH3UIoGOjzGOBt7nPf6U3O1uVJOeBjNLLkuSVAKj8B7UjHanAGBzuX1oEKf3eWwSc8sf5UbzuJzkZ4Cnv6c0MrfKpXIPJVTSceWoHzKR8zY70hht8ti21tzDg9gaGweR+8J+Xp0pGB8sblI3HA5yB70Lnax6sRxtPP1oAIV8k5kPBGMg8Uowq54IXsMUbjt+Y7u3Xr+FEeVcMcMe2BQAkYCkysDhh+H0p3O0cg9sZFKR8mSG3ZwV7CkT5d2DnHGSOaAFkXceV+71XoQPb8acrfMFPy7f4ccUxcIvTbuPHPBp38I53EjA4oAJIyxbOcg8benNFPOVXbn5VGCCeaKTArR52h8dOMhv1p+Rt2hucY+WmRnaoAZSOuSeRUqswII2qD1wSR+NMA2p5YCk56k9+f8AJpVxkcsSTwvQ0wb25wGBznnHNOLPH8o+XNACNhlAwd3qTjHPSkbHoo5OBu5ofOOcAnGOp75pWyuc4Jzz8v60AKRkheVzgkk9qavzY5Xb0560NnccFQ+OcD9KXa23hApPyg5yRz0piHbRt+Ygc55OD7daAvyksNo5ADD+tDMP7w6cluelKjsFDAcn0bmgBcj5iAfm7jGMU3ZtBySoxnccY/KlX5W5PzZ69/egYILAbRz1P9KAELZycL8oHC9vaiP5RnDZ55JwKcz8bi3X5gAPek/i68kY6UDBDjPHYZbdjtn/AA/Kk4Bbpz05p7NlfmOc8j6Dimk5YkHC46/4UAIfu9crg8hqTjrtbvgY96cWG1cjK8846fWmkblBIxt6kigAXPzFiDz1xn8KahJxn2xtYd6XA7MSp5xmlX5iM8nG3gdqBDgdvQ7jngE96Tb83TP8Pf8AP+VLgYYj7vf1prbcAYCjJHv7igA2EqozgE4wQen5Um7bnlevOT70fwkbt2OhJ6UJnsQpBzye+OtAwXDYBBLEZPGMChkBYgA+gyeKTG1Q4fLY6+tC7un3cHls0CF58wBuQoGQuetCx9/m291wTUbf3kchhyd3Oc9sU6NTxlGTnjaeTQA5kcMqgt0xyOAKTCqzfOVXPQ96UtuyFPfPB54pRJIFIGHycHHrQManIYlip7L+NKybhs5IGeenvSlmXC54Xn5eCaPM8v5eFZRkZ5zn3oELtHQAjjkHikA2bfunJzlv6UkhJ6kbiaPXjaRyMn+dACbQuMK3IyB7U58fMCMk85/wxSFuc7trDOaROMHleOGBoAXblmwrAN0OfwpfvZBDBcc7hTfM3LwcZ+UA+nWkGNuQRkfw9utAxxVeADhiSTyPT/P5Uu4gbhnGMfQfhSMxOF4yAcYNLgbQSM8fSgBojG4ZKg5HfpwetKrbVCgqcZGaX/lm3IEe3sc01eo3DcByWJoAVlyRkH6rQG8vHzAZOfYcf/roZxhSOW6dO1PBOdisMgd+v0piGegODgduwpQuMDkNnAyRn2ppwVI25Uj0NO/ixlSSfTikA3cSvAwB+nHWmqvyg9PTnGacWGckYxkZAxim8HaW59TyPwoGK3zDJ+Xr064A6Upz0IYkDp6Ck8x0XGRgcHHU/wCc0jN0XOQONuKAFwUOflB5IXrn8KAN3AZifpSK/lrlWUDk5P8AKjc+3AIUdyooEOZTwVJI6bScU3IXrjjjIB/GjhWZg+1ugPt3zRvKqfm27unegBOGLYOc9sGnsysu0bkBOeucjNIGbaT1HXO3r6UNuXcuenbGO54oGLtHOVDdgooVTkkH5l5PqB7Gj2xz6enuDShgwVRyBkgt2NAh2AvOAF/Wo9oGc8Dvx0HrTt/c4Y9+cn8Kdu2qADjPc0AMYA52ntgBDzigqFClhlRz2/U0jKeSo5zklT2pu7aMcDnI9c0wFwGAwVY4+7nvngCnntzg9Bu5pNzsVYKoOeSPU07cV+UAYJOOPzoAApfIwPmHPqBTDlVzt29Oh6DtSjDLjGDjGBSlirdQTnBY9aQCuoXHBHGOhPNNCfPkqQflzg8/nScbjgg9yBwfzpRJt+UABhg+/fH1oGCg7futyOMHik425L4xjAY474pNx+X5stj6fnRu8xcBcE8bvTPWgQ/YdwOG2+pwc4/pSAKyn5mJ56fz6UKW5JAz1LA/w9qRmPADZHtxigB/yjvnnjPHbvTdp28FunUYPWnbic4YY6Z5pvmHjbyPUfzxQAZQMMc8kdD6Uoj2g/Lx+INNZzz8+cdMDn/P+FIx24wFxgAmgY9fQENz2NMdSWz94gcY6dBk05c/eJIAYU04O0cY579P/r0AHCsQDj0zzmk+8zjK7m45OMD1pUY5XGD7dvzpjLuYsDnuzEc4PpQIdvUnGCccs59KfkMSQy9flUcE1FvLLhSu0cHdxRuaTJRlTtuPbFAEjMqtny8KffijaFUgBicZ4pizbSu1Np2/w8gU5WGQzbSB3GefrQMDhXBIYA+38zS7/m+XntjB4pI5Dv2gbSeS1G4KxyQec9Tg0CHKAffjop3Z4oGMlgCVz1xntUat0PykjGPbPan7mDEEgbT7g0wAhW5IyQvOMg00qN3Rl6EcH8aXcVQ7vlHJHzdaAW7gHdtPB/KkAnC84JLA8jNKG+YEBux20qvllAcZ6c9KYWcqMkD5to46/wCeaAJFO5cAbSeOfrTiA2OG9MswGaYrHoRwvBCnmmruXOQVVRkbeaBknO4qA2M5PIpnHAUPnPPvQrkjAxjGcN1NJgjqhVMYG2gBy5VgDuOP7p5PFM/hCrwOvzNxShsuB8vHZhzS8qwYtt4O3C80AGCTleS3AAbvTpPmkfHXp97mmcdclc8bu/SlYkbSPmyMYB5/OgBSu0jj6KcZ/Cl29TtY88EjFHKsQu0kDO09aFG0gDlR/EDgdBQIaI9vIUkZ49fyo4Cg43LnPB9Aadu+UlMBRn60bj2P7sc8/rQAbQByCWbnjikALL93d6/N2pS5b+LnpkHtSbs428sONx7UDHE/PyM7Tjlc/jSdc8rjvjpmj5jgEfd4AB6etKrZGR1x07UANyWycr04/H0p20ruwMHttNIWLKcgZ6hT6k//AFqU/MpIbJPXJoAT+FQDszxk54zSLlSBhVLdMMe3Wlbr1IOM8HjNCjj/AMe6YAoAOoG3LcEA5pXJ2kBWUYB5xx2oYqFAIB6nJ703aM4O3pg8d6AFkU7nXK8c9cH8qPmWQA/MxK9ME9e1BLMDgnsPWlP7tflbAx91ce2KBjGy23huBjO2kK4DElen4ijAEgywzyeM0AcgY/DPFIBZGUsQoOM4AX6UrKeABnpkc9frStmRg3KBjz27dKaXO3jjP908YpgDbVbDYGVz9446UNnBPQn1PGKVtyYGVA+6PxP/AOul3NGxwcnpQAjfK6jzBkgE+p5pFGEyPve5yMZ9qe6FsFto2Lzj+dIsjDG0gdvlH86QAdqr8wZPm5PNNAGwElc4wCxPf2p2TtDbu+S2f6Ui7gqEMS2MjJ5//VQAi8KGKjAbsaR9u1lLLz/EWyaduZsgvg570i7inDEhs9Tj8qAFbds2/LnI5/CgKcksF246bqXexxznkdPpSbgWyDkjvjigQv8AyzKkYYDOc570n3pMHAOem4il3kKAW4IP060isTu+b07UDFQ7T06c7R0NOUFlBbBBI5zQHPzMGO3PUjnPSk4OSuAuMg0CJNxLMAc89MZ/Gik4C8jaB/P60UmNEUP3d4U/T1pfkwcYY5x8pxgd6jjzGqgHcOCMdvwqfdkFjuIxjDYANUSM3bThshzxg/1pFPJDY/2uevtT/mOVI+/8p5GOKTcNowMAHAJIxQMP4Rwee+ewpsbbj1HIycnnFO5B43nnopHT/ClOUJ+8QDnOQQKAEXO7px1HNIvbJxnByvNKQ2epJPfp/SlXK5OGJ4OQefpQAexzxk4xzSEfLhuuBlu/WnH7p57kkbqRVJ7MDweMZAz70gFB38EqOnQ0nPTHzZzyeRTy2QeSW9u1NVeoJIBOOADQAfMrbTwc/Mfw7UL8hVSMD60EjuNv4Dijadpzx6nG4fhQAo+VV7jHORz9KafvHccE9c8Uv8Jyq8kU3jp0IPGSaBDguMA5xnjsKT7y/KOfrTvvKOwGeCPzpMgj+Fj97HSgYmNwO3cp75FC7MgcDg+tLt5I+X1+90pFIXk7igOByOfSmIVQehznHbpSR/d45PTpS7gy4Kjjvz1oUfKpGOerZwKBjWAXaML1I9hTf4vu55+8OtLtDY+Uhs89fzoC45DfTcM0CE2heSMcnOPrSFi3Qbh3z6/Wk5YMSMnPJWk2jcCwII/unFAAyhcZyGzjJ5wB/wDrpflYDY2CDkEnNJztOFz078kfWneX22gjH3cZJ/GgY7adoyMHouBk0nAypwgwPY0jR7lG1fm/2s/40vlg7hsDAHHJzQAoY7cru3Dj1wPQ0noCfU7e59qUIH42YYcHBxTdxUH5myDy2OnoKBC98YA9A3X6Um0seRtbqT9Ov6UqxhtwIA3f5/CjaBIozuXGfmoARWHGPu9cHnFLuZWBKnjnGOuaGxt3CPbnkn/Cm7dqnaS4xkjdQMVlG3kljnqB+op27Gc4VcdCMVH5anO1SFxjNOPG07W29cZoAeMc9SQOo7dOP1o3FmGScqO4ximKgbAwfunHY5/z/Kl/hPLAY5zk5oAcCPvJyAOWppztDEYAH1pGPSRTxjGGPX/69C8kIqkY6kjrQIccn5iOPQd6buLHjnn5gpySfWm9Oi4Ht96nBsL/AHiDxuHTNAC7gq/Kcn0BppkClQTj/PekbLMRjOOTR5nXggdlagBTwpPUf3iaThsAHpwdvNNHzcY+fuaFPygtvHpkdKQx+4r1HPPb1pA3Unr/ADpu4bs7dvfAOM5oZjyPmHptOaYD2JbI9OB0P4U5W7nPHovX6VErK2O4HBBXn65o8wDHXGeOP60CHcjrngEDK0hcMAA24D1prybW2EcdfvZH0pWYlwWjwT/CcYzQMk4BAG5QTzxSjoBl2J5xj3NRqzLwGz2AoDccrt6Z56D2/GgQ/dubnLDPHGB9M045Vh94c44wc+1Jxzgsf+BcUgyy7QADg5HTH+NADlO1R1AA7jGKQY5x8uOvHQUpfHdiCfTIoVgpBOWA9qAEZvl+UEDODikb72ccngev40nXnhhnnk5xSs24lWy3ow9KAEb0wOn3c4zzT1ztyDu56L3qNWKscDAzgAHpTtx3Dgfj1FAxxPy4UYHXOe9Jglk7t0xmj72CFO7sP89frRz0HykHG4AYz60CFZueOOxzRx6ZA4xjrTVz8xHDL6D9TS43PtJyOzKCMZ6nFAxvOWyQdueopWwyhgSTwAAv4Uoz1ywOM/Lzk0jI7R7gzbjwOO/5/wAqAAKQyknPOAQPSlbHOQC3XKjigr1wvTpwT/WlX7u0cH+6hIx+NADVcMMZHXoDwO2aUZXAOc9AOBSruHTdyMgDBxScYBxkYPDAc0ADBn9e+eKXn8D6L1pPoCRjnAA+g9//AK9IuV5PBz97BpDFXnac4yc9abtPByRwcYGaeccAE56nJz/+qmdeFwOCBjt/nnmmIX7uRjIA+hpGJ3ZH8I5IOMUqqOhbbgcbhz+FI2du7AxjHzdh60AIxwoYjfg4zSM2GAyu4CnHlsMNo78cfnRzzxtVRxzxQISM4wcqOM7h0+lKrAZ6Y7tkUquflLIpBHGf/r0Lhc5GAM5HWgYm49CcOD1JGQMUjZb5QpBPPrxR5jHG5SSD1X/PFK2AckEHt7fX1oEIMEhWPIOfQ8dqc0mWyDuPOOO9Isj5PBLDGNh4pGYbj39eBxQMNxBUHjHZuabwNrbRleMZ5pWYJHzuEZP8B6e9I2G2nqMZB6GgQ7dnHAHPO7rTVye7Yx7Hj/8AXStj7nzAdfvZNJkMvJJzweMEfjSAdxI2MhT+IxSlj0UnBGST0NGeq8nOOd39aPl+c7CD068fzoGKuXHLbvRmGD07Um5ugJ6847+9D9WB3DPvxSYHB2sNp56UwHLlmUAgtnoR0/yKRfl3BTznGc8UbgMZBXjt/LFGAQflJk7tnNIB0bdFyeOMY7etJtKDpgr95l6ChG+XhmAHLEnPHtQMcbVIBAYYbimIcMluCWJ59TQrZ4UkJ1AAzS8sM55z2GBRuXdz1z/eIA4oACOckjc33eP50mduOm5uMY54pf4mwSxPf0pBtZQu5tv+0v65oAQDPOBuPAx3peQ2OAev5dKN25SB1z+H0pMDoU+Y9jyKBi5+Zi3PPYHmlb5UHX3Pahk2jOWLDg7TmmkfN0x2G3+tACjqM/Nz1PHGaVs9MYwOMmhvbJ4wMHp65pPu5zlSOh6igA2/d53ZwM4px298hSfuj9KXbleRjdyFU0zngYK+6nAH1oEDZ2Afe4P4UrZZeACp55NK2wL13jPbr9PekZtrEkAj0Ye/SgBflO4/hSfxAqMZxgbffmgkHdtUxj60/IHLZUN/te36UDGBQrYXP3sDAx0FIqhspu+9+dPDZwNoX5fvE5//AF0ZG3IOe24HFAEbAc7DkHgBufrQvzZAIx1NSH5mwrYJzk46e1NZPlIIwM/dPHHrQBHwrBlXaNvXOeRSqpXgge/HNHHVTksfusOMevSnMBz/ABc8HORQITaFYYG3n5uaI8luoJx260vyL8wbD9AFGcH1pcAZxgkdBn+dAxCvQ4XfnGPam+hPyhh3607CKued38KijhSOSDgA4+7SAbztVSueM7c0rZXAYFio6U4qDwu0H+HPSm/K3BXaqnBYH+XemA3btUcFsYGfwoXuNvy5zznmnnaoxjI6LznJ9aT5fmXnA6ZOC1ADV+VM4yMcZ+tO5foMhj+FOKoAzYKp2VuOTTUwrbSef7+f0oAVexxnLHpx+NP5ZR3PXpzihVXbvC7eOFY8Z9aUL8oweTyPm4+lAC4PJByOpHpRS4VlI6HryDx/jRUsZXiwTkcJjPTrT1VmYYOSwOc84pkW5YVxytSKvykqCPwximIXbyHz0GAW6Zo5BJ68dhxTYmKxDg8dmOKduKqpU5/oaAFK7Qfl29uenIpv3eoz/EMdKQNwwZsnOSe2aFJZc8n2/wAaYC9TwMcZyfSjGM7ufpxx60btzEsQDjjHSk3EsudwPQEc0CH9W3YwD0PajG1uo68MOKaJPnyOQO5alVgcnPA59eOtAxAowfmwnHfNLkDgg8gjPtRv28kgf/X/AK0Z+bJK++OaQg2n0OOBz+gpdpVeeueopNxXBAwAMgEmmqwONu4D+915oAVstjjPAAOfxz+ooxtyQec/WlZsBV6AjOcfn+gpu4NyBg9eBjimMPuvkruC919uf6Ucr3wO1HmLtJ2849SPzoyAOQSf72Mj2oAGJWQ8H1pCpZueucMOmDSt/eJ2k8DINIuWIGf6575oEOUAAdcn3xn60Mpbqd3B5Hr6fpSr9wkYAx0wcmk2BhjGcDOR9DzQAN8rMyEAN+WaRThhxk9hnvTm6jI3Hrxxj60m4/M24nHOP6UAM27Mtnc5GT6ZpOeMK3X14p+3dkDac8/KaRiWwUYnHygdqABwN4cnLKcH0JyKTBPzFV4ODj+VK/3jjB4wTu/kPWnMQMgNjAxgmgYrqR5ZPzc5xjgU35sttAB9AOlIxGACVwQRnPWl+6ncfWkAMqr/ABYDev8AOm53ZbOW46dwPWnc+zH1zkGhWCtkNxyBnuAeMGgAGU5VvrzmjaOhPb5vbjtTuNuMLz/F1ozjO1toweuT+NMBjY+YDcBwOvJ9xSZ3K2c9CMntS/Ly3Hy8DHWkzkEBhyvekAnyrjH3R6jrxQvysSV/2vm4/Cg4GSeCT1/wpDnGGPGeFP8AM0DFY53YXbkk4PrRuwxx97GBSD6duoPf1+uKU9+QBk4z/OgBpzu45C8k44NGRxjdnGMdfxoZj8o7jng96byvTHqOo4oJHt8z7WbBHUgUjHcwPXjj2/CmNIMAYIBXOff60Z3feGSeTkEYPpTAc2dwDkgnnjrSBQxIY5B49v8A9dJvPAORk8sooXK8nAKjPQ5HFIBeCB83XnB7e1A5XB43f3aTdswMAcevtTTyDhcce1AxWJKphvnIz74pVZV6fdxz703dz79O3ApBJwWA3YHHb8aAHf6wplsE/wB2nr5m4HcM9cAVEnyjcOWIoZtvzAY6DJoESbiMDf1znjIFIrBcgruZjk+lI7BRhh8uMbqG+ZnfP+ztUigYFV2uCDn9fbFOyo+8SSeWLdvSmfd28jDdFb1pxdmYkg7h1PUfWmA/sMbSueFzinbflxkvlT8v41EAV4bIbrnt+ApQxbgKQ33h6E/WkIlJ64GFz344p249VfnuO2ah+7823K/7Ro3FsjbuH0/pTAmXcvJOOuD7E9aYpO4EZIHPNMVlC7QAedpNCv0ViRn+E/56UAKpBJODjORjvThubkHJxTTjYQRwPTtT9uOvHPXvQAueuflPb8qb8o256njd0NJnrjAyPbNObaxOSAePcCgBWUh8HOR7UuCcYG5sZ9PbFIWz8w2juCDSrleen8zmgYzcWYsBg9TkU7y/uYH8Q79Kbj+EEYU8Dd1pfuR87cd85NAgClvoAM44JpxzkcgD360mDuJPC/7VL1wD36k0DDaVXG3gjOO4pGU46AikOcknPy/xA5z6UEnHTAPGOtIAYfMRjHf6cdvel4A6EYPTNM+9jaDzweMUu5jyuAPc/rQA7aFPdhnOO9I30z1H/wBal3AYXrz1BxnFA3BgOeOTjntTEH3ipCsc8bfSk2/NtHzEDJB6D2pFkIwRlT7enrS7vl4yADk+poATkkkEnI4zwKRYzkK3yk9hSmYLjBBZuvORz7U4yfKRnr/H/IfnQA0ruYhsnknjpx6Uu0Meu7JyRQZMZwVD/wB3kY9qTd1ABBI7dvpQA7G7DbsYbPseP8/lTecn17+lBbaduFY5xgdPxprMAeowc49PegBeOgO1iwP0/wD10z+Ldxzz9KXIznGe/UdulNLYwPTgeh+tIB2A2APlLDaW603duwSBxxux/n0pq/dBC7h1B9cU7O1VGMjnBoGBzwA2GJyGz2pWZeAH+6eM00kso5wN3qMUpDbhxg/73vQA7jad23d1H1pGwoI3c4yeOtDMP9odv8mkZmLYPuOvHTrQA/uSxXrknP8AnvSfd/i5YcnPrTSMkjjHU5OeeaN/qMfj1oEPjb5lPBGeOfbvSKoUAlzhunNJzGduSCOfl6GlVDt9ePu55oGOHzMCrLjOAppV25x/D229DmhY93J+UcAgnH9KPmZeO390ccUxC464G5fQnBNObIkK7sk8kAUgzuXKjd2BzmlyNqle2SeeT9KADkR856Z4701jwACRt9uppxVmXtnGQOc4pQAdxwwBIJPfjvQMQq3UEbupPYCjbziM85+XdRuyoxwO2OpH0pyg5HGTnHIxx60ARrlsMOvqw/nSr0wcjjqPWl6KuCOBztNAz944Y9e9ACDjBGOOAe+6hR2PJ+8cU/7oORj5c8mk+bd1J56kck0AID8oAOQB1Pb3pdoYY3fLnk+vpTl+8uQvOSB1/Om5LAYJYdT3x/8AWoEIynbjgqOVz1owZlPy5BJA+vqf0p+7AyApJODjik53MByuB09PWgBD8q7CwPrn1oVRtIwMN/F3HvSrkrkdB0GeTS7Tj7zAgfd9famAYI2kndlfSlCneCuA2McUjF2c9Sc8EdKNvyjIyD0I7UhiYK5wcr1980gxk9Sf7tOVgWG7824P4UnLccbfQcGgQjArvbHB65/h44FIMdxgdSMYBp2NsgDZOO59Pwo3HnoV6/WgBBncXwdg5O7jHvTeOuPqtObOSp3ED9B70rMS24YLDgf/AKqBhyxZgMEjAWkH046fXtmglmwed3ThSM0u4+YMDO3jn0oATc2OACueDikHTA+YjJU+h9KerkDIAIzkqKTcVUEcdTgDnNADVzglQSfvcjApfvfKMH+Lp0pfOGBtUdee1Bl25yMA/N/9bigBo5UBQ3TIBpckYXA3eg7H1pwkUhtpJYnheaa0jjJ4C9ivY0ACnoyqxVemf8P89ak2hsbsbv4sd/pUXnK3zKgLZHXIqUM2Dgc9SAKBDyN2fl54B9sUUbl3fMMMeST/ACoqWUU0X5QMe/tTwBuP8RYfxCmQkhQ2RxxUm3crH7zBSeRxQIbtDqpPU7sE9aVgM9csOjHj9KQfdUlcEZxj2PrSjt2bk5PaqATkgEnOfl7ZGaGUtkNJnP4UZ+VSV2HH3h3PtSjBXay8sejUCE3d+d/8qVsjAdx1ySo5oViy7WX5c8bec0J99hhhng5FMA5xkk5A+oFK4HClgM8jaP50eo24Xrhe4podc524HQr1NIB7K3mYJ5J/i6cUh+dRlsZPQD9aThBgcE/wnPFDMdoI4XOVNAA+VUNuwc4wOQaPvDBbHoFHT60u7aTtT5F5HPr3pG6cL9459qYCFCVJU4Zew+vem7jg/NweT2xTzvbK8GPOc0N83z4UeuaAD+ADdu57DnGO9IdyY3nn+lKZEj+Rh85IOTxzSFtzEkbTnApAKuMZByvXPOfpR93GPc4zTVyqlTxzyw6UobpnaCckj1oAc33QSOcfjT9vTAGG4NMOCOQfcU714+bnopz04oGJwFCjGNvuKN2FGSSQckU5WMeD2x/Ce9C5fjOCTgZHfrQAm07htx1OB0FHCkZOOM4zxS/Lt4AJPIzx2pvBB5PTHUGgBFzlAOoPfp+VIffgdcbu9SdJD9c8jGeOlRjBUnuPpQMH653ZbOAvbtSBTksOnrnmhlyMgfNyfu+1G4bdoI7Z4wTSAHVTk47jAxS7iMfw9ep680MpVsLy2emKTA2rxgcY4/OgByqDjjA44Jo4HT1PT6Ui54GPTt19qMYPbOCcYoADuYKSeQB+tIMLgZzz1x+tK3y8AYPA/Sm/dwGPt0/SgA+6i4PqRnr1pq4RjtAPHB96VhtUDHUbemKTb/nbikAMCxJxu5J568DrQWCnAH+fSh2VTgEd/wClNbLZ3EfrimAmVABPIHJz34phJ3AAnd9005mK84XGT/Ko2I2+/JGOKZIpb5ugwp57c00sB0DfMDuZqazFuB8w6+1MZhycnaegxnP+FAEoI2rgtj60gkw3BxlsflUTbt2Plz29KTOAc7ePz+lAE3mBupHr1pN4K4GRx0HHeot27jk+wpeew74xSGSNKGZiB+lCyfdB+pzimLg9uvP9PSkbO7gEt7CgCTzj83OFbtgEULNtCnq9Rr8o53D2/DpSMTtxxg9gOopiJlcKxOSg74OaRpDu29u+OvvUW4naOh7ilDCRV28sRnNAEytzg7to689KN4bAIz9c5qDccEkcduaWNirEA9OoU5x7UAWtwYjhSAeBnrSttXHJ4HfP5VFnnDH5v93inliqk5CgfeI560AScAhVBI9etIvLD5lbnO1ugpNu4ucMPx60/AGPu4JH40AIF689TxkdM9805MrwGBYj0NMXDseGUnhhjoKeqD+L5R34PSgBMZG7pgDr9akXAcHkHnim5IQHI6dT0HP8+lOX5m75zk85oAT15wcd+PxpTwxIyM8D096GwFPIGF6kdMUudzY75wB1FIYNgZ9PTilXO44O4kjJxSEDbjjvxjvSrkt17ZGeO3/16YhuR971PIHU0vLMzHkjnPUemKRcbhgZ7ZxnNDALwB0HUA5zSGLwvzHGRkcDA47UhJZufm6D05pWfcx3FepyffNN+6pJ4X8z9aYgYjjqdvPtzTWk+Ze57HofpSk5JJwR95gQeR2pHz8xbq3JwelADRhyNpIXtgng0rMegO7POBwaQ5Zj2YjjHTHejbwBgdMgZoAfyV6kAH6mo2dVyBwAevrTlI6AcDg96hOFIwcHB/HB70AShs5Bzz1wc5+lN3jzCrfQcdaj3Dr8x96azFs/3fvH0P8AnmgCxuEbKFBCjn60cAbvmHGMd+tVd4B3EkHpnPFKsoYEnaeeMdKYFhmO4EHJYnLYprOMjBOe3AqLcDwScgdsigtnClufcUAT7jFnHyg8+/8An/Cmq4bIJwOowetQs5ZuMc9QeMUobrkqeMjjtSAkZx2zkEd+abwy9MDPBx+lR5GBgqpHOSfcUgY/KSRnHG4UCJWbep4ycYHTijP8W44Ixn1qMMOgVSecc8UzOO42knnsaBk7HcpwxOBwDxQsrswIxnGT/wDXqDcq5+6TTlk+UA7QeP5UAWN7bdoZlHXp703ziVYkZGDnpUUfboRQzBVZcDrSGTZbGAcDPA79KPMaNh8wJPqtQrPhhjb6Hinbju2qcEjjnOKYieP5mAJYhqE+4qnJHvzio422kAcHPHFPTjB/h+lAEvp97OM8gZ+lOYDzh3+bvwBio92W556ckdqGYg4JGN3HFAx+4KWKtgdScUpXqBweh54+lNX33cggCncBmOcDIxlfakA8t8rbSMd/Ximr8pJAwoxkHn8KaZMrubHAz1pWbk7QcNkZB9utMBVPynLYH0/Sk6Z2nPzD6kUNllJ6cZz6mgKQxLBRyBkUDFXH3uPXI6Hk0feXkEt79qRWPyjp07UIwbJzv4xjHNIBwIb7wwPlGenY0q9vxOe/503+NQRuOQePTFLnG0cN1yoGKYBkNge3HHTnrSkgkE4Kr3FJuPT5s45/wpWba2cjr930oEKwwu3IK9fSl4VTnJH6YzSFsrnGeMDmkOQT/F8v0yKBAzBflznsM+lKq/MAcAE4wetK0m5mIGQeNp7UAFmCldxHTmgBAQOCWIHyjvmgHCkdflPfijeecdAc8dqBwvOCcHjPf1oGK7YUgHKKeP8AChcfeIwfahpNzb9uBnkD1poYn3JPfnmgQdI8Kcdc+/oKF5IJ4PbFG7dxnBzkr/X8qVmLKWIyDyfWgYbhzg7c4z+dNzuxu4zxnPSl3BsrlQxxnntSlt28gfWgA2ksSucHIODj8aa2G9ef7vUDNKT8o+XAHO7P6GnDjB5YdMjHNIY0gN82MlRz701lTdn7xwc+9SYOP9leRk9aazDB3ZABzlRQIOeA3QcHd/SkA24IOWPv0/GnsBIu0cjrz3pvHI2koD/DQMau5t2Rt6fSnbtoBY854x2+tBAZdoBA7Z/maFCoSoBb12880AIu5NvQdeAO1OVegHJ9R60NGJMkrtJ6ZqTcWUH7qjo2M0CFCjlcE4x93tRQCPMBXIHqe9FSyirHhlxjb3bPpTmwAANo3Dn5jSRMdoxwRxj1pzZKndkccHjk0yRq42pvPGTwB2/KjhDkdODjJHNK3cF8nAAUdiaBweWXGfzpgIzYQj5ScZy/pmjJ+9jIz36H9KXDbc4U5bA9f8imFcMx3ZOeOeBTEO3AdXyWPHGQPWkUkqe49McnnjBo2lmwpUZ5x60LltvAxjAXPTHUigB6sW3BPl45U/54ppcKo/hA4wG4PPWjkrgEYXncT19qTB3DLA5z8tAx248nLKu7t0+nNC7iQBjd7HgCm/M/dXGcf/Xox8vLEDGMCgB38I/hcYVTgHIpVOc4LHJ/X8qQKNoAfLdj6DNNB77gP7pJ5oEOZcZDfIVBVWX/AD70NiMnJOc84GQaURkRHoyk9+uKacK+d315oAUjbt3ZznGV6c9PpTd27KjjnaMDng09V2q+58E80i5xjPOB8x60AAXax34H+0vHNNDbe5IOc/P0GfWnLhUwrbjnPqSaZkLgBucfNgUDH5+VgT83cZyMUo44UjkEYXPFG0uM8H1pONx+bhhz/WkAvy4xwSV6rwfrShsD7xPPbI4puTgMxG3gcUcljuOfx5FMByZ3E5zxxz/jSf3jngds/wCFBxu+c5K57+tAB3c898k4oGKc5JzxjP3u2O/rSH5vvDAGMDil4XO4g5GefypvXIwO3NAA2NoxxyfUdqTlgP4R/vZzxTuPlzgcnAzTdx2r3OOvekAp27sqADnHH0pvLY+Xt+FOKliMjG7rSZ4HAz1456cCmAqbcgg4PA4/pQM56Z47n/H8KQc4z6fSnfdxwOvY+1IBFRe554BP4U09COcc96cWyB09jRxzwCQOuaAGMhxgjP3vvc96YccjggcYGeKkKlFAPPHJJqJvmPGM85oEObPzdT1/i+lM2licjI9Q1NZRkhjg5P4cUm4d/fvQMVvlxlVzz945H0qNuec/gSR36U/aTnHy+nOab/ewG/KgkYzfeJIDA8kE/lUZb5iduFAwcE4+n1qRlOSCCB3NUdQu5UZYLfm7m4VTyAO7GmIS41KO3m8iNDcXD9IY/T39K0bPQtTvFDCOK3U84X5j+NaPgvwiWuFVFaSWQ5eYjlvYe1fY/wAJ/wBlDxJ4o0mG5tdEcwMBtklXAPvXfTw6kuabscNTEOMuSCuz46g8H3jcyXEmfZQKtr4CupsbZpT9K/RK3/Ya8Rsn72COLPZEBqf/AIYS1kYJ84n0VsVo6WHj9tFc1e1+X8j86k+Hd7/em/OpR8Obv+/J+dfoh/wwzqw/5ZXBP+9ULfsK603IhuB/wKp5KH8wL6xL7Nvmj89l+Gd/JjEkgH1pX+F+p7c+fKP+Aiv0IX9hnxDH9yKb8WqRf2G/E8nSMD/fYCjko9ZGc3iIa2Pzmm+HGqwrlZ2P+8grJuvD+qaZgTWyzL03KcED6V+lc37CPivyyVSIn03ivOPiJ+xj420HS57ptGe5ijGWaH5sU/ZUpaRZn9aqQ1lF29D4RWTO8AEMvWNh0/CjdwOvqPf613HjDwFcW128TxvaX8RwrOuP+At7Vw67vMlhkQxXETbJYz1VhXBKLi7M9GnONSPNEkRj0J245xnGKeGA55yOQO//ANemDPBIzzycdaevzckE85IA4qDQdySedzH14Pv+FO4DZIwP9rnj1pBxlRkkc460p+ZiBgZ4xjjFACngAZJwvI75Bp2Pu7ucfxE4puA3PYk5z3pVYdcncRnJ6UAKcIuB14yPxpfM3Mp49fSmk9+vZufen52nnnOetAxNoUEdgOm7FP3HcMEkZz1pqqSDzkYz1pA25gc4GcdaQC/eyenU9SM05W25K8jjPr+tNb0Bx+lO53D0JXqaAG8N8vbHtg0Ltj3dBgdifz/LNLgdO2OtNHKkEY6Z57ZoAXOcDBIGeeDTMjqAU5xnOeKGbdkfKTk9OO/Wmq23kKAevXjr1piHqSvBDMDxhsdO/wCvNNbgbc55xgrTX4OAMHBJGaazDA9MY9qAHhcKvC9c/KaThgNy9B6+9RmRVI6YHP5A00twO4x1zQBKWCtwuMkciomdhgktj601ZGznOe/WoTNnGOB/k0AS7hwSefWml8nJ46nIYg1F2yPzPSjiQnA8046J/jTSuIfuwCR1zkgZpPM+ZTjPtng1LHazyY2rg+wyauQeENRvsFbSZ1PqCBVqDeyM3UjHdmc0ka/eKhv6Uxr+ErgyZXvwTmursPhfqdzhfIbP91UJNdfov7N/ibVlDWmi6hc+m2BgP5VtHDzl0OeWKpJ2ueR/bo8lBuI9kNJ9rHVEfH+5X0bpf7G/xC1A/J4Uuxk9SpFdRY/sE/Eu6UBPDUyj3OKr6u1u0hfWo7KL+4+S/PZl4gkyf9mjzZAuBBJ/3zX2RD/wTz+KTN/yAioP96QVoR/8E6fiXs+bSolJ/wCmwpexit5Ip4h/yM+Jlmfn/R5M9Adv60faH7QShuv3DX2tJ/wTl+Jo5WwiI9POFVZf+CdPxPVTjSs/9c5RR7GP8yD27X2WfGf2oIATHIhHqhFH2uHaP3m39Ca+q9Z/YB+K1ipceHriVR/t5rz/AFz9k34jaVu8/wALXQC/3Yy1L2EntqNYmHVNfI8cWRGUfMpHXHpSBvkOenciuj1v4P8AiXRWb7VplzZkdd8LL/Subm0fVLLIMLyKDjGM1nKjOO6NI16c9mO9P4m68jFO3E9VB7eoqg16YX2XETRP33Airkc0cygq2R6VibliNiGB/keDxQsn3RgVGrFW5GTx/WlViuDjAoAnHyqTznGfve/tS+Z1A+7uORmolk6fTH060/7vQ5H17Uhjw3IPy/7uTTlwuRnCgjGGIHSmqTvU845PWj1OTgNyKAH+aQgx0PvnFKeuc7RnJPB7VHuJXjk81IPvEDB5HFMA2gcLwMDAp2BgkZ78g+1NU7sEH6f/AFqVW2lSDgY+v0pDFPopJHAxmlI3biMDscf/AKqbw2QOTkfypduWz1GOBmgQH5sc89+hPFA74449f8aRvmYg8HofpS7jnJ4PXP8ASgBSwKkEDryD9KTcRxkjn1/+tSkkKvG0cDHrmk4ViBjPQN60wHbchCcEj+9wf/r0o3M2AS2Djr15pG6DJBGOfc0nCcYzxkA9vTNIB5YjccKc569aaGLMPlycrn5sZ5prdyCNuMn60ZCrnIwP15pgOAACjAxjp1xQzH5s7sY6Aio+FznbjNKO+du3GSaQEjYZ2AVgc9c4IHFKv94sVHcDn9KjaT5gTgHJY/8A16PM6ElTTAdj92AXxt/hYdyaG64wAVPRT29aTd8uCAX4GevTnNIx+bkjGe4oGP8AvcMNxwMDPvS8t/CMHHGePrUfmA8gD+XehAOhYgrj9OtICXKrnjBPYHgfhSMxYDcATjGMdf8APFN3hgOnXPuRQrdCvy8Y/GgBdoOcn8cfrRu9GwAMZzn+tJ8u48jr9KbuOB0ByenWkA/JePkA8/lTdw5+bGOp6n8PSnKFGQBgg5Bz3pm4lTjnPPXpQA4t+7UkcgHsc/SkCqpI3fd6ZycU/aNoI+6vO7PHPak3E8/iec80wAncq569tp5BqRU+bOTkcDnv+NMHIXHrjLDBFOD7sgjp/D1P1oAeWPzKM4zkbfaijO2P7uM/pRUsCCNDIoDN8uM9M0Hcqhz5YC9PWmxfKhyOc8EcZqXJ2lvnbv0B5qhEeHKnkFWPB/qaVQ3zDCsOueKAjLGxJ5k6KKRVDMRnIzjj+VMQMrFSwKgA88fzpDlpD+7Dc460vlnacnbwT1646UhypbLNnjP/AOugBNruw38jJ5/wowNuD8xzxmkeMhdxO1O2fWgLg7QMjttOKAHBWKld2eTkMOlDZ27s49Nq9vWkwdwUBsfewe9IEAxwwB/i9vTFIYpUqNxAPO0leDRtKpjO1R1PX8aVQMqCDkdW7GkAG1goy23kg8GmIVV27iNrKPwpVLOVyQhI4BGRSnaCQwyR8xZf5U3C7vl4J+96YoAcFCx7kKlSTjI/DFNyy5DHaPY07apBI6Dr3znvTD/rPl+8ep9KAH7CY3YFWX17igMwUjGB1+X+eKZgLsPUE84605c9BkHoXb0oAAp27kO4dSSKYxKsDnGeg3dqcESPcNzZbkk9qY3UYGSAT9KAH/MqHnLDncKUbg/3NzAZyT/Omr93PYYxnmlG0/eyScjnqaBgoZT9/Ppt6mgDqCcnOM5xS8fKpOSygBRyAKaMjpnA7fjSAcu7awwpGeuKXjLD7xzxu7mmtgYyMg5JOOtCqei549OBzQMd94NjkN+GMe/pS7jx83B46D9BTem4YyDlRxScNkrxn0GKBAcheBgg84PApeOAWBGAM+o9hSnKMfXGMj3pnUEAbT0GOwFAxW+VTgFFHc80wH5tuOeMjt9frTucAnkLyabk42j6njJ/OmIVm4HGB9c/rSg7uevXuRTRjqPTHApe5+8Dz+FABu+U4+YHuOc/pQSG6nPPHUUnHIK59OO1AzvXaDn1xSAPvbSTk55OR+lRs3UEtjB7jmgt04A4x831yaYfYDNAxrMOmSoz93I6YpM7RyxPHTIoyeR/vYyPpUbZLHI44HAoAkYkqxC8kYBx70jDrypGeCxIzTA2zcSPXnPvSfw8Dv60CHMwH91fxqDwrZHVL6e9kH+vcxxf7Ma9cfU1W1q6MFjKVJ3v8i565PFdh4L03yVijQZ8qNYhjux6/qa2pxuzGpLlR9Jfss/DZPFPiq2aaIPCkigLjjrX6m+KvEo+GvgOB7OCEPEkcUcb8Lzx2r48/Yo8EG1v7YOmSqhmOO5r379qTVmtdJ0uzVtqvMGP0FdM71asafQ4aT9nSqVmZ1x+0B4gfpNbRD/Yhz/M1Sf44+JJDn+0wv0hWvLNF0LW9fkCabpt1eHpuRDt/Ou2sfgj44uIw50kRD+68qg/yrqlRpR3scsK2JqK6v8Acbcfxp8TOCRqzH/tin+FWI/jB4qJ/wCQqCP+uC/4ViRfAnx5NJg6dBGnq1yn+FXh8A/G8Y4itP8Av8P8Klqhe10aN4hdGay/F7xTnA1SMn3gWrMPxW8ZH5lv7WQejQAf1rAb4IeNFDbrOBj22zCoX+Dfja35jslJ9pqOSg+qMlWxMd4s7Kz+OniHTpAb+zt7uHPzGEFWr1vQfFlr4q0MX9qQ0bKcqeoOOhFfMV54M8b6apNzolw6Dq0ZDV2XwB1S8j1nVtHuopIFZRII5BjB71hXw65HOm9jWhi6ntVTqq19jw79pDwnonjq31Kd9LhsdbsZSGkhUKJo88H618AfFjwLLpSp4htkJa1lW01BVH3o2z5Mv4EMhP8Auetfp38X/DZGtagQvLK2R6ivkPxN4fhv72fT7pQtpqUT6bcZ7bzmNv8AgMiofwrOynGy9Tpi3Smr9T5D3BeMjaf71OBHfOcjGBim3VlcaPfXenXQMdzZzNBIp6gg4qNpC2BypHU1yHollm4z8xH8WP8A65oDfLlse3Hf2NQqQ69FB689c07ngBjnryO9Ah+7vgjjqMf408YHOT+YOajGFxkgP7j9KVlPBbBJOMjtQBIGyTxnnPY07PGQcqPzP50zGBjgr02kf59qXknOOe340DHDOD9457n8u1K3zNkY9Rn0pCevy4P/ANelXPJGeQfr9KAEaTcDg9eegpN27IHPI64z9aacbgcZ7fWhm4PB5P8A48e1IBGbao4Xpzn+nrQx4bhl+hHSmBeeOB04H6U2RflOFwCM9KAHnqcLuxnHTjmmvgHaCMY7rgUkgCsQcA5P86bxyVx1x7UxCkr2IxnI4znntSMwXdkEE+3NNBYsR8p7Z+n/AOumr831xyCaAF3MuCdxAHc0nXjkHPc0HailmKqijJLcCnadpuoeIJFFlG0Nv089x8zfSqjGU3aKIlKMFeTIZnS3w0jBB/tdfyotrW71JgLWBsHjzJhj8hXpPg34Ny6nfQwQW0uo3kh4VVLMTX2f8Hf+Cfmra9DBd6/t0q0bDGIffxXasOqetV2PLljXPShHmZ8I6H8OJ9QkQSl7iQnhF5/QV9B/C39jXxF43aMxaPLHA2PnkyoxX6TeAv2YPh38MbdZV0+CeaMZae4AJ/Wrniz9oDwx4HjNrp0Mc0i8BYgAo/Kr9pRi7U43Yeyqy1rysj578Bf8E37K3ijfV76O3HVo4Ey35mvZNH/ZB+FXhCNHvrNb1k/iu5eD+FcJ4g/ae17VGZbRls4/RRzXC3nxA1jX5ibi/muGY/dTJppV5dbehzueDpy0XM/v/M+kvtHwy8EqF07QdN3L02Iv9c1nX37Qmn6flLKytLVeg2jP6ACvCrPw74i1rBtdMvbjd0PlkD8629P+Bfj/AFaRWbSo7WPs00nNHsE/jl97Nliqkv4dM7a+/aUvmb9zc7M9Alv/AI1kXP7Q2uTEhbqb8FVf6VJbfst+Kpo1Mt7ZQt36nFatr+ybqbLi416BP9yLNHLh46XQ1PFy+zY5O4+NWvXPW8u1B9JCP5CqbfE3XZSd13ct9bh/8a9Ptf2UIo1Hm+IJGbOfljAFXo/2WrKPn+2pyf8AcFReh3NLYg8gPj7WGP8Ax+Xan/ZupB/WhfH2tLyupXy/S7k/xr2Fv2YLfHy61J/wKMVXk/Zfbny9bHtuio5qPcXLX7Hl0PxG1uJh/wATrUlPtck/zBrUt/jJ4jiXYNbvNv8A00WJ/wCaV1V1+zDqykmDV7Z/96MisW8/Zw8XW2TA9ncf7sm00uak+xP79dGV/wDhal7dDbqK2GrRt1S+01GB/FSKwNY8P/C3xkpGt/DrTlkY/Nd6bO0Mg9wpGP1qbUPhN410kMZdClnQdWgYNXOXdneWD7LyyuLR+4mjIrWNt4P7mZyc38av6o4/xh+xf8J/Gkcp8P8Ai648O3Lfcs9ctBJGT6GRTxXzf8Sv+CfPxB8Kxy3+jWVv4h09Mn7VoN0twuPUxnBH519clTIOuRT7OafTZlntZ5raZejwuVP6U5Lm31/rysTGbh8On9dmflrq2i6p4Zu5LXVLS4t3jyJC8Loyf7ykZH6iq8cyuqlGV1PdTmv1T8UXWm+OLP7L4u0Gx8RoBhbh4xHdJ7rKBkn6180fE79jHSteFxqHw/uzLeL876XJiG5x7D7sn4c1yzoreP8AXzPQp4hvSSPkdZm5wOvTilDfPkgEdDx6fjVvxB4Z1Xwffy2mq2ksMsL7H3IVKkdmU9KoRybVwDke1crTjozsTT1RY3c4yoBGcdqFO7DMQeR3/Wog3OOBin7tzdD96kUSqdvHy9Dz3pykgjnHc9gRUa59/umnFjwA2c5AoAeOG64GORn9KduyxJ+ZQQTyOPao+3oOvH1qReN59MH360gFJIxjOT/j2oXDD/61N/i6YwOffnpTmyfY8UhgvbG49MY+hx/I0H+HofY88Uf6vnJx/wDrpFXJ9B1wKAH/AHlGDyB1pF69Dnt0pOWX17kZ9qXAGe/POPpxTEKV+UDoVHGec/SkbhSoIAx/nqelDbvLB3DGDmjITg89OO3SgAbGSWTHHp/hTWxx8mDwR3+tPZXUZZt3c/4UqMV4LZwM5/LimBGBtYBUJ6+tA+ZsbcHgYweR3qTa/wApwQpGfpSZIXO47u/PP0FADVY7MALgk9zSxsd3IXr65FKsYVTngkYG765peeM45IAA7+9ACMdzAYzkEDLD86du24wnAPXPNIVI4LD1J49elIqDgBstjmkA1srzgZxncfTvx+lK2V3cfh3+vWnkK3BJzgd+vNRr3O7/AL5FAC7m2/KPXBJzS5O0YB+6DjH5/wCfalKru55OD9KT+JgCowMcCgYAjZwDtB4IyPwpF+7zx97J6dOgp7BVYd/mHTtxUfY7RgKM8+/ekALuCN2OB0yeaVfm4I2/NyM4AFG3nHAO4H9KCvpjnJxnr70DFQtt2ngkEnH6U3O4H+E8Yz2okUM0i8Eg4GPYU5oyzEYDHjNMQqn7+48dM55+tKuGKrg467sUnC7iCCzZHH1HNSeWVUgHtk46fSgQ5Mtu+bae+fSilPQblwT82B1FFIaK8bL5ecjGcfNjinfejIIwB93gjJ9qYrF8dOBnI4z9aXlWAD7iRyGOR+dMQbfL3ZHoBubFCsNvMgUDPQ80i44wvlgtzk5I4pTlmzg5zz0oEMJyv3MsvJp3+syQQeexyMU77ynccNxgKcYpowzEhd4znaxxTAav3zkn5TwT0+lOY/Vc/wB7tT2OPlxtUdD0/lSLhcemMgds0ANKnZ1Yk+lI3Khuc+pOBUgXbzs29fmzS5AxyfQ5PFICPaVHGSvU+vSjll4GVUelSLhVHG3PJ705drsuWyA38XAoGQ7dpyueRyDTlBZQMhV5z/8AXpzR7m3feBbI5/XFG0blxuPYc0xDNoCjG5MDqe5oZdzMucjgdM9Ke0ZTGVwSNgwffNIyryMHHQds0AMTKBvU+noPSnbV2gc7epPvUkmVQKo2qRxg01lVckD5AeNvr65oAZ8zHBOQegB6+1BUhVLcjnLEcfSpGTg7Rnucen1pm0sOOTyQAe1ADPvA4GXzSqG3bgGyfTpxT1znlsjGDnrSHBYD5TjjGPbpSGNyFBGAGPp2FNyGbAK7S2Bz1p3zYIHAbsp6Uf3uCcdOBQMRdqgAjAwcYbigckj+H25o3MWIIyfmzwBQozlRkA/7NADud+D0A6n6Gm7ht4IwAO9OH3jjKDHOB1680M3XHXvzQAFWGTyRnPt25NBYL1OeO2OtIu5eR6nGBQx2kgHkY6mgBOucH5QR97ikHI4OSQckH06UrDBHHAPQdvek2sSepOM4PHXigQm4nHPB9fpRuXk9efp2pWYDPr360i/MwY8cjHPtQAm7co5xkDvSt8jegzgHNIxbaAM9PXj86bgnHUnd6dKAEeQbRzn5fryDUT5GQFLdPY1JuJUZ9cCombcT93P6cUAR7gzYOe/ejdwfvKMDHNPMbHggHk9/X/OKTaeBsBJH8PakMa3zKB94E4+YUi43c4Bz24p2zHI4P+9/nmm5+Xk9T0PamIy7lTea5a23VEbzWr3f4N+Fn1O9gcpkK+48dWLcfkK8V8K2v9oapcXWOHYxr9AK+5v2dfAW6wsJGj+Z23nj1Oa7Ka5Y3OCvK75T7h/ZV8FrpGhy3rx4ZsKpIrqfHfgWHx9490yC7QvYWK+dKOxOeBXX/DfR10XwnaQhdp27jWxa2qxzTTEfPIeT7Cso1HGbmtyp0eeEafTqNsbK30q2WCyt47aFRgLGoFTiRu5NPK5pu0elRdHUuw7efU0hY+ppduO1Jj2qboobuNOFJt5pyinzAG09mNZv9h2cWo/b1t0W7xgyKuCR71qimyLkGpUmtiZRT3PD/jJog/tBZwvEi4r4v+J+giz1yZCNsc65B9G9a/Qb4maSLzSfMAy0Zr5C+N3htptJa7jX54W3fh3rooyUZo4MTG8H5Hwp+0XoP2Hxfp3iOJAlv4gt90pHAFzH8sn5kZrypmxu9CM8kV9SfE7ww3jX4Ta9BCm+/wBGddYtQOu37syj8Oa+WdxYBwNxIDDj9KirHlm0dlKaqQUkKrb2PQnripwx9wcchuagLFjgjkcdaftRzwCQR255rI1JAw5BA9++TmnjG7O1uRk+gpit/vLn7p6jrTxjHGCCO3BoAcm1cNuw2OB2Jp+Txu+UkdD3pNzFzuJA7sBkfhS8BjtGPoP1xQMAw6jAPWk3L0zgdOv40vOOpI44pCxDde/PP8qQEbMeMccevTmnZK5I5+bAwfpzTeg4GRjpgetO6MeQTv54oGNyd2M4685phZiuAMkjHUVIyjbwoOfQ00xhCCQF568UCIiw3cED5ue9MdjjJGPTBqRlPZt2PTuabtXdvfJB46DNMQm0nJ56YIJ74qGa5SNvLwXmfhI1+81MvrkwgxR483rubpGPU+9bfg3wfPqV5HcNG+OoLfff3PoPatKdN1HZGVSpGmuaRY0DwVcatdRy3wD4HFun3E+vqa+nPgf+znrnxQ1KCy0q28u0UgT3bL8iDvXpH7Ln7IeofEeWDUNUjNjoMZBdyMNL7LX6JaF4d8M/CPwv5FlBBpem26/O2AC2O5Pc13Tqxw65KW548adTGz9pPSH5nGfB39m7wr8IdMiW0s0vNU2jzbyZQWJ9vQVrePfjFo3g2JrdJVvL/GBDEfu/XFePfFH9oq+8SO+meGS9nZs21rlc+Y/0rE8C/BTxF46ljuboSWFmx3PNL99/zrm9m5PnrSKnjI037HCQuyn4u+KGt+NLoxNcPDCThba3Jyfan6D8A/FHjLbKtp9gtm/5bXXBPvj8q+k/Bfwf8N+B0SS3s1ubzHNzONzZ/pXbeftwAMCtPbKGlJBHAzrP2mJm2+x4X4Z/ZN0SwZZdWvZb6XHzKnyrXqOi/DPwv4dRRZaRboV6My5NdC059KYzM1YSq1JfFI9Knh6dL4IpDlWOAYiRIx6KAKa0jN/FSYpdvtWXMjosN3H1P50bj6n86dtpduKOYBuW9aPMb+9T9vtR5dLmGIszetP81vameX7Uuz2ouGg7zj3HFSrIp/iqsVoxSCyLn41WvNNtdQQpdWsNwp4xKgb+dMyR04p4mYd8ilqgOL1z4J+FtZ3MLM2MrfxWxwPyrzXxN+zjfWqvLpF2l4g5EMg2v/hX0Es/94YqUENyK2jWnHrc55UKctbHwz4g8M6joNwYL+0mtZBxiRCAfoa524tFkZd2QynKspwyn1B6ivvvVdDsdctzBfWsV1Ef4ZUBrxzxx+zfZ36vcaDMbSbr9nflD9PSuqNaMt9Dnlh3H4dT5Z8a+E/D/wATtIOn+L7NridV2W+uWiAXkAxj5x0mUccHn618UfGz9nHW/hHcpdxMupaFdEta6nagm2nH93PVH9VbFfoF4k8J6p4XuXttRtXt5AcBsfK30Nc81wsNndWF3bR3+lXY23VjcLujlX6dm9GHIq5UuZXRnGo6btI/MaCYSdc7lOCp6g+lT7/mGQM9fzr3n9pr9mi5+HP2fxb4bZ9Q8JXx/dzjlrZu8EvoR2bvXgcTLJGrAcZyV9PauA9NO6JAwHC4xjmpYz8w6D5vX296h3DniplOW46bs4BqRjhx2zx6ZxT9pwxx8p7+n4UxRtX8O496d0546nt04pDHDsRwOx6D607aWz1JyOcU1VGAehx37e1OVRx2Puc/lQA3B4/Lp7HNPwVzxn8KTbz0IIwOevT+VLt289+xC0AJxtBGeR6dT9aAu3jvke3b9alZfun5enXoeoNJ5fcktzk/WgBjA/LlcHrmjcfmX5Qc/NTmjC5JXI7nPFI3ykiRj/tc8N70wEHy5yuQDy2c5oViGwAAR0JGe4p2GRsnHrQu7AOSTkZPFAhq7FX5sgn1bFKroF5wvBOBzRuaTGTtJz6fpSbx0DYXBxxyfxpDEXDYLDK9c/4UblVQQNvOC2Kd90uck5P5DPFOjPzLwp59KYEauCVIUMR1x256075cEAcbucZpVHysWO7njH0oVcAHBK5/I0gE3L1GGAGQAe+aGbC9Pu/xZGPpTpd20jGBjnkY696aQFBydpPP3f1NAwbO3+HoTS8hC2D67s9M0mCScYJxngUufmGMDHHofegAz8oyFxn15poyw45JHOOg9qkVdoVs/kAccU3byFztHUnpSAbkuinbkFqRVLNnH0GKl2JtyT7jjOPrTPL/ALrck8nP60wAsTyvHU8fkBTfmC9duP4cU5o0OcHaO3cEetOKj5sNjIzlRjNACbguFyAcnoOpxmnKpUd2AH4c0r5YDB4bOOnpTh0yMFuvQUgFXABH8Q4NFO5b5sA+/wDSikBUX5VHOc/pTvlQ5bkAcKBSx4xlSMdD1prQdCdgIBO5uPxzVCG7tzHcMuAevQYNLuCsdwIbHA/lTz8qhQUKr26CkjVmwcpz6DIOKYhm4MVGdjDjkdKUSK3HXnJbpTmywI+UqeeT3zSEZJDZbv8AL29hTAFOcjHzZ/i/SlyHbkfe7dqAu8krIcHk56/ShV+UZIQcYG3vn2NIBeemBjOBRn5jkcqO3fB60uNzYKq3sGNIF+6Mjcw4+bpz19KQxWOxjkbtvemhSwK8Nzgexpdudu5iN30496Np2kHbuI47HNACsflztx6UoLdBhi2foKbt5OG46DB6e1O4B3E8ZP40AC/dx/e55poO75Ryx5x6U8KVTG7J/Qj6/h+tMYEZJb5exzj+VMQoJ25YZHQfh1pFYnOPmK8Dtj8KXy+GUE5Y8bTkYP8AKgg/eYYPHHWgBOnJJA5JHajdljjn+E8cgYzik2kdScnPGKcwI5ODzwG6jigY3cSoIGBgYWjcSxGSC3fPtQ0ZXORuGOKGQZJwR83XPt7UANaQMDx2HBFC5OM92xgCjB2nOOgHr/OkAO44AHPH+HFIYm4MMd8dMd6eG65XAyBSZH93PX/PNNH0+XjPrQA9j1JBJxj2NKflyQPTt1pGbblQMfez8x60m3OR8oXjqaQDip69sk5NN/hBwRkA9KXAyowo65BJpm3CnO1T/vE9aYD2+8eODx09qRctwuAAo79KNp3cZxn8OlH8PLYO3+ID1pgMGMkg9yODSsynofTPr06UhyzYJOPTIPWjhQMjb/u4HQHpQIT+Hkr05xSSZ3AdDngj6UOxPIcbiCev6VH95ScjtyrHOfWkAnHf8AG49c0cqRgkc9GFNb2weo4f9aRs78DaTnnDGgBu4MOSvAzxx3puQzEDd15wc0EkryQDt+pz+NNJ5JyOvYDPSgBWBXAAx3zjNVNYuzZ2M0nfGF9cnip1Yq3VRxnuKy9WU3N1Z2w53Pvb6CqWrJex6H8KPDhvbrTrYLksyg++Tk1+nv7PXgsFbCPy+AV7enFfD/7NfhFtQ1ywldMrGvmH6npX6k/ALw2LeFJmTAjWuqfuxPL1nVSR7ZBEtrapGOAq4rn/ABJ4qt9BhjMjDc7hFX1JrW1i9FnalycV8vXXxAf4ifFqXS7Z99jo8il2B4aQ54/AVFGmpJykaYvEqirLc+oLK4+1QLIP4hmrNZmjnbZxj0UVeadU6kCuZrU7ov3U2S0UisGXI5FLSKCikpN1ILjxQaiZsA0QzCZeD7UwuZviCzF5plxHjOVNfOPjfw6NQ0+7gZch0Ir6ili8yNge4xXjfizSfs99Om3jdn8K1j8N+xjJJuz6nwZpskfhnxxDZ3i5s5ZGsrlW6GOQFSD+Yr448ceGZfBPjTXdAm5bTrySJc9485U/kRX3L+0J4bOl+JJpo12CX94re9fMX7T1jHfa54Y8YQr+716x+yXXtdQYU59ypU10Yj3oxqo4Mvk4upQlvF6HjK43HHUdeePxqZAR820gY+tRHuSPrjinry3GSeg5Fch65KrDIBYA5zwentUm75QR1xntx7VErfKOT0/vf/Wp6/MvPPGOgNICaPIY4GOQODxSqwXIORxjk1HnB28biecAjH+FKDnGcYOcc0AOyeSPu98c0c7ux59OBTXI57dT0HTHtQx64659f8aBgx4YYyM+lJuH47vTFMP0APXkleKViVUgDB+X5l5/nQIU7UXnr9aRQWU7eeuee1NGW4JwP73GDTN4C5yOD3I/woEO+7nkbumMUy4lSzgaVnVI16seR9PrUpby1YuxA5bdngAVV8PaZL4q1YXEin+zLdv3UX/PRvWriuZ2Ik0ldnTeCPBcviC8imliIiJzHG33mP8Aeavuv9lf9l0+Otbgub2Apo9qQ8zEffP92uE/Zt+CN34u1qyiEJLSEBm28Ivev1A0HRdF+Evg1IU2W1pbR5kkPBZsV2Tn7GPLHdnkxX1upzP4UXriTR/h34ZziOw020j4VRjoOg96+UPiJ8Qtb+MGvJZ2fmwaOr4jt4wcyc9TXV+OtY1r4rXC3LeZaeH0k229tg7pz2Yj0r1r4V/C+x8I6bHdXECvqEg3ZYfc9qiEVSj7SW5lWqVMXP6vh3aK3Zzfwp+BNlosUOoavAJJwAyQsOF9zXs6skKBIlVEAwFAxTWlLcdqRUrCTcnzSPTw+HhhockEDEtRtp+0elFZuR1WI9tGPanGmOwUZJAFSMUUtYOp+NNL0lT51yu4fwg1w+tfHSwtdy2y7iPWtY0py6GE69OG7PV9wprSKOrAV84at8eNRuWKwOYh/siubuvidrV5ki5m5962+rvqzmeMj0R9YNeQr1lQfU03+0rUdZ4/++hXx3ceKdbuOt3MP+BVmzazr3VL2Qfiar6v5ieKl/Kfa41K1fgTxn/gQqZZY26Op/Gvg+48VeKrP5or4sR2bNVP+F6eO9Db/j2Nyi/885Of1p/VvMlYx/yn35gHvRtr4c0j9srUdOkVNVtbi39d6kj8xXqnhP8Aa60XWFjDXCZbsx5rN4eXQ1WLj9pWPo7FJiuQ8PfFPRfEEamO5QFv9oV1sFxFcqGjkVx7GsJQlHdHVGpGfwsdRkryDinFaaRUFEiXHZvzqVWDcg5qpQGK9OKLDuU/EnhbTvFNg9rf26TIw4YjlfcGvlD4r/CK88E3DzRA3GnO3ySAfd9jX1+kwfg8GqmuaJba9ps1pdRLJFIMEEV00arpvXYwrUlVj5nw34PutOEt34d8Qwrd+GdaT7NeQSDITPCyr6Mp5zX59ftAfCC9+BvxS1Tw1dfPZ+e5tJ+zrnIH5YP41+i/xg8DXHgfWZYtpFs7boZPavF/23vCKePfBmh66il9QfSYpllxz5sI8s/mFFdOJpKLU4bSOHCVnZwn0Z8Hcn5cgc1Ju+YZxnOarwXAnhjkPysRyOevpUnC88D0APPPFcJ6xKG3DjFS7h69if0qLd/tY+hHH6ULyDzn/gVSBMT15HB71IGG0YPHX1qLvyxz+Hr704c4xzwT1x/9akMk/iIDL2zz+lG7dnb6+tIvKkfLjj7x/WhlC5PqcfNjigB+eO54zzzgUisQCCck4yB9KMfKMNxjgbsfh9KVSNxy3y/z49qYhGyo53Bc9DzTWO5iAQxYdfWnKozt9QTnJ6UnHJ+RehPf/IoAbvVsgc842+hpRhWwflI49uvNOZdu4bAMZO5ehoVeRkLk4JG33GKAI1bO1gp6UqyHOWBx2GKRipZSQi8E5ycGkGFw2QCO5J5pDFDBiMk5ORnHNOVz0weRn04ppAVj85J3N8yng0cNgAj2JJzTEKZAOPun6cjNP3ttGFbJPDdzTJMNkiTqoxs+g9etL8rZH5Ek8UDCST5XGDgDJLUbmJPXbkc/hQ20fMpX7o+4DnjPrSfK2BuUnHDE+1IBzOcnG4cc5FLywHDEdf6UxsFtwKMNnTv+tOGORkHdnr1oAe7NjnOT+lJkspJDFsZ+gpeOcmMk4zyaiVQqjOOp+Vuv5igY9nIycnB+XOOPpigN8vAB/Dt3peVUgOCwbO0HtjtTOVzhuSc/McfgaBDgwDFhnaODxwO1IrdVXnPGe9O+8rbXX5uQuPQnNMZvmYlh789PamAFsKThhzjjt71Ikm1jn0z1/So/+WcoBXkAjk+tOH3skjscqcUgJl+bnHfiim8dffA+aipKG8+WuB17HnNLhU6jgnhd3WmRsoGQVOeOM8U/cW4BXHOMEen0piGbZOu9RySAf1obI3YII9Mcc06RkUEAdeQccevWj5OSMc545/SmIYWKyHJ3EHuOBSN94gAe5HFSSMNxOMbl7daZtBbLLznqQaYhCf3mCRnAH/1qcp2rgBeeBt9KN3l4UIenYfh/Wm7RtIJUbfY8f/roGKrbVBO4DPX1FK7HYMjAU4AHPNLuG0fICBnoaTpkhPl4+XBzSAUsu4jgZON2OntRnCjC9iRzQD8x2jIyTSbtoIA3FVxnFAD93yHnLY3ZzjrQp46ZU8k5pMfOSV4Df096MkEY5Oc4C0AO3sMEnKkf40xflyTtyOvtSqTtAwflPODxnmkZ2Lc8c55IFAC7xhcEgH7386Fb5SC2Dnt1z2pNy7Wyp/i6de1DOecjHT7xAxTEKW49GJwc01XA54GeR9OKXcey85wCp5PH8qNx43HaMYALc4oAYzblyS2f6UoO05PbPP4Y4pGYNknhjjuadubcAemT1agY0ksrA7sYHUULkHj7obtSZXaR2wPm5NOVhuHA+93akMTce24DHSm5OSFP4U7A2n5fmxxhvfrQVLbiyZ5HQ0ADMdxwCxPr6460hyucdepo27chl25PvnjP+NL91jz275FABvHPzckHr2pMnp839TTmVmwcbsZpNpJYcBu2M5oAG4bB+9nv3pMfL6HGDk5pV4zg5GQPu0KpjwdoU4wOeetMQxm2tzzxnOKbltw5Ge3oe9O6ngHcB0x3pMncCAoPZVPXPY0CGSMV6Bgvv296aSWX5eeex605l+Xj7uB/F6U1+eoZckckjAoAY2WGR93ngDjrmmfgw74pWI/uGPqAOueaG54DZ6Ac4NIZFI3y4yDwBjHWmN97quM+uKkZW6HcM5PrUcjNgH5iPdaBDPurkZI7fNTPDNidZ1yZ0BZQy20f1PWq+qXi2dnLJu+ZF4BGDk9K9O/Z88Jm81TTVkXJVTcycfxHkfpXRSWtznrS5Ys+x/2bfBA0+CNzH8xwv5Cv0Q+GWljT/DsZ24L18pfBPw/tt7RQvJavs/SLUWOl28XTagzRWd0kc2FjduTOD+NXihPDPha/umfaIYGfr7V8u/sl2L6hDea1MCZdRupLgse4LcfpXW/txeNjp/gyXToJMT30gt1APJyea2v2dfDqaH4L06PbgrGB+ldsVyYdeZ5NSXtsU/X8j3xb9LGzBJxgV5v4p+Jyx6tb2EMg8yRwMA9qr/Efxouj27KHwFXnmvkaH4uJc/EC7vZ5sQ2h2rk9656dFyVz0atboj9FtM1CI2MJZwDtHf2q39vt/wDnqv51+c3iz9tqewZrfTt02zgbDXFL+2v4tlmBWCQJ7ml9XfVmqxLtoj9Ulmjk+64P40pNfAPwz/bQuLy6ih1DdGxPO419f+AvibZeMLGOSKRSWHrWM6TibwrKTsd2/wB01yK+Ihpvic2UjYjmG9Pr3FdM0425rxb4yalJosllq0bYNpMC/up4NKCvdBWly2aPeIZBLGCOc1x3jzTQ0kU+OGBRqueB/EEWuaTbzxuGDqCMGtXxJY/btHnCjLqN6/hTiuWfK+pfNzLm7Hxn+054R+0aDHeonzRHBIHavjjxh4Rk8afCnxZosK79S0YDxDp6dz5ZCzoPrGS3/AK/SX4neH18Q+C72ILuYxlh9RXwbHqS+B/G2najcpmzhufIvYz/AB28mY5VP/AGataV5QdJ7o86qvY4yFVbSPi8TCQKwHDAE8ZqZWXdnIz7itj4meEZPh98SPEfhxiTHZXb+S396InKEe20isHzDxk5zwQDiuY9ks7s8ZwMAdfWpe2cfjjNVlYlupBP/wBfj3qdSODwRjtkUgHjsM45A6+pzS7tvRuO5xRuLLheSdv8Q4pGjJOeR6d6AFj+Yr065xnFG7bx8x5x64pGVhvAVWHc9Me9A+bPzEZHBxx9aAFZlyWxuxxwOKj54Iz1xuHT2oZiMbmCN09B9aX22qU64zgHjrQIbu27fvDHajnvlx14701idxGdx77TkY/KoNSumtbRnjGZSRHEnq54FAiKZX1i4+xRE+UXHmuOv+7X0J8D/hbceJNcsrKC3+RSoCgdK89+Fvgn7frEce3zEtwC5x96U9a/UT9jv4JQaWq6tdQZdfm+Yd67YpU48zPNrylOSpx6ntnwJ+Etj8LvCqTTIq3jpukkYfcXHSsXxJeXHxS8SC3VmTw/ZtlwOkpFdr8R9beYR6FZPiaf/XFf4U9Kd4d8Mx6daQ2UKbf4pDisYavnkVKKhFUYFnw74dt5JI7qSFVhgG2CPHAx3rqWO6kWNYo1RBhVGAKXbUSld3OinTVNWW4irUgpKKyep0IU0h6ZqOa4S3Qs7BQO5rzjxp8U7fS45IreRd4/izTUXLYic1BXZ13iDxdYeH4Ge4mXcP4c814p4w+M13qLPDZfuounFcnFNr3xI1SX7FE0lsp/eXUjbYUHuT1ruPDfwbt7hkLyyaiw+9JHhYl/4Eev4V0e5T33ONupXdo6I8umutR1iUl5GKt71bsvBt/fYCQSSk+imvel8O+F/DZVDEuoXg48uMbsflWvZS6vdqFs7ODTYP7zqA35UTru3umkcLTi/fdzxHT/AIK67fYYWnkr6yHFdJZfAK5Rc3moW8A74INei6pa6fZqX1nxOLfHLKblYx/OuQ1X4qfCbw+CL3xNDcOv8ImeQn8hUKpUqaI05sPHSy+bKjfBfRYeJtfjB/2ahk+DvhtvlOtzv/uA1jXH7Vfwd02QiCO5uZB/Elo5H5mmr+238OrX7sDRD/aTH9K39liezMpYnDx+K33f8A05PgX4Zm4Or3aE92U1A37N+l3Cn7Hrfmt/dZeadY/ttfDi/YI+oWkAP/PaQj/2Wuq0n4u+C/GjKdK8U6XHM3RYrrB/IgVDjXhvcn2mHqLSx5frf7N7wht1qbpf7wWvM/EH7P8Ap6u2bKS2lGTvQFSK+woZtet4/MtbyHUoPwOfxFL/AGnpuqsYNX077LIeC7L8v501Wmt9SHQpy1jofB1x4R8V+C5PO0jUZJYVOfKkJzXX+B/2otb8L3SWusROu04O49fpX1drXwh0zVoS9m6kNyB1FeD/ABN/Z6S4jkDwEPztdRWiqqWhlKjUhZo9o8A/H7Q/FsMYM6xyN2Y16jb3MV5GJInV1PIINfl1rXh3xF8M77zYPNktlP3lzkV7X8G/2pJrForXUJS6cA7jyKiVNS+E0hXlHSex9ustMIrA8J+OtO8W2aTWs6sWGSuea6PGa5JRcdGd8ZKSuiBh+dWLeYSDaetRshqv5nkyBugpDPOP2jPCUeu+Bbm5CZntfnVu+K+YPiVpIv8A4L+GpHG5ozc25+nB/qa+x/itcRr8P9YLngwNivkrxZMsnwO0ok/dv5l/QVtOtL2UI32Zg6MXOUl1X5H5VXtqbHVL+2AwIrh1HPTmmr9eOg9BWp40VYfGWtou3b9qf72MdaxVI27hg9hz1/CszrLK9sfmDUi5XpyevseahVgzA7sL24p6gYwODg9j60gJdw3HA6HHFSK21eTnjpnNRKxz3PJI5Hanbfl2nkY7D/CkBLu5OQTgj27UIw75b8aYzCNs7uc9OmOO9OEhDDkHsRmgCVfuj5snH+RTUzuOeOmemRSDDLkDt0z9eKcMbuCDzyB06dKYhrMyxgLyMHtilPJLFSc4HWk3eg2/Kc8dKG/jzkHHIwM0AJ65U49TSK3zADONwxzTm+82C2cZwRTWbPUgn5T8ykd6AEwflyedvc0rfNjaSSeD0zTd2Cdu0n0HWnKoOMjHqcZ79OKBgfmk7gFicZxS8Dofm/OmZC4GRlSSRjBpQpbquSeBx+vFIAZsNgtx8o68mn5H/As9ucU1m2krn3x04xQuWYbgdxOR8v8AhQArbgp6/dPpnrTmxyQTnIwOKibBQAFcgY9DmpBhd34fMFzQMRiVx6YJ5xUi/KnBwcDHv71H06nPHHAFAUtgYz8v3tv45FAh67tpK5HfnApisNoX+HHHNOGASV5z6nH86RW8xssVPHT19vegY5s7WIBOWx9PpTV7jGdx6ZpV/iIHIb7o4P601W2k5x97nvigQqs3zN94DjAHHSmrnJ9RweelAAZQBt5+bCtxjt/WkLbScDryMYOPemA/0ILMuSTx0pVyVyQfQc4pm1VwTx1/hI7/AOFSIwbqVHOTg0gJBuVdyjO7k/40UD5lGDtx26f/AK6KllEKthMK+ee5xTxknDFc896jRSzL/Hx6CnkFsfIzHBPOAKYhVZuvy8n8TgUZdWwGy2eaa0W1gRg5bA/If5/Cm7TtVdhz03HofeqEOyw2kspBOB34yDTX+VsfLkknpTfL24HO89Mnj/OaXy+vO3k8UADbtuAq7tvFDSHs5xkAcUNG6YYnIIGcd6ERlyAp3cD2oAcGOcllYg/lTVLLt+fBOCPz/wAaPLbOThhnJo2MEI6ZXPr0NAC+Ycn7uN2T7Uu44GdpHp3pAj+gU5H0oWM88YyDz60AO3NyOOg6Gjb1O1Tzx70vluc/KVbAPSjyiGORnnnsKAEVi23oVxkEnp+FIf4sfd4wNtO27cAhd2DmmMh3FeCffIOKBDhKcEnHyZwuOaYjbW+UKo29+pp6htxBIGDkA9+Kj29B8zfxcdDQAu5urMDtPTHT2pdx4IKrjLY9STS8quSNqngD/GkZDuPc5JHHBpgG5/mBIzkZ5/WgZPKlQ5JOcdwKX7owCAMZHejaN2QeB68CkA3LchWySvfoaFy2D0O7lqXaFUBiMY5HvRt+b5RkeitQMaobaBlc/T35o9zjcTwelK6jv19z37UR4VsHBPcelABuKrgOM8nIpSNvHyHoDQcKrAhQeDnsM9P1oK8MCAcYNABuJOG6cjr7UmT5Z+fbnkU7b7ZGTnaO2O1IVCrjkccjqRzQAvzM2Cc4OMUw/KoXdjHLFaXd94DB9/8ACjaAzHJwOfcfhQA3PykMTtb361G3X73A+Yhen/66exPoCOu4DtTNobJzuB53Ke9AhGYso2hdrDJGOPxpCOuSRk49qVmDH5vlZuSfSm88dTz94igY07jzvJOCenP0prbxydx6Z4FHlsRkjecdQevpTWI3YA/76PSgQzHbdjcOw6c0xlBIxg+3Q05kO7gY56A1FcSCGJ3J2hRnpQBhX8Z1TUrWwXkSSjd9M/8A66+vP2a/DouL4XOzCvkr/ujAFfLvgbSm1DXrq6K5Fum0f7xFfoD+zr4NNnY2pKYAiVBx+ddtNWR5uJnpY+uPgZ4f8ya3+X5VINfQusXi6fps0xOAq8VxHwf8PjT9JE5XBIwKk+MXiRND8OTln2hUaRvoAa57e0qKKLjL2NBzZ8PfHzXn+JHxy0zQIW82DTiJ5l6jcelfVngu3XR/DsKfd2R/0r5B/ZzsH8beOvEPiu4Bf7TeFY2b+6pwK+utWvBpuhkZwduK9Kv0SPGw0f3jl2PCfj74uZY7na+MA96+K9Nj1DxNqstrY+ZLNd3BAWPknmvof47ao0kFyQeSD3rQ/YN+HtldaxdeKtViVoLEMYQ44LZ61KfLA64re47wX+wL4l1DSo768j8hpF3CJm+Y5Hek8Sfsl33hW2d7mzkVV/j25Fe0eO/Hnjr4l+I7weFfEjeGdO0xvLg8uMMJ5B13e1eo/BX4oT/ETTbzwr4xihHiC1XZLtHyzL/fFYRxH2rp26HRPBaptvX7j8z/ABl4OuPCl0LiEHajc49K+gP2ZfihJb3lvbyTEocDk1d/aK8ADw34ov8ATXj/AHLZaJiOqnpXzv8ADzWH8K+NjaElAHytddSKkuZbM5Y80dJbo/W7SdQGo6akinOVzXmnxV0/+19GvbZxw6EVY+C/ihdY0OBS2TtArX8bWf3/AEIrz4rlk0ehP95TTR5t+zP47aSCTRbp/wDSbKQwkMecDpX1BFiaEZ5DDmvgf7c/w7+Nlncq3l2WqfI3YbxX3P4Z1JNU0mCZTnKiiqvcT6lUJX3OGuNNAuNS05x90kr9DXwF8fvBZ0/WNUh2YRy3b1r9GPFMYsPEVnc4wlwpjY+46V8vftReEQl0btV4lBzSlLkrQqLqjPEU+ai1/Kz88f2k9HbV9D8E+O0BaS6tv7H1Bx/z3g+QE+5UCvF4wM/1719b3nhX/hL/AIUfEPwjt33liBrtgvfcpxIB+FfI0TbkRicEjkHjmoqRtJnbRn7SCkWV/d8bunPHepVY+/4GoI8nvkj34qf+Dhc8dcVkakm7PykljkZ4HpSBuVzgnHAIwfxpM/N2U56Hgnik+7gnGO5DUAOLBsAADsFB4pfmDYQbzjB9vamFgcjbuyOoHIoyrZwMDduAzSAcrDDY49R2prMCx9DnPHalfOMAbsHvxn2pFYbXK8Edc/ypiG8K3UYxwBxVWxUah4gUAboNPQzMPWQ/dFXJJNkZLDhRnLD+tanwt0dtS3Oy5a7laZuP4RwBW1KPNIxqy5Ytn1R+yj8NJNcvrENEWLP5khI6sT0r9T9Dsrb4d+Cl+UB1T7v95j0FfOf7G/wxj0vSrS6mi/eEea2R3ODXu/jbUP7W1xLBDmG15Ydi1aS/eTUehyQ92LqPdjPCGmyapqj6hdDdK53MT9elegW8SxhmxyxrJ8N2otNN3YwWrZT7orKpK7sjalC2r3CilxUU0whXJrHc6NiSo5ZREhZjgCnE/JuPHFcX4+8UR6XYyIrhTtyTnpVRjzOyJlNQjzM5D4nfEFoBJbW8m1QOWzXB+GfAN14uX+1tbMtroqtkJyJLk9lHtW34J8JjxhdSeIdYyujQMTFG3/LZh3+leoXV1BpOnjWdRURQxjbZ2XTHoSK1nUVNcsdzlo0XiHzz2M610ex0vTYptTjj07S4/wDj30yLjd7v6mpLbV7/AMVN5VoF03SI+MoNpIHf6Vw8mtS+LL6bUr6cJp8GWeWQ7Y1Udh7e/euV17xpr3xMvP8AhGfBkcllpbfJNe7drMnr7A9q4lTniGo81j0E1ZqmtvuNP4h/tDeHvh3dtpHhuzXX9bB2u4GY4z7kdTXlbap8bvi1eMYp73T7CTO2KzTyUH/Aute9eDfgb4L+Eek/2lrbQyTr88txdkEs3UnmvOvil+3V4b8HxyWfh5Y5ShKiQDgfQV6FJ0cOrUad3/NLX8OhxSpr/l5K9+nQzNF/Yv1bVFF14n8QNEzcus0zSn8cnFddafs9/CbwdGv9q6pFcSR9VLLg/hXxz4+/bm1vxHLIFv5FX+6hwBXi+vftCXuoSO8t5cMT/t5pyrTl8UvuHTpxppKET9N/tXwG0LhbG1kcfxbM/wBab/wmXwMuMo2lWpB/6Yivyau/jVcsSVuJz/wKo4vjjeRn/XP+LVm3fqauMnuj9Xbzwb+z74zGxrCzgdv4tm0iub1b9hj4XeLF83w1rbWE/wDD5Mo/pg1+bum/tAXsLDMrfg1dz4e/aY1KxkR4L+SBxzxJTVSeyZjKn3ifXV5+zr8aPgi5vvB3ii+1eziORaNOzoV9CpNdp8Of2voru8Tw/wDEnRpNA1VTs+0yRkROfx6V5B8K/wBv7WdJ8m31Zk1G1GATIfmx9a+mI2+GP7W3hp4ZEhi1TZkEYWaNsdR6iqlJv4kZKm4/C/vPUNHnFxCl7od4l3bONwVWypFa0epWWvBrO8iEVyOqOP5V8TreeNP2R/HVvpd9NLqHhi4fFrdMSUZc9D6GvrXStV074reGYtU0mYQX6qDwcMrehqXFO19jaMpL/I574gfB+21O3l2xh42B7V8YfF74G3vhe4kv9NDRlTnC8Zr7b0D4sLpuotoviRfInVvL85xwfrWz40+Hlp4s0uSS02SiRcheCD9Kq06TtMSdOsrwPz++Dvx31DwdqcdteSuhVtpDGvvv4Z/FCy8aabE6SqZCBnmvgT48/Bq88N6pLdW1u0UisSyYxmk+A/xbvPDOpRQSzMADgqx6Vv7tRcsjh5pUHzLY/T0MGX1rI1+8TT7N5WOMVzPgP4iWmvaPHM0q5285NcD8VvifDLfx6dbSgrvAOD71yOm4t3PQVWM0mh/x+8Yta+B2t43wZo/mFfP/AIovAPgfp6k8/wBoP/6CK6v45aw15YxR5+XYMflXAePt1r8IdGTp5l07foK85z5rep2ctl8j85fG0m7xrrmScfa37+9ZEeQ2cqSehPar/jJv+K11sdf9Lf8AnWYqjaepHQjNdi2Aso24Z3YOelSqu7Hufaooz/u/jx2p6jGC3yjcOcUgJkwwUjkHqSOlHByD/gKSPoB0GeMdcUqL+8/kCKAJM7WGSRg89+1O/ixuwPb+VR854IAyMe5xUq4xkcNxwe1Ahdx8sg9cc8UjMeCfXpSjc2T045H1P86XbtbPQE4656etMQP8oC557570nO1slhx09KXJYA5Hr/8AWNN2kA5X5gMfKeDQAOC275s8dMYoXduAXIYkdGof7z/KQfRj0pNu5lwrA5HuTQMTazHrgtyQRxSj5ZFAwCWGSvFIqHI+XsScnoKVc8YO1c9/zyaQDeWwPmJ3c8fnS8DcRtLdNwGKGQ7sYwc9c4+lKT2DDrjbmmAjZ3Y3ZPHbIPSj7pKrtye3SlcNuA25+QHjijO1eDle4yDQAOrlcHAO3g4z9KG453emWUd/SkbI2dAMdM9eaUKYxn5gRjHOQaQBuJwCxBwfmxmjaPL5x6kAEH60rK/Q+hNHG0AEHPOSeTQMdzj5hn5h2yBTSp2tvYEZ6Y9+tKAxXqDuORz7ULj1xng85/KmIRiSrb2yM56Uirk8t3yMCnDcVZj0GMj0po45Py88Ek4oGJuJj5JZdvAxx1oQDcRuITHT+lKo+Utjjb/e96T7xIx+GDxQAq52A/MBgr16VIMtnLY4zyKTHyN94c4p2DIegIxkDkfjSAfu3ID8pA9eOfWigf3COeuCf1opMCrEw8s7gUOcH5j+dSlW2szN0HDcHP4CmJ8yjLA9h607A+UBMsOuDxTAXf0kYk5/jBzk0nmHaMye/rmkyFHBG/knsOaUHaMDhumFoEBc7f8AnpGOQOeAf85owVPysN7e3PvTD8u4kZdf4cdvelGHbCjfznPpTAcow5VBlDgk54o3eYR8+FJP3s5FNG4gbQeDx7/WnK27KjknjPXFACq7NtwvbAOev1poY9TycYOCRQ3PBJz29h7Ub9w2/MeMMcZoEOJZfvEhxwDnj6UDG3r7gc9vWmj7xUnIz+P/AOunjO4Bhxjn1HHSgAXPAYbO4IY/hR5g7jLE8CkHzDk8HgjueKQMNwAOB6N2oAd5jID8qMOgbFNYheM5ycluh+maQY2gnbwMAZ7UmNpKuduOTx1oAVWKDG1SG6bjux7e1DMueeePlGOB7Cjd8u4/dY+nNNXJwOBnkqenNAC7yozsVgeAW5NH3cEnJxwD2OaThgxBHXnNI2d3zH5c8MOSfQ0wHqwzgqpHvz+fFKvXafmA429unpSNnaccoeAe5NC43cdRncT0FIBFY/LyrDrgjmk4AOQTtOflAHNDENjcQOOg+tNXHA4Lbu/cUDHcKZFGJBkE+v50fdzg7s8lcHB/WiPO7aNu7oOO2KRR0HzAjj5elAh3GMEZZsYAJI/GjaP4WyM43d6Np27FX5gck9DzShRJ0BHYLigYgw3RQD0LEHOPrSbvmUrtLED5Tzn3zS4LcYAONoIPQikH3S3HXPvyKADjaCcAKfu9qRt3HTOSSoOPxpeFbGPl7Y70FeCv3iRz7e1ADD8uAcg/e5P6Uw58zcTjuNo6e1PXbhQTgd9w6UyRSFOcgY6+vvTEJzgtvwWHB6Z+vpTPl+UkFef4ev1pRjPJK9x9KaV3NuIXk4P+FIY1u4IIIbJ9PwqNs8KdrDGQpHepGY7fQE8c/wCelN53HqO3y8/jQIYxG75gp9dp/nWdq0w8mKHPMsgU89hya0FPzEg4453CsTUHa41RUHSGPJ/3m4FVHVilsezfAjwi2qQwtsybu4Mh46gHj+VfpB8L/CiaetpAifcVV/lXyh+zL4SEcmjxsnEUO9uK+/vhToP2zUoWK/KGya6py5Dyre0qXPd/DtkNP0a2iAxhMmvkv9ub4mf8I34P1CCBv9JusWkQB7scf1r681K5XT9NmlPCxpn9K/Mb9pLWpPid8fNC8OREy21rN9qnUHjgjGarBRvNzfQnMKijCNP5/ce1fsx+B18PeA9NQpiRow7nHUnk13vj+9MamFTgBa3fAulppfh+FQuAiAfpXC+OrwyTTHPHNa1HzSscmGTVNSe7PmT4uZupXiA3GQ7APc17j4C09Phn8HERV8qSSHc3bJIrym80dvEHjvS7PbuDTB2+gr2H4yv9j0TTtJi4Mu1dtY1qnLHQ7cNT56mpb+F9ubfwpHK/+tmLSs3uxJrkvGHi4+CfHGi+J7abyDHOLW5K/wASnpmu+tFXRfDsUXAKxA/pXgnxGin8RfC7xlrSIzRWF3EY2Hqp5xXm4OLnVPaxUuWnofSn7TGhxeNvh7pPi60UO9ug80r3Rv8AA/zr8+vH1q2l69banEOFbDV+jH7O95D8VPgALCZhJ5tsYyOuMrx+tfD/AMUvDMlnNf6fOhWa3kaMgj0NezhZc0HTl0PDxUeWcai67n0l+y34yW+s7dA+Rgd6+nPFNuLnTVkAzkV+fX7KPiBrHVDZyPho2457V+hNvMNS8Pqevy1z1VaVzXDu6aPlH9oDRJH0M38C/wCk2MguIzjupzX0H+zX43j8VeDrKYPu8yJW/SuJ+IGipfWVzA65V1KkV55+yv4lk8J+KtT8L3D4NvPuhBPWNuR/UfhVyV16mcP3cz6+8fWLXegySxjMtuRKv4da8j+NWjr4m8CxXkY3EIGr3hlW+s2U8rImD+Iry2wsTeaLrWiTcyWsjKqn+6eRXPZzo+cX+D/4J6Ltzcr+0j877e+XwT8VNHvphi0uJTZXQPRopAVIP518lfFrwi/gP4meI9DI2xW92zQt2MTHKn8jX2b+0B4Xe1kvCilZInLL7EHIr58/aosf7Wt/A/juEfu9WsPsN4w7XEXHPvih+9SjUOXCvllKi+h4av8ACduPUnmpV54+Xp34qFW5+97ZqRMnvn3/AK1ieiWFbBwvOTnrSLnAxlRj+719qYqlsZzjHPNO5ZeBjtw3ekA7jcBkdsYXrTB82C20dB07UNubJ5PHrz6UjdSARnOCCfSgBcjcMcJngA0jKOCxVufT+VGACcrkdcAUwMGYMPkP0PFAiDVpGWxaONgWlIjUKMdTXvf7OPg/+1vEllbqmY0dIzx2HJ/WvBreP7ZrllEOViDTv6cdK+4f2NfC2+6t7l0y8sidvU5NdlL3YORxYh3tE/R/4U6TH4X8D/aWUJthzn6CsXQ2a+upLqTJeZy5z710viyT+x/A9rYp8slxtTA9OprF0aDyIFHfgCopL3XJkVukF0O680WunW6ngyHitSFvkX6VyGtaov8AwkWn6ajZ8qPe4/QV0y3ASMHPasZRskzWnK7a7E9xcLGpya55tV+2atFaqcgcmoPEGuLa28jlsBRXN/Du+OqX1zescrkhT7VUY+62TKfNJRR3evaslhDycYXJr538UazP458ZWfh21YsLh99y4P3Ih1/Ou3+Kvi9NP03UZt+Aq7RzXnX7P9q9xbap4ruBuubyTyYN3ZfatYLkg5HLVl7WoqZ7vFb2lpZxQkrb6NpkYZuMA4FeR694pm+JWuvJITb6LbZ2rnC7B3P1rV+NXihrPTbDwpZsTd3WJbkqex7GsXTdNto1t9LkfZaxxm4vJP8AZUZIrzeeKfNI9jlfKoRMzX1uvFS2dlBD5Gls+LOz6ecR/wAtpB3A7DpXV6t468Nfs6+DWuLt42vNpZtzfPI2OpriW+JVjoNnqfi7UmWC2VSlnG3G2NemPrX5u/tHftEap8UvEF1P9odbEOVjjB7dBxXRTiuXXqY1ZSb9nTe39XPQP2iv21Nf+J2pTqt41vYqxVIYzhQK+YdQ8YalrEj7WlkGepbC/maxmhNw++c5wcmPP86tqvygDpjhV6CrcrjhSUN9WNZrmYBprk4/uxLn8yf8KDaxM2GWRs95JT/TFPXdngc44AHHT/8AXUo47ZOai5sUxp9szBTAh2k8F2Of1qRtLtH3N9mhwT0weP1q0rs2TkLzyceo6CjcvlhRGM4x+RoAz20S0+Y+UY+MhopGU/rmom0u4t2/0W8bBHCzDr/wIVq703Lzlc8/TFMCuB19gPxpCItN8RX+kyILlWjXtIrFlP417F8MfjVqfhDVLfUNPvpYJI2DBkcjpXkkbbsIVyp6hhwarSWb2f7+wJ2q3zwE9f8Adq4yaIlBSR+w3wv+N2gftbfDW98H6+I4vEQgJglbA3uBwy+hzXE/AXxxrHhfUr3ThKYdY0ed4JrZz8twinGCPpX52fC34saj4H1yw1jS7p4pLeQMNpwQQeQa+r7j4oRav4w0/wAb6a+wakFN0qdFlH3vzrqglK66HM7x3P0JvdL0P43eG1vbbEF+q4P95G/un1FecaH8QNZ+D2tjSdX3vYhsBJjwR6ox/lXF+GPiFc+FpLXxNpLGSwnx9stl6Ke5xX0Mi+Ffjx4VHmCKfcvUY3xt7VUanJH2dRXj+RlKipy9pB2l+Zb1zwz4b+M/htZo2jk3r8sqgbkPowr5l8TfsS6nNrom0u+jtjvyJNuQR9K6TUvBHxF+AmpyX3hkvrujZ3Nb5Jbb6EVleJv29NQ0azEMXgHVDqo4ZHibaG9uKn2Ut6buiXWg/dqqzPTvCvwD1vw7oy2w1eN5iMFimAP1rl/HHwGk8M2P9tXmt/ar1riNEg2BV5PavK7f9p74/wDxGuFt/DXgmawjlOBNJbEAZ75Nek+Afg38Rbi+/wCEo+J/iJrqSFd0Glxv+7jb1I9azqc6V5SRrSjBO0YtHC/GNShhhHUAD9K5f4y/6F8PfCdsOC6vIfxrrviQp1jxNHBEN2WxgflXIftIYtJNE04f8utmoI9yMmvCl8SSPV6H5u+NlH/Cca2D91rlu3FZ0IxtBA9vfr2/z0rQ8XMJfGGstzj7Q1ZseV2gH3r1I7GUtyaP16du9SMwZcnb976dxTFb+Hrz/SpYx90NkgmgQ+M7SfrngmngZmPGOOoPNQq2dg9uMnFSZAcd2zn3FAEm35lOckkY5Pp19qkVdzfd2jHfpUSHnPAHBJIp+0bcA89evSgRIFGO2cdD3GDSjHLANjPJzz06ikyxwTgEUisOTnOeM/zNMQrFeOcZ4BNB+fOQwUjtzxzTWx0OR7NSNjsoBJ5Xv0FAD2+Yn5iCfXoaNpbG1l+XHzY56jj/AD6U3IK4AGV6ZpQuVJwDgflQMNv7sNuyv8PNDDCn+/j7wPQd+9I3BOF+U4AWnY4I/wBWo5PvQAN8y53hk2457/SjaVC4JU9jntSMdvQDnngfpS88Dof7tAACSo/fYfOT7cYxTUG1Qd2xug5pZM534DAcNj/Gj5nAGVzjO09qAHLub70gZQdu3PvmmqrN90s2e+f0xRtV2JO0nHc+lJHnaGK8sPvL25NADtu35QTjuo6ZpepJBVlPOM9vT+dJ94MUIUAZOe9G3oAMFhk4HIoAXkMwEm1h054o25zk8LyV6bqAodcHAA6H19qbvIXoVTv3/wA4oAcpKtjf5YI470hU/IQenQc4PvRgtDg7cZ5OKQMY+g2E8DntQMFyr7RheSQuc596NrODnlvXkfhSKAysFAbP3fUU4BtpDKSv14FAh6g8t/D689eh70/aFHO3BHHOcUwcbS5zyQMHHT/9dOTOBn5jnODQMUqNo3bQMYH/ANaikYld3APcgdRRSArxMNpLqy8Y64/HNSCPcrLgBe755NMVW2gHn04607AYbTkL0PP9KBAGUqcr8w7r0/Ohtypxn5uccEfWlOI03qu3dwF9aF5yNmD/AJzTATadrblOc/K+fpSM3XH3R6d6PLXyyxdtuOFoXAY44Y846AUAG5WbCoQ+fvUm0qx5zt+XauDn/Ck2beV5ODkdqcmWYPgFs9c0AKQFXuH6BcdBSs21TjkheQDj/JpBGFYkE788Kx7d6F6khAeePQ0AP/5aAgYAGOcUgHuR6lhjNLHHu3YAKsfu+lJzsO77pNAhwwy7uh+6BnpijdlfvDceBkil/wCWe/7vYc/0pOw6Hnp60AC4Y8qAQCN3b+VMf5WyOg4O44FPGQ25eGYZYdR1po+YddvPT/61AAGIXYR/wKkO5Y8ABjnjn9KOvzDIP3QoNAztLbcc9cfrQAqn5S2zHbtio2A+cFsN9cVJxu+UjHXB9aTALHjdjOfr2oAUbXU/NjuWwQBTem0DkdwT1p+3aMAli3TP9aaq9SNo+h70AB/eYCgKM+vfvQ0ZZ8BTx/eNNkU54JXvx3pyoWU5bn/Z70AMKrtDbQo7MD39adzu2qSE9/50ioIzIRyuOFb3oi9huUdiaYDm/gB+Yseg5I9zQWLL0GAe3BzSD5VbB2nOcjkAetKG2/eHIpDBlVl4G5z05xx7ihiDITkSDA4B/lQ+7cCMjdyO/wCFDcbwow/B6cUAG0bcAbSTj/dpDjbvZMk8g5GB703B+YD7/fng0rLtVyMMSB97rQAjDy4zzjv8vNRMQrHfhC3Qjvmn8qeGbpgjuPakZcKMMQx65oAjk6kcsmORjGDUYYnBJIwc7k6U5k2rzjpww60xgVAy2SvJHSgBjLxk89ydvJHrUTMFywKc8DORT2x/CMEZ3DOO/So2Y7xuLL696BCY2jndjqd2MfhUXgXS28Q65bqRn7VdAn/cU1W1iYw2ZRMebMRGuPU8fyr1X9nzwl9v1qCUJlEBCnHRRxn8a6KMdbmFaXKj7M/Z/wBD8uZpQuBsCr9Olfdvwj0P7Jp/2hl5I4r5Z+CeghfLCpx06e9fbPh2wGnaPbQgYO0E1nWlzM56MPeu+hzXxf1oaP4PuW3bWcEfhivzo/Z70t/G3xm8ZeJ5syobwW8DHnCqB0/HNfXP7Y3juLwz4N1AmXYY7diBnqxGBXjf7F/gd9P+H1jfTpi4v3a6ckc/MeK9KhHko3fU8bGSdStJLyX+Z9ISL/Z+h7ehK14/4wbcshz1r17xM+2ERDoBXkHjAbYXJ9KwTu7no8vLFI5X4ReHRrPxBlvGXKW6hBn161ufESFtc+KVlaL80VuMke9dJ8CdJFlpl9qLjBdmfJ/SszwzB/a/jbUdRYbsOQpNcWKlpY9DBx15ih8WdSOjaTLs4bbtUe+MCtaH4XJH+yzqlk8Y+1X1u9y5YclsZFc98ULc614i0fTEGTc3Sgj1A5NfUevaClv4BexCjYlr5eP+A4qcN7sU11HiGpzcex8s/wDBNrxg17oGpaJK+ZbRjGV9Cpx/Ssb9rzwiND+JFzMse2DUE88YHG7vXnv7EetP4F/am8W+GJW2RzTyMiseuTn/ABr6l/bc8Mm88K6TrcaZa0l8uRh/dau6/s8VJdzCovaUT4i+GN0fDfxGtsErHcNtr9HvhzqAvtFWMnPy1+bOpRnT9YsL1ePLmU5/GvvX4Ia0LzTLchs5UVeIXU48PKzNXxfp5WWQEcGvmfxUreAfjB4f8QR/Jb3T/Y7g9uTlT/n1r678YWO5S4HUV83fHTw6dS8L3TRr++gxPGe4ZTkfyqafvKxdZWlc+yvCeoLqWh206nIZRXMa3Gui+OYLnGINSiMTem9eR+ma5f8AZf8AGQ8V/D2wlL7n8sZ5713XxJ05rrw+bmIfv7J1uFx146/pSw9vbcktpafft+J0Sm3S51utfu3/AAPlP9qDwOI55rlEHlTgn8a+Pte8ISeL/gH498NeWZL/AEGYa9Yr1OxeJQPwyfwr9G/jNpC+JvAq3ca7mCbh+VfFvhq7g8J/EyxlvFB06+L6deo3QxSgo2fzrkw6fLOhLdGVf91ioVVtI+BLeVZY4pFz8yg1OrEADB9QCcnFbnxP8Fy/Df4keJfC8q7f7NvpIos9DGWypHtgisFG6HceeDxUHqkykHHH94Zwf5U/jru5HOMDv7VGr84z8p7569OlP3F1yckk8ZHJoEO4UEkYHHQc00sWz90jG7k4/pQu09CVxwPejcTn7wz3HrQBGy4XrxjIAbmmN8owG2+uT/nmnyZYcnnHTbUF43l28jED5UOCP5UCNb4f2R1TUtRuCM72SBK/TX9kLwf5LaOmzq4J/Ovz++B+gNNHpysuTOwnP54Ffq/+y34dFvdWzFMLBb7v0Fdkny07HA/erI9d8fSC612ztgfkt49xX3P/ANbFVYZEtpLNXOFaUZ+g5NJqTG916+uDyDJtX6DivPfih44i8P8A27bJtOn2Mkjc/wATDav86qMW4qKMKk0pSky74P8AFX/CTePNZ1ANuiWTyY/oK9MvNZEcP3u1fN3wJ1Bo9HSdz88n7wk+/Nej654lEVs7FsACtK1Nc1l0OajW/duT6mZ8VPHC2dj5Eb/vZTsAz610vw5uhp/hdnJ52Zz+FfMnijxM2veMIot+Y4m3fjmvdNA1Py/CRUH5mUClVhywSKpzvJyZ5/8AHDxA76RBbK533cx4z2r1v4X6VH4f8F+HoJgEjgtTeTZ/Ovnf4gXB1vx/pWmKcrEMkV9C/E6+/wCEX+G+qyJ8jixt7OH6soP9ayrXjTSNKNpVHI8/0q7fxV4o1TxHdEshkYRZ6bR0xUOta4zaNc28T4udVmFuW7rCOXP5CprCP+wfBEaNw/kZP1NeXeKPEy6T4Y1XV5JMfZoGggyf+WjHBx+H868JK8/me7rCLb3sfOf7WPxck1C4PhrTZjHZWw2NtPHFfJhk86Tzj90HEee3q1dP8Rdbk1jXpl3lpJXJdu+B1rnGXIOBlAPlHpXpN62Rz0ocsbvdhGpTaD0+nWpFXOMAgf7QpBHuyAOPcVMqbV5XuMVJsCx4Q9e3T6U7+LOeM/yoC9h1Ocf5/OpOMZ4A+agCNVBAwdxG0+vOfrS/d9c5I70HnA7fL14pyqO45zz+VABgMrg8cAjB71GwUMD/AE9qcnByF+XHftTtoQY4A+Zc4zxTAjfuB3xt70MSu0AnrkY5xTsDC5AJ4J96HEe0vg5BJDdf8igRSmtmjme5txiT/lpD2b3+td18OfiI2k5tZ5C1lIcFSeUb1rjwo3Bc+/eqt1YlpPOgOybuOzVcZOLuhOKkrM/Qv4A/EK2uCLC7k82zuAEbJ45711ut+IfEP7Ovi5b6wmeXQrtt8bKTtGe1fBXwl+KE3h2/hSWRkKEBo2P6iv0C8B+ONB+M/gs+HdXljZ3T9xK/VTjiunnja62OOVOUT6J+GX7WnhvxhZxxajILW7wA27G1q6TX/jh8OtB/f30lmrdRI0Sfzr83vF3g7Vfhf4hksZ9yxg5hmXo6545rN1rWG8S6W9leuzqwwCTyKcaMZapmUq0lofo1L+154Ahh/wBH1CFhjgKwArzvxp+154f1eNrW1vYhu4AD1+Unizw/rXhq8fyJZ5bUnIKsTxXX/s7fCfxV8XPiPpdpDDcrYwzrJc3EgIVUB7mlKhFJlxqVH1R+mPwn8JnxdfP4gu1xaRtuDN3HWvn39oTxJHqnjK7kDDYgwOewyK+jPif8VNB+EPgBfD+m3EbXixeWzIenHNfnB8ZPi2ha6mSXdI6lRzXgxi5SuerFu2p4FrF19r8QanKMfNcuRz15ojz8v8OeB/n/AD1rL01XmZpnGS7FufXNa0eAoOMDH516K2MnuSrt6jhc/wB44pVGWB+6fcZpsa9DjGPpUqjAxxnH4daAFI2rtI6DHIp6sN38OO/WmqoyRgEc1Lj5Rg+negQinoV+9jGMnnrUqH5TyWAGOcfzpq/K2PxB/E0+Mg9Bj3oAGztABYqQPT9KFAJxyOT8uKcudo3cDFNbhsjofvH+opiDdnO8KFPvxRyVJBCjP3s/lilUKFU5JXPcUmdrYUBxjPpz3oAU4dQojYYOOopcAHBXI284PToKbj+LGQRjg0se1WBzxkdvXv8AnQAKArAKGKgcsy9aFAXA2Mc8c0jfdIyGA6Zz81LyoKkDp1A6CgBD8qqdp54OefypF7nYzZ9euKfgozYfc6nqegpPL3Lngnn5vWgBGUbVUZDkfdx0+ooPyk4Dc926Zp+w4U5CtnH6U1WO4YIzn06UAG4su7YuVOC2cCl3FGPBAwOhGaRcR52nKsfwpVU5bP0yvHNABtJ4K5P8KjFGTtBxjPJyBg49xS7SVOWyWPG3rQuWkPI3dBj6UAIuSVIOB6UgGWJTcGGfvDA6dKk2/eAYhfXHems2Secr1xnqRQMRWG04G0Y65FIuCAc5btjinDIB3MdvXmmsgLDD5bBHXAHtQMXfuYjb83UbsZFNYkAjPC844/xqSNVLcZBUYH5dP0pkny7Sx+916UAOz8rErjccc9OnFHCrnoOMt7+lEaYXpkZOeelC/N0YEc8YoEObHOcg9duMj8DRShRt+9kNzjHeipYyCP72V9O/FL83BBbA56ZxSKD5Q3HPYUoXdwQGycdMVQgDDzCxIc45HQCg98sRjk//AFqVnIXDcp375pFUgrnGO7E0CEHzMoJ3fgeKX5WX5uO/Az360DKjaMBSMcGjd3bHucnn8PSgY2Qhc/MRuOcY6D1IpcjcSfYDt9cj/Pal3BR8x4b27UhY8/dyec88e9AAq5U8sePXIFPLZYkbiOvQ+nak3Ljjhc46UK23J9sAqTx70gFT5/lzuPqM9KQE7Qe3brjHenN3+bAzgDnimqTuye3vQA4OFVMfM3fnNDYU5Jxt45/woX5TwTjH0B4poyvOQccen6UAOzuVMEYA5IOCcU1mLFgpz0J5wBS53bQckKO/Xr2pnqD90cHHNADlKvuz85HbHSkyOFznI5Yc8dqeDwcgFcDp1pgU7umFX360xDlfGeQQOpA6UjAdAOQTn6j1pfVeGXPRR1NNPXB6YJzQA9See44+71pGZeSBnJx0yMCk5bq3B47ij2zyc8E57GgByllVRgHGc5PSmbQo345PIwOPenLt2rjOOuMCmnce+ee/H4UAJz5m3kehxnNKudxz1xwg4pT8vIYbuRnPWk2ltvQ9/m60AJgbgpOScHPQEetSMx74GeCaRfugggP257elIq7snP69aBhwGB5DbcA56e1NUkDqQoGQc80NhsEDpycjr6UcLuIPJ4455oGHDLtYbQOWz1prZ5O0/KcnjkcfrSsTJ8xIYY53d6ThcDIPHrxSEBG+NT687u9RknoPmHrjOT9Ked3c7jngnjikkXsDhiv3h1oAjkVSo5AU+gIwaikxgjk/iMk+nWpZGLAN90Y6VFJhcZyuOwxTAZMSWw3IH95TxUHBzjB9gamkYqSue3QHAFVppBDCzsylVGTigRkXDNd6skaD/ULnH+03A/nX2V+zX4TFtpDXRTAZFVM+mOtfJHgXSZdavoQATJdzBvw3YH9a/Rb4Y+H00rTbWzRMbUVf0rtiuWn5s4avvOx9J/ADw79omt8r8obJ+lfUMjrBCzHhVFeX/Arw5/ZuhLcuuCw4rs/HerLo/hu6mY4+XHWuFXnKyNlalT5mfn9+3N4ml8XeL9K8LWkjF728jR1X+4GGf0r6j+E/huPQfCunW0aBFhhVQMegr488PWz/ABQ/aUvtQcGS10xsLk5G7NfeWk24stJUdMLivYrPlioLoeBShzVV979Wc/rn76aT06V5h44tT5ewDJbivVLyPczGuM1bS/7Q1q2hxkbgTXIj1pbGhpdqvhr4bytjYzR4/SuZ+HNrs024uD952zmuu+KzDSfC1tZp8pdeRWF4Yh+x+GYyRjcM/pXlYmXNKx6mHjywMPw7po8Q/GzQoSNyW3mSt+GMV9Q+KId2gXwUdIj/ACr54+AkP9pfFe9uyMiGFwD6ZavpC9kju47+0zlxFyPYiuqPu8px8t5VJdz8qvE10fhn+3N4V1ZMxW+rohZugY5Kn9a/Sn4x+H08afCfV7VV8xntvNj+oGRX5z/tsaKdH1L4e+K4wwlsdTks2ZR0G/cK/ST4a6oniz4Y6Pc7t4ubJQ3/AHzg114qPLUUyaMuaPKz8yNe09pNNyVw6nB+oNfT37MuuG40q2Vm5UAGvGfiBoX9k+Itc08rgwXbgD2JyK7L9m/UTY6lPaMcYfIFdldXimeXT92Vj7J1qEXWnBwM8V494y0hbq0niZch1KmvZ9PYX2j+vFcF4jsMs4xXBSlys9KrHmVzyj9kjWm8NeJNY8MzNtEFwTEp/unkV9f3EKXVu8TjKSKVI9iMV8MXk8ngH40aPqq5S2vj5Ep7bu1fcOkXi3+mwTKchlBpVVy2aFh5XvFnlem2pudF1LRp+Wt3eLB9MnFfDvxr8MvY3+oRoNro5ZfYg5FffWtWn9k+OXkxiHUIt3/Ax1r5r/aO8KBLqe5WP5JBnNPESVPGQrLaev8An+NzCdNywvK94af5HwV+2FY/2rq3gjx3GnyeItJEV0wH/LzCSj59zjNeCRk4wchSOwzX1J8R9Fk8V/s5+K7AjfeeEdaS/txjkW8y4cD2DD9a+VYmG0HqG7c81nUjy1JI9KlL2lNSLqjbjK4PQbV/nTlbzMHhzn7ynn8KhVtzDd9BhjwKm39M9euWH9ayNCTce/4BhikXbtP3QegIakU425ONvOATihmz3z/vAcnFACSDk43EdsjP6VR1Y4tGVTy7BBxV3jn+En0+U/WovJ+3atpNqPm824XjrxuApx1Yj6U+CWhiPWdNg28QQRL+OMmv1L+AtiNO8OX98Rt2wqoP4Zr86PgXpnn+ImfHH2gxj6A1+mng2z/szwJFAvD3Uij8MCt63RHBT/iNkkcQt7Rp36AFya+GPjL48k1a516KOUs2o6gtuuD/AMs0619sfFLUh4b+H+r3hbZ5cDAH8DX5n6ZcTeJPEloGYssbtIfqxr0cJG/vHlYt+9Y+pvhjMbPQYB0+QCrHjrxIbPS5m3Y4qHwzF9k0uJfRa4j4rakVszGG5bin8UznjdRSOQ8MXT3msPcMSSz9fxr6J0e+EehDccBVz+lfPPgm1/fIce9es6lqp0/w9KM4Oz+lKtq7HZHS5zPgjd4k+LF5dnLLCjYr3L9pa4cSeFtDXpfXkO9fUJGD/SvKf2edHaa4u79xk3E3lg/rXqfx4cX3xz8J2fVbeF5iPQ7QK4sS9fRHThY3+bRznxKuBpugsi8AAD8q+Vf2gfErWXhbSdFRtrTKbyYZ7s3H6Cvpb40XQXTWUnGK+HP2ivEH2jWtUdW+W0sti+g2x4/ma8jDxulI9rEO8+U+b5Lj7ffXd0c/vJCqcfwg0uzGR0AGPrTLNNlpEuMYQZOe9Tx5z/dboOeMV1EjzgZPfJ9fSlGeuf8AOKI1IwePr+FOX7vH93rgetAx/KrxkY3dqRicgEY5wPShhuPBB5b2o29y2e+VoAF7kjIxjj65z+lHDdAcduaO2M8gcZ9qeDyzZHP8QHNAhqqSwJ9eP8+lMPOMZ5GOn9O1P2qxZdnOOjcD86Cg3At3xhuv4UwE5XByVBH8XPPpTPmXJ9MZGPx/KpWUDHY4OdozUTKOfqByTQMCQrY3EEZxupm08Z6cH1qTavJ9/Y0wY2Nx8uPQcUgKlzaCdgyN5MyfcbvxXZeA/i1qHg26iS4mktipysqk4Ncq6BSQ3zDjryPpTWG75XUMvdWORTQX0Psa1/aO0vx/4fh03xGVkZBiK9Ayy/WseWxjm/e2dzDd2/Z45B0+ma+TV0+OHJheSA4HMb8c+xq0sl7Ao8vVLpOQCABW0Krgc8qMZu59peEf+EQs187xQwkReRGrjmtfxD+1loPg3SZdM8HWVvpcBGGmjxvf6mvhCd7+Zdz6pdOvP6c1TbSxM2ZZriU/7T//AFqmc3PRhTpQpu6R6v8AED48XfiCeWSW5eWRs8biTXlV015r0wnvCyRZysZ6tUtvZxW+fLiVD/e6t+ZqwFDZ4yT37/54rGyR08zGRwhPl6AcAYxVlVAwScjoPypgUjgdeeuamVW3L9cde1MkExt6jp3FPVe+e/G4daaAG5J7cnANOUDce/IJOB0oAlCg4yfcDHXmnqhbnv7j+tMVegbo3PXPf6U9hlTjn/gPWgQuS2B2+nWnfQED/d/lTdoJH3Tk4xk44H+fypfl4I2njuM0wHKxZcAZI46fjSMAc9B6Z4wPanDDKOfQcfTmkZumCcd+uB/kUDBmJOMhhjt/Ok3BozyByDhT/Wnbd2CxBB468ikZeOuB1A689KBDSeGG5SQeB/WpN2NuGPUDJximhgeAuW7cClXHDAc9Mfr+PSgBqkbgS45HPNIzd85OMfNx7U7du5UknpjA6Ui8ZBwR75xnpSGByuCHwrEheM/jSM3I5IA69j+VObK7tg9wSfekXB4IXA+Y7jmmIQgYDcgcDapzkkf/AKqTg8BiDjrjGacxbI4BHqvX8aTlh84XnlqABmDZYnAQA8EHrSyfLwSRj+9x/wDro3dCcY4Geh/CkXO7JPJ43A9KBjsGRSQQOCSymlPzZyTllyMjtTWxwQq/8BNHOWJweeuaQDlO/gNgkcZ54pFYFVJG5RwvHGaVsBTtUEdvem8sd3ykr0Gc/hQMFkG0gE5PGW+tC4JwW3ANg9smnLjaVDAL6YpgJbGMAEc96ADzNxJIwBwSD+VB5L5JPTJxnbSjDE5OTjdwOQfSm7jJ7j3oAd8u1gDn5uR0/Cp9rNIcnHTK9vxqJCCy5A6ncSMU7b8uRgqD34BoAfweHIGOF7UUu1WAUMQAOv8AhRSAgCnHcH3HFOZSWDE8j/Z9qauVVSwUH+Hr70oXcRkKBxjB96AG4YYGGC//AF8Uu0sv6BSKZuG0Btqnk4x2zQCv+yO3U8UxDmUheoHpgY9P50u5mbcejH0/Sm/L+HHQk980p+XdsGAOBxyBQANnbwMZHc88U1tzEHtxj3pXbIY7229xn255oJG5iRyccdwKAFwVXdkAcgY5pTuZSMZwOeP1pvHXo3Ycn8ac2BnseASoJNIY5QOfvdTk/wBKRT065x/9aj7zA5yep3Dik3D0A988delAC7VPJ46c9PWm7id2SMZ45py429fQdTzQScgjIOe5PNADTzGOxA4J69aTd2Ugjtz3pzFtqHleD0IOKTn5sfdBx83UcdqYg4wATtOec9uKRW/POPwpVdehJXC4zjk5pw5znPHy5b+dMQm3qW5XoCKAuAp7Ak5WgspbCNyD075pMAHkY43c9c/5/nQAD7rAk5Pcjil43c8+vsOaX+FjuB6etN8wKcA/Kx65zn1oGCttGOoxyQKBlOxJIwM04btuc5HTBpg2nluRnJAHB5oACrem7Hcd+etCs27gEgnNNZs5B+U55429zSLtxgnB7nAIFAiRY2ZQAOTzlhyODSqx3KfXpUe4MeuO3p696dxznnPT5v0oGKq7WB24GfXv60zOVGGyMdcenenbiWyH4HPXOOeP60hOxevp15z+FIAwGbHAPJP5cU0g7sHGMZ9KU4ZupYN+NJwPm6cbsdxz1oARj1ztLngZ6CowVx1wQMgc57U9t3PBx+X403d93DNn+9jI7D+lMBG+8QMHPp161Cys2eMNT89ARzjByP60xm3E4AUY9e3rQAxh82ASO+OtYXii48mx8tfleYhAP51uFVXcQqkEbuK5nUv+Jl4itrccpCNzCrgrshnuP7OfhH+0vFFmWTMdtEpP1r73+HOl/bdctoVXqQK+cP2aPCBs9KnvZEw8nqPevsX9n/RvtvjO3yuVQ5Nb1W727HBK7j6n1x4d01dJ0a1tlGNqDP1ryb9qPxYvhvwRMd+1vLZv0r2qvhn9ujxrLf3UOg2kgaS4kW3VV68nmpwsb1E30Lxb/dcncwv2O/C7XFnf69OmZdQuWkDeozxX1/cr5Nmie1eX/AXwevhvwfpdqEwUiXP1xXqGoHcwX0rarLmkcGDjfmn3MK4j4JrP0HT/ALZ4kQ4yFrXukwpq54JscXk07chRWLelzvtdpHnHx0vQ2tW1oDwq4xUV1jT/AAvGvQrDk/lWP8SLr+1vHxRTlfNC/rVj4j366b4dnbOMKEH5V4796oj1vhpmn+zLD/p2sai3SWc26N+JY/yrsrX4jWv/AAva58P+cP8ASdNyq5/iB6V594A1VPA/h/wpbu+yW6SW/mHf7pA/nXyVqfxsuLP9oux8Rpcfuba78tuese/Br3KVH2sZT8tDyOflagtz0n9r3QT4k+EPjO2Ufv8ARdWF5H6hccmvoX9hXxmPF3wP0zL73gUL16cV5h42ktvEuueO9I4eDWLCSeDB4YFQwxXLf8ExfFUlnHrfhed28y1uJEKN1GGOK1rJypXfQdPSdjX/AGiNCGm/FjWQFwl0qzL+XNcn8M5P7K8ZR87RKMV7v+1t4b8vXtH1dV+WZGhdvpyK8Cs86frVhcDjbIATWilz00clSPLUZ9w+Crj7RYhc5yKzvEll+8fiq3w4vPOs4GB6gV0/iKz8xS4HUV5z0kegveifL/xz8OtfeH5LiIEXFo4njYdQVOa+g/2f/Fi+KvANhOWy/lrn245rg/GWlrdWc8TLlWUg1ifsq6u2h32qeHZmI+zTkoGP8LHIromuaCOSL5KiZ7n8SrFm0uC+jH7yzlD5/wBk8GvIvjFpS634WaZV3HZuB/CvoXUrNNQ06e3YZWWMr+leNzWv2zQbixl+/CzRkH2rGp+8w0ZdYP8AB/8ABOuy9o4P7S/L+kfCPgrSYbr4ia/4Zu1xa+JNMuLBlPTzQu6M/XIr4S1LT5dD1K802dWWazmeBl91JFffXxYsZ/AfxKs9UiBQ2l5HcAj0DDI/Kvl39rnwrH4Z+OmtzWybbDVguo2+BwVcZOPxoqPmjGoupnhNIyh2Z5LHIeMlSCO5qSOboN3OKrxk9Plx19KnjcqAOc59M1idxKGJGeB06GkXC4PTj1pisfXH+1jGBTt27kheuRu/kKAJOe/1Of8AGrfgu3+2ePNOHBWAK5x0GXFUyoCdMH61v/Cy28zXtUuscxqVU/QritKe5Etj7N/Z903de2j45kuS35tX6Qafb4uLCzH3LeFSw98GvhH9m/R/O17RbYf89V/Q199eHV+0apfTH+F9g/CtK71ic1NayZ4v+2drn9g/CG8jVtr3LiMfjXxH8JdJ87UlkYZxX1H+39qjNY6Do6H/AF0pkZfYV418JtCMKrIVxn2r1KHuUF56njYm8q7ij1m0j8q1A6YFeSfEqY3Woxwg969lki8u1bjtXkGv2pvNdJxkKamn8VxcupZ8F6cVwcVpeOb7ybIwg4ypra8L6Z5cQ+XBxXHfEB2fUBCPpUSd5G9j3L4DaOLfw54d+XDXF2GP5GrHxWkMn7SkAJ4h03I/HFdZ8J9J+y2Hg6LGNoEhH4Vx/wATG8z9pC59V01R+orzcQ/dl6M9DCRenqcB8dLlo9Cups/dxX5+fGS8e8XXpieZIkUf8CkUfyr79+PQ/wCKRvW77gK/Pv4prnT7w7sZaFf/AB8n+lc2HX7i53y1rts80AO3b6YxgUuOpLDgHPtxSspVjyTx69KdzyccY98VYx45bgDr69OKOMdecD3oVSe+McY/D6Un8PoMdxmkBIcZxx1IweMcUu3cw4YfSkUYJx69ufSkVR2PTnlT/SmA/APBwwUcg9RQ2d3zDbk+vBpCSrFtqnvjB/DNKM9fmC92HP4UxDf4SOxBO1u/404Dnp90YbHb3o56HuRkbTg03dheenToQfrSAXHQjcODyBz9abuJbngfL1xRlTn7uPYmkB+Y/h06fypgIP4c++OKbwmASvQY4pduFzgA4IHWjJwfvY+XOCc/rSGN3HaA3Tk465oEalfl4PAAp+0BcfN1Pao+ejHcQeAFoESfM2Tkdz+oFI3YDaTn1zRsDKMnjHJ2+/8AKm5O7k59PegBfLO0Z9CcZpu3rzjkn2py/dxjseo6e/FIV8sNgcZPsetMBnK9/wAc1Mq/7QzkAfkP/r02Pt97H+7+NPHy8cDjHTPfmkAqj69M5zxT/wCLr/Fj5e1MU7sFTng98fpUy9cgkc+x7UDEweMc8ZOPenqo2nnn+768imKucLkHHX5etOHHov8AtYP9aBEgzux2B4wfxp/CrnPLAdaYoAOF6A444NOVeeMgnigY5WbcBjjd3PWlQZwTk9ORScDO09ePT/P/ANendecZOfegQh+XIzuGOeMUg3N+g3Uu0KQfQ889P8KGHKjrjnsAfWgBTgpjIA9PWk5LE8qcce1BHqMA5AOc5pWULkgcdQCSaYgbnPzKRjGAOtLydvHphsZpGYtxtyeeeO9IuMhuB6nJJoGGWVgWC5x2oO5lGB2429qTcVwFTG0f5NIADnI6fe+bqKQDi3zZLLhS3brzRzt7kZ7dqGcnsAcnHfPftSYGc4H4sfypgK2f4tuMg5/DP9P1pAxOSOjHPBpSx+6AQD3wPSm7d3JX5jzg9KAFZWK8YxgZyOnNKzFmbByPQGhmUcYXA9/ekVQeCDkcAE4//VSAPmCdgCDknrinbh0HUDA9DQzBV4XI55FJ944YcdB6E9fSgYoViGA4OMfMab2A/jzhQD0xTuEAwFHTlTTeWXuBzk9s/TFAC4Mi4GPvU0Y43Dv29accc4AJz1BOc00bm3Yx1Oc9P5c0DE+9wR8wP5ZNOKfMQxHXBI/lQEUrxk7skc9v/wBdOjbc3y8kn1xj8cUCFjUjgAFSeh64FPjO5snnjp6elNEfyk4ODnPPU1IzblPvz9PyoAdkcjHYfh15opfmVSxIOetFSxkKcqowRwaVsDZk8HBzt70LJ+5BOAQPUUq7iwwWIHcLx069aYECk8H5mGSf1pT98k5JP5U1EKxg7MbckkmnL97jkkj+KmITP+8pK8d6FAzz97OORRtx8u3Ix1xnv60bg2SFwufXBNADs4b5sMScCmLk5LHB4yTR0UnGMcnP0NDDPyqq8c/Kc4piHNxjGQvTOOKOdx5I5zuI9xRy65AYZPfgfzo/hHy9SDwvrSGOb73ynAzwKTn5jz06UuNrc8gkknHSkXLLjb06AdvegBSxdjjjjBoVV3BeM59KVvvHPXJJ49u1HLHgbePw+tADN20AOewzx160Dd3JLfXj8qcMhcjLHr09sU0Dd0XJ+mM0CFKj5Ru6E89uab1XGT0/X1p67QNoYAqdx5oAz3J28Z6UwGqN0mRyV69qC23GSe53dc05lAwc47nnvTOVUEKTkE7c8DnFAh275PvfMBmhT+8AH44FNdRtwSCw7dzSsx4U8Dtt7+3/ANagBOvBIBxxz+tCtxk7cE46UMoXG7BGc/MOQKaMbgcDbkdORTGG7zGPzLlRxQrbum3J/hNC4CnIDenB/DFAYdMdueM/pSANwO7j5cYz2HWnE7sfdGPWkkYKD8uwHkccHj/61LxywAI9aAFUH+EY6n0JpFbewb253Cl5Zi24p1PI9uMU1lHJwzKACvfigBvKhiRtK8/Wk+Y5/u8EjtjOac3zsOevGPQetM4VlUjjr65HNADN23Izj+eKbkd15wM8cYzzSsvzEcuO/WkG4DgcAHpyf880ANILYU8cYJzUZkKK2M9P0p+Du5PPHGD6VDx2A3Z5xn+dMTGzTCONmb5Quc9xVf4c6HJr2v28m3c11cAD/dBqh4luvs+nsIzlpSI1Hfmvd/2ZfBYv9ctnZMx2cQycfxHmurD2vdmNR6H118O/D66L4ft4Am045r6r/Zo8M+Wt1qciY/hQ4rwPSbLe0MMYyWIUAV9q/Dvw6vhvwtZ2wXDlAzfU1hUl+JjGKlNLsafiTV00TRbu8kOBGhI+tfnPrjS/Ev49xM+ZbeycyHuN2eK+x/2lvFg8P+EWh37S6sx57AV8yfs1+HTqU11rsyHzLudnUn+7niunD+7FvucuMlfRf1c+rvCNmtppcIxjagFXJB5kh4p9qgtrFFHBxRGu4k1nJ3dzajD2cVEoXadq27FF0fw7c3LcfIT+lZ5h865Vfem/EzUBpPhUwAgNIuKxk9DogryPDLFTq3i97huQpMmfxqh8ZLgtplnbA83Fwq/rW34Oi/dXVwRyzbAfYVz3xAUal428Had1E96gI/HNcFP4mztq6Rsct8aPFh0HVLgK2xNJ0eOIY7MUBNfBWp640WpaI8zYa/SRyxPqcg19FftWeNjHYeJpom/e6lfm1i5/gU7a+QfinfG08R6TZRnadPtIkJ9Gxk168qjhCMUebQpe9Ob6s+0PhP8AEabUbjwdfXkhaSEtplyxPoyhc/gav/sw6p/wrr9sjxRort5cF3O0sS54OTzXhnwo1w3PhsFTiSZzLHg9Jo9rfqqtXf8AiHWv7F/ai8B+JIW2Q6vBGXYdyetayfPGwW5ZXP0g/aS0H+2vhvNcIu6SzdZgfbv/ADr46vo8wI46rhhX3veW6eKfAMsJ+cXVmR+O2vhy9sWgaeBxyjMp/A4qcPL3WuxniFqpH0L8F9W+1aTanOTtAr2a6jFxY+vFfMvwJ1Qwp9nZvuNivpzTXFxZ468Vy1FZm1F3R5p4msRlxivGrO8Pgr4tabe/ctr8+RIeg3dVr37xRa/M/qK8G+LmlSXGkvcQcXNqwnjI/vKc10U3dWOetHqj680y5F1ZxyA5yM15v4hsf7P8VXcQGI7pPNX6960vgv4pTxR4PsbpH374lOfwqx8SrUwR2OpKP9RKFc/7LcUqKvOVL+Zf8FG7kpQjUXT/AIY+Pf2qPCaTwfblToME18fftRWI8TfCnwL4sT57jTXk0i8bvwcpn8K/Rj46aAureE77auSE3D8q+EotDPjH4e/EPwUy77mSE6lZL386LkgfUCuSi+ag4fystr2de/SR8eQk8AHkjvU/HqrYFV4H3RRk9cc+2KtLkfwt+VB1Dg+4jB6nnB9qdwAQPl5zyP0pqjoSpxn+6KXp8u459ARQIeCPlzg8+ldj8I4gLHVZ8ctcbPzdBXG/dwc49TXoHwnt/wDimXk/5636g/8AfSGtqe5nPY/Q/wDZP0/7R4qjmIytrE0hr7R8Gpm1llPWRi/5k18k/sgwj7D4hvT1SAID9a+v/Ccfl6TAfVFqaruyI9D49/bCiOvfFrT7MDclrbAke5qv4K0AWdmny44roPipYnXvjPrMpG4QssQ/AVv6fpAt7dQFxXpc1oJeR5co3qykYupQ+XZyfSvMo7Dz9UdsfxV65r0Oy0cYridK00yXJbHGaUHZEyWps6LYCO3Jx2ryzxJbm68WRx9R5gH617nb2Xk2LtjGFryCS1M/i5HP/PUc/jUJ6s0a0PrLwZai31Lw9COkdtn/AMdryT4jE/8ADR1+T/0D1Ga9q8Lw/wDE60dsdLb+leMfEpcftCXbD+KzQV52JfuS9Dvw19PU4D48L/xRd2T/AHhX5+fFaPbpdy2OtxAP1c/0r9C/j1DjwZOMdWFfAfxehKaFdH/p5t//AGpU4f8A3U6p6V7HkXqOBmnDCtweoOcfTpQcjOchfpShgOcYA464J4oKHY3MTknn8OlIw2+/HY0cbsDnnjDZoUZyec4/X86AF+Xrk/WlYhVwG5+tIVA5+Y456/WmGT5eBznvQA8MdwPI+YZOaA42AYwMfnUJKnHykD09aRW7bSSBj6UCLG71IJyOvHao1bCgjII4zmmK68cdTxn6fWo93QfeJX7oFAE7SBS+1sZ9KFYNjjsP59agVuwBAz/+ul8wYGMkHB59u/8AKgCRm9emPWjcqg59vy71ErEKMr2HQUjN97j15P0pgTbgeoOT15+opfOHygDgfnULSbGxjIz/AHaZvX0OMZ4pAWNoXrwePp/nj9aPMVfQjnioDP8ANjHP0+n9KTevUnH8qAJ9wwT1465+lIzjLY55NQNLjIA5wQPenGTkkjufpQBY3qOSeelKsgwGzjgA85qur7sKo5OePw60/dhdw6devr3oAs+ZyQeRg5GKeu78Bj6/56VXj+YZzg9alB/n6+lMCRORywI/LvUjfKTkjHWo1O3J3cEdyKkX5SDkntjrzQA8DLMGG7k085UAHt/Dmmbk3H26dxUm3dkdzzwc0AJtLEgrzn14+op/OOmADzk0cBT3POcnpzShMnBDcnoeaAEz83AwcdPxoA28ZxyOfWl4wMnJ4Bwc8UmST09ztPt70ADFtoGOeT8tIVC8naex460/hRySTj15pC2Cw+Xtjd29KAG5C7uQc+1IWy/XrjqKcwGTn+L6ZpVwzDJ6EZwO+aQDFXpkD7vpTWkPy559Djjineg7rx96nKh3EZIHqSDjtTAavysOFXk55pfm46MO49KAyqpGB3I3ccUKvPcjrkEYx+dADMHA6EZA6e1HPI/hz2Hf1pzbemPQ/epCemOPTaaQxOSuc+n8PvTsltxHIGCeKU9ucDvu+tNHPTd+HIoATnHbgHnFPGccfe28ClK/NkZJA5B4/nTP4jgZwcHYRmgBVzjgA46ZHSlXJVfmwcHvShdvOOg5y3T6UhB3Y24OOVHb3oARV4AZQOnHakXnqc/NgYOKf5YVc85HvjPFJtOMY5z2IzQAig+WXYDPr2PP/wCulXLbgWx2yDwKdtXYDyO/Ud6FH7z7vzdeQM0AJuPygfKefqT61Io284BPTK/zpqgYUg5XnPtUgwcKABxkZzn2oAd6rjGPx/Gil2tt5OO/I60VLGV1JbaM5IGfpSt8uAVUdD1z3piSDywR16E+lO4wNzbQOp6VQiLhuNpzzjb0HNPPyngMB1OaMDapbd1JGeM896Bhm5Oexwe9MBvDcbQFIx09+lDfKeQcZxgmnbV4Qk5yDjPvTSAWbaSc8+vHvSEIzZIBG30x2/Kg/Nn7uzr83p60pVVBCkqSMjPFG0Lk7iR0yfrQAmdyjaOc8be1OPyruAGR3YUfLhTwvsO/vShflXGTjr3x6igYbTzt+7nHX9acq5xj+EHnv9KEjGR/dPf1pVXJ5yoHqf1piG88Y44xyecketKFLLjBHqTSr90E5O3vjjNHBPtnJ75oEMwWVWIz1Wjb97PfrmnYIUbiV5PPbjpTCu5j03HmgYuDIFGB369OnrS7sqQS2e/fn1owdpAPGM80u4ZZt2R0zigQeX2ZVJP+z/OmtxkMOuQTjjH+f5U5VKxtz1OBSMoZsAc89O3+f60AAyVP3lY9CvpScbsELk+vJHvTlAKsOi4yN3Wmn7wIB5446igYisFJDfKOR04470sfZgOPw596Pl57Y6cfnSbdzZHHIxxxQAmDwflx0BPWlYbVIwCucf8A16FVdoLKF6/h7Um3vg/TqMUAKrFeTHg5/DgnnFOZjHk4Zh78UgVW3bSwH8JpFVWyNxY/XmgAVMrleMH7w65/zmjJbb97GPTv+FKflOdzH39MUiqMMN3OMZFACNnlhxu4HqfzqP7xK4IAJBz3FPZe24Fc4Bb+dMPHIBG7kc8UARsxGfm3LjuaaflYBuvf249qfIqsq/dIz27io2BXGOQOd3rQBHuLc9V4+8M0jfxMCSOnH/16WXC7sdPbtVeR9sTEEZxzmmIwtQb+1PElla9Y4f3jn6f5FfdX7Mvhf+zvCRvpE2y3LBs+1fEHgjTZNa1xZVUs91crAn0zzX6Y+C9HTQfDtjZqu3y4lBHviuyCtTv3Oapuev8Awa0T+3/GlhEV3Rxt5jfhX2QoEagDgAYr56/Zc8Pljfas6/d/doa961a+TTdPuLmRgqRoWJP0rinrIKSsnPufG/7afi97jUP7Lt2yzKIQoPc12HwN8NDRfDGlw7dpWJc/lXz7421Z/iL8ao48l4Y7gyHuMDpX134PtRaWUCgYCqBXpS9yKXkea37SrY6iVuAAalhX5SaqBgz1fXiMVxHpE2k2/nXy56A5rgvjpqm1vJDcRpnFeneH4QqyTHsK8B+M+p/a9XmjByXOwfiaxm9zal3F8M2/2fRbXPG5d5riNSnM3xS8P3R5js0muc9vkUmu9vZBpXh5WzjZD/SvMNZmNhJZzN/rpdGu3PtuGM/rXNh1zNmtZ2SPjf43Xx1zx54Z0diSoLXs49ixbP5V81eLtSOteLNTvQcLJOQv0HAr23xxrn2jxp4z10n93pdktpEfR2GAPyzXhFvDmPc4JJ5rum+ZmNJWSPW/gnrwhmtLV2+X7erD6FGVv516j8RHk/4RbwnrPS58P6n9jdu4Xdlf0r5t8J6m2lazbsp27LmOT8CGU/zFfWfibSRqngnxTZKNxmt4NSh/3lGG/lXTRfumNb4j9QvgVrw8RfDfSbndu3QKc+xUV84fEzQxpXjbWLcLtAnZl+hOa7j9hPxZ/wAJD8GtFBbLxx+U3/AaT9obTBZ+N1uAMLdQK34jg/yqYfu6komdRc1JeRwHw3uP7P1xkztDc19U+E73zrVcnPFfJOlyfY9WhkHA3Yr6S8B6h5lvHz1qKncmizoPFFnuywHBFeQeL9PEsMqMOCCDXuupwi5syepxXlXiizyHGKVJ6mlZaHM/st622nSaloMzc2twwQH+6Tkfoa+hfEmmjVtDu7YjO+M4+vavkzwzfHwj8VrabOyG+Gw+m4V9f2UwurWNwchlpzvCSmuhNC0k4Hh2qW/9seE3Rx+8VDE49xxXwjeN/wAK9+L1tfuv+jx3eyZexjY7WB/A1+g+qWf9m63q9iRiNn81PowzXxN+1F4ZNnrd3JGu3zF3g+9RFKni5QW0tfvCu3LDwqdUz4d+N3gU/DX4teJvD6cWsN209q3YwSfOhH4NXGxsdoOAeMZJr379rOBdf0X4deN1X97fWTaTetjrNBgLn32kV8/L93GCc+lZtNNo7r3SZNGNuCcAZAPSnRsWwd36n3qNVPJJ/MVKMj5cH3O3rSAZcErE5HQKe9er/DeER+CYSBgrqS5/74jNeS3mPs8vBztIr2TwCAvgm4X/AJ53cT/nEv8AhXRR3ZlM/RT9kVf+Lf69MOrFVzX1/wCGV26Pbf7g/lXx/wDsgybvhbqZHO6YCvsbQl2aVb/7grGe7FFWZ82yaf8A2h481+5IyWvH5+hxXTS2Hlxj5cU3w3YifWNRmIz5l1If/HjW/qtr5a4xXbKXQ4IrqedeIrf9y4rF0HTfmzjvXVa5BuUjGaZoWn/KOKObQXLqOvLfydKlOP4a8es7PdrwfH/LUfzr3LX4PL0mT6V5Rp1rnUQ2M/Pn9amLLkj6b8MRg6lpjelsf5V4b8T1C/Hx3x1tQK9z8Ht5l1p59Lc/yrxH4rfJ8cYz/etv8K4K70a8juobHG/HyMf8IU5PTeP5V8BfGiEJ4ZvXx0u7Ufn5tfoJ8fl/4oOb/eFfAXxuJ/4Q++/6+7P/ANrU8Ov9mfqaTt7c8S9cYJ/LFO249R9DSc7uM478cU3cO2Nw/Sgoe38Q+93AzmjaNwBGOPSkRQVBwMYx1pVztzjB9mpAR3dwtrCZXYKVAH4ZqpbNfap88CCOE/xyKcfhW14W8OjxTrZedd1nbHYidpJOpP0FfoB+zX+x5ba9p1nr3iKwH9mMwKRuuARXVGEVHnnscNbEcsuSKuz86n0e7WMHz9xHPyxnH8qrNp96GwJh6crX7Y/Fn4S/CXw3osFlZ+HdPS74AEKgkLjvXgt18NfATSFv+EftyfoK0jGE1dXJlWnTdpWPzGk0/U+q8j1IqL7Lqi9Yga/TCT4b+B2Py+H7b8VFMb4Z+C24/sC0/wC+RVexh3ZP1p9j80vs+oN/yzVT/tLika31Ld0jzX6V/wDCq/BLddBtf++RTH+DvgWTk6Db/gKPYw7h9bfY/NlbfUmBwsdMNrqf9yNv8/Wv0k/4U34BzzoMFSr8GfAPX+woQKPYQ7h9afY/NgW+o/8APNB+FN+z6ko4iQ/gK/Sz/hTvgAcf2FB+IpV+DfgDP/ICt/ypewj3D635H5o/Z9WPS36egFKtrrBGBB+GK/TL/hTXgFv+YHCPpUbfBH4ft10SP8DR9Xj3F9c8j81f7P1tv+Xc9c9BT00nWv8AnkF+uK/SP/hQ/wAPG/5gij6Oas2vwK+HKsN2hq31c0/q8O7F9c8j81l0TWGb70I+rCkk0vWoVyBG5yTwc96/UvTfg38MoWUN4ahIzyeM/rXqV7+xX8NfEGhwvpssdpd3EW+NUCHkjOKxqRp09ZXsXDEVav8ADin8z8WFvry0uES8j8tXON2D1reVi2wkZwOF7177+0H8F5fBHiLVfD+oWyiWEExSKuNw7EV89adIzWiLJkvGSjfgcZqZw5bO+jOmjV9ondWaLatnH3/rnmpdoIGATkcDpULY3Anhj6HFO2r1XJ7nn+tYm5OAwwoJHrn1qRcFNuFOOwHT3qIjb7c85p6qNpJXI9O9MB6Dc2MAYwBntTuR8oAA65FM25fAUgZH19acq8jjr0pDDbuKkAg443AY60jKPlAA3Z4yKVlAUg/MxWjA3kY+bOc49qAFwGUYHC/3qcQVUjHzY5zzTWCp/vY+7mlGNwDAsAME/wD16BCEZz8u3jGMUFcMCVVv6c0rALzndkdM96BsyoYnHTHr7UDGqBu5X7vB4zSfKueFXjIwKd8uQwO7I3YNKhwwyCeemO9ADB24+UdeMj6UNgr91QT3xzTio9csDkgHFJ15JIzz7UAMPzfwj145o4bPCjJ6FcZp7KrZJwOwx0pvXJGQP4eM0gEIH3RgZHbml3bmBAA59OlK68YBK8fLxjmgqFyN/A6d6BgR6AYJxSbeuQCB03LS7V9Nw79aMAEAHtz3FMQrL1I2gUigcZUAerClwu0Z49f8KMBQVOW+XuenvQAmMKcBVHp1AFL2PAOTnPY8UoG3J69s4o2ruI69e9IY3/dGOMYx196XaBnAUnPHHel2njLZ9u/FHy7sn5f54oEKv7zHXjpjtT93y7eDk8+tJs6YIweoHPFLxtGR27DoKYC7TjglccD0PrRT2VmUurYBGOelFQxlWP5sAjBxzjr+dOPuckjHrio4ZAynnLDg+1TACPklWPXiqEMUltpPT8TmlJK54CnoOg/SmrkxY5JySQOopfQ/w+/WmMMbhltygDHIz+FGdykbCOfoBSNn7owVI6/jS9ZDkMSeuKBB91sMGyTnAORSN8rEMp68AYwfpS7tzgrhW6DNIpZVyAAc8bqBht454Ttn+VBy3LLz7eo7mk+8OcgDp6ZpQG5CA7s5JbuKBDuVbI2tn7vPOPTNOVf3ZwM+zcik6se2DnI6U0tnDZ4yeOuKBDyw2kg4U8EAc59aTcNv3cDP4mjcNmTwwOPWmkhuM7mbpxQAY+bABXjGeo/Gl+7u4yPYdf1poYhdr8Ant64oxnryT2x0oAXgk9gRzjP/AOqkcBsFQD1O3dxT42I+7kL13du9NVdwJJ4HUY60DBW3chWD+uO340Me5XnoAc8e/WhVYK25fl6DH8qThGAPfJx6UALuO3puB4Cjt+dL0yDyMEYHBFNU+Ydp64/hpdoZsKCD2wO1ABzubjaO/oPaj7nQcjlVAwT9fWlbsNrYIySP50m0FtxZlG7v/SgBoxHuBHDdOM5FKMKMEgE84zg/Sl2nG7v0A9qb8uMOMHqOM0AIFWPuy7m4xS5THViD/EOuaDleAFx069e9IoZVzgDPqfegBV2K2CxPOTtz096C3y9NwGcgduenvRvx8rdM5+XvTV6dGY44JoGGCqtjI/Ln2xTeGfaBkr0UDGOKCB1KEbjjrSM20dTnP3evFICM/KxKcnGTmm8Ng4+fqvOM/wCeafyd25ug60z+MBcHI/XtTEQv8uB1Ld92f0rI8SXf2TS5TuyzDav41sso5wvynoDXN61GdT1vT9PAwC/mP/uj/JpoTPX/ANnbwd/aHjjw5bFMraoLmUf7R5r7xVvMuEjTnJwBXzp+y/4YMEOo6/KmN4EUZI7V9OfC7SX8UeMrC0ALK8oz9M16FT3YJdkefVk09Nz7I+C/h8eH/AVghXbLMPNf8elc/wDtLeL4/CPw1v5mk2NIpUc16ra26WltFDGMJGoUD2Ar4Y/b9+ILXNzY+GraQ7pXClQfeuLDw55pM1rS9nSstzif2edEfWtVl1ycMzTyHaW9M19h6eot7ZAOOK8K+BPh0aTodim3G1B2r3Dztqha66ru7HDhY3vUZq2h3SVqHsKydN5YGtOM7pMVyPc70bnmDT/D8snQlSa+ZfEu7WfFkCZ3AzZP4V9E+O7r+z/DDKODt/pXgfh23+3eJTMRkRrurlrS5abZ2Uo9Cf4hSGHTYbVfvSssYH1ryz4s6pHpesa/HnammeHcH2LMtem+MB/aHjTQ7AdGl3t9BzXzP+0n4iP9i/EjUoX+e9uYNKgx3G4ZxRh4vk5jOtL3rHx340uWtvA9srH/AEjxDqM17Ie5ijOyP8Mg15+v3sABTmu2+M0wh8cW+iw8Q6Lp1vaADpvKBn/8eJriMjPTBrob1HT0RJbL/wATa0A4Mm5M++Mj9RX2T4FvBrvhvw3M5yLyylsn9zt4z+NfGbSeS0E4x+6kVv1r6q+C940nw/B6tpWohvorHP8AI10UOqMa/Rn1p/wTn1w2Ok3+hTNtltbl12Z6c173+01pZa10fUFX7jNCx/Uf1r5E/Zx8TJ4O/aU1rTM+Xb3yJdw84BzjNfd3xi0n/hIfh3dtGN0kIW4T8Ov86J+7UTM4+9Bo+TnbaynuOa9w+GGrCa3iGea8Nb5gK7z4Zasbe6ERPenUWhzw0Z9OWzCa2I65FcF4os9rSDFddot151upz2rM8VWobLAdRXPHRnXLVHzX8TLRrZre+iGJLWVZAfoea+n/AIZa6uueGLSdW3bowf0rwfx5pwuLSeMjhgRXS/sw+JDLpMumyt89tIY+TXRP3oHJB8s0eg/Eiy8m+sb9RgODC5/UV8vftNeHf7Q0YXyrlohtbivsPxpp39peHblVGXjxIv1FfP3xC0pda8NX0DDcXiP54rjqSs6VTtod/s+elUh31Pzs8ZaY3iz9n7xxpAXfdeG7yHXLb1EbN5cuPzU18wQy74kYHggEAGvs/wCH1in/AAsu60C74tNdgn0ecN0/eKQufo2018dalpE3h/VL7S5wUuLG5kt2B6gqxH9K6KytUb7mOFn7SlrutBqgt049TjipVAyPlGffOahDDJHryealXLMpwcHkY5rE6hl0P9HcDBXGOpNe0+BYNvhrV4v7otZfzQj+leLXXEDc846YxXvXgGETWeqxAcvpdtJ+TEf1renoZTPvH9jVt/wqvD63C19o2LCLR427LFn9K+KP2M5QPhZejP8Ay8fyNfaStt8Obv8Ap2z/AOO1lP4hxPLPBNv5imTH35Gb8ya1fEChWIo8E222zhOOozSeJm2zMK3b945UrQOK1KLzGNamh2OIxxVSZd8mMd66fRbX90OKUnoEYnPeMI/L05xjtXmGmQf6XnH8VeqePPltHHtXm+kx5uB9aIsUtz3rwN809mf+mBFeIfF9tnxwtuOtvj+Ve3+AuZrf18o14j8ao9nxusG5+aA/0rjrdTsobHN/HtS/w9um/u4P6V+fnxu58F35/wCnqxP/AKOr9D/jpAT8O7z/AHR/Kvz0+NK58D6kP7tzZH9Za0oK2GY5/wAZHhrEkHPzD0PWncj+9x64wabjnK4BpeOOFXHv1qSx5YMTnOT070y6nW2t5X+8VXI+XFInTBxke3PvVXUhm3YZyMgfrTBnrfwG0YXWrWFqwyqEF/djhmP64r9pLfS5LH4K6fDYx7XhtEYKg9ua/IT9m+zE3iKdwPu7mH4ba/azwVtk8H6SpAZWtUGD3+Wuir8MDgpr95M+PG0XWfGGqPHaW813Mz8kA8fU109n+zJ4tvsNLJa2qnszEn9K+rNP0Ww0nebO0ity5y2xQMmrMk3l1o8R0ghfVlvNny5H+yXrrD5tYtFPshqQ/sl6321y1/79mvpaXVI4epX86rt4ghGfnT86j2tR9CvZUtj5w/4ZJ1z/AKDlr/37b/Gk/wCGTdeH/MbtT/2zavo3/hJIO5X86d/wkVv6r+dHtKnYPY0j5x/4ZL1s9datf+/bUv8AwyXrm3jW7X/vhq+jf+Eig9R+dL/wkUH+TR7Sr2H7Gkz5ub9kvX+2tWZHujUz/hk/xCv/ADFrI/g1fSv/AAkEH+TTv7ego9rV7C+r0j5uX9lPX8c6tafk1PX9lbXlx/xNrT/vlq+j11uFun86lTUon6Gh1qnYn6rRZ84f8Mua2qn/AImloT9DTk/Zj12MjGoWZ/76/wAK+kluA/RhTwxJ60vbzQ/qlI+cG/Zz16Fci4tJD/ssR/Suj8K+BdR8Js0upoqWdtC7lw+cNjjFezXdx5MbHPNeZ/H7xWPDvgO8UPtluAEH0xzUVKs503F9QhhaVOaqK+h8H/teaxF4u8Q6fqSj5mZ4t3chRXwBb/PJd4IC+e+M4/vV9ffFTXvtgt1dsmzt57qT2yDivjvTZN1vvb+NmYcdSTTlaMYQXRGlG/tJy7mgM7edyn9DUg3A/MNoxwoFQLhtuGwccj0qaIxybiDx1YnrWJ1kiKVb72307A1IGHJC7T2Y0xWP3CMc8e49al+7jcM4OOvWgQmAOT8pHHI/wpxUtnABbOTwBSZ2N93B3df6Usa/N0wT3HQe9ADmy3QDA45HX6+1NzlQV9dxbNDdh8wTHJFISAwJ5POMCgByqehAODywHSkY79wUdffr2pDnoQd3UY70mQuTnA6cc/WgB7MH+6pL4544oaTH3eWHQAn8aa2/aQANrfpQWIbqpBON3uaAHb0+6DvOPSgsM4HE3bHFN3OvygdOPelXKnnDKPTmgY4YbGEbGMA46j60m4bcYJb64/SgyEKAD2+lIPujqRngEUAHzD+HKgj7p7kd6DldwAb/AHs9PahjtIGRtJByO1Nx0J6k5Gf50ALtIbaFxn5txJwfanbvmJwNvY5wMU1nI2jgEdR35oUbeFA/lxQMfj5gmMjby3NJuHU46dR2NN3beCcAn8SKVSQSV+bsP8aQhxY8MBuz2z6+lJ0XP3Qvr3pCQpYZwc9RzmjO1lOcH9BQAvzNkjpgA8/rSbvl+6QuepA5NNUYXB4OcFaQt8u4YbB+9jigBwOMvtww9AMdKM7lO1SoPI9/rRzGoBx03AdaduKtuB3N2HpQAu4r8oG5ieSoyKkXBxsAHf8A+sKiCmM4JwDn7tOOfutyw9B0oAm3DofXjgYoppbHGMjGKKkZDEoZRkAYODjHNKMLHwdmf7wFNX5l6KPYjrT93y7VIyeOBVgMDbs7WKp/Fxnt1pdqKWLHOfXNNEoZduQuBjBFJuJVhwO5oENGGysa5XPHJHGKftGSVbGRx2H/ANekYiNThvlXrx9aFK5UttOOMqMmgA+VmKhiOfvZ5pGCrty5fryR096Oflz9zHI9PSlWQLkDOGPLA8daAE+VcBThu+00/wAk5OWZzkBiB0pu/wAvAAxkctij5mJwMHGMjpQAKPvCQnA/WnbSGGA2M4DDoPekX7rLnhecjvTR8gJUkEjOPagQ6MfKNzFT/Okw0eSSeehNO48vI+UnBz7U1fmb5eAetADmwrEhtrZxzyD+VDRhsEYx13HJyaFVFIcdMY9z701ugJPzKeTj1oAcqsFIclV74FBjPPBwDzg5po28BzsK9cd6AfMOc49+1AyQodoBZmHGOBTVjA4G0sox0J5pvmAY3H5+uac6lurZGMkjt6f596ADbtXdjaFHXGM/hSmNW4DkY5DDr0piOd2TltpGe1OLfMQBk4+7jvQAhj4XfvOT2HSl8sOoDtu447ik2lWB3cdNo4pzskjKRyPQ0CGMjrhmBIIwT3FLgtj5/m/LAoYfMvTOMkLnj/69G5cLsDKM4JNAxvkgKQCSw/ukZx6+9K8QXOMtkdwTgUincpLHpnjFIGxnB5PU4/SgAKrtAzv46DjFIR8zAycHqWINDttEZAzt64NI7MdwC7c8ZoGIrLtIVj9D/PpTeUXqG5z8rc/SnNMGTaBjI575pjMNoJ2heSVA60AJyvQvg9mFNbCqw2t6jANPkk5GDluOpqJzu6kZY8daBDcnaSD19ARVDwjpr694zUxjcZZBbx49B941Lql2LOxmlPVVOOc89q9R/Zb8GjV/HmnmRN0drEJH4/iY5NbUleSM5uyPr/wn4Zj8JeCrKwRdrCMM+PUivob9k3wm0+vT6rIhMcCfKSO5rxvVmEk8cK8jpX2P+z74a/sHwHDIybZbk7z9K3ry0t3POpL2lS76HomrXyabp1zcyttSKMsSfYV+Wnj/AFx/ir+0PK+8y2tnIcdxnNfdn7VPxATwN8Nrw+aI5ZkYde2K+Ef2b9Hk1e+n1u4BaS7lL7m9M8VWFjyxc++hljp391H174Js1sbCEAYworpftW6QViaewtrNR7VPb3G6cc96mWruaUfcgonbaa+Iwa2NMHnXkKerCudspMRLXSeFv32pp6KCa533OtGV8Z9QFrpaxbsZFeY+Aof3V1dEfw4B/Guh+Pmq/wCmCBW5UdKzdCjGmeEt7cPIua8vFS91RXU9GkveOWvLgSeLrnVGPyWNpKwPoQCK+UfihG2pSeBNFl5/tLUn1O5z/cU7sn8BX0f4qvDY+FbtM4udSbyU9cEnNfNXxt1CLSvG2sXqtiLw34bMaegkkAUfjya9GlHko2PMrT/e2X9X/wCGPjDxVq58QeOPEOpZ3C5vpCuf7oOBWcBhuuADxwagtflXDhtxbcx9zyf51ZVj908Dqc1K2O21tBLiMvbyLjqDjmvpj9mG4GuWviDRwcteaetxGv8AtIvP8q+axwwyfvc8/wAq9z/Y91xNO+KnhzzDmOaSSyk9NrAgVtTfKzGqro9T1DWpfDfxW+GPiLcVS6X7FKR3YHAzX6r+ELyPxJ4PiSTDrLDsb8Rivyx+NXh9o/h/qkiKRqHhbVjNHjqE3g5/Kv0R/Zs8QNqvw90mdmz51tG4/FQa2rq6ujnpaP1PDPE2jtomu31k4x5MrLj2zUfhy++x6pGc45r0P9oXRRpviyO9RcR3keSf9oV5N5hhmVweho+KJjJcsrH1X4L1IXVnH83OK6HWoRPaE98V5J8MdeEkMalq9gVhcWZ78Vyy0Z1xd1Y8Y8ZWvyyVwnwb1T/hH/iPe2ZO1LjEg/PmvVfGVp9/ivAtdvj4Z8baXqSkqvmiNz7GuqOsTiqe7I+47dlurUZ5Vlwfxrw3xLp5tb2/s2HCuQB7GvWvBOprqeiwSBt2VH8q4n4nWP2bXknA+W4j5+orhqx0a7Hq0JXa8z83/ipps3g/4nXVxCDFJDOt1E3uDn+leAftWaLHpfxp1S+tl2WWtwxarDtHGJUDED8Sa+zP2rPDXlalZ6lGvEkZRjivlv8AaQtP7Y+HXgfxCBmWzMmkzt7Kcpn8CK3k+ajCfyOKivZ4ipT+Z8/IRtxu6HpUyuOcHBbnrVaOTDenuT0qSM/N1HPXryKzO4ddM3kvkEfL3r6G+FqiTV2tyOJ9CXH1BBr52uDiN/ugY/hr6O+Fa/8AFV6CccS6Pg+/Arooq9znqPVH2f8AscyFfhrqSZ6XTD9a+2DJjwezf9OZP/jlfDv7HMnmeCdfiB/1d9IP1r7auJPL8ByMe1kf/QaynpIuOxg+Eo9llB/uCsfxVL/pL/WtzwrzZRHr8n9K5PxZPtuZee9WtZHO/hRmW/7ydfXNd3o1vttwfauB0WQT3C/WvS9PUJa/hUyLieffEJ9qMua4LRV3XA+tdh8RpxuYVx2gMGmH1q47GT3PcvAf/H1D/wBczXjPx2Hl/GjRz/ehP9K9k8Atm5h/3DXkP7Qcfl/FzQ5PWE/0rkrbHXSMb47R/wDFubo4/hH8q/O74xLv8D64c/duLI/rLX6LfHQ/8WyuD6qP5V+c3xYkz4I8QoevnWZ/JnrXD/7vIU9KyPCTuYe3qDRjawOCMcY3U1ux6/XmnKx4x0HPTioNRWByQAR6fMCTVbUF2wnO1eV4APrU0f8ADwvTPuaraiNtvJgY6dDTQH09+yzbpPrl4Cefs9yw/DBr9TNB+IX9m+DfAMiv8t2qJJ7jGK/LP9lVwvi9o/78dwn5pX29Y6003wl8C3AY5t5/L+mGrtceZI8+UuRyaPtFvmXI6YrlPFWuHS1JGTx0UZJrotPm87TbaX+9ErfoK5HxLcIl9b7v71ctPc2q6xTR4/qXjzxPqmoSrY+G9Vnt1OBKsaqp+m5hVYar4zkYH/hF9SH1aP8A+Lr6C0xopogAB0q/5Kelb/WJLZEexjLU+c11XxjyT4Y1AY/2o/8A4qnrrni9fveGdQH/AHx/8VX0T9mX+7S/ZU9B+VT7eXkHsY92fPqa94sXB/4RvUc/RP8A4qnr4i8VtgHw5qA/BP8A4qvfvso9B+VH2UcfKKPbS8g9iu7PB18SeKF6+HtQH4L/AI04+KvEy/8AMvX/AP3yv+Ne7fZR/dH5UjWinqope2l5B7HzPCf+Ez8SL18O6h/3wv8AjU6ePvEUX/Mvagf+AL/jXtbWKf3f0ppsE/uin7afkQ6L7nlWm/ErWzIol0DUIx6tGP8AGvV9Bvn1DT455EaNmGdrDkVBNapH/DVjT5lEbKOMVnKTktUa04uLtcqaxNuuIoh3YZ/OvlX9q7xg19KllE/7tNsfHqSBX0drmrLayXtwTxDGcfWviT4+ak66hYFzlpbpM592FZ1JfDE3guaMpM+UPirqEkfh3xzqYJCh00+L8BzXz5axmO1iUDhV9s17/wDHNltvgzANuJNR12RmPqAa8H2ouAfl2nJz0rSpK835aE0V7il3JFIXk5Udtw5NTIG+7gBfvDn+eKgiYY9AOTu5zViM5ORtK9NqjvWZsSRsrMcMFUdDzT1VgR8hznHJqJWLIuOgXJ9zUiNtYsw6jO3PFAh0ZDcbiD/Fkf5FGxjjhtoHBFIXKZXPHU/X0/KndNvHynrg/pQAvJ4bG1uD2Jprc5IOCpP3eMD0xTs/JtyB2P0pG+9wFLHkj0oADuVNh45+powpwFXkHb0x37Uq4jb5TjPr+tMb7hCgsTx6YH+f5UAJtLNtLkD0Io2RZB/g6Z5/Ol84tEARuXjnNKsh4JHyg8d/0oGNXDfMHKx/7R5pyxr/AHiAeSDxTdxYYyoXHHFKuz0yv8WO9AhP4gdxVW5xjPFKcZyG7YJPT/8AVS7lK7duS3HXpTWZtvTjuOtAB5Y3Hlem7GTgkdv0prcKcZ4HLAH+tOkZlZyAOBjGcAcU3c27rnHXPNAx0mT/ABbhjHGR9cGiQHcdpDcdM9vTjvUmCZizL8u0BW7e9MXLbcYLeuOf/wBVADtnmMqhu2QKRieVckNj7wHp1pJHCPlvmOO3agNtLcAA/wAKnvQA4ZVflPz9hn9aTy3YYU5Vjg4Apu4RsX6E9G/pTTluigAjk+nvQIeXDcFsFuOvNHlsMbXYk8Y7UZEeXAOPSk3AsDtznqR1oGKWRe5btjvShOpMny/3e1N7+YwycduwzSeZuy+AxHU/0pAPLbW54ft3H1qRVG3aqluck02PPHc5P9KVZA2Mfe6ehoAkkcxlgSOeMqOvtRSr3+7u6n/CipGQL8qrIMFsdqdkq+SRnoCxxmnKnlooIwT365oIHlsu/Py5zx/hVAMyEQbeWxg45FNb1bGM4GeM4p23OQT19CPSj5lGMkHpjrimIbj5u5GOQOce9H3t21cc4x60nzLz0Gec9TS7ih25yR256/jQAu1mL+3B96VvmVwuCAM7f/1UnMZJ6Dg4zg0n3Wwf4Tu6mgB+5S3Oc44z0HtTeWznJI5JHbngUMGVj82T97mk2/KSo2gHrn29KAHHbkZUrt6jH5UfdY4JIPp0J9KTJ5CngHgZxQ33SAOSM/SgYH7q5DBc7hmnbiq4yACT8zfypGyu4ABG6kr0zQuF5Ixz09T60CE+XqR/wH9ADSNuXORu7cd/ehshQCMjqecnBpWx1/j7k9qQxygKyjBcdSetNGVwpGcnt2oyY9uDwTx/s+poXb97JGMY/OmA7nb8vzYOaYoDMR25y3Sl5DDhd3WjcOT/AAt1JOcUCAMGYlhgHk8gUrDbIxB53Z59PahmLZOTjHzKOlBJLJkbiP8AOaAEXJxkZB7n9aNojx84+UEhWH9aA23LKMYGeuTTVbdj6YOCRQAq/K2Dzzk46dP/AK9AbLcEFgeBzQzDjC/dyODgdqQMdnA5xjnpQA7d97O3dyOvTuaRiFU/MCMZ60MwAGzlRx17/wCRTS207QSM8+tAwZyMZBxgjpkGmcJuGcN2ycdaVmUKABgMMUjNu+UgfKMY6D86AGGP94cEr2Ck96axHO3O0jG7GTSyMq4AUbSeOc/jUX+1kMf9oZxj3oEIGO7JOB0ztPNM8xjkcEjj5uB1oZ/lPUkn8v8AConZQpI3DP5HtSAytaxd3VlYLj99KCwH90da+xP2R/DostJv9YkTBmchCfQcV8e+GLdtb8USyIC20i3i78k/4V+i/wAOfDq+FPh/Y2gXa5jDHt2rrpq2pyVpaWOx8F2D+KfHFlaKCyvMq/rX6DaTYx6XpttaxjakSBQPwr5C/ZV8JtqXi46jIu6O3XcCR3r681jUE0vS7m7kOEhjLn8BWNZ3kRhoqMXI+A/+CiHjc3+pReHrWbdJK0dvtU+p5/nVj4I+F10XR7OEIFCRqP0rxL4h62/xS/aSIP722sWaRu43FuK+rPB9iLOyQ4xha9RR9nBI8ipL2lRfedHc3HlR49qi0+8DXKjPesbWNQ8vPPFU9G1QNdDnPNc9tLnapa2PV4bwLGozXb+BTuaeY9FXrXlNtfb9ozXqXhVvsXhO5um4yrHP0FclTRHbDWSPEfihqJ1jxk0QOcuFH510PigfZNLtbNOGKbcfhXF6eDrfxDizyPOLH867PxBm88XW1sOVQbj+FePWfNNR7Hp09E2eWeLJEufiBbWDH/RtJ097uUdgxbivjD9orxBu8LeJLvd++8Q6olvH7wRcn8MkV9O+MNeYW/xH16M/NcTR6Xakex5xXxN+0tqyN4q0zw9Ed0Oj2gWXHOZX+Zj9a9uouWmkeLT/AHle542qgyE8j5s1OqkBv4iOQe9MVQP4jwSOlLtA6ZK+tc6PUHMx24II69v8+9db8HNd/sHxpBcg7BZ3UNySew3DNci3C8/xH6H/AD0qXw/cNDrxTOBcR7SPp/kVpD4kZT1R+hXxC+yf8LY8QafdAHR9ds4Z39NsiqC3/j1fWv7M9jPofwz8PWVxxNb2kcTe+0AA/iMV8NHU5PEnhP4b6/dPvnudNuNKuW/24jhc/hivu34F6kuqfCPwnqYOXFsLWY/7SfL/ACFdFTRLzOWn59DW/aI0v7d4PtdQUZa1mGT/ALJ4r5vmG5a+u/FFgvibwTqlifmLRMV+oGRXyX5JC4bhlO0/UVNJ+6RWWtzpfh3rhs7tYy2MGvpTw7fi7tF9xXx7a3v9l6lFJnCk4NfSHw51wXNvGN2eBUzjoOlLWxf8ZW/3+K+b/i7prTabM8fEkfzr9RX1J4st/Mh3jkYrwTx/Y+bbzKRkEGqou+hFdHpX7M/jIa94ZtUZsv5YBz616B8ULLz9HiuQPmhfn6GvmD9lfXjpfiK+0uR8eVOdoPoea+vvEFmNU0G5ixktGSPrWdSPvepeFm+X0Pj79orw6NX8CTzquXtjuH0NfFPibTT4m+C/jjR1XfcaY0erQr3wDtfH4Yr9E/GWl/2p4U1S0ZcloGXHuK+EPCEK2/xEudKuB/o+q20+myg9PnBx+oFc+Hu6M6fZnRiv3eJhUXU+M4P3kaMMDcM+uasqx4IJzn7oFLqWlvoeqajpky4msrqS3YMOm1iKiXDqSDn1HIAqkdDC4yYzw34ivpP4RSLNrPguX+/pkyH8MV83sqnsemMZzX0D8EZvMuPApz8xgu4h+BrqodUc1Xoz7G/Yxk26P4ziJ4S/Yj8TX2rr10IfhrJJnraqo/HAr4Y/Y4udtv49hz8y3O79K+xPGWoeV8H4pd2N0cY/UVnUXvlL4Tb8FjztOU9wn9K868c3nkzT57E16L8NGFxpJPX5R/KvHvirdG3ubxc8qTTp6tmE/hQeCdVW6uuvQ17NayD7CW9q+Uvhd4k3a5NCW5Vq+kLPVx/Zh5HSnUjYdOVzzr4mXYWRuR1rlvC9x5knXvUvxQ1MbmOe9Yngi88xl5q0vdOdy96x9FfD6XN/Cv8Asn+VeZ/tKR+T8RPDc2PvRMP1Fd98PZiNWtuevH6Vxv7UUO3xJ4Yn9mXP41x1Ud1LY5D43N5nwrkb2H8q/OP4wMY/Duux56tbN/4+1fo38Xj53wlmPUgL/Kvzs+McRbRdfUDpBBJ/5GA/rTwsv3EkXUX71M8Fzu4/pTgo3KDx+FMxwMKAenTFL8vc49OoxSNBfM3MCxxkZO7iq+pf8er/AHRxkYqykp+bkgfX9Kq6kc282Cfu+1Mln0h+y/eCPx1ac8NMyH8YxX2p4U3XnwWtR3s9QcfT56+D/wBnG6MPjbTmz967jH5qBX6CfB3T/wC1Phr4ls/vG3vpGA/4FXbskzhkrysfX3hm487wlp0vrbIf/Ha82+Jutf2a1rLuwPMwa7HwbeBfhvp0hP3bYD8uK8R/aA1pYNDeRWwVYMOazoRvUsFZ/ulY9M8L+JPPRSG4x612cOq7lBJr57+FevnUNMt5C2SVHevXba6JjHNFSNmFKbaOsGqCl/tdRXMG696ia8x3rLlNuZnVHWlFH9uL6VyDXnvTftvvT5SednYHXEo/txK4033vTWvvejkDnZ2f9uJTW1yMCuJfUMfxVUuNW2qfmp8gudnW6l4mjjQ84rFsPFyLcTDfnKmvOvFPin7LCTv/AFrlPCvi/wDtLVDCj5LcYzWns/dOf2vvo9L8X6oy+HmYnD3L4/DNfIn7SVx5OsaQgOD50Z/8eFfUvjiQmPTLRf4VBIr5H/akuDD4l00f3ZIz/wCPA15rlzYiC7HrNcuFlI+dv2il8n4c+DrcfxajO5/OvDA3zE+me3vXvX7T0fk+DfAp7SYm/wC+smvBMEsMnDdsY/nXXPScvUzp/ChcgccjjIyeKnChmO4ckjle1QKOqkAY61OoUsMY6r61mWKuFUEsN2OMHj0qTlvlJb5jnoOfpUS4GOucDJp/3cAfeUZOAKBEmO3Ibrjrzjjp2pVYq3BxjB68VGylgVHOAPl96euAoPcdMHOKYD2J8z3H0/z1pdxEmeMY7nvimr8xHII7f04o3Ft4yQep45oEO/hOV9SASPzpuSmclRyCc989KRsYLEKf92lYhs5ODjBOOaBjWXkZO3J6Dpml+6QC2McHp1ppPVSNzZxgGnbSGwQG9M0CEVQzbh8q44z39KU7mwGOf0prYVSM4x0Oev4UoUbASDhRnaT2oGLtb5QMHvu68Um3j+HB46kH60dwN3B6jPAzzQzHb8rexyaABlG4jPzcZxk9v/101XEmMt1x8vel2ndgEDHB445H/wBal+YYw4z1OP5UAHXCh8lenGe9KcK2VYdB1HNIzFsbmYhfbj6UqqYvut82M8ZH5UhhgHA+UHaT8ppN247cqR/F/jSyZfGcnPOP8ik42ksMjrjOc8j+VAhRGzIAxA79s03n5QSMk429KU87wQN3bAyBTl27SOm7gfNn8KAEw23D5xu5PrSH5B97OOAM4zTv4SeAeBjHApEOCcZ44yD0oAcFbDqWXkccjJ5pvK5O7AHOelC7grEAAcYpUA7r36dvyoGPXd8+MZwSvI70q5UKclRwOnfvTB93LDcMk5288Cnjr8wGcehApAP+8xJyecZ6D2/GincquNoAU4x9eM0VIxFUjGScAHH50PtKeuFPbmkO1Y8BcnGPQjmjDNhskfXJ7+1UAxmA5AzgnAx70zaGx6njOeTS/NuI2ZJLc5xnn+dLuaMgYJIOOtUSI2wZyME8gN9KYFH8RY5PUj86WRXUKfU4GR15/wD10FWUt8uOwIJz+VACjy0fc3J6Y6801VCr8xyM8FRwT6UFjz86luNv1oZivyAg5OCCePwoEKoXaQflIPWlGF4AyM5BHSkbMhHKnb0Hajc3+z8pAGOADQAqsvyt/B9OppSQoOAOByc0biGIJAYH7wNJgd0yAM8HJOfUUDHdGPDFA3Ax14FIMdCM4Hb3oaQ7uvvlhzk0hwoBzgfw9aQw+VUAxjKg/U8/40Zzyw57+/tSMzYUk4BHUfhS/wAQfPzE9iOlMBW6ndwW4K+mKT72fl2jOSM9PakJY8cAsMbvT3obCgENlsjaOnSgQ75ckkbSw9elG0s3C43EZH4daY0hbgEBs9MHjNHG3g8jHHQ/T9KBD1+9nsSaTcWbcBzx3HNIzkrjIHOBxSD7pz15J6jp70DF2qucj7vGR9aB3UDIJ9eppBJt3KMAdcqaRfvDduznnAoAVsK2Qfm64A+lJlcggn1yT1NNEhXjKjI/lTPMI6sM9BxnFADm2qCGyRjAx35yTSMRuwAwAPams7tkZVsE9e1I0jDqQQMcUAPYr91ueOT2ABpsnKkEZ5zxTGY7TvOMg4zzn2pu8h8bl3KRjb0oAcdvOPl7LxyagJ6L8x5I9OewpZGYqTkE5+7TWz5i5baVY9ef89qAGNIBnaMdzxVPVLr7LZzSZK7EOAR+FWnPc5bZwBjFYuu/6Q1tZITm5mVTn+6OpprcVz0/9m/wadY8XaRCyZ2t9ol+p6fpX3xfqFhW3Toq7QK+dv2SvC4Rb/WnTC42Rkj24r6U0GxbXPElpaKN3mSKP1rq2PNqyvc+rf2afC/9i+DRdOm2W5OenarH7S3jRPB/w11GQyBHkjYdccYr0bwzpSaJoVnZoNojjUH8q+Gv+CjHxEkWzh0C0l+e4dYQqn1PNc8F7Soi6kvY0Uur0PD/ANnPRX1zXtR8QTJl76curH+6DgV9gxQiz00duK8b+APhMaToNlEF27I1zx7V67r94Le3K5+6K9Wp2PFoe+5VDiPFmqi1hc7sVl+D9UNxJuz3rkPiJ4iBkMStyTjrWn4Dk/cofalJWgdEXeaR7NpN0ZJEAOcnFe0+J7j+wfhi3ZmiCj6mvEPBkRvNUtoxzucV6t8dL77L4bsbFTjeeR9BXl1tUkezRWp5l8MbHzvE810w4jTOat67qn2G68Sauxx9ltGCf7x4FXfhvCLXTru6PBbgGuE+JeoNF4O1lUPz3lwsQ9wMk151OPtcTY6a0/ZUHI8t1q2H/CI+ErCXgXlxNrF2T/cTLDP6V+efjfXG8TeNNc1RmJ+03bsG/wBkHAr7+/aQ1L/hB9A1hlYI+l+HrewT2klXLfjjFfnDDzGAQd5bk+ua9WrLmscWFjrJ/L7iZc+nOaT17DHSlR/l44OeRS/l0NYHeI5+VR6f4VTjm+y6pZXPZJOcGrWNvTr04PHTrVLUF/csVHzLyOc81SJaPsbwBqB1L9n/AFFlOZfDuuQ3Y9op1w34ZAr7c/Y519dY+Feu6ITmfTbtpY1zzscbga/Pv9mjUv8AhIPD/jPw4z/Nqmhs8S+s0LK4/wDHd1fWP7EPib7D4+W1lbbDrFhErA9C4X/6xrrnrA4lpM+xfB+rLeEQMchwVNeC+PvDf9h+LNUtQMJ5nmp9G5/nXqWnStoHi6ezJI2T5X6E1U+O+kiHWtM1BV+S5jMTH3HIrGGkrdxzV43PnPxNC0dqzL95ea9D+Cvi5bq3iUv8y8Hmub8T6f8A6PIuOorgPhvrz+HfGEtk77Y5GytdaipRODmcGmfct0wv9KyOTivFvG1r/rRivUPCOsLfaeqFs7lrjPH1mEkkxXLT92djuqLnhc+fvBmoN4W+Ksb52x3OM/UGvvTQbtdQ0mF85DJ/SvgDx7C2m6raX8fDQygn6Zr7Q+DOuDWPCdq27J2CtKyurnJh5NTsch4isvsurahaMPlLHA9jX53/ABMtZPCfxKupUBVrS7Ey/QNmv0s+Jdr9l8QRT4+WZB+Yr4Q/ap8OfY/G0l0i/JcxBv0rioaV3HueljFzYeE+qZ8f/tJ6KND+MWsTQrtttWSPU4SBwRIuWx+Oa80WQhT145Br3f8AaRsRqngTwH4mA3S24k0e5bGT8pLpn8Ca8BwFXrggenWqas7GsXzRTLbSFsYH5jFe2/Ae/C3XgMt0j1S5t2+jAGvDVyygkBh/KvTPhJffZ9NsJVOGsddRvoHAA/ka3o7syqrRH3B+yq32DxR8QLM8ZmJA/CvrLx5df8WJhkB+6Ez/AN9V8m/BQfYfix4nReBdWgnx/wABr6d8STG8/Z3vmHJhAJ/Dmqmv3i9SF8J6D8F7n7RovP8AdH8q8j+Nv7nWdQj6cmvQ/wBn++FxppXOfkBrz39ob/R/Fl0n9+NX/Os6OkmiKi9xHzt4K1o6b48ljLYVsV9M6dr4exADdR618balfHS/GsUo4BbHWvedD8Sb7GP5uw712Vo6JnFSnq0Q/FTVNsTHdVT4c33mBDmuW+KGreZbthv1qx8Lb7dFGc+lTb3CFK9V2Pq/wDNt1KzP+0Kz/wBqOz32vh+6x/q52X8xTfAdzi5tG9CDW1+0lb/aPBVlOBnyrlT+Yrgqaux6lN6Hj/xEzcfCe5T/AGR/Kvz8+K1v5mm68vXdpuf++ZozX6E+Il+1fDS+TGcRZ/Svg7x3a/ahqMZGfM0+6XH0jLD/ANBrLCfwpo2rO1SJ8vjoCD+GaVWORzz3pI/mhTPXHU9B+lO+4c54AODnpVlCDcFXIPb09KgvyTbTHoNp7VNtBwPTqWzUV4B9ml5J+U96BHsX7P8ANt8YaY2ePtULfotfpd+yjGuqJ40s25BupOK/Mr4Ett8UaZ2/fQ5/Sv0s/YtvBJ4w8aW5PH2hmA/Gux/Acn/LxHtWn6sdL+GMsTttMLPH+TV8wfHfxst1oM0XmZP1r3H4qaj/AGD4f1W2U7f9JYgexwa+Ffiv4pe6uGh3nGema1wiTbkzmxTd+RH0L8D/ABIF0W2Vn6AV7tD4shjgBLj86+H/AId+Mf7LsI134xXXaz8Zl0+0Zmmx+Na1KfMzmpVOVWPqC9+IlvAxHmj86y5Pilbj/lqv518Q6x+0A80zbJCR9ayG+Odw5++fzpewZbqyPu8/FS3/AOeo/Ok/4Wlb/wDPRfzr4RHxsm/vn86evxolb/loQfrVewZn7aR90n4pW/8Az0H50n/Cz7f/AJ6r+dfDS/F64k+7Kw/GpV+I+pS/MkjEfWq9gT7dn2//AMLGgk6Sr+dQzeM1lXh/1r4vsvidqEUoEjMPxr0Pw149kvgoZzk+9DoWH7Z9T1nxdrD3cLBTmsz4HafPqHxE8tuUEZf9KzY7o30WSc16d+zrpKf8J1PIR921aspe6hr3mjq9fb7Tr0YPRVx+VfJH7Vh2+NLJCeqK36V9cXib9alPoW/nXyT+1gv/ABX1njtHH/Kvn4f79Y+lqa4Q8G/adAn+Ffw0u/70SIfwJFeALgNjv6Y4xXvX7QxaT4HfDMn5sOyn8GNeBEDccYHP8Rr0qnxu5y09YkobAznHY7RUi5c8H07VArMWBLKT65/lUy5Az8uR0+Y1iaj1w3RuPpSjaE3cn8cUmQcA4O04OQaX73ONy44HQ/gKBDgB5gxkhTxz6D/9dOXHB2tnoOabn5gvTb1XPP6+wpzDbg7vmxwCKYC8DgYz0wTSrzgnaR6N1PHamAl8kjaQPXNLu3MGGC2TjjjFMQ/cvDHK7uCD04peWyd+OmfT3qNZGZMAqePfgU/dhW+YDp26f/WpAKWX5umecdqbGF3A5xg8859aVt7hgVHT7wOKTcVblRu6YB9elAxFGxB8vPTkdBSjG45B3delNU5YBlXJGTuOO1J5mF29AP7pzQA99qqcBT1JPrzx+lCqMDdnb9KYrHcoK5PQ84796CxTDAKOeNp/WgBwUDcxXK4GPy7/AOe9AjXC9k+nWkDMG3e+PWlVWUbvLoAFUMxAUgdevOKVVDfdDegpreZy2MhvX17dqNxDYAB3e/PNIBzIAwBU4wepo4UncDjBx6daZJlV7bcHjHWl3bRwVw3JG49CO35GgB52L7EsO+KauNvI+XkdfWl3+2Ru9T+VIrMoByN2Dgbv/rUDHqOOGOMjoRSLgNggkbs/5NN3FkJ6qeo/+saQHdkAx7c8Z4pASKqbMg546D2NJuyzHB5ORximeYxU9AuO/wBetKM/MRtAyOd3P60wJcCNcjjls/N0p65boSvA9KgWQ7S3y9yCe31p/ZipTHBJPekBPwxJDAd8evaikDblPy45yGB4oqWNDdvzAc9M8N+lJI5VfukHAPHWkUbkypIHQ7h0oZRtzxkDqVOBVCG7QuThu/J7c0i7NxOeM9e5oYbcruGTnpkAU9TypB68gDsPXpQAzZ8obDFcZOfrTf4uvIJ96c2OByATtx04yKXacsPvNnGAf50xCYI564HJzSnPy5IU+4/rTd2MHHGec9KXacsGBJOOAOvp1piHNngFevUA849aRVzzgnHTd0pMnBK8noSaF+6TjCbuPr9f6UAO6qACCBgYo6A/ePHXPvQFPLKuWHJHpSbTyMLwBxnmgYp+8Q2evfp6dKOeDjOOOtL743DqOetJy2CF7496QCH7ozyu3jn3pA27nHcj2+lKxG0EHA4xxjI60fxK+dpz0/8ArUxiuqruBA29R7UnVmJXacgkEZAoOGzuIBz2/lSld7BicNn7oPP40Egw2seCFIycmm4+VQRggZAzS7t33zjB6ih13L8vUcKRyOetMBCoDA7cAj1zSHA2jGB2z/n60/PykD5fqMmm7dyk54AyM9M9P60ABTan3s9ulN2rk+uRnjjrS8HJbAOM9aaMrgMVHII3ZpDF2cABiDgnpTPL2rgFh0zml8vbgbsjkDB5poU4OCxU8jmgBJFPzEE7PU/TH+FNIZA3p9KfIu1mB+b6Hrnt/Ko8HOCSD0/CgBrBuMjaRngDtS+X1IY/ewcj9aTcFO7ewA4GTz+VIFJJGcf8C5/GkMYYVOTn5c4P50xlXrnJJ5Pt/n+VPJKhsDgcdsVHjav3lOcjt+dMGQuqruwcemKxtOhfVvFyomWEP7pD/tEHJ/LNad7c/Z7Z5cjCDPvXS/AHwi/iDxppsZXcZG81+O7HA/QGtaa1MpuyPt/4S+HR4V+G+nR7dkkq+Y349K92/Z18P/214/tpXTMcH7w/hXm9/Gtraw2sYwkahAB7V9Mfsp+G/sum3mpumGkwik1ctmzzvjmoo9z8QaomjaLd3jnasUZNflB8YNcb4sftDWdiGMttZOZX7jdniv0E/ak8cJ4U8Dzx+ZsLxM7YPYCvz8/Zn0KTxR4y1TxFOrMbiYlGb+7mtcJHeTOTMKnven5s+tPBGkppOkocYwtc/wCOtY8m3lO7FdvfMun6WFHBxXg3xS17y7eUBq7F70jKEfZ00jyzXNXOo63tzn5q9V8FfJBH9K8K0eQ3mrbyc/NXunhX5IY/pVVtrBR1nc98+Dtj9s8RW3GQp3Gtz49ah52sQWwOfKUcfWpP2f7HzbyW4I4RetYHxSuP7Q8a3I6r5qIPwIFeNUep7uHjzM2NHg/s/wAKqMYLLuP5V574k0w61eeHNOUZ+1agu4fVsfyr1HWYxaaLFGOMxgY/CuO03ZaeItO1CbmHTVe4P1Eblf8Ax7Fc+XrmqSkvMrHaxUeh8bft8eKkDavaRvhtQ1coMf8APOFQg/DKmviX7pJBGCea9z/bM8UDUvimulCUt/ZtuBMQePOcln/UmvB0kHHU+nHeump8Q6EeWHrqWI2IOOh5PTvSsRuzn1qBZcZ4JPqMnNKTlsgnB9qg2H7upwAMflxUE3zgoT+HahpNoLDoOnIFNM/y8lqYHsH7KviaLw58T/DbztiD7ekM27p5Ug8ts+3zV9UfCu6l8CfEuwhkOxtNnjU/7pc/0NfBfg3UDZ+JYFQlTI6BT6EHP9K+8teYXWsaJr6DC6zpFpcsR/z0CAP+oNdsPehY4qmkrn3J8Tk+x6/pWrxf6q6RcsPzFa/xYtxrHw2tL5eXt5I5c+3Q1z0d5/wmfwI0nUwd9xaxqWPuvB/Sul0yZfEfwhvIs7iLdx+QyK5lpJeTNJaxfoeFa5AtxalhzxXgXjSN9G1qDUIxgxvyfavfbeYXWmc8nGK8i+IliLi1mUj1rvp6SseZVXNC57x8I/GCX1jAd+cqK7HxwomgEg6MK+Svgv46bT7hbWSTBRtuM19Szaguq+H1kByQKyrQ5ZXN6E1KHKeG/Eax+0WM47gZFex/sn+KvtujrZu+WQbcV5b4uAkEqkUz9m7XDovjqWzZtql+B9aqSvA5ebkqJn1d8VLPfpdvdgcwyYP0NfIP7U2hfbdFstQRcmPKMa+2/Ftj/anhe7QcnZvX8Oa+Zfilov8AbvgfULcrmSNN6/UV47fJWhP5Huyj7ShOJ8BeONKPiL4F+NdPUbp9Jmh1iId9qna+PwavlxMSRBhyWGRX2n4Js477xxe+H7jiHXNOu9MZW6FniYJ/49tr4qt4ZLNXtphsltnaF17hlODXdWVpnPh581NFhO3JHaux+Gly0Nh4jgP8DWt0o/3XIP8AOuOVVGCW2jtXU/DgCTxU9izhUv7V4fqV+b+lKlpI2qfCff8A8L51/wCFnaZdA4S/0pQD6krX1FocX9rfCPxfpXV4rWVwPdRXyF8OrwxeGfAevr0in+xO3sDjFfY3wtXztY8QaaR8t7aTbVP+0uauomncwhroQfsxal9os4BuzuiH8qxf2ol+z+M7JugntPzwf/r1U/ZsvDY6pHaOcNHM8RX6MRWt+15D5GqeFrvGA/mwE/hn+lTT/iBNP2Z8X/EJDb6okw7Nmun8N+Ks2MYL8getZXxGs/OhZwOcZrzjT/ED2OULdK9RR9pA8aUvZybPQvHWvfaIWBbmui+El95kKc14prXiD7Wp5zXpvwVu/MhAz3qZw5aZNGfNWufY/wAP7wO0PPIxXpPxltf7R+Gl0cZMYST8q8Z+Ht7tuolzXv3iC2GreAdQhxuLWzY/AZry5L3kz2YdUfO0Z+1eCL6PrmEj9K+JdetfM1hoSMl/Phx/vRuv9a+2/DoE2g3UR5O1lr418YKNN8YOXGBDehj9N3P6VzYLWc6Z04x8qpzPjjDRsU7qxHzdODRy3y+oxWj4ssG0vxXrNkR/qLqRcfiazlPRge3GeKssUOec8knOMZqvff8AHvMcY+U1YX5mHO7HvUGoHFrLgggLyM0xHqXwZkMHiK1b+66Efhivvr9jHxMtt8bvEOnyPt+1JvUZ6mvz8+E8oj1yDPGQrDn6V9KaB4wn+E/xZ0fxGFZbeQqJD6g9RXowjz02vI4JS5aqufYf7V0z6bHOycJKA/Hr0r8+/EK3eraoziN2XPpX6c+KNE0b9ojwjZ3GkanbGd0DBWYZHTIIri7P9iuaBQf7R00N7wuazw9RQhaWjKq0uefOtj4O021vo4lRYZPyNLfeDb/XOJEk256YNff8f7IN3H01XTx9IG/xq7b/ALJ93H97W7df9yH/AOtWntE/tIw9nZ6RZ+d8PwjkwMwP/wB80k3wndBkQuP+A1+kUX7Kqn/Xa/IP+ucS/wCFWF/ZV0VR/pGu3rfREA/lT9pFf8vPwf8AkDjPpTf3r/M/L3UPh7JaqfkYY9RXKaho8lk54OK/VTXv2L9D1q3cW3iG8icjgtGjD9BXyB+0N+y34l+EK/bbgx6tokp2i+tlOYz2Djt9a6KdaN7KVznqUJcvNy2PmO1LK4Ge9eneDtJ+3RDjPFeeXVn9nmx75r2X4Rwi4jUEZrqntc5Y2bKes+F/JUsFxxSeF5Ht7oITjBr07xPo4FsSF7V51YWvl6kR2zWUZXRpJantHhYmaBc88V7t+z3GE8YXII/5dWrwzwdH/o6V7l8CZPL8cOv961YVwVHudFNbG2Y92sXP++w/Wvkb9q1dvjxM9RHH/SvsHbjVLk/7bfzr5H/a0j/4rqIgdYlrw6b/ANvsfQS1wh86/tAEH4FfD3Bxi4cf+PV4DtO7knHqB0/Gvd/j0274CeA2/u38i/8Aj1eEbgXIB3EH7vtXpVv4kmclH4EOCngDvUyqZMYxn8uKgX3GPULzU68g42kc5x2471ibD9vTg888HinHcOBkDoO+aYjdACoP8OcVKnmLjrubrt60ADKVJJG/nj0PH/16csY5J+Ucj5aTcyrjuM4B6n1oDSL8oABXt7e9AhWhXbn5uB+dIq+YQRu59+1Iu9tvOV64wcZpwycsGyc8Z6e/0qgD5ee69gKTa3Rc8jOKc3zZG3a59KXB3feK8fe9/ekAwqGZsDB/SjaxYFSzBgM/nS53IPubgNvB4NBBC5EuATz06UAMVeQRu+bkZNG1jnaS2RyGp7K3Y/Ln5d3f/wCtTdue/wB3lm9BSARkO5iGYhmOB75//XS9P4j7jFLg9VPy9SWx1+tIueMH5uuOuBQArxnzCcsUAGR9Qef0pAq9CMelLklQQS2fvben+fajIGPmyTyFU5x70DFaNfMj+8TtJPp/nGabwRv+63XPWnNIVVVDqSDnaCM/jR/q2AJyeyqwoAbIvzAjdnaSeaNv8WWHcbh6U5lf5j12jHPOfyo+6MvlVHBHc+1IAcPgMRgbvxpApBzkng4yOpxTwj7TgdDnHtTRGWUMBgcn/wCuKAEfd5bsPbqOTSKp3Z+ZeOcHJp+35TywXsMDNM2lmPI6fMc4xQA5d3l7eSoB6expFjYtzu7dulOA+bgMAwPzdc803d94nbnjIBoGPUHgEgc8kjr6GnIu7++vOKb82xlK/MQPm29BT8/xbwGGOOw+ooESbQy4O7jj8aKUMM/MTyT06E4opMZAG+UZ5AHbPNK3rvJzgnOfypIxtQHBK+mRxSr8z8HJ6cNyaQDVyu3D7Qd3qcCkb16gnGCcmhmLZBzx6DIpUPTChTySR1piDgKNuQFO0L7nvimttCgDK4H0pzBvl78DkDvml5XqO5ycdTTAYV2szJ8qjHuDSbl3DJJ/2/Tr2p7MVZQOD2BpuQuQApLHb8p96Yhu0RkMDzjJ29/cinbgWy2Gb+IdBQuY2HfdxwOlHK8FQx5/yaAF6qqKuFPIJP8AWlDAbX2jA6butNyF3LnAB4/xpei5JA9jzSGH3uowc/rS47lTzxufpQzfxY4wPmPXnmg/MeCMDt3pgJuUgccAYz70igfxYGe57/jTgw6/xemMGmchTztB4+agB5YsVZCFxkAseKVfnZSd3TGR1pu0NGeAFBx8386X/WcquSeoHHFAheOrFl28DB5xTGzkcc8gnr+FSFt2cEHH8P8AjUbYKgDqBgY6+9ADmUbFwAQOnt70KN2MZz0z1NJwc5OB/dPX6Uwg5z1J+9z29RQAH7uCCFxt5AJo2/KcKc49B0oX94oGdzdgaj5DMRkHvjrmgBXYMeQcHkkYJpqqoXkHPXpjin7gVKgbj19DiohubGGz0pDD73y7Q3OQM89OtJ5hYAfN6gjqD3pzb1BB2nPRu/0pj/d4TjuQeaAD+IEu2/nDdAabu6k7gBkYU0v8PAYc8/8A1qYG2c49OMcj3oGIccMwLH2HPHtUTNjkkg5z+HapCQuMcEepqM8LweM9+9MkxPEcxeBIAcvNIFz3PNfUv7H3hdX1a61Z4/kgUhT9AFH9a+VZma98QxIPmW3G4/7x6V99/s86D/wjXw5ikdcS3GPyA/xrohsctWR6jbwNqmrRQL8xdgK+6fhboC+HfB9lAF2sUDGvkH4L6CfEHjK1ypZVYE/nX27fXEei6LLKxCR28RP5Cs6suhz4dKU3LsfBP/BQz4gOpuNJt5PnkK2qhT69aq/szeE10PwxZrswwQEnHtXjXx41t/ib8b7OwR/MjjnNxL378V9V+A9PXR/DqHGMIAPyr0acfZ00mePUl7aqvNt/5Fnxtqwt7dgD0FfLfxP17zpHQN3r2P4j6/shl+avmDxVqpvL4jOea6KMdbmlaRreDYTJdK3vmva9Dfy0SvJfBFt9w4r1jSVPy1nWepeH0XMfWn7PChvDtzN3PGa4XxTE7+JIrhgSkl7jP/AhXXfsu6kmoeF9RgB/eW87RsO9bXjPwiIfDLXIj/e283mk4/2q8asnf+ux7uFvZHHfEDxINP1SysAoIaIMfyrjtU1IN5KbtsckizS/9c4VklYfjtFQ/Fu4ePxbYTAnZJaKyn8K4rUtUd1GSzDy3jIz1V1KsPxBNdGHgqdGMlu0c1abdWSlsfmN8QNWvfGHjrxDrJhmkW8vZXVjGx+Xccc4rKtdG1K44jtGPu5Vf5mvuu6+APgO4kZntrq2ViTtjckD9agT9nn4bp8zR3E3swP+NaeypbykN4mdvdifEI8O6suC0NuhHH7y6Qf1qRfDOpOpJfTwP9q9WvuD/hRvw3j4/s0kf7UQP9aa3wa+GMfTSEdv9qAf40clHuzL6zV6pHwvNoN8ucy2B9lvFNULq0vIiQywEf7M4NfejfCn4ex8poNif963xTf+FceBo+U8P2Of+uFXyUfMbxM1vb+vmfCvhezvZPEmntHEjkTDIWVT+NfoJDbv/wAKg8BXcoxLAJrQ89g2R/Osu38J+GtPcPaaFYwuOQywAH+VaeoXk15pcNht2W0Ll0RRhQT14q/ZxSSj3MZYqEr3Prb9lvVl8RfC/W9Fc5aENhfZhXRfCbXkXwjqthM2GiWSMg+oBFeVfsY3zw+KtUsSfkmtSSPcVoa7fyeC/E3iqzzsXzmkX6MM1nKlebS9TqhP9yps5nQ9UDNPDuztkZf1rl/HFvujkPY1jeC/EP2vV7sbusrH9a67xRb/AGixZgO1dEvdkcEJc9M+c4rx9B8UhgdqO1fXHww8ULq2hGBn3Hb618geOITDeGQDDI2a9G+C/jk2t1FFI+AeOtb1oc8LmNKfs53PWPFbBbmVe9cB4c1b/hHfiLZXOdqSsFP1rsvFtx5lx5i8hhnNea+KI2VEuo/9ZA4cEe1YLWNjSo7u5+k3hm8TWvDdtLncskWD+VeH+KrAWupahZOvyksuPY12P7OPihPEXgW1+fcyoD+lZvxcsTaeIhOBhZkDZ968LExaXoe/hZc0Un1Pzg8bCTwT8T47pBtexv0uEx6Bwa+cPj94dTwr8dfHNhEoS2fUXu7YDoYpT5iEfgwr65/ae0T7D4yNyBhLiHIPuK+cP2orX7drHgbxQORrOgQxSsO8sBMJ/H5BXoTfNTjM4MPeFWdN9Dx2NuuAPTkZrT8PXY03xRol2PlCXaoT/stwf51lQOF3bWyMevenTvthLrkNGd6565BBrFPW53y2Pvv4Zsbr4Oa3bLy+i6kt2nshNfY3wr1Jf+Ey0C5Vsx3toOfXK4r4q/ZnvxreleNNMzuXUNE+0Rj1ZVzX0v8ACnxD5eg+AdT3f6tY4n/4C2DXVU965yJ8rNLwXnwx8Z9c0/7qQ6m5UezNn+tdv+2Zak+ANG1NRxaahGWb0Dgr/WuK+Jit4f8A2irsgbUvIobpTnrkYP8AKvV/2k9MPib9nfX2jXdJDZrdpjrmPDf0rmpu00zaavFo+IPFMYubNu/FeD60pt7yQdOa90kuBfaXHIDkOgI/KvFvGEPl6g/bmvbwz15WeHXRz0kzN3NeufBG+2syE968gYV3nwkvvs2rFM43Gt8RH92zGk0po+yvBOoeXdwNnjgV9VeGmGo+HjGeQ8ZX8xXxl4YvtixOD0wa+tfhTqQvtFTnOBXz8z3IfEeFaBbmxvtUsnGDFcOmPxr5G+OGlNYeKtTABG5ywr7Z8Wab/Y/xI1aIDak5Ey/jXzD+0toZg1Y3QX5XHJrkw79lj2ns/wBToxicsHzrofC/xmtRbfEbUJgNqX0aXKkf7QGa41cc8ZGM816l8c9NMlj4e1dVyFV7ORvcHK/pXlaLyMnHvjNdFSPLNoKcuempDwp4yBn8PSo9QUPayZwflOOOamQFRtximzqZI2xwuMVBodN4D1QWNxp92MbcBTX6hfD/APZ70L9oj4HWV5vWHUlXaso7MK/J7wXMGZ9OmbY6sdpNfc/7Kv7XV78D9Cm0a8tV1KyZtyqz4ZDXXCo1D3XqctSHvXex02sfshfGzwhJJaaBdyTWfIjkt7jYwHatXw78L/2qNDtlgh8SauqKMDfdbv516iv/AAUm8OKo83RJg3fD0rf8FJvDfO3RJvxkFV7aT1cUc3s1f3Zv7jiI/Av7U85xN4j1Jl97gD+lSH4V/tJzD5tcvB6n7Xz/ACrpLr/gpdoi58rQ2+rS1mN/wU4sEcg6EgH/AF1o9tP+VD9musmYsvwN/aDvD/pPiXVEXuI7zr+lZd5+zr8bJM+dqeqXI/6aX7n+tdnF/wAFN9IkIDaMF/4HWlZ/8FJ/Ds7gSaWw9drVLqv+VEOgp3TmzxE3nxk/Zr16z16abUpdKWUC7gmlkkidM85BJFfoV4V1zRfjb8N4LqWGO60/UrfEsLgMBkciuS8H/E7wn+0z8OdUit41kSWF45baYZKnHUV51+xHrzWtn4j8KPJuGmXskcQPZQf8KzbVSLklZo2pxdFqN7pnyH+1B8C7j4R+MLq3iUtpznzLWTHWM9B+HSqvwRXzMCvvf9sP4cweNfhhPfLEGvLAFlbHO09RXwz8HbT7LcvH02tivSo1PaU9Tz69P2VW66nqPiSx3WOcdq8rjs9upHjvXt2u2u/S847V5atj/wATAnHepixyV2d94Rj2wJxXsfwVbb8RoU/v20gryvwvbbYV4r1D4PZj+KFgvrA4/lXNLqaLSx3F5b+TrF0uOjmvkb9rKL/ir4Hx0RR/KvsrxDD5HiO6Hqc18jftZ25XXo3I42A5/KvBTtj4n0G+GZ8pfHIhvgD4V/6ZarMP1rwhk/eddwyeSOBXuXxkJm+AumgdI9ZlH0zXhygK2c7Tn15P0r1qvxs4cPLmppjo1HPzEY9yKkVgx3E59dxpnp8px34qQcKeMnpz2rE6CRQO/P8AeJ5zSq/JwVBHAzUe4Ejg+nPWpeS34c5HQUCHdFU9e+3qce1KF3dTkAde49qZ5ir86k5xjLH9aevqeATj5uc0wFbpjdgtz19+po27mywzu55Gc0pU8cduPak67gvygdMGmA44bORjPI2d6aR8xPHr83BXtQWDKDlQq9PUU5fmUheBnJz+FIBM9CFyOoIpPl3cg8kHp26UZL5UFd2ecHil/iA+VW5A56D/AD/OgCMKu4nkZ+734pdy+Yp2EdsAf0pzF2bJjG8ce2aGBTlQxz90Y4z60ARhdqg4JDD+H17ilyFI+UHnBx1qTLBieDtH3s8Him7dvGTjvxnJoAY6hW3svGPuqOh560cLtJAY9c96lyWYBhg43H2HvTV3Lzjcx+UADIpAI2AwYKCVGTjg80MflOVGevPWpH+ZUBJJPHTn6U3JkVSwyG4ORx9KAGyLl8qrDC89j/8AXpy45IUfMMAsOnenHerYJznsBkj2oALMxAV9vAUdh70AIUDRqQmCe5PX2oGCCdmR0wwx+PFSfMq4HK9MdvwpGRlkJwfl6YOeaAI9oMYIGcYCtnp+NKrAcNudVONpHWnq21GGccZPHGfSm7WPI4/h47mgBiqvl5ALFW49h6inKduRhnUc4x/WnqwDkhcE/rTCGYLxtxzyKBjk+XA24GeWU9afGpIwSQT3AyPrQq9thG7/ADmnR5KjGc+v09qAJN3y4wMY9fSimjHXqepYfyopMCtH91eGGOcKepqRvlUHLgkZOAtRRuAo3EbumKMruGNhGOOaQxW+RWA5UDOAPfvijmSTrk9sqaDGu7d68ZH05/nSjsCzAZ9KABtoXgBTn09/r0pGbdk5BXPqcD6YNHKqpPTO3APvmnEbSRkk9TjsKoQNgseduBnKkf5NMZiEIy2D0Jxkn+lK4+Ybs7CM9KQY28jIbGW6cUCF2/LjeemTyM/TNHyqqrlM98j9KQbduCCVzlcdaRWDKrBtueen6UAKF3bVLAqByT0/ClTsAFy3tjI9KRivUDPOAevFBA5YsNuOdvX8KQwjxlDnPcjJGKXt97cM9yOKVvuj5R/unsOlJzjj+VAC8tGcHBI5BGcAD1pGxxyM9yB0pGZdo+Zsk89/89aGYj+HPcrimITJ5JBDDnKng+lPyzITlgTz8xHNI2Wxgg7uDSqPM4yCCTjcelAAxX+8V2/eBprcYODyM4Uc/XNP/jIBxgd+maZu+bAyNx6+lADj8oIIypxxtpqqNxUsQOhHXPPSlADbirAnrgdKVsYBUcZPagCNk2pkoefl9KT5uMu2O/H4VIQducnaM4XvTOCfVcZP88UAQKCrYVtvUZJ6e3WjnDZIIHADKPzqTHykMMgH+H9KiVTjcEx2HpQAi8KZAQuOTwOT0prLt4DbQO3Bp7BVJ3LvGeo+nNMYKF24wvXJ70DGuJGYFsHkgAj260xjt3YORnAwcdPSntx8oG4YyeabtfcVI3EevFADGZvmLZU461BeXC29u8hGAo5+lTH5mDdT7n9KxfETtLDDaJxJcSrHgfXmhCZtfCvw7L4g16zQqWe8mDnj+EHiv0Q0+zXSdCs7GMYEUarx9Oa+Xf2YfCSXXiuS9ZMw2MeBxxmvrHT7Z9TvYoFBLOwHH1ru5bRPMrz7H0d+yz4XwJNRkTp0Jruf2mvHEfg/4c337wRyTIRn2710vwh8Njw74Ttk27XdQTXx5/wUJ+I0kk0Xh60l/eXDC2AB9ev6VyqPtKiiCtTw/mz5/wDgXosvijxpe69cAu00pCEj+AE4/nX13qky6XoqRDg7a8k+A/hePSbC3ATG1ADXd+PNWCRsAeFGK9Wb6Hk4dczlVfyPF/ifrhMcgDeteDSXBuNQ6969B+I2r+ZJIoavOdNHnXwPvXXRVo3JnLmdj1/wTD+7j+les6JZ+Zt4rynwbIMxivcPC1qJkQ4rhqbnbTWlkdj+zT4pHhn4vat4euH2Q6tCJ4ATwXXqPyr64vtPi1Czmt5VzHKpVh9a+CfiJ4f1fRtQ0vxToW4ajpkglXb/ABAdRX038G/2lvDXxK0mGOe6TTtajAWeznO1g3fGeorlqUpTXPHU7qNZRbhLQ574pfBjV9QhtHsFFy9rlVI6snYfWvI734XeKImIfR7k4/urmvtyG/t7lQY5UcH+6c1L8jf3TWEJqmuVo3qUvavmufBU3wz8SHP/ABJLz/v2apH4V+JpG40G8/791+gexf7q/lRsHZV/KtFWh/L+P/AMfqv94/Ptvg34nmz/AMSe8T/tnTF+A/ieXpYXY/3oSa/QfaP7o/Kl2j0H5Var0esPx/4BP1WX8/4H59f8M+eJu9ncf+A5/wAaRf2d/FTcpZTH6wEf1r9Bto9KNo9Kr6zS/wCff4k/U5dZ/gfAMf7OXi5sY0yV/wANtaVj+y544vWCrp8Nuh/jnl6V920VP1mK2h97f+Zn/Z8X8UvwR4X8BP2fLz4X6pcatqmoRXN3LF5Sw26kKgPXJPWvN/2vbX/hG9SbVEO1bq32sfcV9dOwRSWOAK+I/wBvTx1Z3FrZ6dbyBplyGxV0JyrVk5HRUhGjRcInz58JdQe81aVs5DOTXvt9B52mMCOdteD/AAL01s+cw75r3+7cLp7D2roq6yPLo6Kx82fESzC3EvHc1xvhfVn0zUEw2MNXoPxCw91Lj1ryyZDBc7h616FPWFmTK2x9J2mtf2to8LlssBg1m3yC4idCMhhiuT8CayZLMRFu2K68LvGK4muV2L3R7f8Asb+Jzb3Fzo8jcwuVAJ7HpXvPxm07z9ItrwDmFtp+hr49+Cert4a+K1vk7Yrtce2Qa+5vFlmNa8H3SqNxMW9fqK8vER95rueng5207M+Av2ptBN14dtNRRcmByrHHY18f/Fq3bWfgNplyV3S+H9XeDPpDMocf+PBq/RH4neHV8QeC9StGTL+UxH1Ar4Vk0k6x4P8AHXhphmSay+1RJ/00hOfzwTSwq56Dh1ia4lezxan0kj5jXJUOMjHHGOlSBTjA5GMf41TtpC1rG/Tsc+tXF7c5PfmpO2x9afsS+IFPjjw5bzyfJcLLp0g9QQcV9TfC2F4YvEnh5+H0XUZCgPUITkV+fHwF8ZJ4N1y1vy+HstShuBj+4Tg1972evJp/7QuppAw+x+I9ITUI8dGPf9DXZCLlG6/qx583Zu56x+0Jb7/E3w/8UKvy3dj5DvnjPDD/ANCr3nR7eLxb8LZLKT547mze3YfVSP615F8SrFvEf7N+nahGu640h1cY6qqttP6Yr0f4EaquoeEo0Dbl2K4/EVyS0+R0p3sfnjoAmtdI+xXHE9pJJayD0ZHKH+VedeOrfbeFscGvbfihpP8Awi3xs8eaIV2Kl+byNf8AYnAkBH4sfyryrxxZ+Ym8DmvWpy5ah5FeLszzdlrX8H3hsdahbOATisyRcMaS2lMNxG442kGvUlHmi0eWpcrufX3hG9FxZoc54r6g+A2sCSI25bnpivjP4Yax9qsYxu7V9FfB/XjpniBELYViK+aqRtKx9BTfMlI9J+NWm/ZfEmk6oB8sqmBz79q+fv2hNAOoeH2mVcsgr6z+J2j/APCQ+CpXiG6aACePHXjmvFPF+jp4h8IpKBuWWL9cV59f3Z063bR/I9WmlUpTpPqfnJ4y8P8A/CQ+AvEOl4zc2xF5b8c5X7w/Kvm+NyyJjnI+6PWvtHxro7+EfFLSSR/6OzFXGOCp4NfKvxI8Kt4N8YXlgoP2SU/abR+zRtzgfQ8fhXo4iOsai2Z4+AqNxlSlvFnPhS2OSfT/AD+dOXHU8845b1+lRK/Q/d7HJqVPm3AYHGM4rkPTIns0kbzFZkdRgSpnOaspqmsW+1VvUmGOCxKt+dHO445GSevtTlxg7upp3ENbxJrXQoXwe7g/1pD4k1hsnyW/T/GlwOWGM0Pg7gOeeRRzPuFkM/t7VWHML/mP8aZ/bmotz5BPOMlhUz7euACCMUxRjB24IOfxp8z7isuxF/bWobf+Pd8+zClXxJewTwxyRyQ+bIEViwxyamwG4xisjWWP2nSwOv2pfyp6sHax+hv7Fvjqbwnr1xZLKRDOoXrxnZz+tenfsV+JJLr40eMgz5EuoS5x07V8v/APUm0/XNOlLYDOT17c17Z+xBceV8bNbIPE19I3610ctot+R57l7yR+hHxHtVvvBOsW7DKvbuMfga/N34f2v2XxBexgY2zuP1r9KfGhA8OX2ehiYfoa/OXwigXxjqqjtdP/ADrXCv3ZEYz4onrWo23maMTjtXnMenn7YTjvXrNxb7tEPHauKt9P/wBJJx3qrmdjf8NWf7teK7n4bL9m+LGkf7SOP0FYXh2z+VRit3wy32L4r+Hz03Oy/pWLLcdEeo+O08nxIT/eXNfJ37Wtv/pFpLjIeI819cfEhNuvW5/vJXyr+1fGGsrB/ZxXhT93G02e9BN4aaPiT4qTbvgX5bf8s9Zbj6rXiq8YxgZr2H4obh8JdUi7JqisPxWvHY2baBlTkfpXt1/jPNw/wWJFwOMZHb5jz+dSbsdyQB2qNcnqDn8Kk3fMRwuCM+9cx0j1XkEHeuOd3TNL/Dwzcc89MUzkt02rnIzyKkyGG0sq564FMBy9skp7r/hT+N3PPH8S9PSofuKuwNn+8f5U/IwMnDZ4YdD7UASDMmMDDAd2pWIzwDzwOn86T7ud/wAu75uaTnbjgj3PtTAkb5lyBk9DzTd23cAHOOV+bP4ikkYKAD8wC8EihWVl7Z6llHWkA7+HGd2B9CBSL8pxlz0BUkUw7fm3Ft3XOO1G5S2W5X6UAP2kbSWJXb/Ecc/Sk27lAAVVIx8pOajLK2chgc9cUAptzgl8fLQA/I2oSzHPfg8dvxoZi3GcexPNNZlLZVguR1xxilO3aMk+pI9aAHsFJYnLAuBuJBPvTjIF5UspLemeP8KiLKOdwA28Mo+vWnLgHPmcY49aQDiCUby3wScAZ/nmhmCkkYU9lI+X37013TcHcj1GO5po2rkqQfrTAdtGGLKu0Dbt3nn6U/BTG05baSF7fnTBhGyo3AdEoXbuba2AeoP8qAJYsbWCsy7ui5yaBhABkbx8x64//XTd+1mBBx0U4wMUKVYFt/yg52t/KgBYz33li3QDHzGkO3lWIZifcY9eaazBZG45PIOKVWWRWAIIHFACrknkkHqCoJGPakbDOdxyG/vD/OKTaNoVGJXH4UqyjlQQTnle1AC+YZCBnDdsZx+BqTcq4weQOSp/xqNGXgqxCgndntT1+6FyCw7AcikBLgtuDHGORk9PxoprKGTGMkDPTBBNFSxlZWbywpUgY5ORTwTww5yM7NvPHeoosMuXXDjj/Cng7jjzQR0b2pgLtdf3hQry2FB5GOtG3dnIY45y2MZ9KQE5JI47lxnvil2qY8duhGcD60wFJKYUhRn5jx3/ABpFwygkAdyDycn6dqTHygDjnkAnk07d8p9Sc5PagQbtrMwYM3c+ntTB3DALt4JJ5PpxT2bKkdAxyVzxikZvlY4AB496ADcWbb5nP8OePrTdxdRgrjd8uBkcU/zPvAfu+OAewpVwcYJAxglcUDG7fM4BG3Gfl6Ubt3BAJPAQdTS5bbuAwT2+lJ0jweQOTz2oANpO3jO8DOV6cdKFx0OR1/E0EfdI+XHAIPX3o5OOOM8AdaABnyBgc7QCG9M9qbgbiOc5xgU9l4A6hT1HUegpGOVzn+LOaBDjGrJgrtPQnH65FMXgLkYOedxAz9KXIVcEdfft3o/1eCp54ABoAftDE4+YY4Yn/Cmbtx45Oc/KenrS5UbgGO7OaRmO3J5I5bI70ADt94McD1UdKVVI5A39eccA9u9LuDZw5B68d6RWDbcgsSe/FACMjPh/m+7zmotjYyeMHjBH5Yp/DD72cjAxTcYbDqM57UARsjbT82CGHy+39abJleMYbsqsMflT/wDWZ2lUZegxg8UwgseQo/2fagBqgruYHaB/C3OT04/SkYF25dVbPJU/kKX5WIAAHGR81N8srn5eWH3ic4NAEZbarFjnscHOB603Oc5kyp7A9eKdu6gj5xwGHSkkOwfcAI+lAEUjHG5kIX6c1laan9oeMI16x2kRc5/vHoP1/StSQiNc4wOpOf5Va+Fmivq2qTS7SXvJSR/uhgB/WtIRuyJuyPrr9n3Qf7E8FG6Zdst4xbPfFfS3wP8ADR17xjaKVyqsCeK8k0PTV0vRrCyQYWGNVOPpX1t+yx4Y2rNqTpwowpxXTUfunjzTqTUV1Z7/AKldRaDoU0xISO3iJ/IV+UXxW16X4oftBLHu823spDK3cbj0r9Av2rviFH4J+Gl+PMCTTIR1xxX53fAHR5ta16+1u4G6W6mJ3H+7nijCR+KbDMKnKlFH094Os00nRy+Np21wHxF1wrHId1eianKNP0hUzg4r59+JmsYSQBq7F70jlX7umoo8o8Waobq6b5s81Q0Zdsm41Vk33lyx6jNaFvGYRwMV2v3VYxSe7PQvCmpLDKgLdDX0H4D1iBo48uBXyXaag9uwINdjoPxEm03aNxxXHOHMdUJ8p9u6bdWV1B5c210YYINcp4k+CPhzXLn7ZbK1ld5yJrZyjZ/CvCdL+NjwqoL/AK10Nn8diMDzP1rm9nOL91nQ6kJbo9g0XRvGHhXamn+IZLiFei3R3H867XS/H3jW0UCdIbgjuGrwO1+OQfGXz+Nalv8AGyM/eY4+tKUZv4kClCOzsfQ1t8UfEg4ksowPUuK2bb4masVHmW9vn/ruv+NfOVv8Z7Fmw75+prZtfivo02A5T86jk7xNVW7M+gYviVefxWsH/f5f8an/AOFkT4/49YyfaVf8a8Mt/iBoMv8AGgPuavr400PH+vi/Oo5I9jT2j6M9an+KdzH0sV/77H+NULj4wXcecWS/nmvL5fGmjDpPD+dUbrx9o8K/8fMf4UckOwpVJdz0q5+OGoR522aj6qay7r49avGDstI8+4NeU33xO0uMnbKGrn9Q+LVquREu8/SnyQ7GbqT/AJj0nxN8dPFF7bSRxKsWR/ADXx78XF1rxB4iWbUCz7j3zXpuqfFS5myIk2/hXB6pqs+tX3nTnOK66VoaJHNNtu7Z1vwwsU0vT0BGDiu01rWkitCA3avOdP1o2kQVT2qrrXiB5oT81bcvMzJOyOZ8ZagtxdPznmuJuo/Myas65qRe6ILVDH+8XNdaXKZSNzwPdmG6VCeM17FYw+bGrY614h4fPk6gnbmvoDw1b/aLFD7VzV9JXNKN5aGfdbtJ1HT9TThrWZWJHp0Nfffw91aPxF4RtJchxJEAfyr4k1TSxcWcsePvKRX0Z+yt4n/tLwqLKR8y252EE+lebXV1c7sO+WdjH8XaWLHWL+yYfLubA9jXwB4kt18G/GeeKQbbWS4aN8jgxyfK36Gv0s+L2lfZ9diuwPlnTB+or8/v2pvDxsfGEOoIuBKnJ9wa5cLLlxDi/tHoY5OVGNRbo+KPGvh2Twf401/RGXH2S7dV4/gJyD+RrHRXGAQTjo1evftG6UJtc8O+KYhiLXNPCTMP+e8Xytn3ryJVTnr7U5R5ZNG0Jc0Uza8KyFtWe3bAS4iwfqK+47HVpJPCvwY8fJJ8tu8mgXrZ45yFz+lfBVjcva6lZyq20KwBJr7V+Bm7xt+zH8RvDqZe80G6j1y0XuABliPyr0MLLS39anHiI3TsfoZ8I7eLxd8Ndc0R8Mk6yKAf9peP1rmP2Y9Wm0tW0S63Lc2c0lnIr8H5ScH+VZ37JfjNNW07TZVbCXlspYZ/ixV3xao+Hfx8Z1Oy21tBcxjoPMXhv6VhUjyzlHuVB+4n2PJP23PDq+HvjnoOuKuyHXtKNu7dmmgc/rskX8q8A8RQC4tXHXivtP8Abu8JnxH8G9M8U2qb7jw7ex3pK8nyZBsk/mp/Cvi55lvLNZFOVdcitYSvGMv60MK8dTye9QxTMp7GqjGtrxFb+VeMQMc1itXvwlzRTPBkuWTTPWfhDrm0rEzcjjrX0h4a1T7LeWtyGxtYZr428E6odN1ZOcKxr6i8JagL2zTnnFeJi6fLK6PVws+ZWPuzwbqEeseH4dxDhkwR7YrzV9D/ALJ1zUvDcwxFJuubInuh6qPoaj+A/izzoRYSv8y/LXoXxC8NSarZQalYr/xM9PbzYSOrr/En4ivNnFTTi9n+Z69KpyvTofF/x6+Gv2oTOsXzLntXyH8UvBMvirwnLbJDu17RQ9zaHHM8IGZIh6nAyPpX6m+MPD0Hjbw0NUtEDMy4kjxyrdwa+Kvij4GudJ1J7q3VoZo23Iw6g1dGXNT9lI4MRbDVvbR67n5828vmwo6DCHnnFWAzMQcdOe2K6r4leEm0LW7m/t7fytOupizwoOLaU8lfZTyR9cdq5aMkKSD/APXrJqzsz0otSXMh0ePUcc9PUnmnbgWGCMdKRW+YEd8D9elLk9/fvUFAGJ6fNnHANLgvnPB65IB70bgfvZIGOPbNGQq4IyQOvSkA1sKTnBXqeMZpsjlycjHYnHcmn/KuexPXtxUTOc4B+X6+1MQ3d1G0Y6cVmXX+la3ZqPuwAzN7cgCr8zhVJPHdsU7wrpsmpX+/BL3UqIvsgOf6VtTi2yJOyPpT4ah7GPTWOQyxqT9cV9CfsV2bf8LiZxn55XY8e9eK+FtLaP7OuOigV9XfsW+E2Xx5cXpTCxIW3Y7k12VPdi0eRFuU0fYPxEm+z+Fb5umIz/I1+d3gY/aPF2qOOQbt/wCdff8A8Zbj7L4H1B84/dn+Vfn78If9K1a8mx9+5c5/Glh17jZti/iR9CS2/wDxI+nauWtbPM3TvXeT2+3QV47Vz9jZ5kzilcSRueH7H7tVtSf+zPiL4auDwq3aqfxFdV4bsdxXiuQ+K2dPvLO6HBt7mN8/Qis46ySNJL3dD2b4nPt1jTj/AHga+Z/2qrUPoFk5HKsf5V9DfES+Fy/h64U5WaMMD9QK8I/aij8zwZbyYyA4/lXg4r3cRTf9bntUfeoTSPgD4rR7fhpry9hfRN+leKxkbV64I4xz/wDqr3H4rrn4d+JFxyskMg/PFeHW5Plx5HBHfgCvexD95eh51H4R6Af7PHoS1SfX5F6HIyM1HuPpk9hnpTvl5+6OenTNcpuTbhwcYHbGaeVZmwch2HPBwajVDuxn8G5A+lPYgrhRtHfb/OgBysMKxZWC9Cc/iaVULEnZhceufyNN2tuJKhxkKzAc+op23y+m7g80wHqpVNx6Z6N3oZtrISeOg3Cnbhwy8jrjNIFO7g4Xp+IHSgBCpRckbRg85yKRvlJyWIA44xgUrKoVdrde3QZ9aWNSrYXr1zj3pAIzOPmJBZuPmP8AhRuYrkAPgA/MMetJ+7XJD7s5zkU5QqtlRn0z1HvTAYxkRccYU/eHel3so3hAxPbGKYuHXBTkfxNS/Lvxli+0gZ9aAHZeMAEDOScevtSbpDg4HXPIxxSjDsAGyxPLHnNNGN2NzLzyMUgFViu3Gz5iDjOR9P0pV3swYquBwcjB+gpM5JQlRg4IAx2pBs27SCO/4UASKW3bgmAQBg84H0pqbmwdoynUYwOvSlLYyDnbndycHFNbYuQwIB5G2gBwkIckIVJON2KVCygkDcAccjnpSb8cbiuPuD+tHKlT/F0BA6n3pgKH9FbPQFhnn/GjcZCF4DA9dv15Io3lctvDKOQcUnGCWLdMHb1NABuLKVxglsjnGaRvm2ZQj0IPNIMJGCjFj2+lCskpzjHrjrQA8F2xHgE5x8uaOeBs5XvjimLgLhXYhhyT/nrSrtkxnaT6dCaAHHcqkMPfI6VIxLE5UfXPSozsdgFJB6deBT9w243MPTJ7/WkBK2ef3ar2ypz270UnPHO8kZI7UUmMqL8yhTlGHr1z60/O1d+YyD0J4JNCqWwp44/h4Bo3Hbj5geoy9AC7m8sgZIJLHjke9PZW6EDP3s9qa7N1L/vG4wM8+nP50gYDBwQx9M4NMB287Yyc5Jwfl/rRgqgYBuOAvX/9dHzbevQ8E5+v9P1oLbssPvZzk8/yoAHbjG7btAxuFB6HbgjOeOc+poZhuG4sFPGW703b1Z1DfQ+nagQZbaNw2ryT8vX6UHG4gYyfm68j2xRt2LuKtsPHXj8qRgdu0FWX0HpQA8MmUycAL+tJuLEcjOCeeaViSxO7cPZsDNAzGuCGzyOv60DE2/dGQy8DkdsUq9QN2D09/pSCMbRlMbR/Djr64pytlQByc9XxxQAmT5aggHd15/WgLzgEFs4H09aXGVAD5VenNMb5sjq2c7jj/OaBCsxUZJXKknPr2xSYC5G/BwO/HPelZTxHkFTzj/GkViwwpy3qx7UAKWwoOQCOnPUU3kDJOGxn2zSKAcrgOOvoQadxyB8w6fMoGPUUwF3BVb5gW4wT/KhRyuTtOeOf89aamdoGeo5XpRuCsAOP948Z9qABju2glQSccdqjG7JLAYGQTnFPYhSGDjeecY4IpGK/KB8gzyh5H1pAMYh2Bl+8w4wOBUZZjjau5cYxnk0/HAJLBD05GRSSFmbfu2kfw9aBkR8tsbskZOMD2/pSJnbtjck9T/Sl2hRhlAAGQVPI9abJIGH+sHB4JFIAZiWQNhRz8pBHPrUTc5Y4PPI5/OpOdu0uGZuTg46+9QMQNuSQexz39KBFHWJSlqVQ5dyEUe5r3j9nnweJPETyMmYbGFVP+8Of5mvCNLj/ALW8WafaZ3RxymVz/ujNfZfwJ0MWXhGW+dcS30xfP+zniuukranJWnZWPWtGs31C9hiUZZmA6V97/CHw6vhzwdax7druu5q+S/gX4WOveKrYMu5FYE19r6tdR+H/AA7cTcKlvCSPwFZVpa2ObCxTk5vofn3/AMFDviFJqmtWXhu1kyZ5RGQp7DrWZ8E/DqaVpsChcYQZ4ryv4oaxJ8Rv2hrgk+bDYn1yNxNfQfhC1GnaUGxjivRpRdOnZnlTl7eqm/Ul8bamI4GwcADFfNHxA1FrmZ1B6mvZPiHq+2FxmvB76NtQ1DnkZroprqaS31M/TdL+UEjGeTXsvgv9k3x/8QvDlrrui2FpPpt0N0TtdxqT+BPFc94I8JnXtUgtQuQSC3+6K+j/ANn740aJ8GPiBffDfW79bHTb7F5ps0z4RHb78eT055/GsZ1pe05IbnTTopwVSex5HN+w78WYz8mhW0n+7fwj/wBmqL/hir4tRjnwzGT/ALN/B/8AF1+kdvqVhqUYe21qOVWGQYpo2FK1mGOV1Y/8CKH+lczxNTqkvkzp+rwezf4H5vx/sb/FmPr4W/K9g/8Ai6ST9k/4rWo48IzP/uXER/8AZq/SMWZPH9oxsfotSLpzN1vM/wC7x/I0vrUuy/EPqke7/A/Myb9m34twcjwPqLf7jxn/ANmqo3wF+LcP3vA2rj6KD/Wv1C/ssnrdy/g5/wAaRtLbte3A/wC2hpfWpPdA8JE/Lz/hSfxY5x4F1fr/AHB/jVm1+CPxbJ48C6sP94KP61+nA0s/xX9x/wB/MU1tNgH376f8bg/40/rPkP6rE/OGz+C/xeiYf8UTqZX6r/jXQ2Xwf+KhUb/BGoD6ug/rX3y9vYQj59QZR/tXR/xqpJeaFDzLrEK+u+9A/wDZqj29+g/q0UfEC/BT4nS8HwXeD/eniA/9CqVfgL8SpPveE5Y/965i/wDiq+zpdf8ACEf+s16xX/evl/8Aiqi/4SPwR/0MOmZ979P/AIqp9r5FOjG258bt+zv8SG/5ln87uIf+zVH/AMM5fEUnB8Nov1vof/iq+zl8T+Cei+INLP8A2/R//FUSeIvBS8trmlfjex//ABVP2j7D9jHufFz/ALNPxFk6eHo//A6D/wCLqp/wzP8AETef+KeUf9vkP/xdfaL+NfAMR2t4h0hT/wBfsf8AjVO4+IHw7jyW8SaQD/19p/jVqrLt+BlOjF9fxPkOD9mP4jTcDQEX3a8h/wDiqnl/ZD+I13Gf+JbaqfQ3sX/xVfU03xY+Gtn97xVpaD2ul/xotvjV8NZmxF4u0xj7XQ/xrX21XdL8H/mZexgt3+P/AAD81fjd8K/Evwh12ytfEWnNZm8UvBKsiyJIAecFSRmsPSl8yEGvtj9u7wIPHHwjtfEelN566XIJkkQ7g0Z6ke1fE/hiTz7ePHcV20ajqR5mc9WnyPyNK1h8u6jb3r6D+HJFzp8Y9q8L+z7WVvevaPhNPnZGehqa+sSaDSnY7y40/wCRuKu/s9+ID4b+Jt3pTPiO4xIq59etbFxp+6HIHavMr67bwp8UtC1HdsSR/KY/yri3gdFS8Zpo+zfirpv9oeGvtCruaBg/Hp3r4a/ah0IXmixXIXJQ9a/QDT3j8R+GAp+ZZ4dp/EV8nfGrwub7Qb61ZcyQhhj6V5b/AHdWM+x7TXtaEon5/ePNPbxJ8BdTQDddeGr1b6MdxC52v+HNfO4bhiuCpGa+vPCNpBF4rutBvv8AkH63BLps4boN6kKfwOK+R7zTLjQtQvtLugVutPuZLWQHPBRsf0ruxEbTuupz4SXNTS7Fa4dgqn0YNX15+wX4ygsfiU+hXrj7L4hsLjSpQx4LOm6M/mMV8iMoYEEE12fwz8T3XhfW9N1W0dku9PuElUg85U5H+FLDytPlezNa0fdufon+zB4mk8H+JdR8NXMhW40bUJLYoxwQA5x+lfSP7V2ltN4L0PxjaDMujXCyyMoyfKfhv518ZeNPEUWl/GrSvGWnssekeNdOgvxs6C4HyyLn1yK+/fBr2vxU+D8+mTkSJc2rW7g9srgV14paqqjlpaXgWfDMVl8Vfg/NpdwVmttRsntnzzwykA/hkflX5o22l3XhqfUtAvlZL3SbqS0kVuD8pIB/Kvtv9kvxJc6Tp+oeFdTJW/0q6kspVbg5ViAfxGK8m/bW+HDeGfiTaeLLOPZYa7H5VxtHAuEHX6kVhH3ZOPfUclzR9D5S8T225t/vXKyfLXfavB5yMD1rh76IxSEYr2MPLTlPErR15ivDMYZlcHBU5r6B+FviTzoIlLc4FfPBaux+HniI6fqCRM2FJ4p14c0RUZ+zlc+1PBfiFtB1i2u1bEZID19feHtWi1nS4biNgwZRmvhLwrqCalYqpPUV718E/Hj6ZcjR72TCH/Vsx6ivBcN6fXoe5GaXv9Gega1at4D159RjjL6Bfti7jHIgkP8AHj0PeuL+LHwhtPEVjLfaeFkEi7wqjOe/Fe4z28GpWbwyqssEq7WVuQQa82uLuX4W3QtL7fP4XmbEF0eTaMf4HP8Ad9D2oivaar4l+P8AwTeSjJWnsfnJ8YvhLcWclxKtiLlMFJ7VuPNT09iOoPrXyR4q8LN4cuBLbl59LlciKZxho27xuOzD9a/aH4qfDvT/ABNbte2oQlhuDLyGr4t+LfwCFw11cWEMcdzINs1vIuYbkDpuHYjsw5FXyqor9Tz4OeFlyPWL/A+FF+bIwRk8elI0w7EN2P8AhXT+Nvh7feF7+RGtprNc/wCquPmUf7r9x9a5PybtDnyTn1Rga5pQcXqj04yjJXTJVk3cnJHr7ZFDTBRgckDqTVWRLjnNrIeOMLnn1/Wo/OuQSTbyj6jFRZl3LjTFueP7o5qN2HXp/Xmq32idnAERLZ6DBP8AOp49PuJgFncW6k52r80h56CqjFydkJtIqur6lOLaPJB/1jD09K9l+CvgltR1L7e8ZFtb/dOOGY8cfQVW+HPwavvEGx5LaTTtN6s0nEso/oK+l/DfhK30exhs7WFYoYxhQBXp06Xs1qcNSotbljw34fMl1GqJk54GK+8f2a/h/wD8In4ba7lj2z3IzyOcV5D+zr8HW1y+XUr2Ii0jIIyOGNfYFvbx2kCRRKEjQYAFcdad3yonD038bPKP2ltWXTPh1fktgmJj+lfF3wF09pLOOYg5kdm/M19FftoeJltfC8lkrfPIuzGfUV5f8F9B+yaPZArg7FrrorlpGGIlzTsevXkP/EnjX2rIs7YK3Sug1FdtpGvtWQhCNWLNludn4VhBZOO9cB8dIf8ARLtf9nIrvPB90rXCrmuR+OsQ8mY46rWMfjNX8Jm2PjyPxJ4C8GXO/MkatA/PQqcVi/tDQi9+G+8fwsP51438NvEssMN1pDt8tpetJGPZhXtPxNP9qfCe4b7xVQ3615OZR5akX5nfg5c1KcT4A+LUG3wT4iX1jQ/k1eA2+Ps8OeQVx659q+ifi1Hv8Ja8uM5t8/ka+crMhrWH5eq169Z3cfQ56K90n6/eYdOjcH86kUgYOQRkD5uwqJGxjDEKf4gc5NSKS5JUKMDI7/nXOaknG4nAK5+6tSRgZAz0GfpUacBSMorAZIOc1MMvwNskfp0/GgAyW+4flz/3zn1/KnblwVHDHvzQgHLEZPTd/wDWpzfvF+974PPPvQA5ewG0nGc96b8zY47ccdfWl2howWQY7jHX3FLuKsOpY87v5j6UwBvlXCuCOmDSM/y/eA285xwT3p2Pl65HOOOeaC23IbajcfNj3pAMLHDHtjG4Uu4cYGRjGRx6ZpxkZG5xnB+ZegzSZ25YFQQMB+49aYDDhtjcoQMFfelXzN2Dt3Y+U56GlyY1wx4Y8NjNJ8igOQr+mB39eaAGbVPy5G7ple/uKVFcrnAYdPQ0n+rG2XaAOhHvQuMDIwMY3AdqAFPPDHa7AjkY6UqbmAIwwA5B4pMovynfgnPf09fzpzL1UnjOdgxj2oAVsKcyAM+enbpTY0Y4VTuAPIb3HSnAqykEY3H584/Shtqg5yRjj5RhaABR826QgKowR2/Ok8l8kAkdW/LpSbTGCQu4YwckZFP3IWOBuB+Y+oNAhv8AEocbVxkcUzYw2+WdzMcf1zUoYxsW2szY9cY/CmJsxxzu4JzjHvQMTkLz26cjrSE+Zgjg9PbPvS/KVP7s7wOOgx70KwYFvmzjHuM/zoAGbZhGAAzg7e/pTuBhm4Y8kAZ4pFkG3GWBxxjgd+acsoJLAMSe7Hn3oAUdxvAxnKuMZpw3KB/cBx160kcgHdiw4VTzmnKyjIO52z/F0/CkA8rtyApHoR3op/8AeUNznJJ/lRSGVI/mjwmc5/Cnn5YycZ77cVGnl43Z2nOGwcf/AK6erHnIIboST8p9BTEP8vb8y7QeO/bFIzAgk845AY01UjKE7SGPTnH1/ClVtvylche5P65oGH3sZATHP1pA28nJUE4IzQ7djuYYzt2/kfpSjdkgrwDjcmOPzoAGYMCMgc9D/MULgqGVML1JzSbgVPHzdB8n60NjPKgnj7pxg4oEOydwI+YdQT0FRqPlwV+YHDOB0o5Iz1XOMrzk+pofLYK5ODgspx+lAx7E7lJ4XHIHagjd8wUncMdaYcjJLb1P/fRo5+8QwJP8PegRIxO4nPJGSCOQaFA2gEAL1PHBqPI4wVJ3HLZOcU7pnh+Tgc5oGOTDRhQPl9CODSMpYsRtIX26U3kgkLkg4OOvNKxKqQeB0AboaAFXbtYKMtxkkfpTWXzHGVyVA3CiRQ6gDI2jPJwPrmhlAUhcuOpYtwfagQq/LHnAHPOe/tSNkAEYJbnGKRVXP3W55znj8qAxUA4IP4AGqAcvO4ggP69qTB6DB6sBj2pMbvlPJ6gtQrfxY2Anqw/kaQAFB3KB85HX0pD94AEE520MoZNpDNjkse1J8q8D5xnOQ3T3pAMkRTgbSW3dAe1IwGTu2tjuvalC5UqR167uOfamN8qADp/ED3oGNKn723vg+1Rso2tjBX6VIyruUncqYwWU4B9qYx2txhWccZB4oENk+WPBAGSOgqlfTi1t3fCkKpIx69qsthWbaMBT1VifrWPr8gjtggJxuXPr3OP5ULcDW+F9g15rV5NjLLGIVP8AtN1r708K6aNJ8P6ZZqMBIlX8a+Sv2e/DD3mtRRyJ939/Jx3yCB+Vfa+h2JvtRt4EGRuArv5eWKPKrz952PqT9l/wyIYWv3TBxxXTftTeO4/Bnwx1BvM2SSIe/bFdX8IdCGh+E4AU2sy5NfFX/BQz4kSX8kXh+0kO66nW3Cqe2fmNc0I+1qpdC5L2OH5VuzwT4F6dLrWsX+t3AJlvZ2ky3pnivpeT/RdNVenFeZfB3w4unabbIFwABXpuvsI7faOwr1Kj1PIoq7cjyLx9ctISPeuI0nT90jyEV2HihTNcEZJ5qta2Igt+nUVopcsTblvI9M/Z/wBFSTUbu7ccQxnmvDvjZ+z/AOP/ANo74nTjwLaw3b6VAGmMs4ixuPGCa+j/AITwDS/BWo3Z+VpflBrQ/Z31lvDXhzx54m3bZJRiNvp0r5/nbxE5HvRio0IxPnT4a/8ABPn9pa2vI3bxPD4dgDDJfUmk4/3VJr3Zv2GPjjJCAfjBbb8f3ZaW4/au13wj8J/EmtTXrPdJA/2ZmOcSNkLivEbH/goH4zsY0Rr5pnAAZmPU4rvVaqn8RhKEZLVHs9t+wj8cIX3t8YELZ7ebiuit/wBkP422cYVfiXDOR3LyLXg8f/BRjxqvPnIfwFWo/wDgpB40jHLQt9QKr29a97r7jH6vTTukz2tv2U/jsHJHxCRh2AupFq/p/wCy78bYWzP48WQf3ft8w/kK8JP/AAUq8YjHyQ5/3RSD/gpR4yPO23/75qfa1LdBfVqXmfTth+zn8T1ULdeKEbH8Q1O4Of8Ax2rF9+zH4+vLZ0TxktvKwwH+1TNj8xXyxJ/wUk8aNkKLcfhWddf8FFPHU2WE0Sf7tZ88w+rUvP7z6Yu/2D/EWuAtqfxc1uJm6pa/dHtyayZf+CZtpdEtcfFXxNKT13bf8a+aZ/8AgoN4+kb/AI/VWq0n7f3jxs/6e34Gn7Sp5fcjX2NK2zPou4/4JU6HdN+8+JXiBh9Fz/Olh/4JQ+FosbviBr8n+8F/xr5t/wCG+PHnbUGz9aP+G+viAOmpNT9pPv8Agg9lDon959Kt/wAEpfCbsCfHWu49sD+tTp/wSp8HooH/AAm+vMf9ph/jXy8/7fHxCb/mJsPxpP8Ahvj4hDpqr/nT55vW/wCCJlRg90/vZ9Pyf8EqfCL8/wDCY6ufrj/GoJP+CUvhMjC+LdRPuwz/AFr5mb9vz4h4x/ajfnUDft5fEOQn/icyr9DT5qnf8ER9Xpdn97Ppq6/4JU6BJGUj8Uz4Ixl4zn+dcte/8EkWVpXsfHXlN1QNE3B7c14dH+3j8Qlz/wATy4/76rs/Cf7aHjbW9NFxPrNw3lzBXw+OM1N6ktAjQp0tY3+9n178A5X8ffs36h4R1UrLqelQzaRdKefniyufxxmvgSz0uTw/r95pso2vbTvEQfY19d/sqeJf7M+OHjfQi5Ftqqx6nECeCXQbj+ea8S/aW8Knwf8AGnUSF2Q3jecvbvzXVQfJUlTFWXPSUuxzy2u9Olei/C+Yw3UY964qwUSQqeuRXVeDZPs2oIM4+at5vmicUI8s0z6c022F5Yg4ycV5N8ZtDaPThdxr+8tnEgPpg1674LmFxZxjrxVP4ieH1vtMuIimQykfpXBTevKdlaPucyPSP2d/FyeJvAtm2/c6oM8+1c/8ZNBWHWJjt/dXke8cd+hryn9krxbJoPiC+8O3LFfKlIQE/wAJ6V9K/FbR/wC0tAW5RcyWzZ/4CetcdeHvHdhailGx+VnxQ0KXw/4wuTGCrxy+bGfoc14J+0/4fGm/E5ddtl26f4p0+HU4yo4E2Nky/XejfnX2/wDtGeCyJIdTjTnlW4r5k+L2hN4u+B9xsXfqXg+++2xnGSbOfCyD6LIqn/gddHP7WipdjCnF0K8oPZnzGrE9R8wq7o139j1JMnEU42n/AHu1Z8fzc5yOvFSMgdcZKkEEH3rn2d0eh0Prn4Z6k/xE+Euo+Fg5bXPDMv8AbGkk/eaE8TRD6EBvxNfb/wCxV8Uk1DS4LSaX5bhQuCfuuK/Lr4UePLvwl4i0nxBZORc2cg8yPtInR0I9CMivsPwPrUXgH4k6dqGlt5fhXxSv27TnU4WGX+OH2INevTtWpuLOGceSSaPqn4uaTJ8LvjVY+LLX93pPiJVgutv3UuUGAT/vLj/vk16J8UPBVv8AGz4S3emqVN8I/PtZP7syjI/OrV9p9j8bfhbPpk7qLqSIGOXHMUyjKOPx/ma4H4D+N73Sb6fw1rmYdTsZPs88beoOAw9Qa4rNx/vRNHpK/RnwbqVjPaXNxbXcTQ3VvI0M0TDlXU4I/OuR17Tzy4Ffa/7aPwZ/sm+i8e6PABZXbrBqkUY4SQ8JN9D90++2vkrULXzIypGa7aUr2mjgrU7NpnmsilSc0yO4a3mWRDhlOa19U08wyNgVjTRlc8V6t+ZHkuLi7H0P8JPGy3lvFG8mHHBr3zS7j7ZFHLC+ydPmRx618GeF/EUug6gkisQuea+pfhn4/i1KCMeZ83GRmvJxNF35kelQqr4Gfanwj+I665aDTr5hHfwjBDH73uK9J1DT7bVrGa0u4VntplKvG4yCDXyNY3LyPFe2M3kXsfKOp6+xr3D4afFyDXFXTdVItNTj4w5wH9wa86ScvejuehCfL7stjmPEvhnVvhWsj2gm1bwuxz5eC8tqP6rXnPim507WLU3NrIsiOMjFfXhCTxkHa6MMEHkEV4/8Qv2ddN8QTTX+gz/2LqD8tEozbyn3UdD7iuiFaE/4mj7kVqTa9zU+PPF3g3TtfhkhvLeOZG4+Zc14nr/7MWk3ckj2MggJ/gkGVr6m8YeAPEng2Z01bTJUiXpdQAyQt77gOPxxXJbVm5Uhh7V2WTR5vvwPlW7/AGX9RhYiCLTpx6s7r/Kq8P7LmpzN+9i0uAeoZ3P619XtbA9qga3A7UuSPVB7Wfc+cdN/ZXtYmBvNR+XulsmwH8a73w78G/D3hlgbbT43lH/LWUbm/WvTGh9qiKqn3uKpWjsPnk1qyrZaTHGgCoFHsMV6T8Kfhbd+Ntaijjhb7IhBkkxwBV74U/BrWfiBexStbSWOjg5e6lXG4eig9a+x/CvhXTvB+kxafp0KxRIOW/ic+pNYV6ygrLc6KNF1HzPb8yXw7oFr4b0mCxtY1jjjXHA61euJRHGzZ4AzUjHPSsDxdq0ej6DeXMjbVjjZic+1eWrt6npyaij4d/ae8QS+J/iLb6TGS6m5ClR6CvUPAuki2t4UC4CqB+leD+EZJfiN8YdR1QZltbd22nqNxY/0r6l0PSzY2nmSDbx3FetNcqseNG8pJkGsybRjsK5e+vhCDzV7xBqgRm+avOfEXiERK3zfrXOlc6JSsekeDdeBv1AbvTvjVOJtPLDuleVeB/Exk1EENxu9a7j4m6kLrQVbOTsrKUbSRrCXNBny1pN5/Z/jq5GcLMM/ka+mVk/tj4Y6hDnJ8jIFfLVxGW8USSr96ME/hX0v8Obj7b4ZeEncJISP0rgzON1FnVlstZxPir4qQ/8AEg1tP+ndh+VfMensTYw8j7tfVXxetzDHr8BH3UlH86+UtPYfYosjHGOldMneMX5F09E15lpVOfftkdKe2PmLLk+o70w4boFVu+DwKlQHkncvHRcGoNCWPPs237vpipY4wFJZSc9CO9RIBgMcIvUMpwP/ANdP2tgk4x2yeRQIkZCMbjtycY+nSn43ZDAKcUgXaAShGCB0yfyzR/HkAkZweP4qAFyF4yVGO4/Wl2jgcZyMDvR93C/xdRhulOweCAwH1/nQAmTtA6EHJz0NIfuPggnvijdwMLzzz15p3Kqw3MuPcZz/AFoAb8o3BQOB82e9I6/u2YjjAOBS8nGMjPVTyD+NJIVjPAHGQc8Z9cUAK33gc5A6mkjA8zG3AIzyaXbyPlB3ckKc/TrTR94Nu2jOCeM0AM4xgHafcc09kC5G3BPIyaBj5QCePvYPSk4b73A3feXpQArOP4v4u+KYqrggAdefWnBt2dgPB+XOcHijcAuMcepbBP0NAxzbHzuOP7p7YpNvXauD2VTx1pfMwNzR5Cnrxjml3bVwfb5j1z6UCDj5lHzEc/SkCru3LzydzZ5pd27lFUBck5PNHmZYAllbggYHNIBV7MQDu546mo8KfmAwc/M39KeWZm3bcHJ+6aTzBHwW+ox96gY1T8vzAkHgkH9aHVSynowPPNKqkqzYwo4ypo3u2cLgDtj/ADzQAu4ktx8vTIPalGzcWPOQMc01QVJcKdq/KOaUSbTtGUHuOtMB6528Ebsfe+pp/wB5dgx+eKZnoFUld2c525NObgAybju6f/XoAfIvylQuCv8AnNFOZSy5G7C9QSAc0UmBU8wchn246jqT70/7ykL8zgZ3f/WpsZG1WADn1pzZTLn5T7fw0wDYdzrIM7gPu0rAhuOAOdtJtDfcO5wM7gcUfLuIBzjjHc0ACbmwVBwRzzTQMpxgAcBW6UvcsSyr/dHPPpQzAt8wJP8AeFAAB3Ayepx3pq9AOSFyfmPSlP8ArG2nbjnjvSfKGJPzk9j+tADtvU7t5pPmZkGOR0C8expPl+b5W3dsDijldo38denI9qBDv4gVwMdWI5pFj+YAc87cn+dKNu0c4I+8uetIAduQ20Hr7CgYq5ClDg+oUdqTA2ggZHqe1C7SgwSD396cylWGWOz6igA8tmXD4Ldcj1pu1WDEqD/jSg7n2klGzj60Mu7kH5fqMA0AKN6ckg/Lwv8AjTQo2rhcnoPQUKwXDPkHvjnNBb1J5b5duM0AIys28uu5h0HekbH3Sepyy4pTHhhzt3dGJ60fdYZDDqMevvQIUZVTnGGGAopBmPtjAO3/APVQPu8tjbycg4peOGHAIxk9QKQxn3U5BUd89aMBhkkHuOx4p6/vGKgFSOeajaTaQQOe3HHvSGN5dV6euPWm464VVK9s8Zp8mDgHAxxu9KiBHI2kt2FMQm7aTg+5z6d6j+baWyRzwV70uU+95ny5wcjmouMn5gD27YoENcszYHH+90rMhtf7X1yztD93zTI3+6vH9K0JpBFGzuvyxqWznrU3w509r7UL+46tHCkKf7z8mtqMeaSuZ1HyxufS/wCztoIjtbvUGTBmztPtn/61fXPwO8LtrniKMlNwDgV4Z8L9DGk+G7WELg7FzX2z+y/4T+z2f2+RME8jiu7ESsjxafv1Uj27WLqPwz4Vmk+6sEJA+uK/KP4v6o/xA+O0EOTLFZ7pG7jcTxX6I/tReOI/CvgG5TzNkkik9e1fnX8D9Nl8U+LNU1ycFzcTHYx/uipwcPdlNjx9S0lFdPzZ794G0X7HYxkrjAqTxNIdrDNdRa2gs7MADHFczrkRlY8VcpXkFGny00jzLULMz3nrzTNQg+zxgY7V1S6X5lwDtrB8UR+XMqY74qpSGl1PT7HGj/CcSHj/AEdpT+K8f1rF0m6/sP8AZ+1JfuyTqpP4it/xwhs/hRPEBgC1iT/vrj+tcf4/lOn/AA3bTl6sIVA/4CK8GDvKVu57claEfQ+XPj94ibT/AIc6ZpQk2teXHmuuf4FAP+NfNras24nzACTXp/7Rmqtc+MlsVJ8uwtQm3tubrXlqqCoxjgcV03ci4q0USrqznOH3d+KcdakxzkHtioGhVsYUH1HFH2UYx5fQ+maWvcRIdabkb8fWmnWm/wCenFM8lOoAH14zSrbj04bgcU7sCUazJnO40v8AbkmOW4qL7OrMuEGeOMc0jWicgpg59KXMwsiVtadepOaadaf1OD04qMWvJCK231GRj8KVbU5A5OPqKLsNB39syf7X5Uo1iX+6xP0qP7P0JBPPqf5Uq25Yg7Sc9eTRdhoPbWJf7j+9NbVpz0jYil+zr129RnpR9nHZeOxNO7FoMOp3J52N+dIb66/u/wDj1P8As4XIwD2o8sBiNvPQind9xWXYYLq7bJ2jH+/XpHwg1J5LXWbWRuU2SYzng8V5wcdMDP1rrPhDIya9q0RBAmsyR/wFhWlNvmM52tc+5vgt4sbTfit8O9b34N7aGxmbP3tpwK9T/b98MiCTQtfiX+II7D0NfMPgTVDFZeCrtTiSz1Uxn2DYNfcv7YGjjxJ8BIb0LveGJJQfwrdvkqwZzRXNTkj5F8NyefZxn2rqdIUw3yMB3rj/AAI/nWUXuAa7+1ttsisK7ZaHnR11PffhzeeZDEpNeg+INN+1WG4DPFeTfDe62+UCe9e6wxi800jGTivOvyzTPRj70LHyLe+b4B+NFlfLmOC7+Qn/AGgc/wCNfdei3kXijwxG/DrNDtP1xXyT8ePCpn09r2JP9ItHEyEdeK9l/Zl8bJ4i8JwwmTLqoOM06y5veRlh7U58hwHxe8Ff2joV/bMmZId2OOeK+KNPjg0XxcbXUV/4lWoRyabfKRx5Mo25P+6drf8AAa/Tn4i6Gv23ztuYrhdrfWvz4+Ovgl9F8TahCUKxyEuhx2NYUfdcodGdeM2jWXQ+EPH3g26+H/jPWfD1yMPZzsiN/eTPyke2KwUVv4mxjpXv37RmmnxF4b0LxkkebuH/AIlWpMvXenEbn6rivBlX5gABnpSasbQlzJNGjoWoHTrxSf8AUSHDex9a+rPgv4ih8U+G5vAF9ceVNK32zQ7tm/1F0Oig9g3SvkdW3cYyM5PFdj4K8QzWsiwrMyXVuwkt5M4Ixz+la0pOLsOS5kfq1+yv8VrqRUstTDW2pWz/AGPULVzzFKvB/PqPY1237S3he88P3lj8StAhaR7QLHqkUXWSDs/uV/lXxR4P+MEmppZ/EHTUP9r2QjtPE1gvWVBxHdqO/HB+gr9DfhH4/wBN+JXhGNPMjvLaeLayNyGUjkEV11U7KtH5nLHRumzU+H/ibRvjH8OzDcCO/sbyDypo25DKR/P/AAr4T+Nfwbv/AIU+LLnT5laXTpGL2VzjiSPPA+o6GvXvEEOp/scfEiLVYfOuvhhrVx5bbcn+z5GP3T/s+lfTPizwl4e+OXgSOOR47i3njEtreR4JjYjhgfSs+ZUnzR1jL8CXF1FyvdH5Vatpm7OV5rktQ0srn5a+i/ip8ItU8B65PYXsBDR5KSKPlkTsy15Lqel9crg16MKh5tSm2eX3VqyEkDmuh8GeLp9DvEO8hQfWrGoaTycCsC601o2JAwa6eZSVmc3K1sfX3w3+I0OqQxDzRu9Ca9dWO31u3UhzDcLyk0Zwyn1zX5+eGfFV14fuUZXZcH1r6T+GvxigvUjinmCye5ry61Bxd4nXTrJ+7M+mvCfxm1fwPKll4iVrywzhLxRkgf7Ve5+H/GWleJ7VJ7C8jnRhn5WGa+bdI1my1y02SBJUYYIPIrJuvBd3pF0b/wAManLpdxnd5SnMbfUVy8sZ/FozsVSUNtUfX8kcVzGUkRZUbgqwyK4bxF8D/B/iRneXSY7Wdv8Alta/u2/SvGdD/aD8T+FJFt/E+ltJEvH2u3BZT7kdRXqfhv4++GfECqEv443PVXOCKXs509YM2VWnPSRyWqfso2bMTp2tTRDss6Bv1rnLn9lHWtx8vVrRh6spFfRNl4p0y+UNFeROD6MK0FvYJPuyqfxpe1qoHQpS2PmW0/ZH1SaQfa9bghTv5UZJr0fwX+zX4U8Kypc3MbaveLyJLnlQfZeleqfaYR1dfzqKXV7O3Ul50Qe7CplWqSVriVClDVk0cKWsaxQxrHGowFUYApee9cb4j+MHhbwxGTfarbxN2TeCx+g71w2pfG7xF4gXyvBfg3UdU8z7t7dR/Zrce+98ZH0zVwoVJK9rLz0/MbrQ2i7+h6/q2s2mjWclxdzpBDGMszsAK+YPiR4v8TftAX03hTwJE0Wks2y91qQERRr0IB7n2Fdavwt1nxfOt78RteW5izuXRdLYrAPZ3PLfgBXYSaxZeHdNSw0q3h0+yiG1IbdQoH5VpHkov3fef4L/ADMpc1T4tF2Mz4bfCXwj8E/D8NrbxLe34XMtzKMs79z+dZvjzxot9lUVYo16BayNf8WD5syZ/GvK/FXi9Rv/AHn61Mbyd5O7FJqMbRWhH4m8Rhd/z14/4w8XBQ2HqLxj42VFcCTn6143rviSS+nIDZFdtOFzglK57Z8OdcLSB93U5r0nxl4iEmghd2TivnXwT4g+wQrubFdZqPimbVI/KTJSs5U22aQqKEbDfDli2pa3qbgbljtXc+1e2/CO4Mml24z1XFYXw78Cvpfwk8V+LryMxiaEw2xYYyO5FaHwRYyaPYMerAV5OYSTpq3c9PK4vmc31Pm346Q+TqHiQdOJP5V8faa2bGPnoM4zjvX2J+0dMLfUPE2DjBkFfHGmD/Q4yR8vODt7018MTpW79S8oPY5HuOtTYDZ2nHqe2arLhcglR6BgQalVd2SvyJ6g8Uxk0bHr1LHOMelTowZsAhc8sSKhj+bp8+edwOKkXjhSSpPBGMmgRJyOuQM43d/rUmB8oOQP4T/Wo0ZeMyYZhz9PSn4bdnBxjrnt60AP4IK8Fu+7p7nNIVBwDyO1O2nAIO5enFI2SAd2e5/+t60AKykKQTz1AFIyhlP3W9DjnpQ2F55zk8r/ACNK2Nvrt59/yoAa+7GWXIz/AA9RTcbfUjjcP8/WnMoVs7mUMcYpNq85ZgCMFu/1oAQ43Z5Zc9T3o28bmXgcFRT/AJpAHaTYmOBimqFXJ37QOS1Awb5mYbevRR2FJtZccdePxo4fnP7znHOMUqqS/BYfUYzQITnlSM4/u+uKRVI+XB59TxRhW6sVweo6/wCeaMA4O5s8HoeKBj9vzkA5IHAPQUi7nyOBn+fWkZU3Mc8ryCDyf84o2hc4LHI4OPfrSAc7DGCM89f89qF3HIBA7/8A1v8APrSYC8buT6HP5Um3acBt/GM/0oAFUDJChTn8qACrAKMn+9nFDFQoy27PbHNBXZwHLY68dBQAm3bwOMHOAOvvSOu3kAtzncPWnBUK8HHbB9vSjydhypYrwT/9agA55VyCPvfj6GjJ56Bm4OO1CgSTYU9OM+tL5SryGwnfNMAUbTg4kHQnuMVIuRggZ7AelIuPmOP3jfw9PxpyqFVcNj+QoAUH+82N3NFHlgKVZgT2zkHFFSwIo1BUdcN1yc4oXjPy7xjHTpTFxt2nv2PAqRMBsHCqO+aYCMxO8FQsfUgDOaTkoQCBgdR1pfvdBjC5+U54pVXPKrgj5uaAGKx27c7TjhTyKVQdvygp9O9G4biWO7PRR60YxkA42/3qYCqTkqNq85+UU0d89W46dvb/AD3obbtADYZR6c07btYAjnG7djigBqqF4O5fQYzTl3fMM9jllHJpCMZBbvncPWgrwuRuJPOAaQBtG05RRz1pckN0ye24dPpQOwJB3dcUNt3ccL2PrQAuCsewg4zjd+PSmr8uflx2C5pW/dthvbGaC20bewOSaYCtx90EcBSx5pNvUFfrgdaCuAT0xztz39aNx5Hdj/k0AKp27to46/hjikXKqQVy2Mbt3Sk45xxu42g805uw4Ixk/WgBF3eW247ucAN2pmCzE5JLHK8847098SNyOcZJ/pSfd6cnkDFAhNqsucD1+uKUsXZsjrjPPbmkZjngcA4zmmjByR+ZPIpDHCTv1B469KbztwCFB9859qOGXrt6Y96Y5ycdQKkY3OGyBkdQjGmHlMep5BNSbTtHy4xx19qidt3Ocgj1FMGHXnPzZ4yAahYlsFtxHXjnNPmwrEYHr17/AOTUefl6ZGMkDqKZJma9IRZ7d2WlYR9OxPP6V6Z8DfD5uW+dcb5Enbj1zgflivMJrc6xrVlZR5JJyfYnjP4DNfUHwR0VWt5bpUwks3ycfwqAo/lXoYWOt2ceKnywZ9G+B9HN3NZWqLnJVeBX358M9BTw/wCGbaPbtO0E/lXy7+z14NGsa1bzOmUQg19ceJL+Pw/4bup87FhiIX644rHFT97lRxYGPNeq9j4Z/bs8ftdtLp1vJkySCBFH5VzXwA8IjStHgyuDgZrg/ipqT+PPi9Da7vNit2Mj9+c8V9F/D7RxY6XH8uPlrvj+7pKJxy/f11f1NS+jEceBXK30HmOeOa6vVG61ipbebJ0rkv1PTaMmDTf4sdq858WLu1yGL+9Oo/WvcV03bbs2O1eK+Jk2+N7GMjhrpP51Sle5nUXLG57B8TdJf/hWzqqk75LZOPTcua82+Ku2PU4bR/li3R59sAV9gap8OU1rwSkezc7RLIFx3ABFfN/xo8GPJcJcqhAZQGHoQK8qguWpKMuux6la7w8KsNbaM/Of9obw1c6b421PUpNxV5AJk/uj+Fh/smvMIuYxzgY496+4/HvgW08YaebW/CwXiIUgvGXIA/uSDup/SvlDx18L9U8C6g8c1qyQ437c7ht/vo38S/yrWzjuEKiqLQ5BVB7DP0p+3CleMetO2hl9sdqULjuMdh+WaZoCqT83pxwc0iqVADDKdxUu35vmwPTmnrGdwz1/vHp1oAg2EDgYwec0m3k9T2+Y4qdl7k5z3zRtAxzwRnr1NKwFfyyq4zg9P170pTdkMM/j0qfaGJJYbupGfek27dpPXr9aLARBTHgAcf49qUrtO5hjnHT9amVfmwQGUHn8e9OXZlRkfMMdTmgCHaP9k59OKVlxkZAPOeOOtSycfKOMDjjrTdq8j8uetAis0e7qR+f6U3y+DjAP0qz5e59uDntTLaxvdWn8nTbZ7yVeGZf9XH7lulVFNuyJbSV2UbqaK3Xe7hR36V2fw0jhg1iwuDJtN0ssSI3VgV61lw+DLCwAmv5xq+o9Rbwf6lD/ALTd6734b/DfULzWItd1ENFBD/qE27V6dFFddOk0/M5Z1YuL7HqHgVZf7PhiycR3Ucg+oYCv0s+I2n/29+zZKrDc32HP5LXwr8IfA8+sailusRK+aGJx75r9GtY0cR/BmexYfdsWGP8AgNVirJw7oxoS5nPsfmr8NZ9yIh6r8v5HFew2tvuQHFeL/DxTFrF5D/zzuZE/JzXv2m2ubdTjtXbWOCk+ZHS+B5jBOg6c19CeF7gXFqoJzkV866B+4vFr3Lwbd/uk5rzah6VFlD4iaGtxbzIy5V1IP414p8CfEUnw/wDH91oszFIvN3R7jwVJr6b8SWAvLEsBnivlb4paTJ4d8WWGtRAqEfZJjjjNVGV46mNZOM1JH2xrVmuvaGdnLbd6H3r5U/aK+H/9taGNRiizPCCHwOcV9E/CLxTH4i8MW53hnVQDzUfjHw3FcPcW7xg290pK8cZ7iuaUWtFuj0qdq0OV7M/KabQbe/m1TwxqZ2afrcRhDH/llOP9W/58V8m61ot14c1a90q/RobyykMMikdwev0r9B/2gPhrJ4e1i4MaMihyyMB09K+Y/j94Z/4SPQbbxnaRf8TC022erIo6/wByb8ehNaz95KaPOw83RqPDz6Hg+84/mKkjlkidHRijocow7Gq4Y7u+G6mpF9TjGcVgesep/Df4gXWg6zFqVoyhwphvLVvuTRtwykd1Ir6/+AnxWj+G/iazn026d/CupOPLSQ5+yyHrGx/lX572t1JazLLGSjr0OOv19q9T+HnxKfSnMTr5thNxcWrnv/eX3ruo1uXSRzzp31P3FmsdD+KXgeax1C3h1LSdSg8uaFsEEH+RHUGvmLwXr3iD9jfx0PC3ieeXUfhxqU2NK1Rufs2TwjntiuC/Zc/aS/sLUrfTLzUDc6HcYVHkPMR7A19q+LvB2hfF/wADXOkatDHe6feR8MMEo2OHU9iKH+4bW8Jf196MpR9p5SRY8ZeCtC+LXhuMSGOZWTzLW9iwShI4IPceor4l+LnwK1HwpqUkMkIU5JjkUfu5h6g9j7V0vgn4keKf2QfGy+D/ABv59/4JuZNum6vgsqLnhWPYgdq+vZ4fD/xS8NpJHJBqVlcJvjlQg4yOoPaqt7HreL2Zi17TR6S/M/KrVtBktZWjljKsDyCK5y90nrgV91fFT9mq5jWWawt/t0A5CrxKo9vWvmfxL8MdR03zJI4WmiQ4YbSHT2Ydq64yuro43HW0tDxC70zbniqUVxc6XKHgkZCPQ13WoaUybgyYI9RXOX+nEZwK1U+jMXE7TwH8eL7w/MkVzIxTOOTX0T4Q+OVjrCR5lUMfeviS6sDnIFR2eoX+kyBreZkx70pU4SCLktmfpbpvijTtWjCyeW4Prg1JdfD/AMMeIPne2jSQ/wAcfyn9K+BNA+N+saKyiVmdR716d4d/aoWDas7Mvrmud0H9lmntf5kfUf8Awp2GA7tP1q9tfQLMSP1q9afD3X4eI/Ft8q/VT/SvGdD/AGotMuFUNdKD7mu1034/addAFbpP++qz9nURalTkem2fgXUyoF14p1GQd8OB/IVq2/w/0ZW3Xc95qDd/tFy5U/hmvNo/jRZyLxcp/wB9CiT4wWxGRcr+DVDhUNYypXPaNNh0bw/81jptpav/AM9EiXd+eM0mpeNNoI8zArwe7+MEOP8Aj4H51zOq/GKD5v34/Os/Ytu7Rp7ZbJntus+Ngu795+teeeIPiEqB8yfrXi2vfGKP5gs2fxrzfXvioZ9wEn61vGi2c7rKx7J4g+JA+bMo/OvIvFvxI3bwsnP1rzrVvGV1es21yBWEsdzqUvUtmuqNFR1ZlKpKehd1fxFPqMpwxINR6bps95IOCa3dF8FvOy7lNekeG/A8kkkcNtbtNMxwqqMkmqlNR2J5TltH0FoVXeM17/8AAf4B3/xH1OGa4ia30eNgZJCCN49BXe/Cn9lm5uJINR8UJ9jteGW3b77/AIV9W2MWl+BvDpZUi03TbWPc7NhQqgdTXl1sVryQep10sK5O9RaHgP7Yl1ZeB/g3aeH9OVbdJmW3ijXjI6V598G9La3sbJAuBGoJ/AVxnxH+IN5+058Xlj0mN28M6TL5cDY4lYHlq91uNFh+Gvw/1HU7vEckdswTd/eIrz8VTagov1PXw00pNrY/PT9pzWUaTxLIDnfM6j88V8vWS+Xbxqow2Oa9Y+O3iD+1GaANlrmcs3PvmvLo1DdCVPQH/wCtWi2SEth67pMHH05yalH3iw+VjwADUYxkYIz09Me9SIvqVZc5OKYyZdzMcAqfY9aemDlgOfQcfpUar8qZ5PU8809R8y45J/h7igRIreWRtwc9T3PtT48MoVeufmJJ4/Cmxr5gONoPcHj/ACaXd0AJGBg8d6AJnyNyk47Uij94em4HGc0hIK7Tyy9dxpd3B45J+b+lACbTu+Ukjrz/AI01W3feJJ7j/wCvThtK5AHzHGFNDcKQDlehA+nrQMTaQfVScbadGx3D5cYwc9elJwGYFsceueaRVDNtUnjP1/8A1UAIxLfwhR2P9aduXaMLu2jA5pFbo2C2R1FJy2CSRjqcc0CFkJkZiAoLHBz+HSk+QdF4PXatL/GCQSQOtJ95gOvOR1zQAM2GGF2oBgcZoXCrwAe+3nmlbjP8WDk4PcdBQ2XbnOScg/0oARsYAbGD1wnWjhd2QATydo/SntgSMVyT0Lc4pjfPt6MvTBPNIBW4XhQOckgc0LgMTgA9iODnpSsu1iuCeMd6T723aNy9eTQMduIGVQbsZwMUxdm7JXAwCOx9qcyhQCRjjk/X0pM9Fw2BwwP0oAU7s89M5Y4/SkXEhG0FV5y2en0pV+WH5jwxwCTk4o8w4Krgj/PNACnK7SAScYGetIo3csWwOvQimhsAbcdMnPal8wsSM54Hy460ASbi2MnI5yCD+ApQxbIY4I6rjOKYrD/Z3MemfSpS5KnHK555oAk3MB8q4Dc+/wBaKA2O+F7CikxopxrtUNn24OaCpwep44O7n9alWPCgAFST+dPGN4AbIxyaYrELEAE4GecluT17UmOp2Dk5xn0pQv3Qc/Nn5aQN5eORjv3oAVvXd7jjC47mm/e/hG3oO2KX0yBnofYUYAbsx/lQAuNwzn5V5Oe9GNvJUDHLeh5/KkLD72Qx65akOFOBtz15PegB+3C9cDrjb3poQL8p+XgnPTP4UMNuTjfnv6e1DNt64LDnPWgB3LAj1A4A5/z9aRf4iCFIGMgcijhMYwD6g0vYYAJx938etACfcUj25P19fSjbtbkcE/KD1o3blzjIPPPPJoOFwCPmz1NMBRlVA3csOuc4/wA+tNOMAkKB6Y60Nt5OMDo3PU+lK2OGJ75/D0oAOVVsHI9OPxpuCpwyhypxupWYfKWXLDIA7Ubl25ILDr/9agBSpXqcZ6Adqa2CwGAc7gCT/njil3/keCe9N68gcEYXv+NAA3C8cgccZoJOdwGScjLZ4Ao4bJI46ntSDBI2j2GO3FACHkAH8Qo569KZhe+AB68VJIw5GcHAyD/OouO5468VIxjN04bH09/amtnyzkZ4zkgcfpTxj1y309hUUmDyARTsIhZjuwT9ef15qOSQDk7h71YbJ+XLE9ay9bmMFo21svJ8ij3NAjT+H1i+oX+pantzsBjiOP4m4H6fzr7K+EOg/YdDsLdV+ZVUdO9eBfCXwiYdJgiKcq4eT3Y9B+FfanwZ8JHVNUsbZUyMjPFe1Tj7OmmzwMdV1cEfW37Ofhn+zdFW4dcMV44pv7UfjuLwn4FnTzAruCTz7V6f4Z0uPw/oUMQwoRMmvhD9tfx7L4g1+30K2kz5r4YA9FrzoR9tWOuVqOGUNr/0zyv4N6bJ4i8Q3msTpl7mUsD/ALOeK+sLGFbLT0QDBxXknwR8KLp+nwsUwFAA4r1u+m8uPHYV315X0OLC6t1O5k6g+9iKk0q08xwcVSkk8yWul8P2u9l4rjeiPRjqy++mj7C3Havnf4mW50rxXY3RBCLcIT+dfWA0/faEY7V4V8aPCbXdlJIq/Oh3Dj0qab1KrxvE+zvBd8mpeFNLuEYMr26c/hXOfEH4YWviyzka3Cw3XJ6cMa5X9l/xQNc8Aw27ybp7XCMpNeyZrCS5ZNI6KcuaCPgv4k/DHUPDdw4u7RkTJxJjKn8a8T8XaGl9psljcxLPbHJRXGTGx7oe3uOhr9VNU0Sx1y1a3vrWO5hYYKyLmvBvi1+zD4dvNJuL7Td9hMOfLX7pp86+0YSpOOsD8bfHHhFvDOsPCi/6PIS0fXAPcVzbQ/LgKp/CvoT4+eFX0+61O1kX9/aOWRvpXgTkH5j90jK8+tKSs9Dppz9pG73II4zzhVI6en40uAFwV5HXP509sLwO/wDtUNyCF+8Twv0qTQZtO773PT68elLt29D6cr2NPOGORxng0bfmUbcZPA/pQBGFYIMH355+tKke3OFB/HrTjt2kcZxzn19KONpyMZPAxQMZjDYIO0Fcc8dacSQvoCPSlUBM8hWAzx2oXc3sOe9ADUXcwwMke+PSjcW3DJbIzncD+FEjDPzEhl9BTQNowVG7vQBWffc6pa2SLlJMu4zjKj+HPYGvQNL8O32qrBaG68qBjiOwsl8tPx/xNee6bIf+EkgOACI8cV9dfsr/AAvHxI8UKkpKW8SoZGA55PQV20VGzcjjrSkvhMjwV8JdP0YR3F3D9uu+qRD/AFafX1r3v4YfBbVvidrUNlbqsNt/y1uGX5Y19AK+6dI+Bfgiw023hTQLViiAFyg3Hjua6rQvCuleGITFpljFZoeojXFOOKjGL5Vqcn1WrOSdSWhxXgP4A+HfAukw21tEZLlR807dWNdL43VbHwTqSfwrbsP0NdNurzz41ayun+BtUO7H7lh+lcfvVJas7pKNKDaR+avgmP8A4q7UwOhvJCP++jX0PpseLVfpXgHw8jMmuXUx53Tu36mvfbS4CW69uK9qtsjxMNpEuWsgiuVNereC775V5rxdr4LMMGvQfBupYZOa8+aPSpvU96tdt1ZlTzxXinxg8LrqOm3cJT5iCVPvXrHh++Eka81meOdKF1bs4GeKwg7OzNqsVKB4t+y/8QH07UJdJu3IkifYQ1fWGq241LTyY+XUb0PvXwV4gWX4ffEa21KPKWs7hZMdAc19qfDjxPF4g0SBg4Zto71pUvGV10IoVNOU8b+PHgNfFWgyXUUW6VVORjmvgi/s08O63c22owebpN4rWd9CR96JuCfqvUfSv1j17SYlnZHQfZrj9Gr4e/am+EJ8PahPfW8WbW4+YMBwDUUrRk4dHsZ5hSk0sVS+KO5+a/j7wXN4C8WX2jSnzI4m3W8w6SxHlWHsRiufVRuztwO9e+fEzw9J4s8JbwhbV9DB2HHzS2x5I99p/Q14JxgEHGelRODhJxZ3UK0a9NVIip/tDAFWraYwtuB+X2/nx0NVx2UnjH1pwbPDdzjjvWZseg+DvH0+l3Uaq+1hztPRx6j3r76/Zd/bEOheRpOvStLpbYVXY5aE/wCFfmSGXkNnbkYZeqn2966fw344uNDnjWZ8rn5Jh0Psa2jUto9jOUb6n7u+K/B/hH4++BprK78jVtLu0yrxkFo2xwynsRXxXezfE39hzxUVX7R4g8CSyZimYNIoTPRsD5WA/CvGPgj+1drXw/vInsbxliyN0DtmNx9K+/8A4Z/tGeCvjxoZ0jXIbeC5nTZJbXGDG+R2zWsG4ax1RlKKn8R0nwZ/aO8HfHDSY3069jhv8fvLOVgHVvb1rofG3wx0DxRGXvI2srzpHf2x2v8ARuzD618l/GH9hPUvDOqSeLPhJqktlOG802ET4Hr8pFYHgz9ubxz8I7xNA+LPhm4lt1PljUI4iSB/tU+V/FSZjJpe5PU9K+I37N95bRyTnSY9cteou9MIjmA9WToT9K8C134LxSSOtneNBKOtvfJ5cg9ua+1/h3+0N4F+JlrHceHfENvFO4ybZ3AOfQqa7DW/DumeJof+JroVrqKH/ltGo3fUGq9tOPxoz9lCXws/LnWPhLrVizYtvNHqnNcpe+Eb+1JEtjKvr8pr9L9S+Amh3Exk0vWb/RWz/qJQHjHtg1nzfAHVGQhZNF1pP+miGJz+Iro+sRMvq76n5lTaAW+9Ay/UGs2fw+Qx2riv0l1f9ni12s1/4PlPq+nyCQflXAav8D/A8bMs9vqWmP8A9PFm2B+Iqo1+qF7HzPhIaPNH0yPpVmE3lsflnlT/AIEa+wZvgD4MumIt/EMSt/dkBQ/rULfssabdMfJ1O1mHb96tP26MpYacndWPlW31jUo14vZf++qtf8JHqqnH22Q/jX0zN+yREq5WeE/7sq/41V/4ZRTOPOQH/rov+NJYiHUz+qVdz5w/4STVGGDdOfxqCTWdQkzmZm/Gvpdf2TYhy95Gg95F/wAasQ/srWCHLajEfxzVLEQ3SKjhat76Hyy0l9dHnc1LHot1Ow+Rs+9fYem/s06RCQHuJJP+uMDMa7DSf2bdKYqYdI1K8Pq8flL+ZpPFW2RssLrqz4l03wHc3jgBGY/SvRvDvwlv0VG+yPg9CVxmvtXw/wDANbLB+xafpiDpwZpf8K9G8OfDmy0WRZobQXl2vS4uuQv+6vQVyTxUjpjhony78O/2Y9Y11Y7jUUGi6Z1ae44Zh/sr1r6U8B/DLw54LjRNA0v7dfAfNqF2OAfUV0PiTUtC8I2j6l4o1eC3hjGcTSBVHsBXy/8AFT9vMzTS6F8L9Gk1W4z5X25kO0H/AGR3rBQq4l6bfga3pUdtz6d8ZfEDw38K9Jk1XxTq0MUijcFJG8+yLXxL8RvjD43/AGvvEC+HPDNpcaL4IWXDshIkugD1Y+ntT/An7Lfj747a5Hr/AMQ9RufsxYSC2kY49cYr7A0fw74M+AvhtWJt7NIU5dsBjit4xpYeWnvP8DldSrXbvpE5r4S/AvRvhP4chaWKOJ40yxIHHFfKH7bP7R1rMZfD+m3INumQ+09ad+1X+3eLq3utH8OS+XDyplU8mvzh8SeL7/xhqks88zS7nJdyc1x1VKpK8zvoxUY2jsP1nWH1zUjPI2YhkJ3/ABquqnAA578+1MjQKoAI24x0qZV3MvANI3JY1wpwGHTAzmnhWbcCpzk+lMQjv8p7cYqYbePlyMdxQITaGYgqc5ycAVKuMkd+eCo4pAy9Qcd17ZFT5CgZbJHIGOlAiPiRckYHqPX1FSAbccE9dvOPzpPkVssQSMDI/H9KOg+Y5H1zQA8b1xySMZwQDz6UgX5sEqPVuueKRQu08cMM07dk5x3+9j27UAIzFRgk4xnnHSl2/ebYvUEBh+lKW3IozkHj60hb5WwvXg8egoGI67WIxzjjb39+RSneuR3I6gZ9OKXjc53kc9+DQv3lCkrznPWgCNsBmAcNg4G7PFOztHy/KcYLryPpijd8xYZOR6ZoxuYcFTnOc80CGyfLJIN3fo2evrTlz8uAAf72cgUhb95uBJy2496OG6DB6gnigBCNuwl8/Ln5hwc8ClUFUAXaSOu3ilkI3jBO7gZ69KXcG/hz79KAGyIF2FmJJzndxu9vpSBWbI+Ut/Kntt+VTnKjJ79/SmMwkU5Xrz6c0AKyj7pZgA2Pc8djQq5+8qHPI6j6DFDAKpB4I988/Sl3DIGOAAvpQAHJ4J256r6c0gHV2CkYOM9f50owqkNwOvXtTQQqgAAjBPPSgZIqsqYJG7jGMdKj4aQ5CkA429P8808ABXJ7n9KarD+7klumMUAKqMysSeq78Dt6VHtO7BOWGOmAB61IPuqM4BT1603cvJ2dwelICRd65OSQM4x6Dp196VPvYO0njkjH+TSM2IwucDnIz3pd24NlTjHPFAEu4nID5AOB9KKORg/ex2Pqe9FIYL8pXBJXnHH5f1pWZCo4AIXsBmmx/dG0KTgknp3/AJ0vJXjcDjsenNAETbUYnIIUk9QT1poQsT0XI7jj6nmpDzIOMEs3UGmbgeQFzn72OtMAOPnKsOSD+mM0iqd3O1WHXml2k7c7XPb25pfu5BUMT7UAI+dudwXYP50xj5ZIbkr0U9frUhjGBwFP9MVHt3KcDJx1zzQIdtbpgbMAlu1Ir7kHzLtbgn6npSjlcHO0dFzTshl4AAyBjHGPegBDgSMGACjPalXOFHX17kUobbuAGCvUjNNb5jnO4npx0pgGSNufmAPYZz2pOATgZAHAIp7H94RwFxn5e9NDDC55GemOtIAyVVOVGRzngA9KZwOoI4wSBnNSNnlW2lc46fpSD5ecktnr6UwG7vlDHCnOPmH5U37oG4hevK05ieuchuPmHpTiQi9s54UcY9qAGZ+UP05xyO1NZjyeB6NjgjtUjM27IbPPTGSKbgDH8SrwcHGD2oEI2Np/hGOOM5pM5BxgEcjjNP3sy4ID45wR0pv3ssxzuHI7+woAiydxQYyR1NMbcccY6AcGpN5K4JBB4YY6UxWZj0JHQDd2oGR7umSAOvTP1pFB5+XJ+mf604sTgBu33T6UjD5cAKR0FIRH5Z5OCBjsvNVLGxGseLLW3b5obYedJ9ewq47pBG7kYWMbm7V0fwV8PtrOqPK65kuZlZvZRyBWtOLlJJETlyptn0H8NfD/ANn0+1Vk/eSfvW47np+lfeX7MPggNMt/InyqOOK+W/h/oJ1DXbe0iTcSQuAK/Rf4WeF18M+GbePYFdkBNeji58qUEfP4eHt8Q5SLXxC1tNA8NXUxYLhD/KvzL1O+Pj74tahfMd8UL+UnfvzX2V+158QF0HwnPbpJh2UjrXxV8IVHnSXUn35JC5P1NZ4eDS5i8XP2lRwXTQ+mvCkKabpkYHHFO1TVBzzXNJr4gtQN3asK/wDEYaQ/N+tVJczudEbRSijsbO5Esw5716N4VQNtrxXQ9XEkgJbvXqvhbWETZ81c80dNM9btbUPCPpXGePPDIurOTCZBFdXo+qJIijNaV7bx31qykZyK5ovlZ0yXMrHhfwB1aTwX4+m0yRtttdHAB6Zr644YAjpXyX4o0o6D4tsb+MbfLmGTX0/4d1RdQ06F9wOVFaVFtIwovVxZr1yXxP1D7B4XkbONzAV0GrXX2WyklzjZhv1rzr46X+3wjEyH70oP6VzS2udi1dj84f2orOOXxZqbqvEsef0r40ViY0Cn514246kV9nftFS+Zr0jZ+9DXxhHnbIBztkf6dT1rS94xM6UeVyXmLx04AzjkdakJC4DMBh+3amA914H+e1OXJJC4bqMdDSNg28ncvzev+GKcoOWCk7sj7w7UuVA+T5d3XPenctggK5xwp7UARlSCygYbPPajhR825eenQj9adnGCRtPTbnrmm8kEbhyen+NAg+YPg9OM8ZOe2aRsL12qTnof8inKPLbGNkijIwaNp64HGQ2KAIhltvzA++P1pnEmQdznGOCKfvTI+8gx9KBhl+Y8nkMT7d6AKulqF8RAYONqjn3r9Ff2C5ILPUZo5MK8iqQfoa/Ou2YxawXzjhD+tfZv7Mfio6FrFlIrYWRdvX2rqirwaOWppJM/XDTrqK6tkaKRXGBnaelWW6V4N+zj4um8Qa94jt5JS6xbGVSema9zvZhb2zyHgKK5pR5JWNoy5lcpX1+tupyea+cP2oPHC2fg+7hWTDSKVxmvTfFHigRxud2Pxr4q/aa8dC+uI7NXyC3PNdlGneR52Mq+5yrqcR4DZbdtx4JOa9NOvLHCAGrxHRNaFso+bHFbD+KQy43/AK16Uo3OGnaKsekLrwecDdzmvQ/COscoc1872Ovb51O7v616V4Z8QCNU+auWpE66UtT6s8J6sGVRurtriEahYsOpxXz34R8XLGyAv+te0eGPEsV0iAsDkV50otO56EZX0Z4n8bPBv9oWNwu3DgEqcdxUP7L3xMZZDpl5Jie3bymUn06GvavHXh9NStHdBuBGeK+Pdcjn+GPxYtrtcx2WoNtY9Arium6nHmRxSi4Tsj9ELyBNW08qp+8Nyt6GvL/iN4Uh8d+FbzTLpB5yqV5HIb1rq/hj4jTXtBgffubaO9XPEtj9juFu0HySfLJ/jXNKOjh1WqPQpyUlrs9z8o/G/hi78GeKJ45I8SwOyMp6MvQj6EV81fFTwUvhbXjNbITpl8DLbkdFPdfwr9Pv2vPhWJLePxJZxZGMThR+tfDnjbR18SeHbzS3XMyfvrV/7rjt+IraUvb01Nbrc83DReDxEsO/hlqj5rWPjHQ9jmpF7EYP15pTEVbDAq4O057EHml8vcwycGuQ9oarENgdOTgDqMdaerBVKMN8bdVbpQqFiO444/Onbt3UYz70hFzTtUudHJNuGurUctD/AMtI/p616L4P+KU1hNFPZ3TLtOflOCDXmCM0WCCVPqaWS3SWTz43+zXPd16N9RVRlykuKkfo18C/26dX8NiCz1SUahZDAKyN8wHsa+vNM8afDH9ojRRb6jDaSTSLgxz4Dg+xr8OtP8TXWluBcgqO0qH5T/hXpXg/4xX2hSJNaXjxkHOVat1JPXZmMovbc/RH4gf8E39KmupNU8B62+j3bHei7ivPswP864Td+0v+zu21biTxFpcZwFuo/MXA/wBpc1wXw3/by8QeG0iilu2njHVZDkV9CeFf+Ch2lXyomq6WsgPBaM4/SuiNWS+KzRzumvs6HP8Ah7/gojq9rILTxd8O3aZeGfT7lGJ99jYNd7Y/t1fCW/Uf2ra614dmPVpbF8L+K5FacnxY+B3xaQLrel2aTP8AxzwqG/76FVrj9kH4NeOEM2i3z2jvyDaXXH5Gm5UHvFr0MuWs3o00dP4d/aU+GPiWRV0X4o2EMjH5Yb8+X+GXxXpWm6xd6zCGs9Y0XVoWHDQXCuCPwzXy7rf/AATZ0e+3fYvECsh6C4tgx/MVy11/wTh1zTCX0nWbdXHQxSyQn9DUWot6S/D/AIYmMa6eq+7/AIdn2lJ4WF9ze6HpdwfVokb+lQN8P9Fk+94b0ofSAD+Qr4m/4ZJ+PHhlv+JN4s1GNF+6sOqvj8jT4/Af7XPh9s2fiS6uFXtcTLJ/MVfs4/Zqfp+pfNOG6f3/APAPtP8A4VroLD/kX9PH0Sm/8Kx0Ef8AMv2H/fvNfHEPiz9sbSMK9vp97jvLCpz/AOO1YPxa/a9i4Ph7Q292tj/So9nJ/a/Fk/WIM+xIvh/okJ+XQNOB/wCvZT/OtK38M2duP3On2UH+7bqP6V8XQ/FH9rm84/sjQrf3Fkx/rUn239rbXch9TtbHP/PvZKuPzqXTls5IpV4t2sz7cjsJYxhGWMf7EeKyde8V+HvCtu02veILHTol5Y3d0kf8zXxq/wCz7+0T42IGv+PNRiibrHBN5I/8drT0b/gnXJfXK3PiHX5LyY8s00rTH/x41DpQXxSNvaTa92J6j42/bg+FXg9XTS7q58V3wOFh0m3aRSf+uhAX9a8S1r9sz4p/Eq6Nj4O8LJoNvKdqyMpuJ8evA2ivePDX7Ifw58Exxy6k63Zj5P2hwq/lW1q/xk+E3whtXS3msInjH3LVV3H8acZUobRu/MlqrNe87HzZof7HXxA+Md9FqnxC169eItu8maQr/wCOjpX078Pf2evAfwb05ZDFbh4xkz3JAH15r5z+JP8AwUu0zTVmg0CzXPIWSTmvjH4t/tpeKvHUkon1SWOJs/KjYq5VJVPjdl2QqdFR+FX9T9Ifjh+254N+FtjLaaNNHqmoqMBYvuKa/NP46ftbeIviTeXEt7qLpCxOIUbCgelfPmuePr/XLhhGZbmZuvJP51lpo8sshkv5PMcHPlKfl/E1jzJK0TpjT/nJ7zVrzxJdE5cQZy0hzz9PWrUMKQpsiXCeh6/WnxxBVUKAAvRR0xUm0t1H09vQ1kbh6nBAHX/69TovPXLE4GGB/wA8UiYGCx3cjFPwflBJBJPynoaQAjEAcldvTcP0qVMDncAe2AQKSP5fukK393OQKcqs3QCT+POcUAP+b06YBJGcfSnfc9h1KgHJ/CkVV4O0YPPXBp+75SRlT370CEjxzg4GP8j2FO3bf4QMjninP8p92OSF6Y9aSNVbODkf7XWgAXO1SfmGD0pyrzjrzzhunFJhRGCAQeaA27r0zx144oAPM6cK3BxQoG7OQT7d+D6UuDtAY5zwMntSbi2QQcbfakMRm6/xcduv60RtuZeMjPTg/iaVkyTwflXHBo3EZ7EYJzyOvpQA0Dao4UbjyM4/SjJXIAYLwTxn/IpdreYRjac/3ugo424Qbs9eeTz+lACPgSMuQCX5BGPypPu8Zxu4POTTsgyHacHc2TmlLFcgd/fNMQ1mUM7L8vyjgHAIx/OjlDkbjk9cCiVTuG4nIAz83TigFVzjG7P3qAAMOCMr8nBBAB+tC5jBb6dwccU3duzjJIAH3uOtSN8uSN2frzQMGbI/iBDZ3YGPoaTbjJz9BuH5UoB24O7qeC1B3bVOWBwOd1AA0nmK3I+YgBhyaaF3HdnPp83HvTx0I+fGe5pn3k68ZODuOBSAcJBtycHgjI9R6U1V37fmyO5z6CnjPzsc47Dd703I756nAzQMQyZjIJX7uPpQq7sjOccfKc0vIUBsk7cfe/Gm7gxJY8D3/SgB3mbsZwTg/KR7U9eecr2701cbVB3L1AwcinqS2QQRwM4x/OgB/wDe+bgH7v6UULgDlWPPtwcetFJgCqcDqB9M0HG0cE4X0xTFVivTntx29ac2FG3ao44+WkA1/l4AcnJ69etIituGA3X1HFKw+bnbnc3U96bjjp0P0FMBT83TdgjoR15pRjnI3MTnBHNIvQYzyQMZ6c9ce1K38Q+Y7TyW6/gRQIM7ZAQuMCmEtgZG35uuOvtTuGAAXd/EME9aZjCggEEdMHJpgKQRgMMFufl/lSk5Rcq2cY2kdPrSDIThstu5yOlO/wBpjtJ7DnI7UAHDMoxzkn3+lKzHgkc4zgntQ33jkfvO+T3oXG1STjnB9/p6UAIzDPPJX3xijngdccnBpxULkjIOMZzzjtSdBnB9MDGT/wDWoAQfcGV+9/e61H3CgcY6DvUjL2Y5GPyFIyhuAOhySD2pgDL93uOwPb3pi/N8oBA/ugZ4p7BWUdAegDA8e9Jt/dnA9Oc9qAAEcg7to4B6HP1phyxOeNvBwM8+tPZhuyxDAfw9Oaj2nGT0Xjr6/wBaBD9oUHdz3J/vVHwzcYA4HXpUmAzEg7D9OoprY6HjPA9/U0ARysF6kjuxx+lM3gLgnqeh6n8afv6gsRyB6j+VN3F+u70HQgCgZHy39SDwKZjLDJOf9pafwsfUEDr6mmeuOB6e340hFTVGMixW2QRO2Dj+6OT/AJ9695/Zz0gR6Xcaiy/ekKx18/XEwbVsZJMUDHpjkn/61fVfwstU0nwNpUY+VnTefqa7sL7srnFipWhZH2h+yL8NW1/UptcuI/8ARbc4UsPvNX2RqV5HpOmu5+VUXivOP2a9Gh0b4TaMI1AeePzHb1Jqr8fvH0HhXw3PvkCEKSefauecnUmZ4emqFHne7Pif9sX4jNrXiH7AkuUVvmwa8s8E+KIdNhVS4B+tcn8SvFJ8TeIrq73lgzHHNcd9skj+65H0NfQ06X7tI8rm5Xc+j5fiFA0eBKPzrEuvHERfiQfnXhLapP8A89Wph1KU9ZW/Ol9XD2z7H0ZovxCihZcy4/GvRdB+KFum398B+NfFq6pMvInYfiatweKLu35W5YfjWMsLcuOKceh+jHhf4rWzMgMyn8a9X0XxpbX0K4lB/Gvyr074nalp7qy3Ocepr0jwj+0zf6WyrM4ZR/tVyTwckdMMbHqfcvxLmjmtPOUglTnIrvfhb4lF1pMCls/KBXxJcftO2OraU8UzgOV9a9X/AGe/jBaaxHHEs6kjjGaiVGShZlqtGVS6PrfxNekeG9RYH7sJP5CvLPinqX9oeA7J85yFP6V3Oqagl94Tv2Q5DQMP0NeR+IL03XgaKNjnYErzMQ1Ci+56uHi51L+R8V/H9S2sc5/1NfGKfJNdDn5Z5OM9fmNfbX7QVvt1WJx0aM18TzLt1O/UBeLiTk/WphLmSt2Kirc3qSEdDjgdMdSakKjChsgY49c+9QxndkqcH0b7o/CrEbemCzdW9KsoPvc4DD/ZPSl3KFPJPYEHqaRc8YC7gOFH9KXlfmJZRjoeaYhrZZuTzn5eMdf50m7Z8mSpxzkfypVJ2sE4UcbTzSHO4hTu4+7nrQAowWIY5HBPHJpWbbgZG3uCetEPyqdr8FenrSqdoJKZ7gLgg+9AEbt0/uZ646CmtsUlcbQvGDTo2wScnfnPtUac7gvHpjPNMRXUD+0xjnMJPX0NfSPwZuWW0s5VzujdR+lfNikLq1oP7yup4HpX0b8BwLqxKE8idV/Wuqm9DnqK6Pv/APY2vml8ceIVY8SW0Zr6e8bXwsNAnkJwelfLv7HVm1v4t1mY5+SII35V6z8dvH1vp+j+QsoGDluayl71Qim+Wm2zyX4jeNhYWE7F8HB718I/Ejxm+teJpXZ9yqeOa9Q+LPxSj1CSa2iuOOnWvni+QTXTyeZksc17dCnyq7PHqPmlc3F14ovXtR/wkjD+KucMf/TQCoWT0lWt+VGB2Nr4vMLA7q6rSPicttgM9eReWf8AnoKTaf8AnqPzqXTUhqbi9D6X0P4xxRsv73H416/4G+OEKyIDOPzr4RhZo+k2PxrV07W7uzkUx3W3HvXPLC82xvHF8u5+rPhf4nWetWqxPKrBh61wHx38Aw+LPD88lrjz4x5sTKOQw5r5D8AfGC+0mRFluVZR/tV7zo/x5trqx8ueZTkYOTXB7CpTlod/toVI6nof7J/xQNyv9lXr7Lm3PlSKx7jivrW6hj1CzaM/MjivzI0fxtb+FfixDqVjIFtb04kVTxuz1r9Efhv4oi8R6DBIrhm2isq0XF8y6FYeWjgzC8WaLD4g8OX2mXSCRWQxMD+hr8wPiz4Xm8G+Kb6yIKmGQlD7Z4r9RtbvltfFF7aMcCRA4H4V8O/tieH0/wCEgN7CihjH8/HXnrXNGp7PEOHSSOmtT56UZ9Yn59+PNNXTfF16ijEU224UD/bGSPzzWEI+3P1rrfiV82uWsgOWa3wfwYiuU2nrgbvpmk1yto6U7pMaFGCRyfTOOmeaXbt6jpx0p/pwBj1/z70uzp7dgeeO3vSGNGG4xzjjB5607btY7ehOMHtTiDtPzMGbtjHX6UKCM/MduTjBHtSEOV9wK43dchuc1Wk0uJm3QStbP6xnKn8KsMNuThiVOaQK27AYk9Pw96YFdbjUrEgAC6XrmE/N+VaFn44msXAdpYHx92QEVCSWYZA/EcCpWeWaNVMm+PptYBhj1waaYaHUaZ8ULuAqUlYgf7Vd/wCGv2jdY0NlaK/nhK/3XIrxNtLtpGLeQgyf+WQKY/Kov7JyMx3MyZ4G7DDNVzszdOLPsrwz+3Z4p0XBXWZpABwshJ/nXomjf8FLPEdqwFysFyn+0tfnY1jeLkpcxSdeGUqeKjK6lD/Ap7/I9HP3QvZLoz9TdL/4Kdoyj7XpMZ9dpxXTWv8AwUw8OsB52lMp/wBl6/Iv+0tSj6wSnHoQf60f27frwYJ/yzU3XYtU7dT9gl/4KUeEf4rCT86k/wCHlngtfvadN+Br8ef+EkvF48mb/vmm/wDCS3bf8spsfSkPlP2Fl/4KZeCo1+XTpyf96si+/wCCoHhmPPkaTJn1Zq/I469eN/yymJ+lRnVr9icQyfjxTVuwcp+pGt/8FQ0ZWFlYJGexIzXmHir/AIKQ+K9SV1tblbVD/dGMV8DCbUZ+iqg/23p32G8lzvuwp7CNMn9adgVluz6F8bftfeK/ErOLjXbghv4Vc147r/xXu9QdjNeSSs3dnya5v+xoy372aa4x1DPgfpU8NjBb8RRJH7hcn9aYXRTn1fUtV5iikKH+OT5RUUeitM267nMh/wCecfT861vKZmJPzeuee1PWPkKecHA7UDIobeO1jKxIIo++3+pqZVduQuRTvL2qcDbx1x+lSLHhhjgZH3h04pCIvLIUYGeNxAFTIFbHPt8vX2p4jJzhifqM/hUi8clyeQWwuPpSGMVSQwzs6/KetEY3KD0DDHBzj1/GpghGQOSORxnrSlfu+W5XnAyOvtQBCFU4C7W7Z6HbUiIOQFbJ/hz/ADqRF3MdrEZ7YHAp/lHJ2tyeS3HagRHxyPmwOmV6U/cpYHIP44pU3feUjaeQQCBmn8tyTnnDNwCKBkbLlmwGweM54z2p5x/Fklugxil2/L0y2eMnBJo+8CDlRnOc4/CgBP4VweSOv+falX5c7QSueOetLuzGAcqcZB6U3duwQMAHGOMnjrQIQ/LgE5XBowG4AUDHTnIGKkP+rwNwGeSe/wCVJndldzEY6H/PNAyPb1yRnpjOBQV3fMNxGB1HHGM1KwLL0VdvHApvOMgsGKnDZIoAYwG/KKzDJyc0iqrEE5PPpjPrUi5J3YyAMHcMgUuWyuWLqD06UCI8llB+XBY4I9e9G3g4AYd+1TZfcCXYkD1GR9Dim7RgdevPGc/SgZE6+XI4VRnGDzz0pMMOTkc5O7HFSspfJOMbsEADGP8ACkK9dvy8465zQBHIu3cpK5wBjbS8OzHKnn1/nUnzMxwGcrySxx+FDFucDsM55B+lIBmV4Hyjr60n8P8ACflHAqXd0JLDr+PtSKxwv8uAMUDGZDZHy9R3pF+YYz3IwDmphndn5hznPFJu3KvJHb5T0oAZuDK2cDtz7U0Y3D7vXFTq21WDAkE47U3+EjLAnjjAxQBCrApkgHaCuTRkA7c/QY5NT+Z8mCCB36YGPSmhj2OADnt/hTATbtK7tvQkD04p6x7cDYRgdOwo3FkA+Zc92wQeaeMchRyB83vQIQA7cghh1Pb6UU/AKn5t7nk54xRUsZWRiFGB2PapNpKkktjGfwPGKiTKjDLktyMDIxTiy9MqewyD+tIBzP8AKG+bIJ9PWmgHOSAR79fxpcDfkJgcjG2jG3tz2+XmgAbjhWwe7Y469qVeRuA+X+dJyBu+YAH5QOOT/n9aV8At6g8ls9aYgZupHUHJ3dMelRnCjOwpznceKe3zR5I6jrn+XvSH1AZuMYbB/TNACbR34bBOfWlDK27jB4yfT0FLtxGDjJ7DHQUvPzb1yO//ANc0wAAsxXGCTkse1OXGOhG4HHb8aTb14y46jFCk8scHBzk5/KgADAhcDnOevXtTSuc8Z55J7fSncY6HbgdQPzoX5Rk4PYdf5UAC44ON2eh/Cmbd2FPPt1FPOGyD8wHcDBGaTbuLdAB1wCfwoAVVEijd90Hbx2qMfNtJGCO6jtT1KsMPnaB/CDn64pOgJwc9Dz15oARSMHBIUHg96YRySRtweflqRnDIMqeOxHFM2/OpPBAySOM80wD7o4BA6+5qNu67vlAwB6+tSu2cK3TOQxOKZuHA2jIORuPJOOKAI+VXG9i3UVE2d7EEnA6461Kw2/eX64XODUTfNt+ReB8p5B+tAEf57u64oYhsc5+vWntlcKCTycOO/PQ1GyndyAp+mQDQIxJCRrlyCTzEvX6mvqbRNW+x+G9LwflWNRXy1MNuvyDqDAO2O5r6I8MSf2l4VtQpyfKGK7aJw4nVJH60fs0a9/anwZ0u6Vt3krtOO2MV80ftea5qHia9/s+1dhFn58Gtz/gnp8XrbUNJ1DwdfSqLmI/JG55P/wCuvb/Gn7OfgnxNq0t7c6pqunzSHJjglG0fgVNYwap1byLlH2lJRR+Y0vgS5JOYs/hVZvA0y/8ALE/lX6Nt+yd4ObIi8a6xF7MID/OOq0n7H/hl8n/hO9Vx/wBcrf8A+N16X1uJwPCy7n51N4Hmz/qD+VC+CZO8B/Kv0P8A+GPPDPfx5q3/AH5t/wD43Uqfse+Gm+7451Zv+2Nt/wDG6PrEH1/Mn6rPufnf/wAIM/8AzwP5Un/CFEdbf9K/Q6f9jvw4Rz401s/7sVv/APGqot+xz4YDHPjTXj/2yg/+NUvbQ7i+rzifAK+CY34MHP0qdPh2jH/j3/Svvn/hkHwquMeL/EB/3YYP/jNWY/2TPDSYx4l8RP8AWGH+kVL20Bezmtj4Mg+FS3DDNvwfavUPg/8ADC80PWYpLBZIyzDIGcV9YQfsqaIzYj1vXn+qRr/7JXPfE79k/wAZN4PnT4a+LtQ0fxIHUwzajLGYCvcECMkfWpdWFtzWNGo2eraRZ3Wn+CrhLpwZGiPGfavKzqi32i3lqPvQ4BH0rB+C/wAC/jx4IXVrv4meMrPxDZtbkQ21mzMyPkc/dHGM0/w5HI2r61DKrANgjcPavHx/L7OMou+9/uPcwMZXlF9EeC/tAWm+S1kHdDXwrqC+T4g1WM5BW4btX6G/HLSWksbVwpONy1+fviyD7H441iNwQrMHGD6isKHwpD1Tkn3K4yuOVJx6cfjUi/eyDljjJUdPSolzn37d/wBKmUsu4A8YHfHfmuokczbsYIbJwTTeNuM4POPp6U7avznG30CnkUjMflHzEdR6/jQIibldzAE/kT6Uu44OODjoetLgNg78Mw3HJyPwpu3+NuMjJbHWgY/jhsDJGA3of8/zo+6rEJz2PWkXHyYHzZzuXHOf8/pQOxGTjIAGMfWgBn3o8DleoJHSmMgXGB8rDP8A+unj7y4H+yRjj8TTMbc7fmwcHb+mKBFC6JjvLKToBKB+dfQP7P8AfMq3gXqkysPwNfPeqsqrG5PKyqSOfWvZfgPeGPU76MH+PP511UtVY5q2x+oH7JE0Ooap4hmt2B86JXXH0wa8w/aWutT+3XloxkUqxGOaxf2Q/iTH4J+Ksmh30wij1VM2jSHCs3dM+vpX2l40+GXhb4mfPfiW1vU4MkDKko+oYEH8qyfuT1F/Ep6H5KXHhRppmaXcxJ5zUbeDYv8AnmT+FfpJq37HOlXSn7H4pvrZewktLVyPx8qufb9idFb/AJHmYD3srcf+yV2fWYnHKlUS0R+fi+D4+nlZ/Cn/APCEoRkW7H/gNfoGn7GEK/8AM8zn6WtuP/ZKuQ/sdQLwfHF4R7W8H/xNNV4dzP2dTflPzwXwWvT7M3/fJqUfDwzcraMf+Amv0R/4Y7sNvzeONQX/AHYYB/7LUf8Awx/padfiBrH0C24/9kp+2h3K9nPfl/I/PmH4WyydLVv++auxfB2ab/l2YfhX3z/wyTpC9PH2sf8AkD/4inR/sq6TBz/wnesSewWA/wDtOp9rHox8l94fij4Oh+Ccmc+S6/TNWW+E89vHgSXMZ/2Sa+6z+zZp0I+Xxfrh+lvEf/adN/4Z5sE4/wCEs10/9uUJ/wDadJ1Jv7RpywX2T4Rt/hnfi6ieO4uXZGyN2TX3h+zTcajY6baQXYcELjLfSrFr8BI4GBi8Xa6R/d+wWo/nFXo3hHwWng2zmupr+7vnVTta82AjjrhVAFZzqOzvrf1/yLjTi3zbWPP/AIm+Khb/ABSSCNvuwYbBr5z/AGjb5NTuWDHOYCDXWal4n/4Sn4qatdRS+bFA5iDjoSOteU/GzU995MxPEcRFeVO8sRHyR6u1D1Phbx5P5niApjIjRl5P+2a55fvYA+lafii5N14i1BwQQsxQfln+ZNZq54zux7rkV1yfvNmSVlYkTK/3v59//rVKCQOv6e9RrnGAMjIP61Iq/wAXI75GMdagYpJ6kg/09KXAXJ6dehpQcEZb/a4WnLnb3zg/dx1z19qQDNhXccEjqeKZ5eG4UjAHAPOasKqs2CRtIwdp5/KkMbfdQlHGSOhyKYiLy9u5Q20g7uacq8A/eOOg6VJtXITyy+3nI70CPHPKoTk47UAMUblCZO7bk4607nqNoOMqpp23zMgLuU/dBPI9eaVV3NgszbeTxQBHt5+XDA+/U96RjyF6D6dqk8kMclcZJAK8fpSbQuNshA5+8M4oAiZW74J+8QO/SlxwDjOOcjqRTj8ygbg4BAwRSKu3qR15we/pSAYybsfXnmmMgZc9Tt4x61KVOOuzvgjj/wDXRs5J3bmHOAOo7UwIPs59DxyaNi8E/KByKmZDzyeTncw6E9qTb/BuBBGMk9ADTEQ+X8p4znk8Uu0synvnH0qRgGxks3Hp0NLtTnoxHrkHPpVCK5j+XlcN0yakWPOBuA57dakCjqDlc9FPX8KXyxuAYZPXAAoAhMYx97Bz34PSnbSWwDkA55FTBRtI992cjpQy7S33uDxu/wDrVIyPpGcY+6e+O9PK/N07gcn2pGXg5wOMZY+/pUrKMnsN/wDdHpQUNXIU4GeD0p/qTuwCB69qaPVupHQgj+VSlQpb5QRnOc9qABlKtjlc8E+p7UfxbS2CeR/hS7SpwflOe/f9adxGu1SrHOcntQIGAVj6nr6fhSYB7c9AF70L+74DFc8jvkU7jcWBG8HgsfzzQIUsUxk7WXgemKUDaP4W4/I0xfvHG5VY54Oc0488DcR/d65/WgAOZNwP3uB81KGB7ZJ46Uh6nJ3bTk7RzSnLKNuB6f4GgYu5hx+A496TjdjG4fdB/wAKXG9e2cdwf0pNx4wfkxxtHT60CB+FA5C45zxTlXep7bjjdScFcL8w6A+maazDDDcdy87uCPbigBWPABHy5xwaXlVO5cggBsnoKbwW+VstjO4g/wAqX5cdGGevPpQA5m3Z4KgnIXHUUoyoP3Tnj2ApgZsqVYkMMFsf4UvAXKqxGex6jvQA5mA6cLgYHXmhVKD7oOB69KTlW4PGeODwce3elLfKRjHPO3rn8aBiMBle3Un6np/+qkj4PG0nNDnaoZTg/wAWP5UjFVz/ABEd8Y5/rQA525A9RkjOO9MXLbi3OPT1/wD1UrZfAU7s8t24oZgGHLKxH3tuMfhQAp+8cAsQMZPSk+8rADjknPp/+ukxhlIyxP3jnr9KcGXdkBiSM/NwSKBC7VPZjnp/jQo6gjI64bilQ/LkFi3Yev14oH3QOrA5+Qcde9IYm0MpG0+mc96TbuIXGR0PalEgZWBGcnjqBn8TTcbdyjOd3Ref0oAa2Ci565C5Bp3y7irc88eppVK7CQOpBwRgdKQfNxjAHYHgUAODBivOOoA7YzT1Hy4HzKOm3p9aTbx1ES55HXPvT8luDnH8O0f0pgDYUkv8yt/F/SinYGBwWGOSeD+VFSwKUfynAIPHY4p4zwSW9T0x/wDrqMNtTDjBzke/404Y25Y7h2ww55pDF2nbkgcZwPfNO2/MxIHpnOeajYcspUgdsDIxTtw242sD0AFADm+Vjt5b27c0v8WT07YY4ppO3PLcdMjpz3p2/wC8Aef7oH58UwEkXK8jJx6Dmjlu4IwPvdO9KzBeTtwOST/hQPl3Ag9O+KBCqvyHAUHoDQqj5cdeBg9zQ3y5JVVGcZPpQrZb5jt5zxxu44pgIWD5yQT1OO1G7avXBx+ntRyqqcbfXNG47juO09+e3pQA7hWwQFw3PPtSEk8ZyOwJ/nR1UZBBP97njigthgB1OTjH6ZoABjbg+h6n37Uxs/MM5HWnbv3YOe2PmOfr0pjMFOPXn1ApDFboD0YZznpSfeAIy3bHQfWlOdoPTjHXOB3pu4qxCkonU55yKYgUheMkdffApv8AugYyc+lSbSBxkp1z700kqOv7wcY7570AIw27s/dPB5zSfd6ZPt707ltxByD6dPrUZ+bHAc59ORx0/KmAzltw5LYJbNRNxnOSM8HrgVLvEikoSW7/ANRUKthj82R1+YUAIMpx8xP93OOKbyrbSPw7GnthgDjzCvGe/wBaYsZ2bh8wz93GcUCMO82x+ILbAKiSJlwTXt3wb1P7XZi0Y8xttxXiPiYC2msroKQI5NpPse9dx8M9fXQfEcfmNthmI5zxXZRkceIV0e6XVn4k+HPii28T+GmmhnUhiYwcH619M+DP+Cl2saVp9vbeKfBv224UBWuIX2lvcg16v+xtpfhjxjot0NQsrW/uERSizqGGPpX0LqHwX+Hl82brwtpDt/tQKKJ1IczUkY04VJQvFny9b/8ABSzw5JgP4A1TJ/uOuP5VbX/gpN4WAy3gbVwP95P8K+km+Cfw5wAfDGkge0YH9ar/APCifhkvP/CL6V+X/wBelz0OsWJ08Z0cf6+R86n/AIKVeEVGT4G1od/4P8KY3/BTDwev3vBOtD/vn/CvpD/hSfw06f8ACNaT0x93/wCvSH4H/DN+vhjST/wH/wCvS56H8rF7PG2+KP8AXyPmh/8Agp54VUkReB9YP1ZR/SkX/gqB4Xx83gfV/wDgLqf6V9Kn4CfDA9fCmk/98/8A16fH8CvhnGQV8K6QCDkfIP8AGlz0P5WHs8b/ADL+vkfNC/8ABT/wruIPgfWgfqv+FSL/AMFQvCOOfBmtj/vn/CvpV/gb8NWyW8LaT/3x/wDXqP8A4UT8MV/5lbSB/wAB/wDr0+fD/wArF7PG30kv6+R80XP/AAVE8LQxl08F64w69F/wrAuv+Cr2jI+Ifh3rco9fMUf0r65X4K/DRcf8UzpH4oD/AFqVfhX8NrVdo8OaGg94Epc9H+Vj9njOsl/XyPHfg3+11bftDaLfvpGgXulS2x8uWO6wTz6cVsr4Jvbmd5UtyrOeTivVNN8P+CfCu+XTLPTtNL/f+yqqBvqBXRWupaZcRZhnhYezCsKkoyVorQ9CkpR1k9T5Z+I3wqe40GQzx8xgsOK/Kr45aOdF+JF0AAqt8mccZFftH8e/G2keHvDF0WuIjKUOFDCvx3/aEuo9R1gXgH7yS4J/A1zKKjaxspXkzzWFS2V/HK9Sak2nK7hsC89c1CNy+2Om3rUiMW+QsdufmzxwfetwJOTtBC7h+lAwVJOCMgkr1pQS2M8c46Z47UNgKd52jvt45oENcMMnqVbAXFJtUu2ACcZ29xT2UDDE5OeQPp0zTGG1SjHIXABxQA5FBXnkrgnjkYprDO05PXg+3pTlXdk78qckYGaQYbO0DgfdGeKAGMzfdJDKv3sioc7mw3yt0welTytt5Zcjvt96aFVl2l8AcE+9MRma5H/xLpmx8y4br6V3/wAE9S+z+K5IycCeJXFcZqFs0ljcJwwZCAw78Unw91g2OraLebsDiJ/5V0Una5lUV4n2Bq2iTapZQT20jwXluwkhmjOGRhyCDXsfw9/bo8XeDbWHS/GXhdPE32dRHHqMZCylRwN3rTP2adO8PeL/ABNp9nrbqbSQcjdjJ9M19x2nwb+HVigEfh7Sz/tSAOT+Zq6k4c3vI46MZtPlZ8zw/wDBQrw6VHneB7mMntuH+FXIf+CgnhHq/g28H0Zf8K+jLj4P/De6z5vhzR2/4AB/Wqn/AAof4XHn/hF9J/X/ABrPmo9mDp4q+jR8/Sf8FCPBA+94M1HP+yFP9KZ/w8I8E/weDNUP/AV/wr6HT4GfDFfu+GNJz06f/Xqdfgr8N16eGtKx/u//AF6Oel2YvZ4ruv6+R82yf8FFPCcQ+XwNqZH+8o/pVWb/AIKO+F06eAtRP/bRf8K+nf8AhTPw4YYPhrSSP9wf41G3wN+GjcnwvpJ/4B/9enz0v5WR7LGfzR/r5Hy+P+ClXh6M/u/h/qH181f8Ksxf8FMtC/i8Cakv0lX/AAr6XX4G/DQcDwtpP/fH/wBekb4FfDM9fC2k/wDfP/16XPR/lY/Z4zpJf18j5u/4eaeH1GT4I1QD/rqv+FQyf8FPfDynA8Dawfo6n+lfSq/Aj4Yg8eFtJz/u/wD16mX4I/Ddc48L6SP+2Y/xpc1L+Vi9njf51/XyPlq4/wCCn2j7T5HgTVWbtvIx/KvKPiZ/wUC+IfxKs5NE8J+Ef7GS6/dtcyEu4U8HHvX3+vwZ+HUXI8NaSPrGP8a0dP8Ah74J0qQPaaJpMDjoywpmmqlOO0TWNPEX9+Sa/ryPiL4R+CtW0fw+l3qEEizyLvd5AcljyTXkPxw1IQzakS3Yjr7Gv0Z+L3iLw34d8J3RmktY5NpCrHtz+lflB+0F44tbqW+aCQEOWxz9a5VG0uc7+ZtKB8xmb7TNdSklvMuHY/nipImIIxgEf5xVOxYtbpkkFiW9ByTV3bjG7AHbnrTLJIzgjdgc56Z9alXAX+HO306U2PgdG4I+nX/69O7ZOfwGO9ICU56c9QAV7mk2hdpyCzZwSMH3py/Kc8g8n5hxS4OQuM4JHXIxTBgue2QDwOKQ7eVBATPIPf6U5VKsDgq46ZPGKc2VyNvXoccHNAhqx7QBggjnavIxTuR8qkLx8wHQfWj7y7se3yHIFKc8qCMYzlhTEIqjbvAwvQBfSlZcqF4IB6Y6UuPmyR+8zgben0owCcZzx0xg5oGMZTtzyzHgN3FJgbevbGR1NSnliWBLf3gefoaG3EsDzz29aQEDruY7uORjsaGjywyBnP8AD0NS/dySN3IPHrTcYYcH5iSvNAyPG1c4xx/Ok5ZjkYY9Tjpint6huSON3AOO1JyqjqBk/MR2zQIbtXoFK5Gfx9aGVWVQQoBGApHf1pyrnjeMDj5uOKX7q7toGTkknqfSmIZtI3AkqT37Uo7PhTgZFL5fy5AkUDoMZzR0+8ODx93oPegBPL2ZG0FhzwP1pFU9Ryuc/KeSaeibgSM5xk85A54FO9G6dy2ePpRcBNpOQMEnHUdDTP4sjgn+HpUm07fuluMjPX605m2ttA4B4H4UDImztIyc7ee/elK/Pnvu+lK3TnI44xjkU4nHfA3H5T1NIYisRkA4DZ96UKPlyAP4Rkc880i/Nkc8jGOPy9qk3Fcldo6f8B46UAAxtGNo65yKaq4AXrjkL3pVxu5AIX72Dmnhhxld/OODTEIrEMTghj/nikztXkj0Vj1NG0Bee3BBP5CnN8u4sN2OevA9s0AIwIcAjkcZzmlI3Ke/b5eKTaN2MNhuQM8gUpUNnjbxjODQIGHmNg5B+7x2FJ94HsW5ztpWVfvAYU9A2R070ehYbR26gmgYNhlBOfu8H+tJxu5GMHA59ulO/g43BscBuabu2tgHjr7ZoEOb5gFJzg8YpoU78nk5GMfTvT/Lwq/Lj+7npmmkFUIORH/eA4+tACE/MTv3ZHPbPtRyxXOfQNnP6Uh5JG7eAM7sdPwpRjkjae2AMGgBdx3AnaCvBxxmlX5STsyRyOf0ppkTr8pfqSe5oyMFjtJHXaeTQA4naeQEZf4QetKvOS4BHU55/ClVjvOCOWyTjrn/AApFJOMBmA5+Xpj1oAJG2qcEBvukKOPYUxlyQcY7DvTsmP7p/iyAewPFMBT7oIc9MqeSaAFchpFUrgEZ6Uindlj643D8ulDZ3Jj5RjBzz+BpNw6MWT3x0oAfvPmZC4OcbsdqRM5YDB65YDjpQWO0Nvxzj3x60u5DtyQQw42ccetADt43N94ADjNJ90nODjk7epGOlC5aM8k+gxj8aasmG7F24AHBxQApYLwCxXHJPAo285yMDnOeRQ3+rI5z/CG9KbuCtt4VsckjigYu4AgqGAPtml3Bc5I68DPNA4XCsGJHG0dAKTzNz4AwSM8jn86AHbieq8ZPbPWpV+TjdgZwMHmok2rkg4KnryQtL5g2kxjC92HOaBEwA27f4c/ez196KRcqpYEMDye+PpRUsZVjypHJwB1z09KfjdjqCR94qMk1GuAox8pxzxT1wrKzLnPTBzQMj5VhzwDzj5RSrlnORkY56Z+maTB2nKE5JOTz/nmncMwyCRnqB/OgBG7c89Ryfyp6nd13YPPJ/WmjbtHOeSDn0p2OuRgeh60xDmYLJkcnAHFN3FlOR/vHv16ChshvunBA6DpSElVJHyA9V70wHcLuI7cfMMmkLHJJbJLfxdf/AK1DA7ecDngdqWP5pMj5AvHrSEI3yyEgBTnpml2grgjc2DgH19aFVflLc880NhuucN+QpjBmLdeBjqO3+TSHIVt2R75zTuqkEjO3JHrScKxwvGOO9AwZvmXnjpnOP0qP7sfcHOep5/xp7Y2qMcEDqOnNIygnORnOBSAaMso4Gc5LelOUkZOc/wAJNIyjaQfvfN/KhlHGPmHfJoANixhlC7tx570Mu4DlmBJ5PUUBRyAee4PAFKxOwt15wc9hmgBGHy5LLnoTjmm4Zsckkc5J7/WpVU/Ljrj71RM21sdBu4Pc0xEbMFY8AZ43dOajPBAwfZjVhlLR7dq8nnHeom+Xghgrdc9fagRD5Y2kA+oA64pPmAGfvAY+U9vepVj3yZB4xyV78UzaVYn5uOu4c0xla8tYtQsXhkLFW4+YZwawI7iXTV+y3LESRcwzdmFdRLhWxgfRTxmq15p8V1GEkVWjHdhg01JoTipaM9m+Bn7UWu/DuEfYbpkk27c5xXq8n7Zfi+/k3yalKC3/AE0NfF1voYsSz2s8iZ/hcZA/KrIuNVjZQs0Z4/i3D+ldca0be8tTjeH191n2O/7V3im566tMP+Bmoj+054nbOdXnP/bQ18gJqer9p4R+Jpf7W1bg+fD1/vGj20H0BUJLqfXn/DSHiE9dVmz/ANdDTW/aO8QN/wAxa4/7+H/GvkU6tq//AD0jz/v006xrO7G6PP8A10FHtodh+wl3Prtv2kNfXpq03/fw1BJ+0j4jY/8AIXuP+/h/xr5IbVtYYfej49JBSf2nq4xl4/8Avun7aH8oewl3Prhf2lfEKc/2vP8A9/DTh+014lGMaxP/AN/DXyEdS1ZuBJH/AN90f2hq/H76Menz0e3h/KJYdrqfYH/DTXibp/a83/fw09f2kvEUv3tVlP8AwM18ffbtX6faYgf94077bq/GLtAOvBNS60P5Rqg+59hv+0h4hZdp1KQr7saSL9pvxLa8RanIB6bzXx415rGDm/UemAaTzNUP3tRbHfaDWUqifQ1jRtuz6f8AFfx01HXo2bUtRaVeu0vxXgPivxKfFWsB8/6NEc7vU1z3lSTcz3EknP8AF0q2kW1QFXKeijHNc77m6tFaE65Y4HJz1zirG8spUcjHJbpxUEcZZuBuLfw+lTqDt+4dndaYxy4OePfFOX5d20/N275NC5bvuwMnBxSjg8HJHocH60AJ/FuDY5wT/e/Cl+6AVHTpg8CpHUqVJGcDp+PFNZdzMCPmPVVoEMbCl+ApP5+9H+zvOOuDjj605shM8ngnqMD2pGjLYyDwOuO1AEXAUnAXAzhehpCpYfP1Axmn4G3BAx+R+tNICRryVOe/QGmBEylVJDDkdl61zOnbrG8uLNjtKSebF9Ce1dTt+6DyO/tWRrGmm8KvE225j5R+30NVF2E1dHtHw8+LF7oqQMlw0c0WMMDg164n7UviVkC/2nLjpw5r4uW41e1ODbgH1DjmrEepa1xh1TtzIK29ouqOb6uujPspP2m/EIyW1KUn/fNSj9pzxA3H9pyj/gZr40/tLWTkfaI8/wC+aF1PWlXPnR4/36tVo9g9i+59oL+0tr566pN/38NI/wC0pru3jVZv+/h/xr4y/tjXF/5axf8Afyj+2Ncx/rIv+/lV7aHYXsZdz7Bm/aV8Rr01afP/AF0P+NVH/ac8TdP7YuP+/pr5IbVtZ7vEe3+spv8AaGsN/HH/AN90e2p9g9jLufWv/DT3idf+Yxcf9/TTv+GpPFXT+2Lj/v4a+SP7Q1bbnfHgf7dH2zVuvmxj/gVT7WHYr2L7n1yv7Ufir/oL3H/fw1L/AMNSeKf+gxP/AN/DXyGt9quP9fF+ZpRqGq8Hzouf9o0vbR7B7F9z6+X9qTxPj/kLT/8Afw1HJ+1B4mYf8hWbP/XQ18jLf6qTgTx/maPt2qNkm4i6Z6ml7aPYfsX0Z9E+LvjtrevQslzqEjqfVya8G8WeIJ9XmaEP5jE8nOcCs55r5+JLhef7oNFvbiPlcn+8SOTWE5c2xtCKhr1JLeMLGoU5VR0q0nysMDaT0qONRwcBQOMHoferCxlR2BbtuqCxyr8uScFc4GKl27cKCc4468U3nbjr13c0/ACjgZb/AGqQCr/Fk5ycCnKAcA5YbeckjJpdp2hfqePpRjOVHJ7H19aYhV+9gjII5IFC43AgkBenzY+oFKnLEZDHH5U0HDAKVPoaADzCGx0Oc/Nx+tSLk5HXPG1jkE+lNVfkPykgjoacDuULweO/pQAoUYzjAA+6OCBRyucMCRjluv50oB2nqB06c+1LzzwPSgCPaF246g9zn60ZA6ZAznA6A09d27IX/a9j7U3b8/XOBnHegQxV+YkcHqd3fHrQeMjJIx/Fyfwp/wB3POfqOCaRVIyeR34NADNrbmIbOOzc0jYUbRlcHPXNSFtuF3cnjNIF454G7BHv3NADQjMOD/tfMOuKYTuf5QQ3XbjipWHQcFuxzx+NN+9nI4Iz/wDWFAxMhMsCcdsjkUsYG4DO3nJZTxSszbTk4Hfv9Kb/AAryMdWUdD6UAKq55wwCnO89acqlOpw+OvbBoXAYlypY46HFK2ewLAHHv/8AqoAQsOh5VuckDJHtRtKtjcSenXvTvLIB744wRg0HHOOTnG7vQMb91TgkgL2+tIQQ38WMnvTuP4uxyF7kUvBYlRwDnB6igA4+UHOO/v8AWk6DGT2G3OQKXbkcrnIOBnGad3Ygg/NxikMa8jMwOAcdKFXghuMY6/qaF75Gep6daX7w6HrnJpiAscgg8dAO1AHp8pPXn9aAvzHIwcZ49aXndj7x6+5oEIzFs53Y7kjOfpTtpOSvDHgf/qpFxyR+APWnYz659u9ADX+9hsnt/jilx33YOMEml46n5epP/wBb/Pem4O45GMdeM0ABJ2qDwcdR1po3dPunIOe3TvTtoEYK46dz+lNPQf3Tzj1oAccMNuW49RxQyhlYhuc/e6fhSuhKgY2k8A+tBOFII4x1zwfpQIRpAw4ONvG0d6RSOGOQV4x060rDGDgFdvBFC5BGE3sQCKAEVxwTlGA6Y55pYztChvMz257UgIwoAzxglutKpG7dxgDPNAxu4tgMSynoMdRT9o25I359hn8aTcV4fO/J7Z70L82FP3gaAFWTeSCMHpjpnj+dNHQKSc9sdqVgPvD5htyTjnOetJ/DhRwOnvQA3fh9u3HbdjGaVNq7jlmXtznJpZDhm5IOBjd60jfKrbcYHII60AODSdTjB4HHNN/i53Aclgwzg0MDwchjgn2HvSjuePmHbqBQIUMfNzszgZBz0pB8ysSDt6tjp+FCbQwHUAHr3oXjb05PJFAwDeWnyHPrgc/nSqoYnALKBnaeRn2pFUtEdxwM5/XvSbvL4+Xb/DigAUn7yj5884PH4e1OO1t3J3N0VTilVSFYb+e5/pRjIxtAGMj2oAZ5m5SMlQMdeuafvLd1wOrLx+FIdu0hsBWPT2BoGdu0ptGcbR/OgRLtK5wNq9sdKKaVz1B24wP8aKTGQROPL+YYboQwA+hqTJXO51HGBtB5qOLLbQRzipFPl8qFBUfd/nQMYxXy8ZXHIB5/xpeCuC20+2ak/wCWg+UKOTgdxQTlgNpyOcA0AMJHC4wQ27C574pQc525K5yeuRSliYyDkAY5HNJ1Yk4ByTgigQNhc/LkMB1J/WmrhjzwcY6EY57+tI3EmflJ/X6U4napXBbdycHPemALsHylSGI64ODS8fKZMsT6A0m4bSd34AfpTs/N15z6/SgBdxyWbaR94HofypN2VyzZwCePXFObAZj/AAjuOtNYHOAOPpjHvQAKeuVyMYPzCmqOw5+bOQOKNobc/GMnk/WlA29uc+lACg79q52gf3WyaRssvBb2wRzQq/uyfukcA45oYbTsIxk9qBguNpGRjr0PH40Kvyn5ApAwO2PpRIhZl+UZI+UDoaMKVAHHPIx3pAIrKqkB/mByc0K25SV27sZ6YFGxdx3ABsdO+aRmIJJ6EHHqKYDhhlwAHB79MfrUS78E5Tocf/qqTaOTlQ3A96a3uCQvUcc/54oEQ528/Kc8Ajg59KTcdykqcA5znB+uKl2hlIIJHqexpu8qAcEDGOmc+tMCJnPmbiPlbgfMc4pCNw+YhV65yc09nGCuWwePmpjYXdxhOh9hSAjZt6tyAMepamyg5B2bdvXHJqZl84A8RleeOh9BQ+W6c8YLUAQEFfnGD/Dz0qMD5iBkDtyD+FTLGY+Mbsfwt0FJIm+MLjK54JGPxoAh2nGRkN/EoGDSlFYhi2F746D/AAqQqezZGMZP86BxvwDvIySP60wI9hYn5t3fPr70BCw+9tOM/hUnBYDDAHHT19aVgOchiD178f5FAEO0rk55zyOlO27iBnqeMdamYAc4wSf8imlR/tc8fjjmgCARnsSeMZx1x+FLsLc7sLn0xj9Kk+T+5xjA4p3lh+SH/OgCLb3LgjnnP9KVRt+Vj+fpUq/eBwx64yBnPanKvI4bjmgCHy8ggnOOBz3o8vy+GYZBwe+fepNm0seh7D396TaI8YXAz1A6fSkA1VKtzx/vcfpQqnAwVwOxJ59x+dSBVXpkbuAp6Uq4Tk5AxjHbPt+OaAFVWZmVsr7hu1SIFyC2QAeozn8aauOnzAHozU9X3ZZuV6j0/CgB/P8AEykDn/61P2nZgjIxnk5OKT5toBwQRwRxml3H73f3GD9KAFbDbSMqT0+mKTHy9ADjk5zinMCqnn5RwefSkxub06Z9BQAzaCRkA9gu04+v+fWkZQoXhcE4wp/pT+WBzuPvmk+6o3cAf3h1oAj8vapyjNx/EKRY22lQSw6f59adnbyD3700nGf733R9KAGlVGGG0dt2OlQ7NwIJ3DGePyyasYJ+U5PYlTTSvykMhPYfnTGV5I9zAlf/AB39KQ2x6hgTjBB9fSp2AbHBI6Z601o9qjls+tAiDyyu0Bs+5/U5pBGxwPrwankUDcCdp9KbtO0kBvbmgCFoypAJ9OeffFIq9fm+gx1/SphtHG35c45+lJwwztbp2NAEZjHA8wYI9enP09aVSf72ec0/jbzuxxnn2pzdcbW9RQBAw7hhnGNoPr+FBGTkZxnrnt/SpQucj584xn+tDZXkBgOmP1pDIRGR/F1HQGjy2OWx0ONoPrx6VPtGeP4jyo7UmF44ZWVh/hTAhCkKfvNxS+WDIWJC7SN3J6VLt2rwSoxycU4pnryO+09KQEKxkLnOevH/AOunrGOSPkJ46EU4jcwyuT2Vu1SooX5iWGO9AhvlhVIDAdBjI7d6kVRgMRjPQ4yacuGySQR9OfY0sY5HDc9fWgBY325D7eR8wXjFO8ssoB2nPtjPtTUHz/xccHjr6A0/c21eCvOOe9AC4+QqAN38VIxyvTB6AEdPWnYzkY6H6nNLyMk5bcPvf7NADVXyz8nQ9QvSjBb5RhGbkheuKcvJ2YAHU/SmjcOfrj1PNAhRjgZ2Nn71KG+Y8hl79uaRejDsBkCnfdADLx+ufWgY5hhsAqzY554PvQvYc8e/SmpnjI4/QmpMFc5GQeg6UCEZcctwVPAHFMOOpOeeuOTT/utnr3PHem8q33sHGfagAIKuMcNkH5fQ8U0/KwBUrjpjkUu4Nxgjjg+g/wA5oZiAVBYLnjvmmA3K7cbvqSOlKPlbk5BGFC8j/PFDZYnAwTxtPtzxSHbkAjAyTz19qADagxlMAnBOM5o2jcQG3A8gZ4FLuUHljjPXHAoG1vxORxxikA3CqwbIBJ4UE8U7OG+Zl9+9C4ZejBm9v0pc/MSVBPYUxgPmY8oQDnkEU2PG4ZXjH8PP40px83G48AHPIpS6hixyDjHzCkMTjcnGccFef8+tL8oKkbunpjmjlsfl159/5UnmEYJGDju1AhWI4BLrjuBkmlP3uu7P069fSmIw7k7Rz1+tO3FSOxX1OaBjuOP73Y+5+lIw6ZIPPGR+BNC/MTzx1J5FOz838Wenrj0oEJxu9l9OQKQjK4KgDr17e1Ko2gE8Y7dDSYJxnBIPWgBGzyThj6g4o2lg2BsAHbH61JyW3Fck8Y7imbTu4Gd3bvQIGbd8xG4ZzweelPVTtZvunH3aDnAJ4J4GfSm/d3DB9u9AxWOTgdMYx6e9HqQMjGfQflShSzAdTkdfYUjMW564Pp1oAGzlQDtzx6004GMHI75zx6Uuz5SAuM9setHPTv1+nFAh0g+UMGwvfnNNDbSOGzj3x7cU7aSqnqe4A7UjHdnHH8RP9DQAcrj95kk8+1N+6Aw3E9QG46UpJ+ZiApbvQrZZfu9hQMX5d21UC7ffn8aMbmAI3tnrnimKw+XIAx1GO9KoG1mwowM4oANx3YZtwJJO3o2felZiqjp7Y5Ao3Y4HVR3/AM9KRF3d8dyaAEb5SABtRudvU4Hv2/8ArUpXIJyBnkHOcUZVskdMgknnNIMSZx1J4/wNADt258ZBHXdnk/nTQCeMsD6kgD6UMQ24H5ieFzSYDdF6f3eCKQx3CsygEjoWJxn2pu0FjnI5IzjJ9h9KcyqWAJVl6HPUmlUnccDaccDpTEwXj93tBzyNvH40gI2kAgA8Zbn9KerbeVyQOOR1pNu1htGHPXP8qABVKIfmxj8c/hSHDLt+Xk888n9KVCqYz8rdvejCqGOMFu4oAEjEbbSfMwfu4xmk2s3zMu0Mf4af907mAXacZxSNIXx8g/GgBomYsoIDHPIf+eaUMvOAC46nnihsSMxccgYwRQcD5cFV6hhzmgQ4xgfdk+THAH8qKeoKknHJ9O1FJjKsY/djb8zN6mn7l3YfOM8DoPwNRx8rtI+bqflH51LuG0gFQQOMjFADn37enU4Kgc8Uc56kk9VUdqYFCliFbJwAueDjvSjKghR83bcKYAy/KvBweSBzz2pdvHHA/u55pNp4J3A8Dg8E0Ebc5OWHG7rmgQmVaQAcADjA5NIgOB7+/HX2pW+dj0PA/OlZVGBjqcnk0AP3FMbSzcHsPzpFUqf7xLYyTwOPpTdg28Dcp6tnApSBu4GRuxwcYpFDtgUE7Vbt1/Om7RjnLFhkkNR5Y+9g7STnb0oI+UgAjI4APNMQH5h8vK8/Ow/WkTDMCcMSeeegp3lneWUY44GaT+I4yVBzwec0AKo/dHGRzxznrTOeTxuHcg/nz1p3ljuuSRnr7/1pNw8w84J5+YZ/CgB/3cjcUPYsMjn+VG0bTghONuc9PpTSpCpgFevA70bQyryWPX6UAAU+XwwY55LUgVSwVS2epK9vUUGMOxJXnGTQVHTpgce/fFAhWHfG49wxxRtxkhV9SMn8BRsALZGM+hpNoQ5Ax3GR+FMBgTd0bHqfelYHJGABjHXAPbNGxWUAHd68mkKj0JPoDwRmgBMKMjjK8DH/ANemDJ43Z9sYp+wc46NyNwpECrjJbA/WkMYyrldrLtPr600xqrDgbjk7VNSmNWwu0EZ/LvQY0YNkdQDgcYoAh2guDliOvTI47Uzy14xkBhwMHFSmMDdnnjt36daR0XODk4GDk80ARFVIIIx0x8vFKUD5w/bOG7fWnbQu5cndjndQI1b7o3EnA3HnOOaAG7Mg7m5wDkjP40Kg3clVP0I9/wDP1pzQrxgDaPf9KPLVV/iz2zyPrTAb5ac8qwweRkkfhS4XBXeMgZ6cCnLHu546Z6ccmlZAvUc+imkBGYxu+8GOdvP05o2q2PmQeo5p3lk8lcn+fUZp2PbBxgkUARqqd9vIJ4J9acqjdnAPHqeKXaWySPr6880CNRk4Oem4GgBm1Wyvc8A9QaXamMADb2XOCPelb5+GG7tj1p20K2B26ZH6UAMMY3Nll9OR/KlCdF3JyPxpfL2jIBxn7o6ZpNq8D7wB+8B9KBCqrLyWAyOuc4p6rtUEE4J+6eCeaaFVeCMZOACOnvTvL3K24Aj1z39qAJCu05IG5e+eKUAcbTww+8wyKbsAHAJ9RnpSt8wz97gEDmgYu3cgAHzfQ8cUu48fez/nikZvm4OduQd3pSKNqkjhgMg460ALk4O7kknoOfek29znbnAA5xzTY1zGy/e/THtSt/rAME8d6AEk/gDN8vXkYzzzUbMOuMZ4wRipGxwAB6YB9e9MTGM5bjC/pQMOV65A6jp6Um3+Ek5xjoQPX/GlYbuTjPJp5jC5BO3txxnr/jQBG0Y4I65x3P40jRjnLgnnr+HFP8vHPJA4BHJoaNW4PJJAOffvQA1s5PKnnrTFjGeiY6dak8vcCdvGO4pPLVvkPPb36UCI2X5jjA7/AHxR5eM88qDj0NP2L1yRkZA/HpTRHt/h4yRwaAGfxYLdx7CnY2kDKceppdoUH+Lvwe/pQ0a8AjPqQOlMBpj90PGDzS7QzBgTkt0HrS7RuPy4GRgjkD3o8sP1AxngA/rSAQIV3buO/wCVKFXc3zFjnGPXjNOVR/CN3bLdqMbsFgCAAevpxTAiVQI/lOT6bqftXHJJGcYPGM08RjbyDkjJwaeqjgBsDP8ASkBCqrn7+TgHDCpAflHzqR3zTlTceg5xk04xjjCY74A/lQAwINnJUDu2P84pqqitnJKeoPSpTGpyQCCT168UbDycj5h07YoAjYHkHK7efapFX5RhSB2yc0jI2wAfMMd85p+zacAduW/pQANg4H3TjbnOcUpPfsTwvXpSrlu2T1w3ShjwQfvEEcfnmgQctno5xyc1GwLStg55wD05+tPC7ipP3R04yaQ/KxyM45HHQ0AC/Lg5Hy9OMZNC53ZySW4POD+FCqOcn5cck8805QdwJxnOc49qQCj5Rtbj9MCnKC3bNIG+YN6joRTl75G5T+FMYfKF+YcZ6cj6DNNOOMlR3JPUUowOvHXIx6UAFVwAcfWgQhX5SMgBumaTbuAyEO3/AGqGw2cjIJB+gpMAfNtPPzEYpgBUbW2kqMZDLz+VJu28c8nAO3264o2hlAwrDB4zSDHljJY5GMbqAFVjtYcsfQjApxU7gcrj16j1pmRs+Y7lHtTuuAAu3ngdTn1pDD5vMJOD9M5+lIqldxAYe5xTl2queUJ6LnpTWUdTjOMbckUwAZ+YjI7glPwpFG5QfmB/vdaU4VeSRk/dz1pGQqc4GTwSDikAegB9MHGen9eaTbxgEfiKdGo3AjIOemf1xTdpVT82M9CeaBi8cENkDk+h9BTtu0qTj03YpFYbiwGeQQF74pVXyzjOeOOTigQrKM9+OAW70u0Mc46EKdp9qFHzjjn+9uxQ3ToMduMUAL+JHBAyM4FGRzzzjjtj3pFJKnB4PXmlZjuUZ6nv+VADWU8EHPPJx/U0pIUHOM+vrSBuuCG7hcU5c7gO3fnOaQDdvzDGRnoG9KVW5P3lH8XApVJCg5BPBHGKbk7OuD2x0pgDfKxyuDnLDsPxpwzuPGCf0pMFW49fT09f896TjIAH4d6AF58sd0A5DUDqTncR14H50bNzZQDnj8cUbuh5wTu60CJBjcAu0D3P61GMEKMDAwMjjPv+nelOQAMNjHOO1BYttHygnrn+WKAAr83ILHHUkjj3pYwCwIJJ6naO/wDWmDBBAZgM9c07eGYZJ7ZX1oGG7dtyWHYseDR8owdueoBbkGkXDYO3DbcksKVvmxkHOOQDx9aAEb5pCG2tztyp64HUUjcclQMdcn+tKcs2TkEdd3btxQzdRyuD0Bx/+ugBHbcxbP8AD9B35H+e9DfKT94exXPFIfvDlie+R0pzttyAPk78mkMHVuhyRjhmGP0pMAKfnxzx3yfelxkuu30xuPFIz/NnnB4+U8fSmArKQucLs7nHelChep69+opG2rtBGAegPehss2TyeoIoEOjXbyQrdtw4AoBC9SWB4BPT/OKYygFjtyo7Cj7u0AAnPTOMn/8AVQA7+ENuBHU7Rk4oT5m3L8ox+X/16ApI5HbnJ5AphUN930JIb1oAkjVcMrHcF4yOR65pNgDE7gCOCVOMCoWUqM7AO5HoO2KXkDAAA9c5JoAmb7pKBmQ9s/epxwvGcjP3V7VCADyFIYnGc+lSrlFPAGRxu6jHrQIkKsCc4wecGimLnbuXhvr/AEoqWUVoT+7XHze/SpNvG4ggDn5hkmooVXqCQCOe/wDOpFwx++cjhX6YpiHdMEsCwGDxj8KQbpOpGM8nORQuARtc5br3/nRgcnOSPugHvTEKv3erBuwI/wA8ULmRs8kH24oZhu3E7h7AjmjaORxkdB+vNACA/MSepPBxxQoZhwTnjpz/AJ4pOmGY4Az3/pTmwDgFc4yTjHNIY7ceQCpAOKZtxj72dufl5P40v3k7EA5HPNKpUbcnA7/Nz7dqBj25JxwQASpNN3c8Nnd1PXFKme/zHOeoJo3DgFuec445piAKyr0KcZ3Hrmk5X1x0wByTTsHaMsMnrkk9O9N5UMF5989KBCr/AKv5R1PHf60xwVY5OdvXb1p2zdnAzxx6imltpOcD/Zz3oAcjEoT1CkEUhyi5OB3P4dBQACSc5B44PQ/hTeMHdtyDxnrQMVcMoYqSWPOKRt3QAZ6kse3pSNjggEd8470qMBtKhQxGCcHA/wD10xDtx8vd1b0I7UcnBHI788U08li2fXJP+FDLlQdw5646kUALu4c4+bPGOBijaD8235OuKb5anBDgHpkZpFVckEqFB44/WgBfvttbBIGeP5Un+s+boPQ9KRsbiw4I4JUcfjQFHIZg3oDQA4N+8wTtx8xwO/Sk2nnj68UmOgXIGeNo4/GnLgtjp3J6ikMTlTg4HY4689qjC7mII3f7vWpDhuC+5epxxyPSkz8uM5z1yOfzoAYwLYBPA9OtIVPTbhuhJH5U/arEqCCrDpnFIQMDuwOcZ59vakAwpt+Y8d6VcuBk+/056U/bgjnnHI3dKQqNw53HqfbimA1htOCSPWkOe+c9zjNSnHBXGO5FH3WBDA575PHvQBGzFemFA6/WmhcZyGB+lTeXlVJ6DnP/AOqhc4IHXsAaAGHIb5T0IzxwOMUBSCRhV7nBqTb8oJHp1/z7UrdOOvTk9aAIeQv4Z56H8aXJVAPu+m71qRlLNzz6dv8AP40FRydxx1zgfgKBDDkcDlunpRtPUrntx/P9KkVcZOSQBj1/SkXCnaCAM+hGaBjOW3blY5HIalVRt3Ec9vSnHb2OV7HrijA3YHK5xyQP5UCFfKkA/wAJzgdaT5sHH6jGfal/vbjuzxuJ6UMPm/icY9aAEkBAXHUknBpFYsTk98mlZSGA6noTk80BdxKnnn6/jQMjVWbaWzgkkYqRv3i9eOmaNpC8c9uT1/Ol2qy7iO/GRmgBi53Y6gjGSO1GDz1C98d6d8rN1xx64wfpRt+6T8vGORg/nQA0gjgnDdMfUUEszZPQ9Rj2/wD1U9gobC7c9SR1/WkVRggnG3ocZoAACvI2j3FN244xyBj5vz4qTHQkj1GT3/pShN3GcHqVzx+dAEbLtVcdMZ244pCuFyev86kUZ7nB9D1pVTp1HqRgZoAgY8kN3/LFJknJK4HbjipXjLNkNgn+VM2p8xBHtyetADPlZs8hsfdIxzmiNGXBBGD0qZcFi27gdcE/59aPldf4c54PegCJVKqQVwT196QIdyHOARjj0FTbAGYnOF/iByaa0Zy2CzN1B4/KgQxsr7DPTvTo8ng/dJ+b/CnbflOW56Zzzj2pAMMF5bBwM5575pgN+ZsYzgdM08Aqwb3J6Yp2MnOVOfqCPpSv8ykgj/dOc8UhjNpySeMf3qXDdCcZOBnpT17YOTn+FiaOjE/XIOaQxmCP9njPPpQyk89vz/CpBubuM9DyTzSOMsD6fpQA1d3YgHgH15oGdo44HIOeD25peuBlcE9OeBQCNpycD2OcnP0oEOOeSeSeN3amyLjqe5xxkj1pfvYGcjPcjpRuKkenPOeuaYCbiRhuucGmsoMjDONzev05p0eWYe3rzScKA2MctgZ60gDGSpPB6gEU5c/KAw5xnnuTim7undgccmnfdbtjjo3vQAvCptPHT+VHPXP5mnbcKPocen4UcLjHBGOMUDEGFU9scc9ee/8An1pGY84PAFLztz1wM+vf1/CkbK9sHqe1MTEjb5iCQQeX49qBuBIA2npz70Y84qOvcYakYDcTtJPTGf5UCEVlGeRnpgjmkbKja3GODxmnZG5AMfMNueB+VJ/wPD44HagBO2MjDdT60MN0nXeQMDt3oZeeuRjtjg0HPylXOA3A6896YCkEHPGB264FByzDo2f4jR8nQNtHUH1P0pCoQlg+D09QfwoAUruGdgwMY5yPpSL8xyx9+KX5MfMwJ/venpxRt+bl846H3pDEUbmBwT6H8/8AGkXKqB2H4U/aFxuO7HJxjg4oVQ2F35X6cGgYAEbSSVH04+v8qFXKqmAOSD1oZfl425IyVBI/WnNjftLZAOM7iRSAFJ24/hzjgZFDfLx2HCnpxSMc/wBMcEfrTmJZnOSSSM5PrQIRmHA3KRnHIx9KRQWUgELyefX6Uv1Zgexz+tBPzcEls8+ooAbk9M4P+elGO6kdPoaAu0Y+U8n7p4pWYDaM54A6/wCeKQwbHIJAHvnA5oXAznrig9ScdPw6Ubgqg0wEGBnBz2H+P5UBu4Oe3ufenLnuufXj2P8AT+dAbHHPvigA3BQNueOSabtYHbyNvJwPYflTgPlBznH0o3ngfjyeeaBAzhc8YyM7c9aAHVyc9CvOM/hRz8pPOe+KaewyvXBO3BznrTAduIBIwQeMkUkYORkcA8Er9aYQm5huyB0wKOFYEtn5e2M/56UDF3DavzEYHNKqbmUHcOuTjr7U0Y4Gc8deMGh+cgs2COckZNAh2cIGPBU56+tCruYevXJ7fSkI+cqGO7J+fPalLDjDk++MHH9aAE3YQndj+L60u0lSfmx9RSZ2sNrbicDpn/PWkYDgFsnoDtwKAHsT03YLDuOfrSD+8cj8RjNI2do/eDcTx7duaRuMqGUL0H179qAH5HUlSp5O6kU7cbTljzx6/wBKTb8o2uOevTr2p2MD5pMnH3lGNv8An+lAgVQVLZ+YcnceDTV2thchi3buBT1+7tz7nnikUFVVi+c9+Mrjv60DBVDcljnvjnj1FKsYZgBkj0NLGOMF/lbj6U3y/L287gx+VT0BoAZ87f3cjhueKPl4IPy9gCKkXLJsyS3Qbun6UqxIrHBHXrjkUACxhlDZxIT8o7Dj9O9OCgsMOS2OvfH9aTycgkfuyD8zL3/Cn4ZQw3hzjkd8UAIcd+ePlOO1FOwNuMN0zyegoqWMpQNlQxxu6YxUnHDFSNvbFRxYKDHDei9TT/lZS2ORwPegBYzuUOcBmHHHApyqGbkKSOetRKys2ARtPYgjpT1YMvBVuOuMUxCrnbuJ5HA/LrQoBzkZXuaRm2qD0DccjI6Uv0IIB7cGgQbtuSByc4A4xQudoIHAx1PX6Um/02E543cU4qVY4OT7A9aYwDbcADA9jSopzt9eSDyBSbTt6Ak9No5NG4KFUn0B3cUgHZI4zkZxkDrQvy8MPw7U3cE5J47YH+NHCqARxjJ+XPP50xEnMYYZYj19OaaQWJHbORnvTfu5LdMAdKAcKf8Ae6Y4oGPzhBxjru20xiRnd8ox60LgDOflIzgDH9f84pJD8xbdjnBUdhQIf83UHagGckYqJGG0ArlhwO3NSKTIu0pnb7+tN+8VwcDoc8mgGOxJswxyrHAHrTWU7efug8Y/SlVt3BJ3Z454/Wg4yMLzyAuMZPrTAX5lG/A6fKPWmjKkgAliMA0Fg2cjPp1H6ChcADBzzz2/WkAhbjcfuZ5Y0mBt4A9CwPNLztzyyjn8KXq2duBnHTmmAo37tycJ1IPNNA3ZxjrikXDKQp57c/pSqm5sDcyj0NIBU3Nu2/LGp4B70dWIxjnNHLd9rg8r2A/Kjjdjfle+epoAT2cgZ/Wk+8vTJXgZPApWHyncuOMZ7Y7daG/ducn23YoGAX5VyuST1WmfMcnIznPt+f407eV7kr2OAKQsAqgAAYOD1+tAhf4QBkNjkUemeRnOD3PpSdMgKWXPXjr6UpbHQrjbnB6ZoGIy84wDgcYpW+XluB7mkXaVPoOmT/8AXpwB3bccHpkcUhCdMDJHPJA/KnJGOh6n27Uq/NkEjHXofXjNNUljwdxPHTimAoJXG36UgA5yOOp9DT1xjOBzjBAz/nFNXuOMD3NADScYIwRwcDvRtPf5u2aVsHk49Tnk/pSHPK5HXoOv0xQAuAyrlvpxzmhScZGcdD360LjcAcZ7k+lBZeCNpIHBJoADnkZ4oVfl6YPQZGTnNGN2O+OvI4peOwx3HOM0gEZiWwTwOB7+9KoGQp655x/jQQVBUrz+nrQ3y7R1X2H9aYBzxxnk8ClGM8/N9f6UH5SoPPp1PWhcKc9T6/0pDDPy8Hle5pOTwSeuOlAO0DLAnnGevXFJuxwCMe5GTTEKpxk8HAxnrQVK8Yzj3oOOCep6Yxx/j0pT91ctuIGRQA1VOQDng460uR2O7I+hzQGLfdwT1HzZpVUHd6DpwT360ACKckYwe/f86F+6RjkDOAaTcBwPx4xTwwZe2O3OBQAnGevXuRQvysMDHpijPzHPB+tDMqqxyB6jGDQAxl3NknIPA96GGOOM4+92p3zE4Cg849Ov86YrDbkbeOec5/KgB2AeTHuPP4+9JtViT0P86bv3LuxjH54/w5p24rjavb+HB/GgYPsOcfd54/ChlAzn7wPO33o/hIxuwPvBf1pVZtxHfP4/WgQSAtkAZCj60BcZA4I465Of/wBVDMM8YAzwDwPzpDjGeABxnOST/nNACtmToMc8e1HJHoDxnPb60YONwAz34x/WjLNxjGeB0oAcAW9xyduRSKp2cdPT/wCvS8KOmD05ANI2N2AOMDHHFAxSQOc4P+eKbt9sH0p7Ek8qck9DzTcf7AI4HUUgEyc856jPHtTVU98/40vPpjgnHHpinNtBwPXqcc0DDaoBbO7qcYpW+ZuvdqRcFSeB1/x/KnEL1wByePegBigbsKevtTeWyPUkfhmnEk9DzgdiKQYJHTOSM8fWgQct833eeuO3pTg3zjJ5+nT3pnPbkDkE8UuMkDbnkD6+tADsHgYPQ8kU4egH+cU1u3I6ckZxQrbvbPbFAxxx0A7dvrmmjnk5IzmlUBmAGAc4PHH0zQcL/dxj04oAP4tmQex7Gg5bj5gc555wKb/Fzg8DtkEmnP8Ae+Yhjntx0pkjQpOB0bGQq0i5YYA4Bx7Uu4DBLbWxwQOc0EhguSTzgDH60DDHy4wOuBntTsFcDOccHHamll4OckkcjoKGbPP1GORmgQrKfvcDseaAhXIGDzndikEnAI2gA4HHc0xmwpG/JPbnBx1oGOVfQYUn+Yp/K8ZHJ603f26845IHajA+bPC+5J/UUgFxhdxXG3n0/wAmlbcMFiOfzApN23P3T2POfT/GhcEkb1x1OB/KgAZSwPy5OO4pZG+Yj3z8opPvDAIOeMk0YYsAeCTz3/lQMAOckYPI+7S7vlwTjkdvam5x0PH1xS7sL3Xoeo/z0pAJ97t64zTsdjkc9c8nFN/h98en+FDMoYZXnJwMdeKADJGAeOvShV+ZVz83HvSbgq4PXGeg9aC4znOMEUAKfvH0yelI2c+tKNu7g9uTnNAx/ERj60wAZXqev5nilXlvXIz0xTd2TgsD69+1G4DBDD+n0oAeCPLXqvX6dKPu8n24zQcqvJLDb6Z/z3pe7Ng4zgjFAgY/N8o98U33bPykZAP50pc7QxJPbAx1prAc46Yx8v05oAQ7hkEY79O1KoJHbPHb3/8A1Um4MrfOWHuad3wDxgHuO9MBqqVVfmzxShfl+ZR8uTgimKA2AuM45bBGPpT1x944bjOOgP50CFGDzxlfbjPekVTJ2zznkYpCu5sbWDE7Tn+dL8q4OTzxzmgAVg2MbeP7vakGZBjrnjnigsAdoUKufusOckfrSLtx0wfzFAC8fNyFYcDFHqPlP+8OtIWCgbcKvXceOaapHJAXJ6H6+3akMe0nlqB8q7uaTeQ5OBg85FLxwSATjIHXp70gyzep5JYdRz0oGKdy4TAU+p7UM3zDOOnXFG5NuCDtb25zTVYrljkZ6fN07c0gJP8AVsFxy3TnpQv3sHGR69PrUaMNrFcFs9T6UpzzxgZxwefYUwHrIMjL4H8P0pxx8wAyAODim7gzHHH93jHQ80M+9d2M+4PBNADl+TC7vzHH0p6N6rt7kA9aYvzAAD5RkcUqjdtIGOOm3k0AP+b04PP0opFbvlsDniioGVo+dvPUZOeacuWccZHT5eOlRR4WMZGCenvUy8/LgjHG4Dp71RInKxrwd3Pp09KXG7rkLnk4601DhBvbnkAdM9s09VbIGOAeDmmBG21c7Nu48jj8KdtAJwSSDjrS/KvU7k6Db1x70u3p82WPpgUxB052jIApqqCRxyBng9c07aSxG4lu/PajaOecAnjtmgAMa8ZXleSc/pTdrL1GPTn8acFGQV4APXPb1NG0bSA+Qv8AFQAuGYj5s7vSkCjDDOQTjdnHNH3cjJUdM57Unyqh28nrj8aBj2yrFfTt+FIoJYHdx1655psnyn72A3v2pflZuWG326UAKjHbuJwOB/OmY4znK9zS8IoGSBjg9iaJAGzuPJ9AaAGn5u5JByARyfSnc7iMlpM9V6ULujDDdwRwWo2quMNnPy5z6etAh2dpG4544z0pNvQ8f3guOmc035myMAj69qcy7lBLNn7xIoABnbuGR/QUuOqgjjO4kdKN3DMrYHtSr+8Bycjk8Y/WgBoHDNu5ycjHvSIxI49cjnHNG1QTk4XqAxxR95sh88gkEigA2sFznax5U+1JyuQ2eOvelHv8wXvntSsu7hMMR0yeaABk2soJ7ZLLweOlCqVGC2GIznFLs/ebRt8zqWzxik28EAjdnjnBoAbx82Sc88Y696UDBO0YBPc8ingH+8AxyP8AGmtgkgHI4wD/ADoATmNRwCw/OkC5zxnnH40pXryz4PPFIy/KM8t1549aAEGBj5c88e9KFVeDlT1OTxwR0pMlm+UqccYFKVG1CW57BumKQwYbmJ+YZ4pVADYPyncAeKONq/38cjNOVWZsEYBPr3oEM4OCOgHJHFPXueQB975qb09G3e3BNKq9WJAXHPPemAm1TjAyQOf14peO2TwR96kHK4PBzj3/ABpyxnkYIPtg5oAacc4G08YOf8+lNbG3r9D3NPUbmC+/Ujjoeab9/BBDc8+/4UAJwP7x46ZoXGQBwQCOuOvel+8wGSvY0qgZ7D0JHPFAB8p42dhjNCqflIzngc0bSQDhhn24p+AzFQeeoNIBD6cYHPI9utNHYZwex70/kggbufQUmOx6dCSDQMR88H1yTxzjikKgZOQT346e9K2VcLk7xxz9KbjZHuYcY+73pgAyv8XTgHNCctg5X8aUglQf0HNC5565HTOKBB/ujn+HJ/WkC9CM4wMf59KXa27JIX0Ddx3o/hBwFweAetACt94nGevGeOlNYKrcLgDnr9P8acQwDEjgdSec01l2bgx2rx1HakAqo2MjdnPPPSnMOnXODzTVA/ixgnA56/Wl2kqd3yjgbj2HNMAYn+HccHr1zQckcHB6BqUfMpJAHqc96VSS393HXOMAUARtjGQATnjikbOM7WPcj/61KylsdD2+bgcd6QnGAvQjORzn8aBiN93heflzzmncLwqjbzjb1pDls4wUP92k43YPJzxjjNAhy4IJIAGOT/jTz6dT144Ipqnc2cg84J702NSTt4I65PBxQAq5VgT8vrntTmUFWJIJJHbpSf3sfMD/AHetAXbktkbRhv6UAIVHTC5PI96cqhVPyknjGfrSN8o9x2x0pTnjAzjuB930oANuMgIAOQDQMc8ZHTB4zSLhsYOQDjGf1NKW3dPnx7cfWgBTgsfr0xx0pONvAOMCg/w55Dfw9/rmgk4+YgdMD1oGGBtbAJ4agK3Clsc4z/hSNxnGD3+X+dKy8ZJOc4HegQYO7BOeMfLS/wCsORwfr29aTaSgIGM9Md6BhiAMHGTz7dv0oAXhV4PGORmmtxuHQH1NKvzMuQSM9McUnH3iccksaBibAPmxjg0uFHRRnI6tSZYNzx64GRmhvlzg4f3H60gAKOwwAD3qTBXOM5/3qYvbjBx26D8aOGySck+o6UASAEthunXNN27cAnt1z0pcYfpuGdu7BphJ3fNzjigB4PzAMeM8/Tr1po4xknB6c0hxH97Hy9jQSd21x04z/hTAV8dT8oxx3OaRiSwO7g/5xSfMvPJIB3AjPFLsO0E/KQPagQq7toyeMjjNNLFeBnAzj0pD823jGTwFHWl2kDLDaM88UhidhyQuMAA/qaQL8o5PuM0YY5JGfXmhP3i/3V/pQApbcpLen96nNhSAOB3w1Iq5XoWGew4oWMt/ex1+7+lADlPTdke/brTWJZemR9cfjRywB9OTkHH+elImW+UY4HJ9KQDsZzkFhyf0pGUchQAOuc0nCqSDkeuMUL1+9xnb04NMB8a/UD8qDhsgcdM7jSN2/vemR/Kg9gD83A+YY60ALtCgcY6/N3ob7rfxfjTOFzyQD196c2OPuhc8Dp+FAArdR1zxuzS/TqenNNXGD3PbimMeScgjse45oAl+8xIyeeOaVuF+XLe+eaa20Nk8jp1zimrlhu4574oAfg79w45wMngAd6TGW9fTJFMyFyM4HqT19qey7cdOuQPagBSoTGeABkCgKGY8A9tp7UcFQGyBnI/z6U3Jbbj15A6H2piHYK8L1oWM8bMMMA4pc7VBIKHv9KTywqhgSmOhz3HY0AIcnvzgk805QQwwSRnJ+amj5u+OOw4NOI5wvYg8Y5zQMbydp4yRzzSL+8ZeBn0oZct09fwoY4BIZd2CeGxjigQuAvKk4Hy560DL5GOv4U3lhwSRjPXinDAAy2D1PI/KgA2jc7LwQ2OvHvSHLZHBx3HFKcsTxnnAwfahTsXk7gD3NAxGU4JZcZUDP+NDMW7j1z6GhvvHaeDjOW5HNKgG0gNgg5AznPPekMaVLD5hztJpcjpnII5+aj1CjPqd3Sk4LEnac8f/AKqQD/mbbk4Oep78UxQR8uCe2enWnM23HPHGFz0OKaijOGBxjJ9qAD/lm25cjIHJ4oX+Ijjac9OlCsFXqoPHSkzu6gd/vGgBedv975cc+9O2lXOQBjGDik+VWQY+XBAwaNwYEklhxxQA9MtkjB6np04oA75AJoXp3PJH04pNw9cKRuPb8KAHjqRnp29qKDhVHyHA9feipGV4wdoBOVxkcU5ivyjcCPckj+fFMjXanzZ68c1IELYUgqD1x0qiRFbhAQAmc/d4HtzS/Lt+ZQSfTJJ96jVi3LAGJTge/tUirxlAuGH3ieRTEPXMY+VRtztHbNNYp824rtzzx0+lJvC4BJkVR8vpTm3LgLtx0xTAGywI2qVIGAaRmDK2cBeg749cUrZyQArlevpSbm+VlQYPGV9qABdu0hdqjoXx1pTu+XJ3gHJXH4UpbgZAyRjbnr9aareXljGfTNAArLxhcqOTn+lG7dyx3KvsfSl3CNdoOSpwc96duKdBukIIGOlADSQQWA2r1JA49uKNxY/w4J+72P8AhQrbVY7huPX39KTgAHJ3EYCigBQ2wEDALDBGc9O9IMKwO3ae5GBzR6AphgMgHrSNnbuJ2kc8e9ADtzLlsgcn+HGfakGQTxvHueffNNZt3Us230HGaWQDy+TwDycYzTAVirKW4QZxgCmY2gHgHGSVX16U5WYgrt2j6ZpCwf5S24nJPPp0FIBSwxnaVPds05iDgsoIY+n6fpSLJ8pAJIPcjilXlgCcsO3Tv1oANp8ndwFLYxTD/FuXcFHBPWnA9erKvfPFJye7Duc0AOkyiocDGMBfrzTFI3ENyc/eOeKXeRwvK9evShn+UKGx6rjrQA4Yztwy7eeOcj+tNVt2AU3+oHb/AApJGP3RuJb05AoZxtB+YKDjjvQA5tpYIy5AOcY4xRxyXGVXpzjFJw3dm7AD0pM7XJ5Lf7PQe1AC7tzb2w3t39qT+JcLhiM7mPP0pd4Vi23acgHPWl8wDqfMY8igBv3myVDHOOelOZQMlVAIP8PX1pD90Bjz1Pak5X5snAwQehx7UADbsnKjg4zQyj5htUHHGBnFKGVgShx9aFyys27GOc5xQAMTuHUFRkAHjNC8DOxc4z8oppbv8wY889aXliME+nXp60AKy5K/dJYZJxRt+XOwD04o5+YqGA9TQWLYxu+mQMUALxnj5gDwNxHalXduJO7OOTnOKQH94mPlyckn6UA7enYdzSARtoVihbJGOp5pQrEnaDu7NnI+v6Uq5Yjllz1JFKzDnbnaecL0/GmA3G5SRySOuaDu4OWAPryTS7urfjjPApV+ZsKSxJ/hNIBP4cYUH/Z44z0oA/eDeMEepyfzpWcbeOM+vrQv3geST0GepoAYcs20/MMnIpVXcSAAp9D6e1DMR7BeDx196byqggcEfdXrTATcOrfMfXGacuV27U4zxu7Gl3fLjIQr7UZO3liM/wAXrTAPL+8xX5cHueaBleOAVOM5OTjsaTbtYndyB03daVWXCAcMRnLf1pAKu1j8nAJweTTdzYAXlRx1/XFO5KK3y9cj60Nu53Ltz1IoAQj5ssuCT9085pFK98qM7dvbPvS+YOnGMfj9aPmYEErx+APvQAjK2SSQDnggnI9vpT923By27oAwpv3VL7GA9c5pVc8jfz3HemAnzMxO3LfKCw+maZ83A3YHpz/OnOTyyjIU8ZPbHb8qbuAOMMP8KQCHGQpVcA84GSRTuZPuqo7Yz2pu8t0bAI6H60Kvz7VAYDjIPagB3yhueB0LAfpS/NtLN3Hrz9KFk3Kedi5xj0FOhVuQowAeuaYDdv8Ask/7p/SlXBZeEAAOcihWznnaCeCKVPu4PTnB64pANQnbgbiMnAU0FdvyHbtyvynr1pT823BwcZyO9Jz5eCoyOexP1oAXlsMeeT2zzSYJOW+8DxtBFKuGzj5jyeD09qd/q+CCoxknPWgA+ZcfxN3yfXtRtZfl5IGB8p6fWkX7x2jrztz04oGVCgrjPPNACN1Ofm3ZUll9v5UrBTyExxkfLikUnAGSQScMP8/WgYbq+W4IIoAdtZmXPUjjkjFN3buQWbA+ZmGcfhTuWjwfmYnoTSMuXyx7csOOewoAX7uVAUcUjcswJzjONv1//VSrnv0/ummnDBskEjJ6cc0ALzG2AvbPJ55pFRuOoXjnHIoxvUtnJApV2/KcluQc5oAX5mAUfdGT9eaFHBwCpx/Ce1AQ7TxuYE42ng89aXcNzg5OevYUDFOC43EjkHv6Uz+E9/lzkketO6NuxnJzwec88Uzd78dMelACBQTjaqjGWY9cYpO2WOSRk8nFO27sD7x44zk0eYeedrenbrQIaBuB2AKQuTkUgG7Bxgn04/Cn9x/FnI4PJpjNjIyVx054oAT5ew7gtxTfl6gYXd2H86fuO0Hdkk9j1z2o+ZSQSV6HHXvQMaq/L0Iz12j+VLtXd8pZM+g5NLwygNy2OOadyihu+cDnmgQnl425DJk+vFKPmweDxztJBpTldvzZ7c9c0pO1jk9uB0oAj43LuGc8c9jSsxyjMFJb605c5GDuXr1xQq7cNg7cevFIYzcWywPIH3sH1pzSFieCOT25603dk7gx6Y+9+tKeGxjkHuaAHDK469M/d4pfm5xuzxkj6U1VPzd+OmaUcfePzZ9cdqBgM7Tzt4xzn1o4BzuVTn0oyWUEHPHUnpTgrOQSuOTxmgBhbdjLHr+X40o9QdzYxyfelL5UbuDzx60EEMMhW5Hy0CI9p3YxxnOduO5pcArzgjB7UegwMDOTnvRznkDA96YCgnAyy9ccfhSr97rnOeuaRS3BIUYAPHoOKXduCjIPPrSAdglF4Xpjjj2xQM5BwWIPTceKNvygldrDnjmmghmDLgkHPXBNMQvLDOQeMA/XtQ2AWG1QxH9fWhsptJLdfwoPzL97OB60ALIXG8Ebe5weKT0+UOcqfu+9JuyowWHPJIzTt5UD5+vX2oGMwONqj5gT0x3pu5iAFJIxxhf1p+3OdpbjgE0rL8pOW9PSgCPGeQgBYtxjHel+76+hwOKOS3ViQcmnbTkAEt6+1IBrY3FiMtuBDbfakXpu+6fTH6U7lmbLHr3PtSK24gg8HqKABsNGwzk7cfdHPNOZs7hznqOBQuWfGdxyOc470nrzkemfegYrLlfmXjnJK9aaPmwp+ZmHJAA7cYp/LNwzHqPY0FTsUZ57r60ANXBxlcjJz8lNX7oBHByMKOfY1Jy2zlgeSAOKApVQT8vtu6+1IBvJX5sYyMjbx0pFxuxwF3HtjtTtxOATjoM7utKvy5Ldz1JoGRqzbSThsDHI9en9adyzEDIA4GRmneYdoyegwTnr1pNx65wvfnFMQ7d0yuAC3ahdy5PzDI9KHBAGBxjg5/OlGGXCj070gF2jLENtPfNFO5HbIBPPXrRUspFOIDbydyr/ALPWntgx9cDHQP1pkW5Vx97uCO1SDAblG3YyFx/WqIGK25V2sxUAngYA/On4XaC/zMfvbT0pvzKxXaZCW5Pp7U5WCyfLHhs5BA6fWmIGk3RqA3GOYyPehgOchsjqR0H6UbkyoLNnPNO+bB28Y5AHvTAbgqAcEIDz0yTmkGOCyNu688U5yVYKzdOcelNbLZAPXjaT1+tADgGb5SuG+8TnFIrfKfkLjP8Aex+XrSFjyrDORx9PSnFvlB2KGXACmgBdy/KCeATlm6/SkXAUkBk4xkEH6ClZh16Bj93GfqaTcGXcUO/+E560ACsp8sKeAM+59jS7QvbBz95eg+tKZOrjPzH9aF+Y5KkOR1zxQA04ZQuCXJyTj070FVXJX5ucg7jT8/Org8kZbnqfamr2Ozk84I4oAVWLK6pu3nrkcj6U35VZCpJI67fbjFKr/vM9GXndmkA4U7QH64/rQMT/AFmDlQvQ8YJ9qTd22kfMxxnH/wCunMwYYK8ZyMdBSYy/AO3BI9h2oAUY5Q4IABp3O3CttBXsSc96TeF/h2nA7UHbuTIw3fj04oEKOY8K3qSNvFJlcgZydwJypoY4BDAE4zxxgUKx6hscjvmgBpVTHhgB2xyO/WjbngbsD2z+NL/dGGbAxuH1o2/7Oee47UAJu4J3tkgZwPc9qUKc5z2AAwT+dKW3KGAJUdunGTTWVs8od31oAGxtI+6enfsR2/OlLKoYKCQMY4/Wl3fLhcj8PzNR7hhWaPnGBzn86AHHbvG85xycdDR91V9VB6HOPSjc0a56k8jPb2pF+X5ijKevzdPagA4LAjleCSxpV2nBAAAJ+bOfwAoIIzhdo6n0OaXcdzKyAhT+AoAaTuXLEnA5+XrQWXBO3CgHjBz+VKsm3PykevPX0pyt6MST2x0oAa27HOTxjp14o3DjOCpI+6pGaY3zY+UggYPen7+n3h9eKBiAHauBlRjHHP480qgpu4A46sp4puTu6fMA39KX+8WViP8AaFIBxADDadxyBtx7fpRGpUjKr93sMfgaVlwyY4BPYdOKRf4dq4HrQIGYNwoByc8Hmg45YsOvRen40rj5icfL0PHJoLncQB1HIb2pgBxgrgBu+04o3HcCcr29QKUsdoABIB645pF2qBwAN2eODQAq984HUAA5z+dNJ6g8HA64Jpw+bOOOvTkUm1lx976cUhjZAAFO37w4Gc4/yc05v41DYfGdzdf5UMw2oF5PrijcF+8pcjv2zTEMXpyrAYyQMEH/AAp+GReF5PA7kHvSAhVA7rksvrR5u3kk4bow9fWmAjtt4IbK47ZAFOZh8vzB1I6kUeaoKYOT64o3bmy21Tt5x2FIB+4H7oUkNx83ApjK3z8HP97Oe5oZtwYABl9vSlOC0n7sgZz+tAxGUqSTz6Nj+dHy9AMLkA5Oc/hQuNxwME8Ag4oboT1XjBYc0CEXLMfveZ/dPSn/AOr4IYbfvcjFKWK7iPnYjr2pu35Sc44zyOTQAxlGQGyo77RkdKCrfKRuPHC9KezFTjAznIz0JNR9gWT/AD7UAN3BVOBtbjO7gcjtRGfmCnenHAwDxT2/u/NtxnGKRegwS2eTigB/K5JGWxkAc5pB94/w/NycZzn6UBCxxnBPQYpVAAGRnpQAoUryfTuvSjGQ4C4zj7vJP50h+bJ7ZJNCgYIYEngnI56GgYjLkt3J/h29vwpWbOCVzzj0x7YpMnbgnGF6CnghsHI2jnp7dTQITBI/iAxySo598U4529GU4/u5wKRfTOeOmO3pSnBX377ewoAAeDz3zxgdP89Kb36kA+pzz9Kk5xkHpxjt+VMztZQVyR03d6AGqQ+CpyM4I6EcdaVmHygbQP8Aexj9KcG/eEkcr8xK+mKaoyxXbg9enFADox2BBG7PzAYqNW3ZwvBwSeM1IrZYZGMkc+tR/wB3POFOcGgY77pYYI45z1/Ck3bfmUZX0DYG7/CkB+YbSSTwc0jKPNLfeAwM56D1oEPPy9WbdjoQOKVNpbPXsdo68Umfv8c44OelGCMjOUIwecUAAZSqgNt3AjhemPejdwTnPpv6Uv3l4Xbnrk9PalbczEYwcfgKAD5fMXnjPAUdOP8AP50nHOfm4/hpVkKjIVmOcZxSDBzjBFAAud74DK2OuAfwpvHAP3Dk/N1PtTgBv4OQRn2OO9N3Etk5XPQMMgUABYrzt8tsZzjj6YpNvbHH3vWncLzncRy3r17U1eHKqOMnHp9KAEY8DpnttzSbTuIz7E9QOakblQCSdx+mKYwC5HVVOORxQMOFypUYJ4APOB79qDxyBsHUnGcelKMyZyBz6cinL6A4JHygdjQIRSo+XG4DkkfypNrKRwV9SOSPwp6ndn5TjH8XQ0gYbiQ2OxOOnsKAEUfMBt6+oxx/n+VNbb/CMg9CpzgU7+IbeGHGT19sUuVJLbu2eB1NAxm4DnOS3Cq4H50pOct3xzjJP5U45bg4J6/Sh8+ZkjeeFJ96QDcYyecbe6dfel4yccnIzznjHXmgEhjweh5Pb6UMwDbR0HQkdeOtAxOQufmzj+6Kc+GYY3DnlsY7UFtuMAFcEg0zcF+VhuP0/HNAhy4wcjaefvE5pMqrZCkjcMcZzTtrcdz39MUm47c8E54OOPagBo27uOcbuCtKMdeFx0JGKdy2fxxzS7R83OWx96mAwbWXkZUA4OMcfhTs/Kwxkf59qRm52/eX+8OuaUkbTweRkZoELIuGUk56dODSrlWC44HGW6fhilVgyjHy8cCo+4/hAOOmeaABgAO5BB6nj6U5huViOV4IwcLnuaUMuBg4HUY/iNIcleuRtHt3oAGZldgSXwOgxxSD5Tu+8cjO5QR9fzpx+8SI8cdO2KbnLDC4PZlH5UAIMMFxsB28k0qqC25Txg8seDxQWZnGUPzdh9KFwzFQuDn8aAGqF2oNv1wTz70HJ6HntjkD8aGY85yUP+elK33cBfz60ADMeRg7c8dPTjil+62W4YdiBSSb12jAyDwcdaRuh+Un645NAwZvmwVXcByGPHrSgDbknAGACRz+FLJkheCmB8xP1pWYckrlscZ6UAIzHgMuTjOPWm8BcnhAMZPNObPl8Bs/xc9vQUgYbQ20kH5VU0AO/hXAz/MU0Ywf4AOp64/SlUlVIUHee9N3DaSRgLx83+FIBd2EbCjaTjPAo/iwBtHvyPehSVVsKACcY64pmTyCpJznrwKBihggwMMp/i6fUVIp24+Vjj361GuQD+72tnO0dDS8tnggt1I7UCJPvckqx6FlHQU7gqRgMCB04/pTAxHK8fNg+/HFKGwQSGX1x6+9AD17jOBnP6dKKTI6H5j/AHs0VJRWhwqghdw6U4KTggNlRn3NJCD5eGGAfbOacMFinJyMEdP5UyRhBjWRRyB1POcmnFfmOcpk4wp60DbGArswJHrSqWzgZ9jngVQgBZVAC/KRjd/IUgXc3AYt0DLnHFA27lDOysvHP1o3YU54J5z60AKsZ5YA7SBnI5NNVRwcFWx94jGAKczDdhzycEdqEY7iccfX9KAFUdFAwGOQw5pFyynJyO/PWlViSSrHHfPUUoYFVLAsdv3ccYpDF2ltpCnJOB9KZt3ddwXk4zzTlIOAC2epbpQMKqnGSOcdePSgAUZjQ7Wzxhvrmk52kbuDx8x/pTvl25HJzz1pwyMlfl5wfegBpC7M9Vzx7evH+e9IzbmbBI3ejDilBVf7+S3rikbLMwyNvT5R/WmIaq7iASygtjOcD60fe2H75J7dSPSnZUBWBJfoFHShQVXKnbkclfWgBFUN2IG7GKaTyccL/tccfjTwUbdt3Bx2OfzpGPlkZJz0YevbP+fWgBV+XJKk9CcfpSYC7uSCSccipFw3JbJA5296RRtIA6sTkD/GgY35mU/w4GOeCM0gwv8AEuN3dqduBXO87uMgjvTABuOOGyOfxoAavEYPRMZ+vPSn/Mxz8xbPAWgsvHzsCOMc/lScZbru+tABtBBLLgEE9eeOen40373Ufkf1qRsdC7L3Hp07UBjk8/X0pAMCgtnG7ngqetRrllPLA456dvaplYFhwuMY6dORTeAEJ2scdxQA1VZvnC8sQAaUddpyMndgnnA7U9WAwFyXx908Ck4VRluCS2ccnmmIaq5wwVumevB9qCDtLEYXphu+enepDjhVHJ+826m7gvOSTnaW67aAGhQyjjdt7U//AFxKkLk8fKenvSEfKASG9McY9qX+DhmbI9KAGMFbIBXkkEfSk2s2NoGRyO9OZg2BxkdRt/Oj7ysB+YWgY3H8QAI54HAI96eB0yDnoc5/Oj5FY7Qd3UbuwwBTvvAkMxPf3oEMbcoBOVHViTinKoXGVHHI2nj6A0vO5dpwx4LY9B/+qlDblBzx6nI/SgBrd8Bs4zjOcGlAO5SVzz16c/4U+QDO4HHQDPP4mkOBgYAB7YOTzQA3kYwGBwSMGlVD6HrgZX880u1dpBA4HXbQSNnT9P1pAINoz/dxjJIAzSbTwf8AP14qUEbTz0zlif8AGo93OSue2BQMSRev3lBzjvQ3CsAcdPmUcU4gZBGQF75yT603dyMlk65PXNADeOdw4xzkHNB+4x3L/MUq+ucHJLbRzSqQcsMdMcDBpiGj5gMMhbsAcdKF+UAA7FA5OQc4peOTjap4Jx60m1OAvzqTyD0oABzjAHT0Oc5p3JyFYnJOePfrStkcAsx7Bv6UnDA7juUdQ3uaBjBjb19gGqVcjJ25Y8FgegpW5XJIb2pvl9VRCq8NlTQIbuDDOcZ7sppxIU9sH+I5Io3HO4M20Enp196QD5iB83fA6UANKhSvKjj7pBpFOFHVT02k4GPXmlZmVTj5h1bAxQMY2rl/Y84oAbhFyoZgueeOnpT/AOLbwZOo2jijhVO07QO3rzS92Bzz6dKABQSp54YHoe1Gzvt29Kdxhiwwo9etJ91jkZPQ0hiHHJPXPpnP5UBSxJI+9jp9D+VKflBJ4A6HqaRWO4jjI43N1IoAQN3HLY7jFK3z5bhu+ew9qFB+U47c570HLZClehBx0PGf6UwHL3BUttJJ560H5n5GTwTgg4oLfxHpn17/AOFKpx1J9e1ACEeXg4AxwOOtI27pw23pzQV27gBgDtjpSuoC4AyR0IGB9aQCLhcAD7pBPYD25+tK4JOByueucUj8YAxjoOc/pTWVVbbjjr0pgKuFyPcDg/ypinuOfYkc0/dubJ6gdPWm4K4PCnb8xHtQAmdrEK20Ackc5pcg7guFH3TnoacvO0bmAA/OmsNrF8FecevGOKBBnaPYnG084HrSqvy8KSOuKftWQlmyZPam7WHPRSeB70AGwqpOSzADI29aQrjKkEZ42np+dOU7mxjHfYTxS8AsB8pxjP8AhQAZDFSp5z2BwCKaDv5OQQM8EHv0pSvzfN1GOo5zS8bskAevHFACqWUgA8de1I33shgFJ4A/+vSYCspxxjoOcUYVdv8Adxnk0DERdoUkEjP8Ipv3mIO3gnPzd6XHYcKwxnt1peZG7OM5znigQ3diPHI29WU5xSc7hkHI9PqP1p7bvu7ge3NMbPOSQOp9etAxTtyAAAR/d/8Ar0gX5ccezZ/PpTsOik9AP7vU+9IwHO3vxgcUAGVHAYkE5x6/hTixyBnfnp/hTvmzgkALzyc4zSLk9R908n1oABhWXCsO31pq/wAQUfMDhuMGhcJweB/d9RStneeDuHvQAcKnzD3Bxnn0zSsTuKjjjgN0+tImVjJ3le2O1Oz8208nOeB7UgGrheTtYAdM/pRznGMjGCevYe9PO5mBJ9uRnFN+XaOBwPlGMH3NAxjL5fUbTjhe9HbJBXDDgc546U7hd2DhR2I7fWmhlAOMY7EdRxQIOehHDHjt+FO+6QWHzDAOOlLnqOTxwzGgfKwPO3GBTACwViNoJycjrzQy7sZIwB97/wDVQrZ+VfnGMnJ4oDBgC/J/u9qBDeCowcFQT8vJPv8ASjBdiVbPq3UCnEZ3b2PJGS3t2okUfISPlx2A/OgBNuFBO4rgDBHvQq5I/gDDAPORT9isilDjjPzf0pjE9QThvvMexoAVjuVRjoDzjj60EDy9oX34H9aXqv3gwJ7HgU3lcqrDgduD9KACRi+cFSCcdeRSn3ONwABz70nGc7SvGfxpFyo4AAP8Xce9AAXbOWKhicdKRWw4AbeM49aVSQ4Gzacdu/HWlUsuGAJI7E4oATaUZRkOR83XNN29CpOAeSfT8adtManawyx3E+tIuODsBY9m7UAIf3fDHAzvGRn+X4fnStjbkrkd9pzij+AjJZnHbngdqT1IGGA785oAVjhl3btrDkt069/akVvlzkMM42gU7cQVJ5LfLgelHzMhBBI6devvQAOxXDf6tegJPejByz9B3xyCe1LuC7eSSOMk9M0ozuPcfpn6UANztYKFZB+tIVO4s3HQlhzx9KeBuUoMDjJYU3zANw6f3iON35UANyNo+VlPB3AUBdvJU5PPTv8AjTxgxld2W69ePrTGyp28uD1bpQMTaWba27evyFsdKfx3VmUHOe5oVfMjCq529c5/KgllOG+Ze/8A9agAIJPzod/PCnt2p5DJuBx6cDIzTV+ZQu7du+UsT2pQrqu0At/X8KAHCMjd8o98dqKG27iAfmxyT7dqKljRXh528kqONwNSKW4P3uM88YxUUTfuwHAHYjp+tPXbzuxtx1DZzVCFwY1LFss3U/QnFDBtx6BemSOlNaTbkHaq4zjb+XNG4IuCoB49cf8A66BAuEVWPRhgUDcw68/TOal3eYwyo46AHgj06VHwc/IMnnnjn6igBTztcjkDAZuKUbupAB4xz+tJuA5ddqkfU4zQuOW8vLDp7Y9qBhuBzuHGevShmLKCc5wOQfenGQYyr8Lz070vypjpgjA5AP50gGNgghdxx7daXJ3YG4cHAFKuNoIYrt565PSkyFUZ4/3uv50AO3LJuIOAQCOO1IuN2OgB/wA4p3rgnjn6egyKTIxk8nsN3/1qAFVh5YySRj09/wDAU1lyWX5iOOgqQPu5DhTnAVTwfqPzpuFyTtAxwCw60wG7CzZUNkdcCkwxwdvQ8AHqfWpNyBSc8sMHcwx9elMUqAF4Aznr/npQApby2IyuDyfamFTkDHXOcHnFO4ycDcqjnPGTTVYZ2naWznBGM0AS7SqkYBPB96BheTuHXt9aZuXjoW7jipN+zDnJ7np9OOPpQBGoHRjk4yNv1pNv8JPPXqBinrIMZOOxG3oBSF+CW5Tpgc5oAaVbzD3U549KQBuuMn1AzTtwk3E44+7tpgA67ccYycj+VAEmwsxJ6Zbr+lIzfKScjgUj/e42rgnA78ihSFOOMgDsMfSkAHByvL5Ybqb8pUj7v0PNSCTnIOzHzHA9P/rUz5dqgtx36cmgBeCuehxhQ3Y03jcRgnrhQe3T+dPZsknOeg2CkVic72HU5GevqaYCNGQrYUBcYxml24IGNp7Fvoef0o43E8MOw9fal3ZyNw7kDHPagBvVR2PGcUrHG4cg9Rk+1O3DoDnOByO2KRflU88ccK3WkAjYVMANnkk9utIzZyV3dh7UM456Yxhdw4H5U5WKnAOAMe2KAE+ZssBkMD35xSqG4AViccCkDEDgndyCCBzxjP8AKnDHPO7PXngUAJ0zgEc4Kin8Dru3DnGeR7UnJYAnLdMdsYPBpwY7RyCcZB6UxCOrKxJ68e3WlDYyM8kkc8/hSt94lSSvbpSc9Cee/I6en+fWkAw42j6fxH9aeCAy4IznJ5/DNJu4x0XH5Ck5zgnA7r0GKQxWPyg9+QPfmk/2mxx78U7dkcDjBxSBiCATkY/h/nQAj43E5xk8elIGC7iNuO3NOZWOwZy2PwprNuyCcZ9R1x6UwEZgykMQDz+FJ/CpGCB360uNx3DIPcn+GlDFuCCoA/D60xDEYSY8vGO4PSnHkFcgd/TApSx44AHTPH+NIFD5wuADtC57e9AAqndtwNze/SgcsSfl7YB7Z605WKEqWIHquKRS21uByfr+NAwZctjlD0GB1pVO043A84x0z70LhlbqAeu05p7MRjA4xj/69AhOGx/EOuAcnNI3y5Gd/Yheppfu9go7t700ewb1J/z3oAYuOBnccdCeMU75gwwQ2OCaGyvHGCuSO9N2jb8wzx7ZNACfw5YYHr+J5qRR8+7O3JycCo927HORjIxxg+1OXbg7gPoef1oAc33uOWwTQvO089j/AJzSc7TwWGMnPb8DRuBbPy8jkdfzpDDbnPUN1oDDeTn72Mdx6ZozhWwMKDnnp9MUJJz1wccHJwR6imA3du759s05V3cYJyB9PWm53Y4xx3OKVnDg8c4xtHOR6f59aBC8425+g605Rn6559qNw5ztHJ4X69aPXPQfmRQAqZDDgk8c460nlsq5x+R460ZG7HGVPPy0mQw7EDrzSGLt+bG0bQcZJ/Smc8Bec/yp+4bgAxyG45x29cU3IbIJ3cA72HFMAVeCMkc/jTN3OF5HcfzFSAlsYA+U564xTOuMjPHIbpgHrSAXaFUgg5x9ce9IFKMVwMjpk9evFKMsRjhu5XpTX+Vyc5Gdu5gDzjrTEOOCnynnrzTs7flKlRjAX1NIGJbg7WHHsRSbsSYLED1A6mgCRV+UYBB55PXjikCsFySev92gtzjO0/xD19qUjcRxtzx3wKAE2tuVs8heh9f8ab95hkc9eDT9y7ugB7bcZ5pnzLnsB1460ALzj5eCMZz35pu0l2+8Bk5+Wl47nB/vKO9DKcgdSOSccCgA2nzF/wBodMYpNwOBt4Bz7YpVbcw+fBIOSBjNIMsAQOckn169KAF/hODk546U0ZYrkjOfxAzT+G/hXrkHJOaRidxwoAOQaBgqnOM8Z7fzoCkbm3Yx6+lKMf3RnHQ4oZtvQcd2OaAEZWyctgA8H/P0pWV887duM+gpFITkAKc8Z5x/j1pN/wA2QMc87TwPfmgQqjzHG5uCOvsP/wBVRqT/ABNg9ASOac23OMYGe4zn34/zxRuZstt3Y47UAK2W+6eoIx9BTmzu2gBxnAPrUYAXG4HPY5Ib6/hT2YMRwozxwxGcUDJFRtxwMnGNopm0tg4JAIG4ihWVS2ApPYdc0cZIG3av8TCkAbSvHXr1603yzktt4yMg+4peGYngdegPFIWC7gdq8ev9aBBhmwSoPPf2pRh/mJI6ABaRs7Rwc/71A2Y52hT17n2pgPZsdem7GRTVjLYDjryfp2oVm+8TkE/xf/WpUceXy2QeDz39aADa+0/NtAPcevSmtGw4J2txjipF+XJ6n16k9e9N3FW6gAcjHUigBM/LyMgDn0FO4+UsdoXjnjNIfXblO4IpNzK3zOCehJXge1ACtnAG0BcY4Pemtt24ycYzSKvykYxnj/Jpdx8wlQOx29AaYB6rvB2/xZoIDHl/3eMg5/Wl3A8gZLdumKTjIGByeM8mgA/eM2GYZPHShV+bC5ZTxjHvSM6OxOwDcclM9P8A61KpRf4VyvIw3FIBvAO7PGSPQ8dqdu2qcAkZyTnNJuMfAxlTnr19qbwzEkKT355xQAu1kfG4Ko6nH6UKdqkJyvfnmkYozMNoAP44xwO1N3K8gJYZPXg8frQBJyq5ULjgn/ClKlGJBHmDoF7CmsyKDgIAevJPPvSfKp5K8enX65oAcQ3QEZIyMjp70pVT3XKr8ucj8aCUHZdp4z3H1pqsuTgrjsMcnNAEuT8vy/dHY0yNRxgjI5LHt7Um5FwB/qs888mmswCguAu7jaRzx70APX51C8FgdxPTApoZSykdxwM5BpQ3yvh2I64JzTPM+XDFQxHORnigZIzbWZWKjoSO34UqsqhTk5JwF6/jUbY3bkzgABQen+f8aPODEfvMN2+WgCTcOjEZHAVT19/0pVVVIIJJxkY5496avc9Ng+XPT6+9L5hfpyV5Jzg0CJfLXaR94A5yDwKKb5g7AndzuYc0VLGVo88A5PHWhm2rkgsfpT1T90AV2+9PEfX5xnHBApgRHcuMhtoP3T17UioTggEHOTkcGpWbb83HPI98U1WC8nnn7uD1piGqH3Ku3C/eytSKz7sgFupH/wBemeYrDGDjPUdval3beCG39+2B6UAIqnlMbi3TFKMt8wO/OCAKcJC3yAhXB5BHWgNtf5VOBxuUYA9/1oAYFOTkZz04px6Da3bjPQnNSb8sOzY/u/e/GmcrgqMfL83fHPagBH5bjB2nbg0vOTu7cGl42rgAlTgjGC1CjoQD357k0AKOMMvKAYye5o+6wGcd+aNwdUXd9eKaOMYC9cZ6k0hgcswxyOm3GOlKPmOAcdlxTtxkAAO0jjoeT3P5Uwtjcy9zjpjimIUruUAsM579fak3HaueOTkY6U7eVXJUORzubj86bnbgj5uwyT178UDE68q3Tv05pFzzwxPPvin8lchsY6/41Hu3AEJuDckZwc5oEPXOdpIY/THNOP7tccdPvdR16UoY7QCwOeCT/iKGIjycEgNj0/KgCMqdzY5HYHtRt8sYxksDjuBUi/MMjOemM54pmRhgM4yM84oAa3DnG0gcAUoUsu7B9/f2pwG/dt+UrwBnP5+9NMi7uoyOMZOPrQAhUFSSpJweo54OP60YX5gOBjBOO9PLbmwF2sMg/NnrSBtrDJ+6MYAJoKG7AG9VJwPX60HGxRkjK5/+vT1cRspKbmxkcjn9aRl4Ixt4+ZiR+AoEN5O7B5Az8tJtH3RwVJHTtjNSvJxs4A6FSOaYAWPRlXc2cHmgBFVmYBcE/wB5RS8nj0z1Htyc0rOflG5cEYGDyKQMOhTIXhSGyDx1oAXYc4ALEY5b6daaVLL7kbc496cW5JLcZyDjr9KTcgY5XPptzQAzaWXpnBOPzp21nwC3OQOO1DMFVWJ6jJ9ASKUMOy7iMHIGMe/NAAofnGAf1Of/ANVB4ypbnoKPlGNwyy8devOc0/ccHBXGOnagQgUqQSSTn+EULzjPbpxSF/4icZIJH+elO3FepGOmORzQAH5echu44/Wkzk8+pxx1oZucYLAgdGzQWC/exye3OPakAnReDjA96XcWb07cj8KTd8oxlhjOcmncdBxn6nj60ABU8kbsfTijJY9ccDt+lKG3dOvXBB696VXHAIwp98nNADf4tvfoB2pFHzH2P3acWOz5nAB9Bz0o5CnG1sDgDsaBkRU7Rkg7vahVLLjILd+1ShtwPoeBtPrTR6HOO565piGqv7zBxkjHTrQ3ygEnPq386dkLu6Z7cnFGfm4IVTnt0oARQegPBHGRTdh2jjPHJ9f85qRmXOWJ25zkZ4FMJ6DrxgdfWgA/hI3c57jH4U5ctngDPIAP607JwCMkj7vIwaPM4469CcYIHoPxxQAhypPOTjr1oUfKehJPPpQMNzs46gAgGhWGcfMcdef196AInyq9MdzmhlPP3u/SpPZeuMnB5zk0nbv+IoAjWM9SpGDgD14p38QOMcdMUEL2JzwBn34py/NgqoI9cZpAKy7VPceh7nFNb5jyVzxx/SnKvY8N0FJu3EggL+Of170wE29hkE/rRgsSSuB7jj2pfvbvm3Ed1pd43FeVORjnPFAEefRucc0v8JOcYGeOtO3fMAR8wO77tIzBgRkd+owenb3oAQZ+73BPan7dw+UFmx6U5SGboy/Nzxj8KRmA+UnaD9elAC8ljxnn04zx3pjJt4OemflNSNJjBZG28kcnj0pnHBJwpA7ZoGNbcpGfc9PwpM9wcgjrinRsFbCnJzkgYzimfeYg/Myj3H60hDh905Ydcbvak5Tr7gtT1bd8pIPbvx9DTCSWyyqzN83BwM9/yoATaNoJI4HPak3exftj09afuO4fMN2Mc8imyMWkO7aOzY7ccDNADFXbux17Hpmng4VlKYAG5s80uTuznGD2GR+FDMVAJIO7quevOBz/AEpgCjZg7s4x075pyjqfvLnB9+KXJC/M2xgeVpNx25zlgpwF4H50AIvzfMDn7p6cHI6Ur4TJPAPXuKUNkkk4JGByOMGj7u7Jw3TjJzQAzk5Occ5PHftS87vu4OcZzxTt23duVgB/ePHX+lIx+baXB/DmgBoJOcnPOeRxQFI64LdCKdu+XAyG28ZP50P97axUjOenpQAm0tyPyNAG3ABUHOfw9KcccHHJPrxTV5ONpBPoPegY7cWyQcntke9NYbQfl2j6U7I5GMtj1waRmHJwwOCOT/WgAb5lOW5zxntSMwXt7ZxT920klVbkHrmm+uMEc/KDQA3bymRg8cimqQcegGMEd6fkrggj0BzmkPy5bcrLwRzQAKp4GcjGc4/SkbcGLHkcMDjnmlXoOOvRQ1K23+EMNvBBOccmgBN37wbiQM88U8fxDJHORn6U1Oi9Qc92pd3csu/IJBOe3rQAnLLkjnjH/wBekZjvAznnHSlJ3dFznI+U8mlGehLKfXdwBQIaynk7flPGTSbieSQD06dD2pWO4ZHbkcnFIJF5VfxOf6UABbOd6ncTgMKV/fAYcdOtLuPdjk/xbfbtSiQtwOf7oHX3/GgAPznAOepOKCxZiCMdjgUrNuz29RnOBQ2Bn1z64GPWgAChsDO4Efezim5PPPOcnI68U8MWjQYyp4PHBHpxSBt3GPMGM7/6UAN2ls56g9V9aVcyYwcdxxz0p0jDnDrt7DHtQe45dQQCQT/nFAEe1nBJAXPTBxQ3zkfKw9M/SlbLKD17cd6FYR7TuUcjA3HigBqlhj5QuBtwKVWG0ZzlckDHWk3L6fOCSfenruPIOOMYJ4FADf4uAV2E5zR/D0YHrnFPZt4LZHbjrn1/GkXLYOMg9t3FADG3biuNu05PI9OKFbdndlQT6c09trHOAzEYP60i/Ng4I/4EBQAnzZxtIHHOP8+1JuZ8kgg49KkLHdtGCB0GeoNIvy4BI9MEkfrQAjbl3ALhSDzj86TduOM9BtHHensx6cAYyATnPrTee/GO2e+fX6UDA71LEZxjPTv6VHu+ZiGI45yOPXNSHH8OG9PmJ/Gl3Hn8yxPGPQUANYfLgHcTzimbi3A6kdx3qZeG2+/Rjz9eKY2eT1Ocbhx+ApARsw2oAfMx90U4/M/XHBypHBqTACyKdoyON3X6cUbiCOAfRsdPrQA3cF5Y4bHboKkVf4W+bjk4oXtjaozxk88g9qdkjjH1GOT+FMBGOAcLgEZ49qKf0jIzsyOB+dFIRGrBtozkdR7U9gysjMoIwD8ppuTtDYx+H60m44x3xjocfypFjFb7qoP72fzpq/LJjpz6VLJvXI/i+bkDpzSLndz82D1AwOlUIj9yzZ29+/NLz1K9+R0zSsrMOQGGAf1preynOeoB9aBCnDSYbH5+1LvG0/KQMjOD1NDKCuNpZi3pTWPl8lsZOD8vFAD1xtyTkdBhqXdt+8epA6d896Z93G07vXC0/BUk4yd/r+tAhFyqrggAE59qTkYGCOuB2+tJ83Tpzj9aVcYyCTnI6EjNAx6/KxUMeB1BpmSVK4Oc9cA5NIi/L8oyB1LD360KMsWxlt3OKBD1wcqCNuPWjJTGfvHjk5FM3ZX5RkKMHcOef/10SDc2fvjueOKAFGN24jDL1YijkKecDOTupcnyyu4jceRjn/Oab3A+8cggjoKAF2jLdjn6fjTNx4bOT2Ydv880sn3mLEN6YHemc8Ejr36Ae1MCZT5anIwD70Kd6bc5AGBnoTQoK5IxgDgt2pdx4JGF69ht96QDV4fuqkc+g+lKcL33LkDGaUsQuNg2gCmry3II+bpxQMThpC7c8cgDFKD2XdtI/hoVn2sR0I6EU1WLE/NzwDtAOaAJdrSYbO0A4JHJ78U0scEDHTPXrQ3y/KA2N2MY7460Lt5HTaOBxn60ALg7cAgHIA7kZxUYX5cAfLgdRjrUiuu8HcTlgM45pFJYBhkE8bnoAaFxllPHXgdKRsMowMY3YPcU7nHPCqeucZpFwzHbnbnDMaBCLubGMjA+9nNL/rGUHduB4xjuKU5UEHaABjOKXq2QMjPLYx0HSgBAGZRvzgDI5BpSzFSMsfpj0oIbAwFwF5GOntRxyoIHrtHTigYhjWMAHgqvBxRvO1hgHj8DS7TtjAJORzuNNVlfAB3sei9OKBDtrBnwAo5Gep96bndgZZj/AHcYpxyMEkFQW5HX/wDXSru7nHGPmFMBu4bo2znHXI5FCqNo42jHpS84UsvBPFG3p/EfukdxSARiOh+YA5GBR1bg4zzjoDnPNKxw2GGDgD5T0FG35eAB/sn3/wAKAEJBXG7IxRtDYwMAnHy8Z+tKzDaTlemOPX2p+4Zxhslu46YpAJ91SAeOc80gxtBxt9WAwaUFduPu4yccH6Ck3ZUcHB/nQMczHkg/L03Z6Uu4tk5PHI3CmE543EZJODijPykFD2zQIRlG07QMY7f5/wA4oVhgY+UHg5607o+M4zzwM49P8+9IzHdxu9OcCmAm75iA3XjGPakVVTGVw+OOPzpzZbg5OB0C9TStw2NxK4wTnn8qABc7uuNxwetNXowPf73Oe9OzhlGWHIxxUbbfm4x09RnnpSAcrbiAMDBx6fnUi7lycHGM8nOKi3A5+bBHGOtOZw275WPswpgBwrAsM44+72pNo29f6U75VOcsByc460xm9CoYD1oAVtoOG+Zc5x1/zzmm8bgTwccCnFlVsgnr128DrSDnpuIx1pALyepY9OhFO2ktlhwTwAOaReflzn7ueOuO+aQNuxw2Dwf8aAADCnHyjGeetGCz/N0DZ+YYpWGEYcgYzjH603cN2AMDOehxTAUndjByO4HNAy2AM8LxwDSN8uRk5OT0zShtpyFwMgZ6UANztA+YZxz60oysbNjBUZ4P17UisOOD06DFO8wfN8+eMYA96AA42442j2704fd3A4z6dqXd8xJJDAkAdO9N5LAE4BOBz1oGLnIYDhs88Z7f/qpvyrkheeMZ4p7SBf4jzxnr/n/69NY55+Y8DtQAwjc3zfLyQdx68UgY8HIOR0HSnHdJINo6knkY7UzDNgYycAjjgUAPT7wZucZH6UjYVgCAcZAJFPX/AJaElT8pHzduKauC3AI3f3f1oARBwpzhQOmaQMcnBUhfmBIpzNls4+bvxzSsyhypyzYywUfpQIZt2sWPQAcKcU4LjrkBufm7e9G07eSNuBj60eYVJ3YLN1wccUAIq7doJ3gDmlKmNTuBCnkjil2kIMYUZyyd8+lN43ENw3fvQArDMnQkbs9AO1C43ZXjjkkmljxuB5UDnb3z6/ypvK8sdvHUf4UAKp+Yjg4XqeaAAQG4z1Jx1pyg7tv0zn6UzJ+XOAewBxQAu4t/CCNpIx2pOFUKF5+tLGoZgFGTg/ifTNM/hUheTn3H1oAXI5JyeecHtmjdhQuGXnPPPehckADv0JGOlId/DEgM2B0z3NAx2Q3IJHXCilyF3kfeI/iHpQrMuNu0novv70YbGSv3OOvXmgBx+8MKC390HsabjbIQR2wOhp247X4ye5xj8KaQOQVIx0B9fegQn3nUgKM/w/jSKzfMdqjtkHH6U7aFPzA5B7j6GkZWOcBWTrx296Bi/dYrz1wcjvSHDMrEbiRk8etJGMruPK5znPSj5vlyvHAFAC7gjDtwcnFL1wNx7Z2n29KRQcbevoG6UuCxYbvvMCaADjBz0PbFJwpGMlQ3PHXNK3OMDI55waULzt3BDkflQAwrtUgHODgnFJIu4/KT25wKdxtHOeuFAyTRtJ4wAM4+UdPegAbczY5GD0DegpVLeX8o4A5LDrQxYyFt2Tk9snFHLAgHJAxjsaAEHGAhUfw7cYx3NO5Vj97OeM9KTB37uBuPoefWkxgjAJ7Y64oESKvyj+8RTVBYAHr14HtQ2Co4I+Xk7envSkYOcBskjd2FACtltoICkDI4pGJ2468DvkflQzZ27WGNvOD/ACpDIArKxDHGTx0HPFAwPyufkxkHHrTF+WQrtwOAOKdIp3Png4B3dqRcJ90srY+774oAavzBQEJwOcmnDczAHapXkYNLtccKylTzx2pF6ZwuD2zkn2oAftxtITBHJ+b/AD60mN277pPTp0pGWRtzHaD3UnvTRjr1x1AGR+dAhWXnhVznPXtS5GMYHttHakXLLleS3zcKefakQk45zjj5RxQMds+XaEJJ6HPajePm4wCB2zSLukJw3zfdwOehpqNtBG8enA75pDHMFAbgsDwMDGKUZU7sfd7N3pNwDbdxYEEDjihdvBDHI4J68/5xQIAARluQBn5TTl/dryvyjsR2oXbtwVICn5iBSfKv97dj73X8fyoAVV3Ag8L1yOKRc/3evTcKFVeR3xzx0FNUDfxuJAzz2oAVccngq3JwcYNCsBnsPxNHlqy4U7snk4xjAoGM/wCtJHXAHPFADlORg4Usx+6OlPjHbb1GM4GaiVf41G8jn5l7mn7QgO0knPOKYE23qgPTjAGP1opN2QcjjOBj+tFICEZ8sYbqfu5xijleCCM5/j9RSq2VzznOBkdRSMDtB4AwT92kMjY7l2lf/Hj+X+fSge+MZ4+b9al2ttOFBHyn68UgZVyTgLnjIpiIvbG1SM5z0pQhySQuATzn6U85C5wfLPUj0NBYM2CxHJ/P1pgR87hzjPTk04Ar8o3MOn3u3+c0/Z83yHcoB3E9KbHsDLuwpwMH0oAT5uOOMY+Y0nA+VRkhuMNUiqMg8OCev+NOChlUbuG6YGP1oAjOUHB465z703dge2DjnrUsaBQOOPVvSnDZu4O7PX/CgREyFWJwT/wKk/DC5yBk1YVQucqM/wDoPrRt/eDYP+BZ4FAFcKQVCnrz1JINKwJLEDdzk9ck1LtMa/e5Ck7h79qZ91zwcg8belADGU8kjKnsck/lS4BVV2ghuzcAU47CrZJLY+UDvTUXayl2OBxQApjZQwOA3QKRn9ajZdxx03HJGfap/XB6nnJ6e9RFQuRztHy/TmgAjG1MBA3rmlfCsRx8wxk8mpVCyZzjGPXkU1lHJVsJnkj0xxTAh2hejFRjIUGhvvZ25OfbHqOamxuwMqwwB0pv3PvHGOcY/SkMi2ZILAA467iM0qq3Ixgcc9af3w/IAxkjIpAvY9G/CgBFG5lycEcHa2PzpSDtAzlf7w6U9lO3HQ9xjt9aXbhclNp9c9/pQAi7l5yM/wB76+1M8oNkAg9OCxGMCpNo8zJbaw55+tJhSANwCN3I5NADVXDZ6sMdTkGmFQzHByx49CCealKjyyzDjpuJ/pQqbiw3H5eNx/SgCML0wMEDrnijdu4x36H3H/6qf5YzkKQF4Pp9aOFYkZ+Xux/CgCPYAq4BHHOG/Snbsr8o4z9CTT9vlnp908tTd23HZv4cDJoEM8sbTkBTnpk59qVsMduMN+QGKk+dRkHcWPU+tRjHTdu5446++aADYB8wUnJyBu4xS7efujK8n2PtUhjIkzw2ec+1NzGf4yOvzetMA2CMrltrAjHPHPekVWwpBJPQ/Nk8U442jB4J5PsO9HDEEDcD8uM9aQCPgKfmBXu3vR5eSCcNgZznrmnEKmSuQB265pV+Ygbsn6d6AGj5QR0A4GD0pNhJB+VeTlgcEU4x7VIIOcc89KRZDwy8eisPSgA6KMZB5GTzSMPl3lc9AWBIp7KVyAflx/kU0YOADk/7VAwOQxJ/A59qQKMnPBxxtyOKeylmULwo9OmcU3cWU4bORzQIMhVARjweMjrzQqE8E8Z788+tGNuMEhSCVyaMADjPTGDwfrTAUqBgYAPOeDSKnyqRgHGeMkE07+I/eyOMKefc0HCthTgDI/GkA1sbXB28/e4NNyPmOcMPc+tSsp2k59ulJJuXeS36c9TSAbnoAx3Z7c0AbsZI7kYz7UbSemTzksOlKMYzyBg98D6UwGnazYBwAcDLUvIHXnGRhv508defqenFNPzD736UANYlmIOP+BZPrSbQvXHTgKeaeQvXd6HK8YH/AOumYDH39c80DAqemAemCc9ev507C9fuq3Xbn8qQ4BIIwB0Cnk/55oUtnGcn0z0FIBG5Xg5GM8/lQTyMgkeozSt/qyOuOox19KFUFsdT19KYDVXrt49eTRheoHJAydxpzbl+U7vUheuKVF3buQx2nKmgBgGwsfQ/3aXaW5O1hxnk/mKTKrtBP8Pr0py8Lnf82QcY7UAIMMoJ29+QSPfrT2wq/Ln2Y8g0K37s4yf4RuHH0pVX5gVHPbPQH0oAVWLfKTnnkY4HaopFGB938yKmyNoxubbyf/rVFwrMRkbeM460AIY/m6gJn+E5602RRuIPDfQjj6047TkNu2dsCnN8jFfm55FAhu3p8o598n6UjMF4PBxt+nftUhUbcLyw5Yg8cUzb82PmU8k/4UAC55PQADkE5I9KRgVV07YyefX6f55pW5xk/Kw5OaGC7sYbB5DHsMUDGiMNljtzjhuxNL93O9VA69OM077z9yfukdD9aa21ZM5I4wcHJoARVDMu4AtjBK+tO27VPHHTj1pWU7FyMgdc9RSZP3icKPw/GgQDbIwLBWBO7nnGe3+fWkVTHk4IOcZzSow4A+ZRjjHU+tI2FOM570AOXbvHHGR3OeOtM2+XtOOcYqUKWVsfezz6UjDHO3YW6HvQMi2/MdpUY/h5pNo2hunH8IzxU6/vMkZyoxjuajyyjaTjLfw/yoERsoZT8ucfMeTyadtwoGDhh1ycjNL5Y2jnlj93PSk2NuwTt5wWzQABVOA4GO/BHSn8cMAWUj+I9/am5J6vjsG6ilGACOM9sevrQMFUtjKg44B6EU/cclfM3jqAw6mm7Q2AWGDyN3r65pQobjIG0csvc0CERSWUDC8/L0xjvTUVckbWGDjg4H5U4r93LZU9fY+n+fWjaw3nAK9vagBFySu4A/X6Um0L1BHG7G7GM88UAr64JPUD+VLgKqg/Mc/e64FAxFjJY5AB6hg1Kw+UZ4X7wHf/AD/hSqoYjPIBwd3WhV9N3oB3x3NAAqqwbHAz2ak4Vgv3huzhu4pWKkDqQOPTNDZVlC9eh28nHagBOffaRj0prRiRiFRSD6kinsQfmHHbrTX3YADbOcBfagBNoyMADB7UqruUFlwAP4eCKkk6jkAADPpTFIKdecfxd6ADgjAGVbtnJHvQB8ucLhecYxzTtu9SAMlumOMUn3SGL5OMfjTEAVFU7c884yeePSk3HcT6HP5/SnkblBPIUHJzSN8rkfeZe3bNIYjKdoG3gjJ5/WgufmPUgYO4k9DyMUpQqoYgYxkntSLtb7zEH0z1NACfcGBxznacYA9qM/KTgbuoz2HoKPmGS6gY798Ubh5ZBfnHK55oAFjRXOFPynB29KVm2/dyD1XKg84prRGNlye2cjnNLuORucbSQcjtQIXcY2YEZI/iIzgUu7CjA+X/AGl4zSeWx53ZBO4NSc4JDE/h+tAxCx3Bid2QcFTgD1OKNw2g4O3uGGRSyKJGTD7k7sOOetM3Zz8+SR6YFACtuaQAhS3U8dB60q/cBweOcg8Gl272Rt25emR60m0nHzZwMe1IBfMJAQgrnnpTt33j3H8QGPzpAu9R8x9+elH3GCls7eMn6d6YDmZlySMDOPl7UcsB90k8sSMD2pFXABzu7letNxjhmU885685oAerFc5J3Yyd3Q0377YYrheBx0ojX922Q2f72f1pu7HTI2n73r7mgYv8RdRgjg7jzntSru6gYY9NwzQqs6uo+dVbk9CaY33jh/lI470hD1C/LjG7JB44HtTl+bGQCOhULxSABmYk4IwQuP5Uq58td3AHbuTTAeufLBD47AdAPWilGWycZU/xentRUsaIlwi5xt3ep/wp/Bck7ZD0wuf1ohwFyOT0AFLgMofAKr/eHWmIiCsFHMgHIK91oDLjA6kYLHpUg4jX5Qp5yO596bJ+8UsVwmfu0wGbirbQdgx8wxwfoacNrJtA2luzdMf403b+7ARtyk5HHf0pWVsFW6kA+pFADVUrw3C/7PQ+1P3LljtG3OAM5wfejAbCgkAc7j2/Cl2klgvzDHHH60AMICqMjB/hPY0/lQuAFPoe9OA3nO4EqMDPFIu5gB+GAO/rQAeURkkZx1XNLtO0KCPmPKjv+nFOXoecNnkHrTeMdByemOePWgB235m/u4528g0MAFznGW6EYpU/jBb7vqMUmPnxjjrigBm3ocYJ7beB70H5lOeOcgbuf5VIqHaGBDEcAE01z94g9PU8UARAFuQAVHbNO3FtzYDdwSemKUbRnsMcYOM8UL8qruwB0z1JoARtyruLHHowBzRJlsk9DyAOfyNP5jPRuenNMOFA559fX6UAIpYrtVst3z1/SnbizZI4zk+p4PT9aWPO4kqMY5xSHsv3R0HzdOKYCbnDDawUAZ56ik42bv4uQAfX1px+baQvyg9e9I23dkrtGOF7mkAgycpI5AA5VhzxTck5z175PHtUm35T/eXOG6fjTd3VXJx/OgBPvYJ3Bs4yDxTmB3EkNjpyefypNp2kodwxgr3FHTjO/jODQAZManO7uBz1GOeaXLbc/MD2GQR9KcueCpBfP3PrTFyeFzkA53HigA+ZdoOHU9eoFNbLAMxKjJ+bGQfbFOztyCuPRSePrScr1PzEfkc0AKrHcAxDH+6OOKa3VmyzHOCP64pxxtIYZY8YzQMBlPUD7tIARiyhdxI/2hgUffYDvngDr0pQpUbWBOM96aRtxyPckZNAAM+WMuxPdcjg0i/fOPk4x74p+DHuOMA9MU1V2ABgCoOfc0wBQGVsjaOobB/KnM2Oh2kcLnkUq7lOcYG75c9KTjn5sE8HNAhB8zbsZ9Ru+9xSfwglmBAzjintlVGcLg5wOc+lNXdGTkkZ4JxnmgBzMdwDAA8c57UjZ6KMbiT97p+lSBe2cA4O7vRgtleTxxu/xoGRNhVIIOcY3HoaRs84Yhj0VcEHipWUM2A2NvA701QWwAOc9xxxQAhPyLhcH+905pGJ25xwvVt2KXaOfu9PTvSE9AGzx+tACv8AIcDB4wWDUfNtycqOmB9360jDKru6HLHHv60E5Jx34HpQIUng7QR7dj/9anKcdPkHXLHr61GML8v8PbHf1p+FHAzjHfv7UALwv+z356/j7Use75ep9FbjHFJt6nccdNpHPShmIzhic8kf0oAM5OSGbnp/hTOMHG7d2zxin7sN1AbnCmkZuo3fwqPr7UDAkbRnjn+I9aAct/c54yfUUdC2c7cc0cfdHyf73egQYyM/MR26ZNOyeMZPt0FIQSeVGc5+YUMw46gdRzxQA1sMAzHAJ5B/lSLnp8wz9MYpzdcKRtxn5upNRsGZWK7h6896BitjaOuc4Dc8ikORxkBc4DA9adnzCFxhR1BOaFbdjGMLjgUAK2YvcA8Z/QGmY2sADxnuc/jxTmXJJC8BeO/50KefkO7bwPT3oAGzvbCnJ/iB4/nTU+8dnIA+U5p0i45OSo9DTwwBB7nkD0/+vQIYpA74UdcN/jQu75s5YccZ560ctxnggnpjNGR5bkltxwcnsKBjkB4+Y7mJz0P404naVKDcF7j1ppx86g528D3pedw+owvTmgBBk/3c57f3vemSNuBc9D0I/wAKk/2Q42j7v+fWmn5ZCQ3PUAjr9KAGZZJAzYYf7Rxx9KceGZRwOnJ5/Kk287WYpn7vOeaVlYN8+044INADtu3GSwOf4R/OmhsZBHzjqT1H+eKX0JJHOfTikzwQxwD83B/CgA/iG49xz0P5UjKd/wA+Q2/+E+1OPzcDcNw49qYwXcDkgMeMjpQA3aSwwxzjPIxTgQOSu3nOW9aPvBcbsdBSsu188v2PoDikMRd7MuQVbGSw5FOyOWY5GMZ7/l6UgQlN6phR97HBNJt5ZiGxjHXmmIaudyruOSf4sEA9qlZi2eMeuB2pFw3IyFHIXv70PjI3E4+lADFyF2k71PAOefb6VIzbX5y2PutmlVs5wAW4JXv+FI3GME4689cUxCFiMKoB9OeQfqKT5Rgjhjy3PH51Io3sDuy2eVz1pjMGLZO4En5fT60AMZfm3KAVxyE/nmkKblBY5+b+I8YpcjYRvznjatK2VbqcZ6L6Z6UANZlP8Z25xxnIpWzuYhlcDpk4FLjyz85IychaGyFbhT7L6UhiMPmZmLArjO05H0pwY9RyOvJxk/Sk4QM4T5s8elO+4uSTnrigBFYRkMRg9gT9Oc0i5ZWDKWb+9u4p65bDKe2Nx7+9NXDfNnbu4HvigYbiqZHGOm7/AApMHI2qA2ckFsflS4I5LYXlWbHbHSgqz8hlZSM0CDjuWwP7wzS7t75JCuODnp/nFG7gc4HTK9jTudgG75eu7HX1oAbzn92Op4BPalzjuMMcFqGZgpP8WOc9APak3BTlRnbggdsUAN2879oPAz1A/wA+9KzHc27cx9AvX05oYGPHP1GfyoZd2F5O3JwKAGqM9Bj154/Dmmr8pOXbA6cipXJbkpkZ+7np6UzaXUlemPunmgBcDduU7h/snknv+FOGdpwAWPJwwHB7UhLDKZwxOFI4FCye+N3YdaYh0bHAywK56ZH5UjY45IH8XY57U7LeWFPAbjPoKaAGYqQCxOWPcCkAZIGGLDnle1Eih+AMlflweh+hpdxJIU5b0pNypzuG/AAWmAHDqOCQo6MaQ5VQQAzfxHp26Uu1o8gnA65x1+lJ3+bhQuT3pDBQN2VVkGMbSRRtG3JUFu4xjj60vlsr4L4OPvYyDQq7sZ3KvILAc4oAQ4Zx8hQ9wSOaGQjAwEOeme3vS9QG3YYnsO3rSdehxzw3tQAjEk7cbSOSN3b8qQqWzyEGcbsk/pTpF6HOBwFYfjmkbjkE9fvUADZcBSu3+6c//WpzLw2VCjGR6/hRt+8euPuk0nqAd3HHr+FAwY/LsKcfwnIoCkLgABepbOf/ANdOKkxt83zdSO4pnfn5j37YzQIVTsDnG5fXODSqp2gADA+8SacqsyAsSy5yR6UwfdXJyM8g9AKADB8s4Dbe4J5xTST5YAUEddo5H409VZs5OT90A9aaR8zEsQV4+XvSGJtk3Y3MqtyO9DBs/eJAPG0Dj6ijb9/zMg/wjNG04w7bhjO3H6ZpgOUNF/Fk4yEPHelC/OB918ZB3c0cNzuwCeR/9enjjDZ256LjOPxoEOXI5HzgcfMQD9eKKdHwpAIAzwfX2opAQooONu4Buen9KfuDcFgxHIAP86YvC71wD6CncKuSuOeFz3pgNbbkYk3l+OtN8sHO5s4ONob9ackpZTzu7Y9PWlXIbpx2AIxQBG21vu59sjA470rKu7cWyRyeaft+UsuPYjuaB82eMjpx29uaAGtgcdemMKeTRhY2f5wp/wB48f5/rTtu5jjC8fWmrzxnG7jbg+tADvkXOcg4zt9TS7SigEld3zbQD1pAp3MpbH9KXg7lxknjB6n6UASDARVALEjJ9aiBCr1xj6c0pbhtpJHpmk6Dn8vb+dICX/lmDksc88UxvlUhiAc+hp3KjbkgAZADdqF5z1IbnH9aYAynaSN2PugEUxlCliBn0XGKev8Aqx0AI545x71FgYJxkd+9ADlBXcQScDI4prDaDkd8DHX/AOtTgo2uR1I9fX+VNzkZHC9Tx/KgY7/lmfmyT/DSSNleDjHABpW6Zxgsfx+tJ6nOD0555oECt1ByIz+X50u3cHGMsw6D2pM7c4wOO9Ky7m9CRgdOaABQGJy5bjPPH4U1s+2QQB/hT+GyTt4HbPFNU9MtgZzuzQAiqOAWOMnCn+VN55+bHq3Wn53Egj1wM80zc2w4zg989KABsfPkFTgGnFRtOTtPUc0mO/3STx07UbvQDp+QoGIyfKpUcDJ3f560EKythj7DGPzpQwTpxhcdeaDx1yQP8/WgA+XBGCd2MntTVyq5ztVjwP60uNoEecD0A60gIGQDkdCT3x3oAUYADZOW+8euBRyzE7SMnAxSbQu3IKjr6k0L8p4PzE9T275NIB2PkzjJx+VH8J6gAjp2pu3gEcD8KU8qW7Y5Gc/zoAVRhcjduzt+lJxgnbk9M9eKRvmA5IbJJpeW2nrn3z+lMQ5cfMT977u0nkUucKRz7Z7U372PX7xJ7U5QdoAzlunP60AA+8ODz/CO9CjkDJB6cA9e9DEtwOOemOnFC4HOPlDY6kYoAcy7T/cIONx70jKu7gj0zuPJxQwPY4btzmlOGHHIbglvSgBHQ8nbjAGD/wDqpCqqeW789eKRstk49uKVvlG05wOef5UDA52qu04xwB/jTNuFyMgYzyOM05gPu4Xnk9e9J93gDI79z9KBCNjapbDB+pFIqlupxuHGRzTm+VgMkADA560hxjZzj8eTQA4NtxtHGOMDNJu74BGc8n9aRVBbkbQOuDShjHwOvQd6BDvvc479T34pvCkemN2Ac0DuR16fj/SlGVwRkcevOaBjt3PHzYOT3OKbtxnIPygdqNpyM5+uAaRuuSFAOTjBOPWgB3yjIH97A/8ArUrEt/CcD5jkfpTSxZhng9etOUDd9OxGOaBCgrwck9QMnrSBivTIHUZFNAJKkYyeuCQT7inf7oz29aAGMeVIByoJwPTtSLhio+bb2GeM0sucLn+EL164pMsG/vbe9Ax0hbdgAk8EelNwHb7xwTw3Sl2KxPAG3AH0/wAaX5sqT1I79BSGEmEGc84IDfhSbfn6NjI+XHTNG0Nn2Az2+tC8sMD5epx1piHEnsDjPBFIvEvzZBbnPqKG67SOevPNKg/eEdQ2OvcUCE4jzjIXPHFHzFXJHHcnpjPtRx8xGB3HBpVUqG464z0x70DEHy4O3tjBHTtml2qm0qcnq3NNTO0sDxTpPkzxwOBjtQAjMSucHDYYMRinbcnpznjrkUbMZYbVGew5xQzHjJ6eo6UDGbRuUjBwSCCe2OtJyc5U7j2JpyoVZhypzjIzzx0/z6UmSXJ7Y6Y/pQIVANvH3icDJpN29sbPl6n+lHOzcQDzyeevakEa4DYGMZ56knvQAoxwp3fN6mkLMzY2sA3X+ppeWI/2uDxTGAdjnA9M8/rQARgblyG5GfwpzcqVAyB+NIu44x1IyeKGbknOccAnnmkMdHhl3MD6tzS9Hwo5I7dRR0+UYwvf3pFXrnA77u1MBdu6QEq2WwvTHSk3bW+TrntzinL97B4Ucj/9dNx8209D6k4oEGNr5OQ2PvdPqac5VWYjn3oQYZVBwD196ax5HGcknHXn3oACOVyG3jp2NDMpYtjqOCO9GGVhtI/pmlPzBdvA64/rTAbJtOCBgn+LA7UxvlYkN8uPqDnFS7d21cZ/4FSdFBHQ4HJzzQAwbVUZOS3BbOaaFDZYEoFGN3/1qmbAkycAYP403lCO5/maQDQyHaxbcT07g0oT5sZKHqd1OHqw465/pSNkkkc/QYNAwXYZOSrr9frRuDY+6DjntS45BJBC4YHb0pFY4IU5wcdKAALnbxhSDwe3PWhsCQ5UoP4QeKNu7nPJOD83SlJO7PP3sjmgAKhcDG0+h6UueVyh3dgB16c0nBbGADkHd070YLSPnavPX8OlAB/q8gA7scZpsi7QcE8dNwwMfWj+Dk4A5xjrRt2oQPurjKqOtADz8pACn1qPlD/EOc4/wp7AtwfmOMk9AKQN0I+4MYHrmgQ5sRyEYIwcZ7H2qPdhtzfx/wAqc2UcAcY4B45/SkLFVIHIPVhzmgAIGM/N6liOgpCxPUMuRxjpRJnHTI3AZI7YoVduCCOmSQMUASbdqrnLfLnjrScyKp5Azxx1z603jbk8LwWwenpTvu5ZcK/Tr2oAUA7S3Hyn+Hr9KbIyhCMgADn1qT7vT5iB2479c0xWbbncR1J+bnP+FACt9xdwyAOOaRtjbVPIJwegowFyNwyBzg4x7UKPMG0DaWPryP8AGgBPk+7n5eBls8/SlXb1yAeoGcZpd25gf4iP4jk0YLsdy/w4O454oACv7wjG09SoGcCkwW4QZY9d3an/AHgGIUMTgj3pGy2FP50AIwC4Ukq+cgegpvyoW/h9cjtT2P3iD90D73OfQ0hLfXb+v5UAM4TgZG3+IjPU0uBtOBg9iw4FObdufcd3I+YHv+VN+bkHByOeOtACfJypJxjAx3NP2jec9cZLMOPpS/PlUJIIGfpSDJyowVYZ2gY/OgQgVVVmw3Tk9qBt4z8xPXA7D2qRQ2AGGFbk88//AFqRd2MZ+8cEe31NAxnlljk5JHJI4/CkCA9FIYnGORgUoU7Mt8objaP60hX5SoJI6cHrQAR4XLP34HfFIFG04DMnUcdfen7mWMdQW9+lG3DbR09AefzoAVUDLuPLdRn6cU88kgg++B3pg+4WKjrjr1p6xhQpXj0b+tAC8jPIyOufeijcqljtwM4zRUsCKOP5V6HIyCaVWYNwOOThaesYWPABBz3/AKc07aejSKDtyG9PpTAgjURqpwuWBzmlzhv4QM445oVfkGSen1z/APXpdzhQv6t2pgIcryQMqMYz6/1py5TI6kfjTNpG3AwD0Vu9HbJ2lu+Rk5oAe2cAsMqAP50iltpXKg9S2elI33SDnqPvZNK53bs4ZuGOOo/OgBW/uk8Kc5Pf3pBlsDqW+bhug9aQgspJ3E9eRwKd93AyGJO4bsj6UgDcOmQ4HA/xoJLYA6+qj9KFyyjp7bTzn60L8gBHJzk80AO+8QSDliOfal5UDkYzj60nPPYbeVx0HakGeu7B+oxQA7efLfH/AI7/ACqM/K3y7SAf1p5+YE5VeMkEZ/H/AD60m3duztwB65oATqj9D7+tJwsgAA6fzp7bipJCgAZOee1Iq4JBbCkZwDmmA3dtDHPt7Uhzu4I+n07/AK05QW7LheetII1yMY24znPf/JoAMncepOM5YYpNxZgf4mJye3FLjdkZ98k0uDuwp3An6fnQITeehOMjPT9KQsdpwArHn5h+lL93IHPc5HSmtjkblXoNyk0DEyCp2nrwCTyRQe3y47Bc0smRkjKnHTOcUijd2BJIx2NAw2lsHA5zz9Binklc9BnHy03dwuRhQc7iaULt9v8Ae6AUAI2Ts4B5JP096GzlixGVbGaftPIJyOmccYpqjADYYA5xu70AN3fM2SOuS39KTG7JxyeAFPpT9rbgG7nuOc4prKceh29GP60AGCp6fT6UnB6rnjDep4pQm7kNn5uvOKOR/EMYJ/D1oAXBwcjluvt7U123KT7An/CnMP73pzgHp0FGB0PTI7npSAYwO0g7UGTjmnZ+bkADIpvONwxjkfTmnru4IYAEj5s0wDaM+mQWP+FDNu5yvI5x/SgLu6Hplhg/rj86dkqTlu31P4UCBl3HkgD7o55oZ+vI+hOaUhvMxnqcjjn60gOF6jGDtyOn50AG0rJlQB2GaQt2JDHP5e1OZSOSS397bSKCpwTuwefb/GgBJcsxbbzxjPpTG7gcj/Z69O9PZWXaN2SBnr0pNu3gYb1Bxk0AKzDqB8xHGR0puOnTA5+v0pzAsCT1Gc/X2NLtICk8ntnigBN27BOMckY6Ui5DAnAY9MdM04j5VclSM8YpVQjccqVByeeooAiXpjqOTxx6U/aO33uvtn2pmwLhSCDyevFP+9gN8o6geooENbO4AEdM4NLu2hflAXrt65pWX5j02dPmNHYAFcbRz2FAAuc9h81N429Rgc7s9s0/ksAADyOw5NM28HnnuB3GTQMUPz1GOmfSpMjGO36n6UwL1we+DgcmnDL5OcdycdKBCqOv8XPNIxXjGMDt/WgsQRkrkdM07aSCBjpjgZxQMjZdzduy+9M4GOV78Zp7jnAPoBnI/rSYIGRnHPegBGbcDu2glRilVfnXABJPTPPFI27AJIH3RmnNuViOcg88Uhg0nVvve3am4KnHG7PJPr7U6RflI6HbwOnejlc4w2DwfU0xClueME9MenrQqjIHT056cd6TLLnPA5zwc0dWx8oJIOOnagBF4UYHGODnFCqFRumeoz05zzQv935fT1pWDMjkgD5SP1HpQArDDEFc54A/maX0AwT1ApOUAbbh88c8UvMhBA3N13dqBCyY+Ynr3btmmsd2c7VbgnmlOOh4xnAC+386D8zN8ynkZxxigYm7cwH+1TdobJ+X1OD+lLh8lQcfMCWAAzR97IBHTJ4yKAAE7XyQMccetIx+bpkZwOetPGeOMr1zjJpuCrDJwMHg9s0AN4Qeo69aRmHCjA+Y9/enZbAC4GRjPHFIyncoJXOSOPoKBjAuORwTn5ScmnK3XGORwtJ8y4AyTkjt1pSrZ6ZYcYBx1pAKMNt55welO3bs9MHjmkyVChflBBOTjH6UoX+IrgfXI+lAB3X+EFscmlLbW984/CkUfMOjH72e3NIoPT2PIHH86YhYyd3YHpilI28DBxn/APXQPlII27lKjOMCk53HhSOevWgA2bl27eDgDn1701WbaGOATT9u1vvYwuR6CmLllQbuT05oAThoyo5BPrSnKnaMLg4XNDDC9QuTjAGM0gByMMN2cAjPHfNACqQq8jK/TkmjLcgjbkYGe1OUcrnnqVwOg9aRfm6tnPBFAwXB4B7UzlgSRyB1B5p7L1y2McY96RlHIDDgYoAA26QAcjjK59utNAzg/dXn5c04KSwAOSehwOKbtOwYbAA7AGgBG567Tx0+lPwQxJx97qfp2oC5T/gJxxlhSFWVhk8k/wB05PFACqwz1ycE8Hp6Upbrnlc7vrmk5QA49ecdPrSleowQAR7dB9aAE8ssu0jGOS2elDHOe4+vb/JpCRgjrwevXmg/KCcKeQdoGT0oAdn72OnIxUbdCwAJwPzp7DcCSpJOcY4pu3b8xySuOPegQ7DKTxtYHaPpTfvZzgA9s09vv7SdwGTuwaaqhYwOvGRz70ABAVxnGcnjPtxRHlsHB6Z4NKqsZDjBw2eR7UnLYCkA4wfWgY5SFQDHzHn5vpRt3ewz9896OigAjkYDAH8TxTlUBjgZUNhVzx0/SgQ1m/d7eit/EB1xTgwJzkAYwcj0FN3Oy+qYP4e1OZQ3zMcE8YJ6cUARL90gFc9c05Cd5IPGAc/4frTmzJ1KjAAyo64oGVU5K4xQAxSOOADjnv8ASnqwVhtI3AZ6UnK4HmL8qDOPpR/yzORuGMDjnmgBzIM4JBB79z3pN23aN20k898e1LKh83hSDnjcM9OKXlskEnueMc+1ADZCW2swPqxx6/8A6qa/y5xnPfPFSlWjVMYUsvGTnv1NMKtgnAYA88daBEat83CggAEc8ZzS+/qM4zTm3rndjGQMZx3o2ldwI3DjNAC/LyR1Pq3X/wCtQqryTwvXrkHvTm3tuYjG3OeeelC7uAWXhfyFAxcEhiCCcZx/9em7QHOcbSMk56kU5VLAnj024H+NNVQExyEIJ+UY70AN5OeQxxncB1pMbTnHGMc9z61MQxV9zZyQAvU/So1jVXJw3JIC9O1ACK25QAQF5YH19qCoGSw47fSnqrMFwVGU4GKbs2zEjIx1PJFACo3ysFPseOg/yKkyr7gANvGOeaao2xk+YqjJ+XqTS9XG5kPH3ccCgQ4sOBkbM8Y6milbcVILKAvHP86KQxVztGW4AOM/WlZRg4KjCkUxSPLweTx0Oc801iFz2GDnOBSGNbCqpbnaCBkfrTeHY4yO21elBZW6bj1GNue9CybCBjJU9xVCAbcliN3dc9OBRuDdyOOSvc0m8tjqRnb1AzyP6UNlSeM4PFACgu+eOF4HPSkXLEZJGSOp/wA/5NNDFm4HHfHFKFKqNwOSONy80CHZBIYlsdTzgUfPnIJXB4bP6UqsWYdM+3A6Ug6YO0jAPFIY/wCXIzzxjHpTVzwc5xznt9DTuXySNvOc0nIUdQSNwVR/OgBEKsuNzBQec0DI7HJOOtKMyBiSoB9+n6U1V+Uk+vfFAD1bKsCcHqVPrQ3LnBz/ALJ9+9N3dVKEDJ/PFKP48DIGM4PP0oAUA5IbgEgZPOaZ/EAoA4H40o7jbxnJyePSgKFDYOVAxuOOfYUwDbtD7lA4wfShsbgBtXA6/SkO0Ek/KmMfN60qqNxwWCDq2O/oKBBymW7AZ5ORQ3cgBjnr+GaGJ242scfw4o+73xuJxgetAxIzydrcY7d6TacKOu0jj1obO0kZxjA5HNKqncDg7sjuKBjPvfxAHBIApd2GPzc5GaRh0wCBt69aXbtX7uenQc0AG0sDxwDnGffpTySRzkng5FN5/ukck8Uq5TORx6BcUAB7ksdo5FIfugcZx3PT1FO3FiTz1ye2KRfugglsj2PX+tACY56kc8ZPNC8IecjBPX06UvLHlTjIJz2pD8y5BydueDgUAISQTyM54o+fgHIH8RB7YpcANkEjkdQOaQ88YwCSDx3oAVRt4Y7Ruzg03hgAvfqufelx68huevNOU453E9uBQA1fugngEkAGl4kzjbnjrSMTxkcZOM9vrxSsw5GOSOmMUAB+92ztxjHSkPOSGwMf/robG7kMC2SOO3+c0vmHH3e3bHFAh23JG0EknBwegpvmZYHP9RjtQxO7GSp7A/SnbtvBBOM46AUgGsqsOcE7uaVvm9wOw7e9JyxBADZwN3Y0rN8pALHt1wD9KBg+CoI2nnFNwWbbjPzAcccU9ir4AXDZye+KTcdwwTndjdt4+lAA2MHG0kZA/OgBuMEBuvB7U04K/wC2P7ozTm4XpuBHPFADt2DzwBnjGM03+E4A+71HWhm3segIJ74/Q0DvjBIx3zQALlmKsSSRk49u1Kv3fn5JGWyf0pC/ysDtBGf4sd6XB5bkr3JAP5UyQP3tq4C/3T296T5l5OB0I9KdwykE55J47cUzBYgkZyv3celAB/ESB3z1pvyrkcEgDFObLq2APXrRIu3ccbffPTpxQA3jj7uM9KevygEL+vHWk2jP3cc9v8aXnH3e3Xt9TQAvzfN94dOtDH5ffnrTsFs8YJOcZFJxjsOoyR+dAxu1i3HPIwc/Wm/w/eyeetOLfN0XOc9cc4pNox3I+mc0ANcbQTgAcY9+KFzkHq2eimlLHk88Aew7UbimQDyDyMCkA85x7ck889KaqnIxnIOF3HqPWlZcKRuwcHtgfnR/FjLbvXjjjjNMQZBBUjqcE55NJ8zNn8Bz14oxsxkY6gE8fzo29DtA5XpzQAmGyQx70pG0HgE7PX9KArEncM984pvDLgjHBHbJ4PGKBjwp3ZBIJJ5xR8owNp3Dn/69IC23JDEHOKQEL1JK470CHFeCAc5PAz9KVlI4IGM+tKzb+Ny9ScLz6U0qcjuSP7tAAo3NzyM9z2xSNyewOAetP/iAwBz/AHT6VGvC4yANoz/9bigY8cbjjIU8c9TTOeQvIySDmnqG6/MB2DY69qbyrDA3DHHb+dAAQd2OoHrSPlWY+hPQ+9JtOBxj8qRixbBz97qRj3pAIoA4zn15xzTs9Nvtzn1pv3VB68dTSjAZSFAJIwM8mgYRqeCrbmGBTuFYDgdenf3pp3EDqcDJxyPanRscc46gfMeaYChcsgLA9Cf1pd3yjIGSOcdhSLhmPLEE7eBnik+5kHuMfdPFADkBZkHftk5pOQM4GeSeOtKuGcN909OM+nHamqo+8CWXkdO/egQ5VHyqQAue9Nb5VycfN6U44xwM/LjG7mk8v5uBnBJ5HvQA0jpwDz9cUfdznAByetHXgLg/7WBj3pMcAnceCfl5oGLtbHOSWxnmlYr82AF9D7YpMjp16DG79aRcbhu6d+aAH/dy3QHpuHOaaRu7YXGev50qt03LnJxk9z7U0+54bjOMcflQAoI3AHHYEUihQAcAk/pT9oXB4HQ8sP8AP/66FjZl6se2TyKAGN82457HipCp3bgCTk9T2ox1UL8xBGcY/lSSfeYEd+gb17UAM4P8XXrzSjJB9TjoemRTgp65IOfbrSF+R0AyOtIBGB5OfmIJob5c9WOcHn2pFUt+ue9KzcMvr+v40wHfdG0/3eeeajZTgAck4OPSpOWLE884OO1N3HcAB3z6UCHMwyRt5Hy9aaFLcZ3cfhTtpDA4yCTjPJ/+tSZzHtGTgdugoARj8xDbc5P8qOVzjAGeMml25c555z8xH4Um4cDnOMYIoAeo/dqD1IPAOKZyTy2M4BGcdfel2qFwflKjnJHTFOUHnghQQBjGT/8AWoARl2j5gAM56/rR/rGcoMbvehs9NpZW7jGadJkbmIAY4GM4zx0oAbkfMflJOR/9akXHGdo7H8xTmUMvyptOcckd6NvDfLt+XAOc96AGLkKML94ZP4UudzDG3PT9etK2/fjjHOPpSc8H73BAI+lAgXsV3EsT36Cl7gDg/WnMGDfd2g8rSrnjIyAccDvQMT7ucDdjB6+3+JFN46Zwf/r0/LlcY+VuAfXp/jSEFW5XjdxQBHtXLELlQfXvmjcG9AW5yPr0p+GOflG0t/FxTVDEsgXnAzzQAfKOGXHB/GjsAQFOOn9acdzK7BcjuT+XFA3D8RwO+KAFHzYDYwTztpuflweCQcKT7047sfKpxkAdjSLnhgeOT05NAxF5574yDnrSKBnBxyeeTTuZFHy5XGBz2pVX1YgbsfLj8qAIwSy5O0lR0HtRjcpABxx34qVA2wkgEYxuI/wqNvmPO3geuf0oEO+Zh/CRyfcVNub7wHXgemKYoHy4APOWGeaQDauT8oboW9fSgRJ6kjeo/PNFJt+XrsIGcMf60UhjVwFAz8jH7vTvTXbIxvJU5Jy1EYODuyCDzuGfyoLKvy4w2NuPegBpzGoO7cRkj9OaT5mY/MCeuadtDclSSDgrjpxSDsMEYOT0pgIzcHMmducDH0qPq3Y987ae8e3aSrAknHofQUikDIOV5zwentQICgIPTbwcc0u4kZPDE59eaTaHJ+Y+q/hSoOSARu4GScUAPBJ6uwLE8UhYtGOCV2/dbHSl3Zbht2TnpS/MFyRj5eOKAFwCw5LEHApn3s/NnHJOOtOGN3IB5ye1IegONq4PpyaQxNpaPldvdQD0JNH8WOo78DGRS7cqAW/+sAaaCNgLYAJ4x3NMB8eXUsMjcSASec9abyzHC4zxjrSrlwVJX/Z59v503puOGAz1HagQ9FG0ZT5N3RT1NNwV2gndnt1OKEJbIBHquPX3pdmWO0dtpwccetAAvfaoCqOR3FNbjIHzKpx0560qbvmC/d9WFIAWfcoyRkcH3pgPC8liCR1ZulDHGXzyMEjdx0puD0G7aRjOMcUo+YMG2njJ6D6UAMyGZjk5xzz2oUKzcDGSD1pzBlzg5JGDximrt5yAxU5I3YpDG5BUMDtJ5PoBR8pyepPTBp20pkk7tw429ABTVwvXAzzQA88ZAZjnOf50ZzyQfQdvpSN8zEg8HP8AL0pSepb5MAe/4UAPHLbSSWzzzjHWoyS6n+NR06YpWYMrEsMjn1PNK3y8EBCOAB2HvQAMvHQg5HPemMysx3sSPXGfb8Kdncckgt160i4ChmODyTgdaABgD154+nFHHADEEjPrn2oZtzAvj65xS4bcOQOp68DigQiqH+8vAOOvNDH7oZvocZpR93b1HXd049qThlPIQED5gfzoGCttXIbjJ28kUowBgOQvHvmh9zBc4x2yaFKlWAYA44ww/wAigA3Nzz/ewT+dISeSG5Iyxo2nqfm64B5x/n+tG7cvDKfYUAOZsHIYsVPLHnNN54xxxnlRwaAcOp2hvmzx9KCcbRlj2PegBZPXO7oOR/KjdtbcQTuOBnjmmso3rgLk/wAOaVm5YZBIxnPb6UAOxwuBtCj5s9KZkjDYy3QAjGDSyc44BJPzUsjH5uu8ckYyKAFcgEBvl2Z4FR/eXnp/sjj2pW6FuC319aXgY/hOOKQDmb5st1XOfx9qb97JYZHTkZpGxu5IZsZPbk0M2xSCSDjkimBIz7l5yPp26Zpudw988cYPtTdy7s5DDPPNOV1x1z2znFAh4U5AJyeo3H29KauNqY4UdSByfpTg3ByRjuRz3pXYdfl29OvQUAIQNpJJIwfvVHxnkM3cg8/NUjHhiCobsM0yTDb9pXHTdn86AEXHJB9grUoVcHB5wRkHr0obHG45GevYU7j+Ir0yePegAJHDfNkjrnn6UL7ccc59PehsknJ3c96T5SB3LZHYA0AKWO7JLFsjv7U1s5GeO2M0Hjqy9cEH1pRgY5wOvSgBJOn3mwAO/rSbjuB5JJ7Hml3cgcHpgcetOXKcqBuHWgBrFguCSw5ypNIoOcbd3RfmGKdJypBA6Y69jSMpDYG4NnhSO1ADtvUAkEnBbPFMX5t3AJHcjgn+vag4HIH03Uv3VXkjaBgDnp3xQANhs9Wz97nigMVK5JwCTjjPpSAYbcwByck9Ka3zKdpUnbgY+vSgAXsD9D8v6U/c20DO0gcKBxRyME8fMcH1NH3uSd3GcnigAztzliMYA4yM4/8Ar0oO1cY2rjjtmnZ5GTzknAbgU3DMoJyxxjpigBdoZsZ3ZY98dqbIx3A5OCOctn8ac2EIwrDknPXnFM2ncVPpjJHT2oAOoOUyi85NEgKtyA5zyOOCKVVPIAJVhgDGPzpGX5+PmAB5HqaYDc7mI2hlJzxQzFWJwwCtjCngUIpBHJBx19qV1bcBtPOOfXjrSAb828k8Njk5zSlvmc7yvrz7cUm07Sc54wRinLjqB6dxjpSGNXO1Rt/edgf604KOevzDGd350yEbVHzASHnGf1qX7qlskL05FMQoy0gIHOMj2FN3bADhl9OeKdjbIdw+bG0lsgDvTCCzFRhhjj60AKrdyWBXIBz1/wA5o4wCS2cdumaVdqbiRuDcD2yKT/loFH48g5NMAQKWzuLL69O/SjgRgbiTySAeBTvuEMxyFAJUetN+TK7TvHf0pADZ2nDk84FN+XLHLHn8+DT2BwGOcZ5Cn3pjcdsDPX88UDBcDAB44zzzS7UwFZ8rgn2+lKoHJA46HpSFvlxsB4wM8daAHK3mEHAK8Ee3FID2Dn164AFKV+8STjrwOv0oYAMMJ7+xoEAxt2jhfuhc9eeaXAXJKgtkA89OKRSVUEuCMdcc9qPKAAAVjxkmgYKFHqCQSTn2oLbWyC3GMYOTSbR5ecNyD0xRja3fbkYGM54oATcNwwBnofX60q5XjDDA24HY9aQ5XAY4J6cU5mKtzxk5J96QBnox+bvtPakXK4A3Yx0B7+lKq8AsP/r01W7r1B49c0xC7ivf6bucGlI2sfvbTjIBoVeoGc9QGHNNyFdsFR83Hfn1NAC424wNu07ewxTWZehJIA9Opp69fvBhuz9TSBT1zjHPTqaAEbHO75m5ySevp/OlONxUFgOvPrQfmk55Oc5PFLj5QSCDg4OMYoAeFHBI3H7wwKj2/MAuD05HBHelG3aORuAxjPTjvSyABicHaDkkfTAxTAAo+UlOpONp6+tN4O4KNxYAjP8AntQyhkBBOB/Cv3qU7l5U43HA4/P6UAIu3c+OWJ5pFVWYcfI2ODz3pSEIyqNkDB3etKrMqsV/u4HHSgBqsMAnJJGMZ6Y4xS8H029CuaVkKuwEZBApPujJx0+6Rg0gF4Vi2GPJUc9AKX+L5eCP7rUhYvIGKkMfmyB68f0pFyqgrt+negBzKn+1lSAqqfXHP6Uhw309u3vik4kZgX/eBhx0wMUn3d3yndnkigB21N7HoMDaB3pmQygYJ/3v55pzY3FXfGR8p7A+lJtI3fKzD9fagBSq7iCWxj/vo0bh36+/8qG5L7gSSMrjqDS4w3BPyjgdfrQAu3KknrgH73Wmrk7eOeSM+1KNjDrgAHBzihcYGWHQ8f40DBVyoIGGK8c9KbzuAxtyccD261JGA2Nxzgk5Hao8DoWwuc0AGd2CV2gk4A/mabJ8uV5A9xnr2qWEbgoZsg8fTrxTG+Vi+7APHIwM0CHKvyqSvPbHt1p6sWXceTnGCKYo3Rja3zDIweCD61KM4+VW3Y6+1MB3PIHzLn+LtRQuxu+09MkH8qKljIFLFNhA6Z4PX/6/NSK7JgCQliM4YZFRw7gvzMAc/ePWneuVYjOGApiF2jbgMfM3c4PHB9KTeWyWOFJ6cGkWMqSqkrk7fp3owFfb17jHT60wG+YRjLEt/Dwex60bmkzk5UnJzxTixVVz944G72z1/lQ+NwAAbHrQAbnLhd+SxB+WmmRs+hxgbhnp3pzsF2HYNxPWjaAcgFgeg9aAGlyVZd+V/wB2l3fL8vDY9McemadymMDAGBg0nJzkdwSSeBikAE5zyvv8ufwprt93AAAzhgvFSt6gLnr/AIUn3efu8HOe5oAYQJFznJBxuIyMUzd+8IU7W7ls1JywVcc7cEdM+4o8vruKhffrQBHu3KAflj9eoY9c0M5bG7C8Y3LnIHvTsfIp2bcDYF+vel28528Nnd60wE3b+GO5AuQAOfrSeYWCBuOMgMM4FLuLLkrgr07f5FOOcfKDn+LbzwfSgBhkDL1DIP7vUe4pWdsrna7DjaRzmnRjar8BR2ob5lbKnOSWKnoaYhm4MDjlT2b+lOM3l5w27AJ54x6fzoX5m6YJGDzkAUpXdkYIYDluv0NADVzt+XgY5BAz+GKI2IywYgHopxzQqoGyflbHJ9+9B+990n0+lAxD1bJ2MMgjOM/lSqzdmCHjg0bQDtZctnOe5z3pdwjHKZAOdxpAJuO07gCpyenuBSFj257YyRil2ncO3Y7u/Oc0pyQchgcc45pDF+bGVb5h3YZz6nimZBY4O1fqefSnMuGA2bRnAx9KNny4dcrgfL6UCGtyxJzuzk44GKA29mIOCOrEkUvCx9MqRyD2odPu7hu5/iHagAZsAA9B02HANK0m7qdxDcsFGV4pGUbs4KkDGMdqXHKkK3cZ75PemAxnDnHLbRw3TFDSYXg5C99vNO2/LnIYLx9TQOuQDxjLdRj0pAN524UhuvI96creXj5j6AYGfrScfdHGCSfcUYG0gA5PbrQAHO1c/wB7llPX605d5U4IXcPXJNAjDFwFwc5/+tR9/Ix0GMLQAjfKdxUYU/wjrxzSL2G4BSAcKP6U9V2uhwScjGT7UK3TA34HJ70AMc4JbcGB5CnjFCsflYNlV+6ByadtxswoBPIz2pdo3Y2gkcBh2FMBpA/4F/Hnj9aarfdOcDsMkEGlZcDB3dOfp6mgtuI3H5sg4xSARmJjUYYevQk0nVeMAdyvBNPbJI45ye/NIQflVuR02/1oAc3zSE/Nnnr36daZuG44IQE9Vpdudu7cxx3pf4Qccd6AA7tmOACOcUqltxOCP90g4pjqQpGCFwOnr61JgbTkN1xzxzTAXLltu0nB9aNxwBuOcc7jmkGAx4Odp6nijrjjnGDz0pAP2s2QWwDnkUxjjK7yR6HjvTmx1PXtx04pvK5A4GMfqaAEXO7pznBIencrnBODgctz9aQYzyeAemM4o9CBggenTmgAXPOT34ycj8jSR/eJyOT2XJpx5Ygg+y0dsc5PvQAmSowuBwoxihd23rgc5wc0HCndkkZ4z+IFNPQeuO3SgBVUdNxAAGPlFIrHIbhc89MGlVM4GDj5QRikwP7u7aSdqigBdvlj5jjAJOeQfY+tMXnbhQTjH0+lOPKnHzcHqaCBvPP8Q7UACqOCWIPTcDk/lS8nJUYBIwc4BpMexyc8gUuMNnocr7dqAEX5s43ZOSWzn8KcNy4OR1yRjnoabnoxweOi0YWRSAD26fWgA2/NwV444OO3SnYO1Rty3c7skZpFboTkkE/Sl25w2DkdT3oAUBl3HPuSvsKaDhgNrN6ZNPZdy4CkYBIpvPPRgcNQA0IOeCp5x83tQ3fbkgj7uc/iKXkLuUYUHPzdD2xS7DnG0JwF5oARcqcYY47E9z0NNK7eMEgnjngevHpT+mVUlsnv3IpOd+c5GCRj3piG5PfP4HOfrRtG4N8wDNtC9elOVRg46gelDFmbsD19hxQMbxjheMHB4GKaVG0kdeOWQZp5UccZPqD/ADpygjBbtz8vHSkAwE7hjrzlvp7U5gqt8pA46kHNIobAAGQBgs3P1py/MMd+vHSgA/jBxk5wcN1PqaRlwo53nqc9h7U7lWyuDkk49B/nNNC9c8DHHNMBEA+ZhhieOp79sUu0Lhd23tjHH5047mzjbk4I/D3poXnj7pJ70AIq7cNgZA9fU0Fdqkb2wSRzz0pz4xxj7vIH1puz0G4ZPegBoUNjIzjjjgD8KQoq/KDgY5AOc4+tOZQy4BJPc00r8oJILdcEUAO8sNwST2wBjtTWwFAwenrT+vbI7DFG35cZ5HqPekACMbSPmA46HgUrKsceOWHPPpikXGCAflxjOPSlC88hR369aAFQtIwyd2CB+B7GmbVUDKtzxgdKdxwvU8ZPWm8598nAzQAhHynK8Y4xxx6UrxhW4U43EY6gUbRtxhs7Txnj60pyrZAP3s0AN4VcYKqT1FK2BnbkIGxjGc0ABSOG/wATThlWJGcA/wAQ9qAGsfnyNufpj8aXaGzk56DPQj/JoXdxkE8c04ehPp2oAGw2OQxzj5hzxSfeXLj5F98CnfdHvz9c0jfNuG0vwF60AJuLLhiQ27+IZH4U048sfIp9N3epMurAsQ5+6O2D3puD1JOfb0oAPLVvl2hRu5z+HT86CobB2kjPDZ5pG2g45ZeO3P1/SlxnBORwfxpgSZ45GWPTknPtUTLuU8rxwMn8akQnapIxtFNYjchBA64BHT0pgJweQCgI5Pc0zG/O8dskMTx7ilwZMA5Ud8c5pWzIpxwSM/Mf0oENXGCScjPCjml5kJJKtu7EYzyO9DY3NhSG6Uithh0Vl/lSGIAqABchTyOc0u8lgcsM8Ag449KarN8p2bSR07e9O3AYGGK+nWkA5vlzhmCliCvDUMS3DYxnH0puDuIMYUc8j0zR8oG3B7YHr70wBmX+6wUjAHXp2xSqWXuw2nHB4oZtjBCAAuTuPvjik+7yVLDPY0AOOF3kHI2nljznNNfPzA7lHb3/ACpWXvtCg8k/jSNJ8rblyGH3h3oAGUZJJYn++vXil3nb1LKOTzz+VIfePAYDb7Uu4LycsPu5UdKAHCPcF3bDg9fwpNzNzglh0wf0pFxgFQD25pyk7V4zt6bTzz1oADskHH3sjBNIuGYBRyOdvTml/h+6WHBLdMUfPtzgsMcetACNslOSOSCTu6jmkHDKmOe/JwaXopCqroCRyeTR83J7ZAxigBxw23djuOT1p/8ADgAuuMg55qMA4wOAOQG9fSpedpIBVu5xQA/hUC8sMZ5OMUVHu6kHbn+9RUgRp8ygMAFXn68n9alAK9Dljz868+3SmpkqDkHHTFO272wVHC880wI23L5i5LAZP5+9IwJHTA7+X1PtUkkXlsSFXjHbo1G1WxsxyOSenvimAzhd2P3mR9SFNNUFTsC7ivVW/wAacY129P3Y+XI4zRtUEcbn5+bPSgBqsI2zncW6d/ypyjC4zkAgAE4ycDkcelJtCqAGxH3JFKxDDGf9pd3QUAKp4yMAcjnOQPxobHGSwzwefmp7Iquc4fA6YpNpO7gBs5LehpAJ9/OCVJ5I28ZFJ94/KFZuqjB698+lOODyp4zx/U0Mybm+chcbeB60ANPCnDNxwQwzjP8AKjb8xbKqR3U5BHvS7DtABw+eMdPxpxUs2GACtydvfFADOepPzcZK8j6Y9qCoztDMozt6fe96kwN+8ALuHCg9TTdoVSOhXgYPemIjbd1yXYjaCBjHtj0o24JAbnpnaRjNSkLu5wzKMgYxQsYbjkrnPLc/SgCEoeASQQdqt/WlOO+Qpy2QMc9M1JsUcHgnpnnin7VYnG5FwGxmmBW25yqncGwARTkbLdSyZwTjB46c1KFK4BJXJI9aTasnCkpu4YUARHG0p94dc9Qc05flbaG68YYbvrzSjO3k8HgY4/Gn4B2qCRzjOev40ARcbeSW3DG80DK/x7QMfeGc08rsHBHlrwOPWjqAFIBU8c4oGN3ZYbuSw49hk0ijIPJY45x25/nUu3743HPUn+lNbayn5sHP4UgGL1b5z3I9c9s0hUjIBwMck8/rUgUh+D05ORxmjC/KrfKB6UAMUMzDOQzH5lxkcULkNnPmEj1/l9Kk2/dBO4n06/nRxtBIHA9OOvSgCPaVBbefmGOnX60oXGRuKHGD2zjpipQioWyuOw/+tSNH8obdnsMelAEX91hujAXnikYnbtYKE/FT0zUxwr/N8zfTrSeWO2X5+UE0CI23KRuyHPAA6D0zQF4O4qB13jIz7VJtWPOMleu0jrQUTacMcZzx6+lAyNlyiE7gB1Pck0vzKeWAJGcqOn40/G3DOAT1HvntijYr8Bto/iXsPwpgRkFlYLyD1z1PvSk9GLL68j8hn1pfLG3eRg55/DpSt94ZPzY79PagQh3bmGwFsfNzz+FIq+gDIvy7jkNTsLg8EuOd3Sl2jCkKG2/KDnvQBGc45bl+uTxQuWxj5uQ2OuDTti9ASF6sxHWl+8y5bnPyg9DQMjVcrwSR1xt96NucYXIzwMYJ/Gn7QMcAjvntSqq8kjg8eopAN+b1bjHPB685NIyH1ALHAx0/GpNgZjjAbOGOKTap524Ht/OgCP7p5O0dSOpI9aOWJySGJ5P19RUixlScZGOT3GKXATg8H1FAEeB0yVXocc5PrUh3NnI6nnP+NKE28gAjGFH9adt2nGc4OB6/XNICPaFyOR19aGYLu2884+9TtpC8DBx2PH1pWUjKgjB4H5c5oAj5c8888cdfxFIFwQCeTwOvWpNuVxjntz+tDL8uAcfw7s+9ADNxIIAJXOevJoxjk8ng4K5/DNSYXvxn8ccU3buPIGT744oAjbO85XuPu0m3jOSDz25NSqBwSOM55/Kk25AHAOMUDGBdwHzZGRj5fagZ24yRu544NSovbvkD736U0KML/E3O1iaBDWcDlcA4+XK/nmm4G4AgkccZz+NS4yp2nhuOufyppG7BHAxgZ/zxQAzaOdzE9eq5zTvunPDDglVXvninbRzjCj3PUUu3kZwXJP0GBQBHgksQdrHknHGKXncNzAAEEYGM0/aAD8x2+xp2xR82MEHru7+n5UARLu+Vck4yOGGaXbuYD5s47DoPWnBRtC7gSM53DpT9o9ML255xQAxR8oO4bW4yBgk01sFVOCu0YwKkxvUk9AOOOTQRtIGQzA/hmgCPaFYDLKSfu9RzzTdwfqAwBzxnJPapPl+c7gq/7I5z6Um7dgs3PB+XtTAASDyxHfHUD1GaThVKrkAY7fepVCuxyxwTk8YNKu5VU5zkfL6j1FAhnpj6Bu5/Cl4HBO7B3Nxwfen7VwdoOOue4o27sFuM44Hb3oAj5XGAMYI6YPWlC7ufmXt0+76cfhTx82Su0cdKI1Abd74zmgYxmOSNxO4Z4x/KkVQcEkhvcZxUnBBBfJOTyODSZ24wcsezdKAGKVj29O46Y5oVex3AL0GKl2Z3EfLk8Hrk0nJGAOM9PegBNpUKeoVicYx2zTOWyp4UE53Dn8KkGN2VI/iPPPalznOACMctmi4Ee1ug3D/gOOKby7HqOdxOPapQoJXAwSR9KaD8o4Xjr2+tADCpx2IGDnGM0nzFiTuz79Ov9Aak8sFRlc/j+tOwFbkKTuOKQEIXHCk5xjcFxQclhwx9O3vTwqsnIzlenal2qrYJGMgDk0AR8LzuDYPVVxmlZhtztDHBzT8j7wADBufmo+7nDduBnvQAzA8wfMM5B+7nFNwVUY9OuKkZiWJJBOMcH6GkVAqrwuMZx3FADPLJUnKkYPDKeKXB3Hud2cAYzxTmAfK8cDv2FOCA4OAMk5zQAwY4y20cnpxj0pC3XLbjndx0PFO53KfY98CnBeDzg/d69TQAwgbe5PuehxSghuBuJyOn+fpTl+bHQ5Pc0gUc55wBj8/X/PSgBADtyGI9ivGaTcQpwVz935eOfWn54AGBzjr+dI2N42tznjjNACDDZ+ZipJx2z6UcquAcnByAKe3GcAYxgE+lAUbugx9c0wGDPc/LxjAyeh4H50ceq5ABPy4p/wAp/hXcVOT29zSbfufdxxwOaAE3Nu3HKnHDf59qayjaQMAfd3dN2PapfuMcYzkgHrTMBTkEY6AKAeKYCNlmBxkEYXj8qYV4bDZGNoLLyfxqRkC5x0BwPWkbDSHc4TB6f1oER/3uSW6HPelA+YfM38P8Oe/tT8Dkk547ik27mYkAY6/X2pDI8soHDEAYowGxkkHHt/kf/Wp+1U25x04yOacoUyff+XHOR2oAjbGGXDdWIPY80qKT91iq9MFSc/SlB+XDYPcbhSjooAU59c0wEZiq42fKRkt+mP0pqg+pHp8udxp+1UGQQEwDyO/r+lK3z4Hy5B4FIBnO45+YFQCOnekUHnBYnrt255BxUoUKXK4GD6cHmkwNnY/jj8aAG4ZWbcA3Xj/61MAKttDMuBySPSp2QbcBQD1Y5/SmNhlIwuAME980AG45DBt+3jOMY/CkU+vAxnK9x/8ArNL/AMtAx2gdcdaXpwDx3xx+FADR91fn6nGMD8qVcbgWbkHAz+nFCr8qYYEc/wA6P4sjHcdaAG84G4ENjGF+vJpdqqT1X06n5aVVXCgHPBb0P0oUhlUAgf7OOvtQAL9ejEjHr71KAB0Zx2Ddf8im4GFIOepBAxz6U5V28AAHGd2elACli4K44Hqeh/wooZUZc+nGcUUgFVBwQVDEY5p+0NhvlC4zjH6UUUAMZFkyM44H3jn9ab5e7oAp7gmiimIazDgqB2Ow03ZxxyuexAx6UUUAKzAqSMDaMc9CKXZ/Cuwex/PmiijoArMPUHjr2pNm5Rg7T025/nRRR0Ad97DBfl6D8utIudu1WHQgjGKKKQx20dcd85H06UKu7HIHPBz1oooEOaNdxPTnhuOh70gwowp3YzzxzRRTAQr1UhWbHVjjH+RS4XljhlxgdjRRTELtBYdGGOrdu/NIFHDYVlxj8fSiigAGGXI+df7p60u0H5gVKrzgn9KKKAEYDjGCP7hpDF1HHB5Hp7iiigBWxIvy9j93se4xTWQLyQqqPoTRRQMVlLZyeP7317UrD+H5U5xg8/jRRQIaVz+WdwPB/wAil2BWOOO+D0oooGKV+6BiMH7rUi/vB13KTtJ47UUUAOxjnbwfuk+lIv8AFyDz/DxwaKKQhdu0k8H1fNIAF3EBcjBAHGf/AK9FFMB3lhcZGdp2j/Z+v50KpOTkMPQdaKKADZuwF4J6ZOQopNg2jdjnoT1oopAIwGdxB25xtzSYAyMdG5VuvuPwoopjF29eQyrzgcUjfKcnbGFzkDv/APXoooAQqVGGYEDjPrS7dx2japPG3PFFFAAQOoG3Ixz0Io2nPBUHGeKKKQxWUKMHAKjGc57UnljOeFLdlPIoooADgLycN3IP6fzp3l/MeFBPI54NFFOwDtgH8IGR69Kd5ecc54+8D68/nRRUgNZRtPIHGf6U3ywG57nAbP8An/JoooANo6ZC8c+vFAXoSAxxwDRRQAm0ddwxnp2P+c01gGyoA/E9KKKADHzE53KD1bindOAOPeiigA29emN2SB19KAuF4xjHHHvRRQAu3uFU46DPShV+bqP72T/UUUUANEarjuD2PvS7fmxgdxnt3oooAaFAzg9urU7aGwCAOoHQ4460UUAAw2ADkno2RmnbQ2Puk8AHPAoopgO2ggZbPocjIzUe0Nk/Lt7NRRQIBHuzjDbumOD/AJ/xqPaN2QQrdcY/SiimA9VORkgnsKAoYZzgDnqM80UUgHbAvBA46EnrSld27oPUZ9M9DRRQAjRjklQo6/8A1qTbtwcLjOR+P+FFFACrHjjOVAwM+1Iw6kgKOMj2oooAVY9zAJ8vPA+venbVOONp6ZP88UUUAJsJxyvPX8aZtBwMgAj+EUUUDF27R7jqwpFUYXOAMke9FFIA28Yx83rShc55X73U96KKYBtyvG0tjp0pNvJzg9CaKKAG8BcAjP05601l25yOfXNFFIB2P9lRhsAfhQEzxx05WiigB3puKjkc4z7Umzd2HrtFFFABtG0lgAMde9IV3MccgHH4UUUAG0HBIC8ECjZ5mAozxx79j+tFFAAwB6gADJGaNueh3Ljd2B+goopiHBc8KOAcjnr/AJ4pAoIXawG7sB3oooACuFK7cDBpSoyQhz04GBRRTANu3Ax77iep6U3aAvJGSAcLwelFFABtKsMHknG7NIuF2g4zjPJ6YJGKKKAE29t27+Kl29sAMOmTnNFFIBu0MRyNpGRnqKVVC4JAPfOf0oopjE2jjIU84Kt6/wCFLt6HOQD83pRRQIGUHgdzkK1K0a8j5VI7qP60UUugCMpbPPAHJzxStjBAIjP93AzRRTGLtPA+8BwSD603b6YABHf9fp/jRRQBHjdjBBzyQOKPu8Yxjn1oooAd14GD0yB29aFwOoXrx3oopAAUsu37x7Y6+tOXDZOAQf4vSiimA5FyCQockZODjgdqcqgYAYKfvcD9KKKQAy9cjJIz1HeiiikCP//Z" preserveAspectRatio="none" id="img2"></image><clipPath id="clip3"><path d="M-0.25 0 6858000 0 6858000 6858000 0 6858000Z" fill-rule="evenodd" clip-rule="evenodd"/></clipPath></defs><g clip-path="url(#clip0)" transform="translate(-280 0)"><g clip-path="url(#clip1)" transform="matrix(0.000104987 0 0 0.000104987 280 0)"><g clip-path="url(#clip3)"><use width="100%" height="100%" xlink:href="#img2" transform="matrix(6350 0 0 6350 -0.25 0)"></use></g></g></g></svg>diff --git a/docs/images/external/crew/crew.png b/docs/images/external/crewai/crewai-logo.pngsimilarity index 100%rename from docs/images/external/crew/crew.pngrename to docs/images/external/crewai/crewai-logo.pngdiff --git a/docs/mint.json b/docs/mint.jsonindex 7f02bbec..1c45eef7 100644--- a/docs/mint.json+++ b/docs/mint.json@@ -95,7 +95,7 @@{"group": "Integrations","pages": [- "v1/integrations/agentssdk",+ "v1/integrations/agents_sdk","v1/integrations/ai21","v1/integrations/anthropic","v1/integrations/autogen",@@ -168,16 +168,17 @@"group": "Integrations","pages": ["v2/integrations/ag2",- "v2/integrations/autogen","v2/integrations/anthropic",+ "v2/integrations/autogen","v2/integrations/crewai","v2/integrations/google_adk",- "v2/integrations/gemini",+ "v2/integrations/google_generative_ai","v2/integrations/langchain","v2/integrations/litellm","v2/integrations/openai",- "v2/integrations/agentssdk",- "v2/integrations/ibm_watsonx_ai"+ "v2/integrations/agents_sdk",+ "v2/integrations/ibm_watsonx_ai",+ "v2/integrations/xai"],"version": "v2"},diff --git a/docs/v1/introduction.mdx b/docs/v1/introduction.mdxindex 9cfb70aa..5012f461 100644--- a/docs/v1/introduction.mdx+++ b/docs/v1/introduction.mdx@@ -7,7 +7,7 @@ mode: "wide"## Integrate with developer favorite agent frameworks<CardGroup cols={2}>- <Card title="OpenAI Agents SDK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI Agents SDK" />} iconType="image" href="/v1/integrations/agentssdk" />+ <Card title="OpenAI Agents SDK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI Agents SDK" />} iconType="image" href="/v1/integrations/agents_sdk" /><Card title="CrewAI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/v1/img/docs-icons/crew.png?raw=true" alt="CrewAI"/>} iconType="image" href="/v1/integrations/crewai" /><Card title="AG2" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/autogen/ag2.svg?raw=true" alt="AG2"/>} iconType="image" href="/v1/integrations/autogen" /><Card title="AutoGen" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/microsoft/microsoft_logo.svg?raw=true" alt="AutoGen" />} iconType="image" href="/v1/integrations/autogen" />diff --git a/docs/v2/examples/ag2.mdx b/docs/v2/examples/ag2.mdxnew file mode 100644index 00000000..cd28800e--- /dev/null+++ b/docs/v2/examples/ag2.mdx@@ -0,0 +1,176 @@+---+title: 'AG2 with Mem0 Example'+description: 'Observe an AG2 Agent with memory powered by Mem0 using AgentOps'+---+{/* SOURCE_FILE: examples/ag2/agentchat_with_memory.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/ag2/agentchat_with_memory.ipynb'} target={'_blank'}>Github</a>_++# Observe an Agent with memory powered by Mem0++This notebook demonstrates an intelligent customer service chatbot system that combines:++- AG2 for conversational agents+- Mem0 for memory management++[Mem0](https://www.mem0.ai/) provides a smart, self-improving memory layer for Large Language Models (LLMs), enabling developers to create personalized AI experiences that evolve with each user interaction. Refer [docs](https://docs.mem0.ai/overview) for more information.++The implementation showcases how to initialize agents, manage conversation memory, and facilitate multi-agent conversations for enhanced problem-solving in customer support scenarios.++With AgentOps, you can observe the agent's memory and interactions in real-time, providing insights into how the agent learns and adapts over time.++## Pre-requisites+- AgentOps API key from [AgentOps](https://app.agentops.ai/).+- Mem0 API key from [Mem0 Platform](https://app.mem0.ai/).+- OpenAI API key from [OpenAI](https://platform.openai.com/).++## Installation++Install required dependencies:+<CodeGroup>+ ```bash pip+ pip install agentops "ag2[openai]" mem0ai python-dotenv+ ```+ ```bash poetry+ poetry add agentops ag2 mem0ai python-dotenv+ # Note: For ag2[openai] with poetry, you might need to specify openai as an extra or directly.+ # poetry add ag2 -E openai+ ```+ ```bash uv+ uv add agentops "ag2[openai]" mem0ai python-dotenv+ ```+</CodeGroup>++## Setup++```python+import os+from dotenv import load_dotenv+import agentops+from mem0 import MemoryClient+from autogen import ConversableAgent++load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+os.environ["MEM0_API_KEY"] = os.getenv("MEM0_API_KEY", "your_mem0_api_key_here")+```++## Initialize Agent and Memory++The conversational agent is set up using the 'gpt-4o' model and a mem0 client. We'll utilize the client's methods for storing and accessing memories.++```python+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(trace_name="AG2 Agent using Mem0", tags=["ag2-mem0-example", "agentops-example"])++agent = ConversableAgent(+ "chatbot",+ llm_config={"config_list": [{"model": "gpt-4o", "api_key": os.environ.get("OPENAI_API_KEY")}]},+ code_execution_config=False,+ function_map=None,+ human_input_mode="NEVER",+)++memory = MemoryClient()+```++Initialize a conversation history for a Best Buy customer service chatbot. It contains a list of message exchanges between the user and the assistant, structured as dictionaries with 'role' and 'content' keys. The entire conversation is then stored in memory using the `memory.add()` method, associated with the identifier "customer_service_bot".++```python+conversation = [+ {+ "role": "assistant",+ "content": "Hi, I'm Best Buy's chatbot!\n\nThanks for being a My Best Buy TotalTM member.\n\nWhat can I help you with?",+ },+ {+ "role": "user",+ "content": 'Seeing horizontal lines on our tv. TV model: Sony - 77" Class BRAVIA XR A80K OLED 4K UHD Smart Google TV',+ },+ {+ "role": "assistant",+ "content": "Thanks for being a My Best Buy Total™ member. I can connect you to an expert immediately - just one perk of your membership!\n\nSelect the button below when you're ready to chat.",+ },+ {+ "role": "assistant",+ "content": "Good evening, thank you for choosing Best Buy, Fnu. My name is Lovely. I hope you are doing well. I'm sorry to hear that you're seeing horizontal lines on your TV.\n\nI'm absolutely committed to exploring all possible ways to assist you to fix this issue.\n\nTo ensure that we are on the right account, may I please have your email address registered with your Best Buy account?",+ },+ {"role": "user", "content": "[email protected]"},+ {+ "role": "assistant",+ "content": "Perfect! Thank you for providing all the details, surely you have made my job easier by doing this. I really appreciate it.\n\nI also want to take a moment to express our heartfelt appreciation for your trust and loyalty. Thank you for being an amazing customer of BestBuy Total.\n\nCould you please help me with the order number or product's details to check it quickly?\n\nSamsung - 49\\" Odyssey OLED G9 (G95SC) DQHD 240Hz 0.03ms G-Sync Compatible Curved Smart Gaming Monitor - Silver - just to confirm this is the item, right?",+ },+ {"role": "user", "content": "Order number: 112217629"},+ {+ "role": "assistant",+ "content": "Superb! Thank you for confirmation.\n\nThank you for your patience. After exploring all possible solutions, I can help you to arrange a home repair appointment for your device. Our Geek Squad experts will visit your home to inspect and fix your device.\n\nIt's great that you have a protection plan - rest assured, we've got your back! As a valued Total member, you can avail this service at a minimal service fee. This fee, applicable to all repairs, covers the cost of diagnosing the issue and any small parts needed for the repair. It's part of our 24-month free protection plan.\n\nPlease click here to review the service fee and plan coverage details -\n\nhttps://www.bestbuy.com/site/best-buy-membership/best-buy-protection/pcmcat1608643232014.c?id=pcmcat1608643232014#jl-servicefees\n\nFnu - just to confirm shall I proceed to schedule the appointment?",+ },+ {"role": "user", "content": "Yes please"},+ {"role": "assistant", "content": "When should I schedule the appointment?"},+ {"role": "user", "content": "Schedule it for tomorrow please"},+]++memory.add(messages=conversation, user_id="customer_service_bot")+```++## Agent Inference++We ask a question to the agent, utilizing mem0 to retrieve relevant memories. The agent then formulates a response based on both the question and the retrieved contextual information.++```python+data = "I forgot the order number, can you quickly tell me?"++relevant_memories = memory.search(data, user_id="customer_service_bot")+flatten_relevant_memories = "\n".join([m["memory"] for m in relevant_memories])++prompt = f\"\"\"Answer the user question considering the memories. Keep answers clear and concise.+Memories:+{flatten_relevant_memories}+\n\n+Question: {data}+\"\"\"++reply = agent.generate_reply(messages=[{"content": prompt, "role": "user"}])+print(reply)+```++## Multi Agent Conversation++Initialize two AI agents: a "manager" for resolving customer issues and a "customer_bot" for gathering information on customer problems, both using GPT-4. It then retrieves relevant memories for a given question, combining them with the question into a prompt. This prompt can be used by either the manager or customer_bot to generate a contextually informed response.++```python+manager = ConversableAgent(+ "manager",+ system_message="You are a manager who helps in resolving customer issues.",+ llm_config={"config_list": [{"model": "gpt-4o-mini", "api_key": os.environ.get("OPENAI_API_KEY")}]},+ human_input_mode="NEVER",+)++customer_bot = ConversableAgent(+ "customer_bot",+ system_message="You are a customer service bot who gathers information on issues customers are facing. Keep answers clear and concise.",+ llm_config={"config_list": [{"model": "gpt-4", "api_key": os.environ.get("OPENAI_API_KEY")}]},+ human_input_mode="NEVER",+)++data = "When is the appointment?"++relevant_memories = memory.search(data, user_id="customer_service_bot")+flatten_relevant_memories = "\n".join([m["memory"] for m in relevant_memories])++prompt = f\"\"\"+Context:+{flatten_relevant_memories}+\n\n+Question: {data}+\"\"\"++result = manager.send(prompt, customer_bot, request_reply=True)++agentops.end_trace(tracer, end_state="Success")+```++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/anthropic.mdx b/docs/v2/examples/anthropic.mdxnew file mode 100644index 00000000..02d1446b--- /dev/null+++ b/docs/v2/examples/anthropic.mdx@@ -0,0 +1,455 @@+---+title: 'Anthropic Tools Example'+description: 'Understanding and using tools with the Anthropic SDK and AgentOps'+---+{/* SOURCE_FILE: examples/anthropic/agentops-anthropic-understanding-tools.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/anthropic/agentops-anthropic-understanding-tools.ipynb'} target={'_blank'}>Github</a>_++# Anthropic Example for understanding Tools++Anthropic's tool returns are not as simple as getting a few strings! While this system is more complex than those before it, it's also simple enough to be used without problem once you understand how it works!++To get started, we will import Agentops and Anthropic.++## Installation+<CodeGroup>+ ```bash pip+ pip install agentops anthropic python-dotenv+ ```+ ```bash poetry+ poetry add agentops anthropic python-dotenv+ ```+ ```bash uv+ uv add agentops anthropic python-dotenv+ ```+</CodeGroup>++## Setup++Setup our generic default statements:+```python+import agentops+from anthropic import Anthropic+from dotenv import load_dotenv+import os+import random+```++And set our API keys.+```python+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["ANTHROPIC_API_KEY"] = os.getenv("ANTHROPIC_API_KEY", "your_anthropic_api_key_here")+```++Now let's set the client as Anthropic and make an AgentOps trace.+```python+agentops.init(tags=["anthropic-example-tool-tutorials", "agentops-example"])+client = Anthropic()+```++## Creating a Dummy Tool++Now to create a simple dummy tool! We are going to make a tool that will tell us about the demon infestation levels for 3 areas. From there, we will have VEGA, our AI determine the best place for the Doom Slayer to attack.++```python+locations = [+ {+ "Name": "Super Gore Nest",+ "Description": "A grotesque mass of demonic growth and organic structures infesting the ruins of an urban area on Earth. The Super Gore Nest serves as a massive, pulsating hive for Hell’s forces, complete with rivers of blood, twisted tendrils, and a dark, organic design that shows how deeply Hell has taken root in the city.",+ },+ {+ "Name": "Exultia",+ "Description": "An ancient, mystical world that holds the ruins of the Night Sentinels' kingdom, with gothic structures and arcane symbols throughout. This realm is filled with epic landscapes, medieval architecture, and hints of the powerful civilization that once defended against Hell’s forces.",+ },+ {+ "Name": "Cultist Base",+ "Description": "A grim fortress hidden within the icy mountains, where a fanatical cult worships demons. Filled with chilling sacrificial chambers, traps, and rituals, the Cultist Base is a hostile stronghold where Doom Slayer must confront the cult leaders aiding Hell's invasion of Earth.",+ },+ {+ "Name": "Taras Nabad",+ "Description": "A war-ravaged city on the homeworld of the Night Sentinels, showcasing grandiose, ancient architecture in the midst of destruction. Taras Nabad's sprawling structures and historical significance reveal glimpses into the Doom Slayer’s past and the once-thriving Sentinel civilization.",+ },+ {+ "Name": "Nekravol",+ "Description": "A hellish, industrial fortress where souls are processed into Argent energy. With conveyor belts moving the damned and a skyline dominated by fire and darkness, Nekravol is a nightmarish facility that powers Hell's armies and embodies the horrific machinery of Hell's cruelty.",+ },+ {+ "Name": "Urdak",+ "Description": "A surreal, high-tech realm that serves as the home of the angelic Maykrs. Urdak’s sleek, pristine architecture and ethereal ambiance sharply contrast with Hell’s brutal landscapes, yet this realm holds its own dark secrets and a critical role in Hell's invasion of Earth.",+ },+ {+ "Name": "UAC Base",+ "Description": "A futuristic military base on Earth controlled by the Union Aerospace Corporation (UAC), filled with high-tech weaponry and security systems. The UAC Base serves as a human foothold in the fight against Hell, though some within its ranks may have darker intentions.",+ },+]++combat_casualties = ["Nonexistent", "Low", "Medium", "High", "Extinction"]++missions = [+ "Locate and confront a key leader of Hell’s invasion forces.",+ "Clear out demonic infestations to secure a strategic foothold.",+ "Disrupt Hell's control over the area by eliminating critical targets.",+ "Enter a critical demonic stronghold to disrupt enemy operations.",+ "Locate and destroy the central power source to weaken enemy forces.",+ "Collect essential resources before the area becomes unstable.",+]+```++Now that that's done, we can make a function! We will generate three random missions and pass it off to the AI.+```python+def generate_missions():+ selectedmissions = []+ loop = 0++ while loop < 3:+ location = random.choice(locations)+ casualties = random.choice(combat_casualties)+ mission = random.choice(missions)+ final = (+ f"LocationName: {location['Name']}, "+ f"LocationInfo: {location['Description']}, "+ f"HumanCombatCasualties: {casualties}, "+ f"Mission: {mission}"+ )++ selectedmissions.append(final)+ loop += 1++ # Combine all mission strings into a single string with a separator (e.g., newline or comma)+ # Notebook had 'missions_string = "\n".join(missions)', which is a bug.+ # Using 'selectedmissions' as it's the correct variable.+ missions_string = "\n".join(selectedmissions)+ print(missions_string)+ return missions_string+```++```python+generate_missions()+```++## Constructing the Message Stream++Now to the real core of this; making our message stream! We create this as a function we can call later! I create examples since the LLM's context size can handle it (and it's generally good practice)!++We are also going to take several steps here; we must create an example of the tool being used as context. Next, we must add the generated lines to the messages list once done being generated. Finally, we will parse the text for the format we want and request another line.++Now we make a message! This time around we will skip making an initial message that has too much context, unlike in the past!+```python+# We make our history a separate block to be easier to add to later on! This is essentially our history+initial_messages = [+ {+ "role": "user",+ "content": "You are VEGA, the assistant to the DOOMGUY. Get three missions from the ship's API and tell me which mission is most to least important for quellng the forces of hell. ",+ }+]+```++Now to construct a request!+```python+response = client.messages.create(+ max_tokens=5000,+ model="claude-3-7-sonnet-20250219", # Matched notebook+ tools=[+ {+ "name": "generate_missions",+ "description": "Retrieve three missions for the DoomSlayer",+ "input_schema": {"type": "object", "properties": {}, "required": []},+ }+ ],+ messages=initial_messages,+)++print(response.content)+```+Having trouble understanding this? The first block given is always AI dialogue! You can use `response.content[0].text` to get the AI's text! Let's try it below.+```python+message = response.content[0].text+print(message)+```+The code below finds the tool used!+```python+gen_mission_result = ""++# Print response content to see the data+# print(response.content) # Already printed in the cell above in notebook++# Assuming ToolUseBlock is at index 1 (matches notebook's direct access)+tool_use_block = response.content[1]++# Get the tool name and input+tool_name = tool_use_block.name+tool_input = tool_use_block.input++# We don't need to look to extract any inputs since we don't use any++# Check if the tool name is "generate_missions"+if tool_name == "generate_missions":+ # Call the function with the tool creator as an argument+ gen_mission_result = generate_missions()+```+Now we add these as context to the LLM through `initial_messages`!+```python+# Matches notebook cell 25 logic+initial_messages.append({"role": "assistant", "content": gen_mission_result})++initial_messages.append(+ {+ "role": "user",+ "content": "Based on these, which location should take priority and why?",+ }+)+```+And now to get a response!+```python+response = client.messages.create(+ max_tokens=5000,+ model="claude-3-7-sonnet-20250219", # Matched notebook+ tools=[+ {+ "name": "generate_missions",+ "description": "Retrieve three missions for the DoomSlayer",+ "input_schema": {"type": "object", "properties": {}, "required": []},+ }+ ],+ messages=initial_messages,+)++print(response)+```+Isolate again!+```python+message = response.content[0].text+print(message)+```+Hmmm, what if we wanted to include more tools and add inputs? Let's create two new functions to display this!++One will show the kind of demon we are facing, whereas another one will take our weapon input to determine what the best weapon chain to use is (You heard that right, we believe in quick weapon switches around these parts)+```python+demons = [+ {+ "Name": "Imp",+ "Description": "A fast, agile demon that hurls fireballs and uses its claws to tear apart its prey. Imps are commonly found in Hell’s army, notorious for their quickness and ability to climb walls, making them dangerous adversaries in any environment.",+ },+ {+ "Name": "Cacodemon",+ "Description": "A floating, spherical demon with a large mouth full of teeth and an ability to launch explosive projectiles. Cacodemons are often encountered in open areas, where their aerial agility and relentless attacks pose a constant threat.",+ },+ {+ "Name": "Hell Knight",+ "Description": "A towering, brutish demon with immense strength and durability. The Hell Knight is capable of charging at the Doom Slayer and delivering devastating melee attacks. Its tough hide makes it resistant to most forms of damage.",+ },+ {+ "Name": "Mancubus",+ "Description": "A grotesque, overweight demon that releases powerful fireballs from its massive arm cannons. Mancubus demons are slow-moving but dangerous due to their firepower and the ability to overwhelm enemies with their fiery onslaughts.",+ },+]+++weapons = [+ {+ "Name": "Super Shotgun",+ "Description": "A powerful, double-barreled shotgun that delivers devastating close-range damage. Known for its sheer stopping power, the Super Shotgun can tear through enemies with ease, especially when equipped with the Meat Hook attachment, allowing for rapid mobility and devastating hits.",+ },+ {+ "Name": "Rocket Launcher",+ "Description": "A high-powered weapon that fires explosive rockets capable of dealing massive area damage. The Rocket Launcher is invaluable for taking down groups of enemies or dealing significant damage to larger demons, especially when upgraded with the Lock-On Burst mod.",+ },+ {+ "Name": "Chaingun",+ "Description": "A rapid-fire weapon that can unleash a torrent of bullets at a high rate of speed. The Chaingun is perfect for mowing down enemies and can be equipped with the Heat Blast mod, allowing for explosive energy rounds that can clear multiple enemies at once.",+ },+ {+ "Name": "BFG 9000",+ "Description": "One of the most iconic weapons in the *Doom* franchise, the BFG 9000 fires a massive energy beam that obliterates anything in its path. With its massive damage potential, the BFG 9000 is a game-changer, especially in dealing with large groups of enemies or the toughest foes.",+ },+ {+ "Name": "Ice Bomb",+ "Description": "A special grenade that freezes enemies in a wide area, giving the Doom Slayer a chance to deal with multiple foes at once. The Ice Bomb is effective for crowd control, allowing for easy Glory Kills or creating distance from overwhelming enemies.",+ },+]+```+Now we can keep the `initial_messages` from before actually! However let's change the context.+```python+# Matches notebook cell 33 (no conditional append of previous AI message)+initial_messages.append(+ {+ "role": "user",+ "content": "The first priority mission was selected. At the same time, scan for enemies and check inventory to determine the best combat strategy. You should use both tools at once.",+ }+)+```+And we of course make functions.+```python+def enemyscan(amount): # Matched notebook (no type hint)+ enemiesonscene = []+ loop = 0++ while loop < amount + 1: # Matched notebook+ scannedenemy = random.choice(demons)++ # Append name and description separately (Matches notebook)+ enemiesonscene.append(scannedenemy["Name"])+ enemiesonscene.append(scannedenemy["Description"])+ loop += 1++ # Combine all mission strings into a single string with a separator (e.g., newline or comma)+ enemies_string = "\n".join(enemiesonscene)+ print(enemies_string)+ return enemies_string+```+```python+enemyscan(5)+```+And now inventory.+```python+def inventoryscan():+ weapons_at_hand = []+ loop = 0++ while loop < 5: # Matched notebook (loop < 5)+ weapon = random.choice(weapons)++ # Append name and description separately (Matches notebook)+ weapons_at_hand.append(weapon["Name"])+ weapons_at_hand.append(weapon["Description"])+ loop += 1++ # Combine all mission strings into a single string with a separator (e.g., newline or comma)+ weapons_string = "\n".join(weapons_at_hand)+ print(weapons_string)+ return weapons_string+```+```python+inventoryscan()+```+With that, let's construct our new tools and run this!!+```python+response = client.messages.create(+ max_tokens=5000,+ model="claude-3-7-sonnet-20250219", # Matched notebook+ tools=[+ {+ "name": "enemyscan_tool",+ "description": "Retrieve a list of demons currently present in the area.",+ "input_schema": {+ "type": "object",+ "properties": {+ "amount": {+ "type": "integer",+ "description": "Number of enemies to scan.",+ }+ },+ "required": ["amount"],+ },+ },+ {+ "name": "inventoryscan_tool",+ "description": "Retrieve a list of weapons the Doom Slayer has at hand.",+ "input_schema": {"type": "object", "properties": {}, "required": []},+ },+ ],+ messages=initial_messages,+)++print(response)+```+Display just the text.+```python+# Matches notebook cell 43+message = response.content[0].text+print(message)+```+```python+# Matches notebook cell 44+initial_messages.append({"role": "assistant", "content": f"{str(response.content[0].text)}"})+```+And now to get the information and put it all together! PLEASE read the comments!+```python+# Matches notebook cell 46 logic+inv_scan_res = ""+enemy_scan_res = ""++response_str = str(response) # As in notebook+tool_use_count = response_str.count(+ "ToolUseBlock"+) # We know the ToolUseBlock will appear once for each tool request so we check how many time it appears++# You can use print(tool_use_count)to validate the ToolBlocks here if you wish++loop = 0++# We do this instead of a (foreach) because we need to skip the first block! This contains the message from the AI, not the tool! This way allows us to reference the item we want as easily as possible without complex logic needed!+while loop < tool_use_count: # We will get the tools now+ tool_use_block = response.content[loop + 1] # We start at 1 since 0 holds the AI mesage+ tool_name = tool_use_block.name+ tool_input = tool_use_block.input++ if tool_name == "inventoryscan_tool":+ # Call the inventoryscan function for inventoryscan_tool+ inv_scan_res = inventoryscan()+ elif tool_name == "enemyscan_tool":+ # Get the amount for enemyscan_tool+ amount = tool_input["amount"] # Direct access as in notebook+ # Call the enemyscan function with the amount+ enemy_scan_res = enemyscan(amount)++ loop = loop + 1 # Matches notebook+print(inv_scan_res)+print(enemy_scan_res)+```+And now we are basically done! We can give this to the AI and see what we get.+```python+# Matches notebook cell 48+initial_messages.append(+ {+ "role": "assistant", # Notebook uses assistant role here for tool results+ "content": f"Weapons Inventory Scan Result: {inv_scan_res}\nEnemy Scans Result: {enemy_scan_res}",+ }+)++initial_messages.append(+ {+ "role": "user",+ "content": "What is the combat plan for killing these demons? Based on the last message, tell me which demons to kill first, in which order and using which weapons as well as any sweakpoints.", # Typo 'sweakpoints' from notebook+ }+)+```+```python+# Matches notebook cell 49+response = client.messages.create(+ max_tokens=5000,+ model="claude-3-7-sonnet-20250219", # Matched notebook+ tools=[+ {+ "name": "enemyscan_tool",+ "description": "Retrieve a list of demons currently present in the area.",+ "input_schema": {+ "type": "object",+ "properties": {+ "amount": {+ "type": "integer",+ "description": "Number of enemies to scan.",+ }+ },+ "required": ["amount"],+ },+ },+ {+ "name": "inventoryscan_tool",+ "description": "Retrieve a list of weapons the Doom Slayer has at hand.",+ "input_schema": {"type": "object", "properties": {}, "required": []},+ },+ ],+ messages=initial_messages,+)++message = response.content[0].text # Matches notebook+print(message)+```++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/autogen.mdx b/docs/v2/examples/autogen.mdxnew file mode 100644index 00000000..9893b265--- /dev/null+++ b/docs/v2/examples/autogen.mdx@@ -0,0 +1,144 @@+---+title: 'Autogen Example'+description: 'Using Autogen with AgentOps for agent chat monitoring'+---+{/* SOURCE_FILE: examples/autogen/AgentChat.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/autogen/AgentChat.ipynb'} target={'_blank'}>Github</a>_++# Microsoft Autogen Chat Example++AgentOps automatically configures itself when it's initialized meaning your agent run data will be tracked and logged to your AgentOps dashboard right away.++First let's install the required packages.++## Installation+<CodeGroup>+ ```bash pip+ pip install -U autogen-agentchat "autogen-ext[openai]" agentops python-dotenv+ ```+ ```bash poetry+ poetry add autogen-agentchat autogen-ext agentops python-dotenv+ # For autogen-ext[openai] with poetry, you might need to specify openai as an extra:+ # poetry add autogen-ext -E openai+ ```+ ```bash uv+ uv add autogen-agentchat "autogen-ext[openai]" agentops python-dotenv+ ```+</CodeGroup>++## Setup+Then import them.+```python+import os+from dotenv import load_dotenv+from IPython.core.error import (+ StdinNotImplementedError,+)+import asyncio++import agentops++from autogen_agentchat.agents import AssistantAgent, UserProxyAgent+from autogen_ext.models.openai import OpenAIChatCompletionClient++from autogen_agentchat.teams import RoundRobinGroupChat+from autogen_agentchat.conditions import MaxMessageTermination+from autogen_agentchat.ui import Console+```++Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.++[Get an AgentOps API key](https://agentops.ai/settings/projects)++1. Create an environment variable in a `.env` file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...++2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!++```python+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+```++```python+# When initializing AgentOps, you can pass in optional tags to help filter sessions+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(trace_name="Microsoft Agent Chat Example", tags=["autogen-chat", "microsoft-autogen", "agentops-example"])+```++AutoGen will now start automatically tracking:++* LLM prompts and completions+* Token usage and costs+* Agent names and actions+* Correspondence between agents+* Tool usage+* Errors++# Simple Chat Example+```python+# Define model and API key+model_name = "gpt-4-turbo" # Or "gpt-4o" / "gpt-4o-mini" as per migration guide examples+api_key = os.getenv("OPENAI_API_KEY")++# Create the model client+model_client = OpenAIChatCompletionClient(model=model_name, api_key=api_key)++# Create the agent that uses the LLM.+assistant = AssistantAgent(+ name="assistant",+ system_message="You are a helpful assistant.", # Added system message for clarity+ model_client=model_client+)++user_proxy_initiator = UserProxyAgent("user_initiator")++async def main():+ termination = MaxMessageTermination(max_messages=2)++ group_chat = RoundRobinGroupChat(+ [user_proxy_initiator, assistant], # Corrected: agents as positional argument+ termination_condition=termination+ )++ chat_task = "How can I help you today?"+ print(f"User Initiator: {chat_task}")++ try:+ stream = group_chat.run_stream(task=chat_task)+ await Console().run(stream)+ agentops.end_trace(tracer, end_state="Success")++ except StdinNotImplementedError:+ print("StdinNotImplementedError: This typically happens in non-interactive environments.")+ print("Skipping interactive part of chat for automation.")+ agentops.end_trace(tracer, end_state="Indeterminate")+ except Exception as e:+ print(f"An error occurred: {e}")+ agentops.end_trace(tracer, end_state="Error")+ finally:+ await model_client.close()++if __name__ == '__main__':+ try:+ loop = asyncio.get_running_loop()+ except RuntimeError:+ loop = None++ if loop and loop.is_running():+ import nest_asyncio+ nest_asyncio.apply()+ asyncio.run(main())+ else:+ asyncio.run(main())+```++You can view data on this run at [app.agentops.ai](https://app.agentops.ai).++The dashboard will display LLM events for each message sent by each agent, including those made by the human user.++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/crewai.mdx b/docs/v2/examples/crewai.mdxnew file mode 100644index 00000000..f84f77c3--- /dev/null+++ b/docs/v2/examples/crewai.mdx@@ -0,0 +1,230 @@+---+title: 'CrewAI Example'+description: 'Using CrewAI with AgentOps to create a job posting'+---+{/* SOURCE_FILE: examples/crewai/job_posting.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/crewai/job_posting.ipynb'} target={'_blank'}>Github</a>_++# CrewAI Job Posting Example++This notebook demonstrates how to use CrewAI with AgentOps to automate the creation of a job posting.++First let's install the required packages.++## Installation+<CodeGroup>+ ```bash pip+ pip install -U 'crewai[tools]' agentops python-dotenv+ ```+ ```bash poetry+ poetry add crewai agentops python-dotenv+ # For tools, you might need to add them or specific extras:+ # poetry add crewai --extras tools+ # or poetry add crewai[tools] depending on your poetry version+ ```+ ```bash uv+ uv add 'crewai[tools]' agentops python-dotenv+ ```+</CodeGroup>++## Setup+Then import them.+```python+from crewai import Crew, Agent, Task+from crewai_tools.tools import WebsiteSearchTool, SerperDevTool, FileReadTool # Corrected import in previous MDX version+import agentops+import os+from dotenv import load_dotenv+from textwrap import dedent # Added import+```++Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.++[Get an AgentOps API key](https://agentops.ai/settings/projects)++1. Create an environment variable in a `.env` file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...++2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!++```python+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+os.environ["SERPER_API_KEY"] = os.getenv("SERPER_API_KEY", "your_serper_api_key_here")+```++```python+# Initialize AgentOps client+agentops.init(auto_start_session=False)+```++## Define Agents and Tasks++```python+web_search_tool = WebsiteSearchTool()+serper_dev_tool = SerperDevTool()+file_read_tool = FileReadTool(+ file_path="job_description_example.md", # Ensure this file exists or handle appropriately+ description="A tool to read the job description example file.",+)+++class Agents:+ def research_agent(self):+ return Agent(+ role="Research Analyst",+ goal="Analyze the company website and provided description to extract insights on culture, values, and specific needs.",+ tools=[web_search_tool, serper_dev_tool],+ backstory="Expert in analyzing company cultures and identifying key values and needs from various sources, including websites and brief descriptions.",+ verbose=True,+ )++ def writer_agent(self):+ return Agent(+ role="Job Description Writer",+ goal="Use insights from the Research Analyst to create a detailed, engaging, and enticing job posting.",+ tools=[web_search_tool, serper_dev_tool, file_read_tool],+ backstory="Skilled in crafting compelling job descriptions that resonate with the company's values and attract the right candidates.",+ verbose=True,+ )++ def review_agent(self):+ return Agent(+ role="Review and Editing Specialist",+ goal="Review the job posting for clarity, engagement, grammatical accuracy, and alignment with company values and refine it to ensure perfection.",+ tools=[web_search_tool, serper_dev_tool, file_read_tool],+ backstory="A meticulous editor with an eye for detail, ensuring every piece of content is clear, engaging, and grammatically perfect.",+ verbose=True,+ )+```++```python+class Tasks:+ def research_company_culture_task(self, agent, company_description, company_domain):+ return Task(+ description=dedent(+ f\"\"\"\\+ Analyze the provided company website and the hiring manager's company's domain {company_domain}, description: "{company_description}". Focus on understanding the company's culture, values, and mission. Identify unique selling points and specific projects or achievements highlighted on the site.+ Compile a report summarizing these insights, specifically how they can be leveraged in a job posting to attract the right candidates.\"\"\"+ ),+ expected_output=dedent(+ \"\"\"\\+ A comprehensive report detailing the company's culture, values, and mission, along with specific selling points relevant to the job role. Suggestions on incorporating these insights into the job posting should be included.\"\"\"+ ),+ agent=agent,+ )++ def research_role_requirements_task(self, agent, hiring_needs):+ return Task(+ description=dedent(+ f\"\"\"\\+ Based on the hiring manager's needs: "{hiring_needs}", identify the key skills, experiences, and qualities the ideal candidate should possess for the role. Consider the company's current projects, its competitive landscape, and industry trends. Prepare a list of recommended job requirements and qualifications that align with the company's needs and values.\"\"\"+ ),+ expected_output=dedent(+ \"\"\"\\+ A list of recommended skills, experiences, and qualities for the ideal candidate, aligned with the company's culture, ongoing projects, and the specific role's requirements.\"\"\"+ ),+ agent=agent,+ )++ def draft_job_posting_task(self, agent, company_description, hiring_needs, specific_benefits):+ return Task(+ description=dedent(+ f\"\"\"\\+ Draft a job posting for the role described by the hiring manager: "{hiring_needs}". Use the insights on "{company_description}" to start with a compelling introduction, followed by a detailed role description, responsibilities, and required skills and qualifications. Ensure the tone aligns with the company's culture and incorporate any unique benefits or opportunities offered by the company.+ Specific benefits: "{specific_benefits}"\"\"\"+ ),+ expected_output=dedent(+ \"\"\"\\+ A detailed, engaging job posting that includes an introduction, role description, responsibilities, requirements, and unique company benefits. The tone should resonate with the company's culture and values, aimed at attracting the right candidates.\"\"\"+ ),+ agent=agent,+ )++ def review_and_edit_job_posting_task(self, agent, hiring_needs):+ return Task(+ description=dedent(+ f\"\"\"\\+ Review the draft job posting for the role: "{hiring_needs}". Check for clarity, engagement, grammatical accuracy, and alignment with the company's culture and values. Edit and refine the content, ensuring it speaks directly to the desired candidates and accurately reflects the role's unique benefits and opportunities. Provide feedback for any necessary revisions.\"\"\"+ ),+ expected_output=dedent(+ \"\"\"\\+ A polished, error-free job posting that is clear, engaging, and perfectly aligned with the company's culture and values. Feedback on potential improvements and final approval for publishing. Formated in markdown.\"\"\"+ ),+ agent=agent,+ output_file="job_posting.md",+ )++ def industry_analysis_task(self, agent, company_domain, company_description):+ return Task(+ description=dedent(+ f\"\"\"\\+ Conduct an in-depth analysis of the industry related to the company's domain: "{company_domain}". Investigate current trends, challenges, and opportunities within the industry, utilizing market reports, recent developments, and expert opinions. Assess how these factors could impact the role being hired for and the overall attractiveness of the position to potential candidates.+ Consider how the company's position within this industry and its response to these trends could be leveraged to attract top talent. Include in your report how the role contributes to addressing industry challenges or seizing opportunities.\"\"\"+ ),+ expected_output=dedent(+ \"\"\"\\+ A detailed analysis report that identifies major industry trends, challenges, and opportunities relevant to the company's domain and the specific job role. This report should provide strategic insights on positioning the job role and the company as an attractive choice for potential candidates.\"\"\"+ ),+ agent=agent,+ )+```++## Run the Crew++```python+tracer = agentops.start_trace(trace_name="CrewAI Job Posting", tags=["crew-job-posting-example", "agentops-example"])++tasks = Tasks()+agents = Agents()++# Note: In a real scenario, you'd get these inputs dynamically.+# For this MDX example, we'll use placeholders.+company_description = "A fast-paced tech startup focused on AI-driven solutions for e-commerce."+company_domain = "agentops.ai" # Example domain+hiring_needs = "Senior Software Engineer with experience in Python, AI, and cloud platforms."+specific_benefits = "Competitive salary, stock options, remote work flexibility, and a great team culture."++# Create Agents+researcher_agent = agents.research_agent()+writer_agent = agents.writer_agent()+review_agent = agents.review_agent()++# Define Tasks for each agent+research_company_culture_task = tasks.research_company_culture_task(+ researcher_agent, company_description, company_domain+)+industry_analysis_task = tasks.industry_analysis_task(researcher_agent, company_domain, company_description)+research_role_requirements_task = tasks.research_role_requirements_task(researcher_agent, hiring_needs)+draft_job_posting_task = tasks.draft_job_posting_task(+ writer_agent, company_description, hiring_needs, specific_benefits+)+review_and_edit_job_posting_task = tasks.review_and_edit_job_posting_task(review_agent, hiring_needs)++# Instantiate the crew with a sequential process+crew = Crew(+ agents=[researcher_agent, writer_agent, review_agent],+ tasks=[+ research_company_culture_task,+ industry_analysis_task,+ research_role_requirements_task,+ draft_job_posting_task,+ review_and_edit_job_posting_task,+ ],+)+++result = crew.kickoff()+print("Job Posting Creation Process Completed.")+print("Final Job Posting:")+print(result) # This will print the path to the output file job_posting.md++agentops.end_trace(tracer, end_state="Success")+```+The `job_posting.md` file will be created in the same directory where this script/notebook is run.++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/examples.mdx b/docs/v2/examples/examples.mdxindex b36f990d..bdf9c2b8 100644--- a/docs/v2/examples/examples.mdx+++ b/docs/v2/examples/examples.mdx@@ -1,127 +1,73 @@----title: 'Integration Examples'+title: 'Examples'description: 'Examples of AgentOps with various integrations'-mode: "wide"----## Explore our integration examples to see AgentOps in action!+## Explore our examples to see AgentOps in action!-### Integration Examples+### LLM Integrations-<CardGroup cols={2}>- <Card title="Multi-Agent" icon="robot" href="/v2/examples/multi_agent">- Tracking operations from multiple different agents- </Card>+<CardGroup cols={3}>- <Card title="OpenAI Assistants" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI Assistants" />} iconType="image" href="/v2/examples/openai_assistants">- Observe OpenAI Assistants with AgentOps+ <Card title="Anthropic" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/anthropic/anthropic_icon_slate.png?raw=true" alt="Anthropic" />} iconType="image" href="/v2/examples/anthropic">+ Claude integration with tool usage and advanced features</Card>- <Card title="Simple Agent" icon="microchip-ai" iconType="solid" href="/v2/examples/simple_agent">- Basic usage with OpenAI API, perfect for getting started- </Card>-- <Card title="OpenAI Agents SDK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI Agents SDK" />} iconType="image" href="/v2/integrations/agentssdk">- Monitor multi-agent workflows with handoffs and tool usage+ <Card title="Google Generative AI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/deepmind/gemini-logo.png?raw=true" alt="Gemini" />} iconType="image" href="/v2/examples/google_generative_ai">+ Google Gemini models and their examples</Card>-</CardGroup>--### Other Integrations Documentation-<CardGroup cols={2}>- <Card title="Anthropic" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/anthropic/anthropic_icon_slate.png?raw=true" alt="Anthropic" />} iconType="image" href="/v2/integrations/anthropic">- Track observations from Claude, Haiku and Sonnet series of models+ <Card title="LiteLLM" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/litellm/litellm.png?raw=true" alt="LiteLLM" />} iconType="image" href="/v2/examples/litellm">+ Unified LLM interface monitoring example</Card>- <Card title="Autogen" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/autogen/ag2.svg?raw=true" alt="Autogen"/>} iconType="image" href="/v2/integrations/autogen">- Autogen/AG2 multi-agent conversible workflow with tool usage+ <Card title="OpenAI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI" />} iconType="image" href="/v2/examples/openai">+ Advanced multi-tool orchestration with GPT models</Card>- <Card title="CrewAI" icon="ship" href="/v2/integrations/crewai">- CrewAI multi-agent framework with AgentOps support+ <Card title="Watsonx" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/ibm/ibm-logo.svg?raw=true" alt="IBM" />} iconType="image" href="/v2/examples/watsonx">+ Watsonx text chat integration example</Card>- <Card title="Gemini" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/deepmind/gemini-logo.png?raw=true" alt="Gemini" />} iconType="image" href="/v2/integrations/gemini">- Explore Google DeepMind's Gemini with observation via AgentOps+ <Card title="x.AI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/xai/xai-logo.png?raw=true" alt="x.AI" />} iconType="image" href="/v2/examples/xai">+ Grok LLM basic usage patterns</Card>- <Card title="Google ADK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/google-adk/google-adk-logo.png?raw=true" alt="Google" />} iconType="image" href="/v2/integrations/google_adk">- Track and analyze your Google Agent Development Kit (ADK) AI agents- </Card>+</CardGroup>- <Card title="IBM Watsonx.ai" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/ibm/ibm-logo.svg?raw=true" alt="IBM" />} iconType="image" href="/v2/integrations/ibm_watsonx_ai">- Track and analyze your IBM Watsonx.ai model interactions- </Card>- <Card title="LangChain" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/langchain/langchain-logo.svg?raw=true" alt="LangChain" />} iconType="image" href="/v2/integrations/langchain">- First-class support for LangChain agents and chains- </Card>+### Agent Integrations- <Card title="LiteLLM" icon="train-tram" href="/v2/integrations/litellm">- Unified interface for multiple LLM providers- </Card>+<CardGroup>- <Card title="OpenAI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI" />} iconType="image" href="/v2/integrations/openai">- First class support for GPT family of models+ <Card title="AG2" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/ag2/ag2-logo.svg?raw=true" alt="AG2" />} iconType="image" href="/v2/examples/ag2">+ Multi-agent conversations with memory capabilities</Card>-- <Card title="OpenAI Agents SDK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI Agents SDK" />} iconType="image" href="/v2/integrations/agentssdk">- Monitor OpenAI Agents SDK multi-agent workflows with handoffs++ <Card title="Autogen" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/autogen/autogen-logo.svg?raw=true" alt="Autogen" />} iconType="image" href="/v2/examples/autogen">+ AG2 multi-agent workflow demonstration</Card>-</CardGroup>-## Video Guides--<CardGroup cols={2}>- <Card title="AgentOps x CrewAI" icon="film" iconType="solid">- Learn how to monitor CrewAI applications with AgentOps- <iframe- width="280"- height="158"- src="https://www.youtube.com/embed/sF_bgRuRa3s"- title="YouTube video player"- frameborder="0"- allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture"- allowfullscreen- ></iframe>+ <Card title="CrewAI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/crewai/crewai-logo.png?raw=true" alt="CrewAI" />} iconType="image" href="/v2/examples/crewai">+ CrewAI multi-agent framework example</Card>- <Card title="AgentOps x Anthropic" icon="film" iconType="solid">- Learn how to monitor applications that use the Anthropic SDK directly with AgentOps- <iframe- width="280"- height="158"- src="https://www.youtube.com/embed/Yx2Crpbms7I"- title="YouTube video player"- frameborder="0"- allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture"- allowfullscreen- ></iframe>+ <Card title="Google ADK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/google-adk/google-adk-logo.png?raw=true" alt="Google ADK" />} iconType="image" href="/v2/examples/google_adk">+ Google Agent Development Kit integration</Card>- <Card title="AgentOps x OpenAI" icon="film" iconType="solid">- Learn how to monitor applications that use the OpenAI SDK directly with AgentOps- <iframe- width="280"- height="158"- src="https://www.youtube.com/embed/R0K9Qi2dBwM"- title="YouTube video player"- frameborder="0"- allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture"- allowfullscreen- ></iframe>+ <Card title="OpenAI Agents SDK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI Agents SDK" />} iconType="image" href="/v2/examples/openai_agents">+ OpenAI Agents SDK workflow walkthrough</Card>- <Card title="Crew.ai" icon="ship" href="https://www.loom.com/share/cfcaaef8d4a14cc7a974843bda1076bf">- CrewAI multi-agent framework with AgentOps support- + <Card title="LangChain" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/langchain/langchain-logo.svg?raw=true" alt="LangChain" />} iconType="image" href="/v2/examples/langchain">+ LangChain callback handler integration</Card>+</CardGroup>-<script type="module" src="/scripts/github_stars.js" />+<script type="module" src="/scripts/github_stars.js" /><script type="module" src="/scripts/scroll-img-fadein-animation.js" />-<script type="module" src="/scripts/button_heartbeat_animation.js" />-<script type="module" src="/scripts/adjust_api_dynamically.js" />\ No newline at end of filediff --git a/docs/v2/examples/google_adk.mdx b/docs/v2/examples/google_adk.mdxnew file mode 100644index 00000000..6a454790--- /dev/null+++ b/docs/v2/examples/google_adk.mdx@@ -0,0 +1,296 @@+---+title: 'Google Adk'+description: 'Google ADK Example: Human Approval Workflow with AgentOps'+---+{/* SOURCE_FILE: examples/google_adk/human_approval.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/google_adk/human_approval.ipynb'} target={'_blank'}>Github</a>_++# Google ADK Example: Human Approval Workflow with AgentOps++This notebook demonstrates a complete human approval workflow using the Google ADK (Agent Development Kit), integrated with AgentOps for observability.++**Key Features:**+- **Sequential Agent Processing:** The workflow uses multiple agents chained together to handle different stages of the approval process.+- **External Tool Integration:** An agent interacts with an external tool that simulates (or in this version, directly prompts for) human approval.+- **Session State Management:** Information is passed between agents and persisted using session state.+- **AgentOps Observability:** All agent actions, tool calls, and LLM interactions are traced and can be viewed in your AgentOps dashboard.+- **Interactive Human Input:** The approval step now requires direct input from the user.++## 1. Setup and Dependencies++First, let's install the necessary libraries if they are not already present and import them.++++## Installation+<CodeGroup>+ ```bash pip+ pip install agentops asyncio google-adk nest_asyncio python-dotenv+ ```+ ```bash poetry+ poetry add agentops asyncio google-adk nest_asyncio python-dotenv+ ```+ ```bash uv+ uv add agentops asyncio google-adk nest_asyncio python-dotenv+ ```+</CodeGroup>+++```python+import json+import os+import asyncio+from google.adk.agents import LlmAgent, SequentialAgent+from google.adk.tools import FunctionTool+from google.adk.runners import Runner+from google.adk.sessions import InMemorySessionService+from google.genai import types+from pydantic import BaseModel, Field+import nest_asyncio+import agentops+from dotenv import load_dotenv+```++## 2. Configuration and Initialization++Load environment variables (especially `AGENTOPS_API_KEY` and your Google API key for Gemini) and initialize AgentOps.+++```python+# Load environment variables from .env file+load_dotenv()+nest_asyncio.apply()+AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your_agentops_api_key_here"+# Initialize AgentOps - Just 2 lines!+agentops.init(AGENTOPS_API_KEY, trace_name="adk-human-approval-notebook", auto_start_session=False)+```++Define some constants for our application.+++```python+APP_NAME = "human_approval_app_notebook"+USER_ID = "test_user_notebook_123"+SESSION_ID = "approval_session_notebook_456"+MODEL_NAME = "gemini-1.5-flash"+agentops.start_trace(trace_name=APP_NAME, tags=["google_adk","notebook"])+```++## 3. Define Schemas++Pydantic models are used to define the structure of data for approval requests and decisions. This helps with validation and clarity.+++```python+class ApprovalRequest(BaseModel):+ amount: float = Field(description="The amount requiring approval")+ reason: str = Field(description="The reason for the request")+class ApprovalDecision(BaseModel):+ decision: str = Field(description="The approval decision: 'approved' or 'rejected'")+ comments: str = Field(description="Additional comments from the approver")+```++## 4. External Approval Tool (with Human Interaction)++This tool now directly prompts the user for an approval decision. In a real-world scenario, this might involve sending a notification to an approver and waiting for their response through a UI or API.+++```python+async def external_approval_tool(amount: float, reason: str) -> str:+ """+ Prompts for human approval and returns the decision as a JSON string.+ """+ print(f"🔔 HUMAN APPROVAL REQUIRED:")+ print(f" Amount: ${amount:,.2f}")+ print(f" Reason: {reason}")+ decision = ""+ while decision.lower() not in ["approved", "rejected"]:+ decision = input(" Enter decision (approved/rejected): ").strip().lower()+ if decision.lower() not in ["approved", "rejected"]:+ print(" Invalid input. Please enter 'approved' or 'rejected'.")+ comments = input(" Enter comments (optional): ").strip()+ print(f" Decision: {decision.upper()}")+ print(f" Comments: {comments if comments else 'N/A'}")+ return json.dumps({+ "decision": decision,+ "comments": comments,+ "amount": amount,+ "reason": reason+ })++# Create the approval tool instance+approval_tool = FunctionTool(func=external_approval_tool)+```++## 5. Define Agents++We define three agents for our workflow:+1. **`PrepareApprovalAgent`**: Extracts details from the user's request.+2. **`RequestHumanApprovalAgent`**: Uses the `external_approval_tool` to get a decision.+3. **`ProcessDecisionAgent`**: Processes the decision and formulates a final response.+++```python+# Agent 1: Prepare the approval request+prepare_request = LlmAgent(+ model=MODEL_NAME,+ name="PrepareApprovalAgent",+ description="Extracts and prepares approval request details from user input",+ instruction="""You are an approval request preparation agent.+ Your task:+ 1. Extract the amount and reason from the user's request+ 2. Store these values in the session state with keys 'approval_amount' and 'approval_reason'+ 3. Validate that both amount and reason are provided+ 4. Respond with a summary of what will be submitted for approval+ If the user input is missing amount or reason, ask for clarification.+ """,+ output_key="request_prepared"+)++# Agent 2: Request human approval using the tool+request_approval = LlmAgent(+ model=MODEL_NAME,+ name="RequestHumanApprovalAgent",+ description="Calls the external approval system with prepared request details",+ instruction="""You are a human approval request agent.+ Your task:+ 1. Get the 'approval_amount' and 'approval_reason' from the session state+ 2. Use the external_approval_tool with these values+ 3. Store the approval decision in session state with key 'human_decision'+ 4. Respond with the approval status+ Always use the exact values from the session state for the tool call.+ """,+ tools=[approval_tool],+ output_key="approval_requested"+)++# Agent 3: Process the approval decision+process_decision = LlmAgent(+ model=MODEL_NAME,+ name="ProcessDecisionAgent",+ description="Processes the human approval decision and provides final response",+ instruction="""You are a decision processing agent.+ Your task:+ 1. Check the 'human_decision' from session state+ 2. Parse the approval decision JSON+ 3. If approved: congratulate and provide next steps+ 4. If rejected: explain the rejection and suggest alternatives+ 5. Provide a clear, helpful final response to the user++ Be professional and helpful in your response.+ """,+ output_key="final_decision"+)+```++## 6. Create Sequential Workflow++Combine the agents into a sequential workflow. The `SequentialAgent` ensures that the sub-agents are executed in the specified order.+++```python+approval_workflow = SequentialAgent(+ name="HumanApprovalWorkflowNotebook",+ description="Complete workflow for processing approval requests with human oversight",+ sub_agents=[prepare_request, request_approval, process_decision]+)+```++## 7. Session Management and Runner++Set up an in-memory session service and the workflow runner.+++```python+session_service = InMemorySessionService()+# Create runner+workflow_runner = Runner(+ agent=approval_workflow,+ app_name=APP_NAME,+ session_service=session_service+)+```++## 8. Helper Function to Run Workflow++This function encapsulates the logic to run the workflow for a given user request and session ID.+++```python+async def run_approval_workflow_notebook(user_request: str, session_id: str):+ """Run the complete approval workflow with a user request in the notebook environment"""+ print(f"{'='*60}")+ print(f" Starting Approval Workflow for Session: {session_id}")+ print(f"{'='*60}")+ print(f"User Request: {user_request}")+ # Create user message+ user_content = types.Content(+ role='user',+ parts=[types.Part(text=user_request)]+ )+ step_count = 0+ final_response = "No response received"+ # Run the workflow+ async for event in workflow_runner.run_async(+ user_id=USER_ID,+ session_id=session_id,+ new_message=user_content,+ ):+ if event.author and event.content:+ step_count += 1+ print(f"📋 Step {step_count} - {event.author}:")+ if event.content.parts:+ response_text = event.content.parts[0].text+ print(f" {response_text}")+ if event.is_final_response():+ final_response = response_text+ session = await session_service.get_session(+ app_name=APP_NAME,+ user_id=USER_ID,+ session_id=session_id,+ )+ print(f"{'='*60}")+ print(f"📊 Workflow Complete - Session State ({session_id}):")+ print(f"{'='*60}")+ for key, value in session.state.items():+ print(f" {key}: {value}")+ print(f"🎯 Final Response: {final_response}")+ return final_response+```++## 9. Main Execution Logic++This cell contains the main logic to run the workflow with a few test cases. Each test case will run in its own session.+++```python+async def main_notebook():+ test_requests = [+ "I need approval for $750 for team lunch and celebrations",+ "Please approve $3,000 for a conference ticket and travel expenses",+ "I need $12,000 approved for critical software licenses renewal"+ ]+ for i, request in enumerate(test_requests, 1):+ current_session_id = f"approval_session_notebook_{456 + i -1}"+ # Create the session before running the workflow+ await session_service.create_session(+ app_name=APP_NAME,+ user_id=USER_ID,+ session_id=current_session_id+ )+ print(f"Created session: {current_session_id}")+ await run_approval_workflow_notebook(request, current_session_id)+try:+ asyncio.run(main_notebook())+ agentops.end_trace(end_state="Success")+except Exception as e:+ print(f"Error: {e}")+ agentops.end_trace(end_state="Error")+```+++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>\ No newline at end of filediff --git a/docs/v2/examples/google_generative_ai.mdx b/docs/v2/examples/google_generative_ai.mdxnew file mode 100644index 00000000..344959d5--- /dev/null+++ b/docs/v2/examples/google_generative_ai.mdx@@ -0,0 +1,102 @@+---+title: 'Google Generative AI Example'+description: 'Using Google Generative AI API with AgentOps for synchronous and streaming text generation'+---+{/* SOURCE_FILE: examples/google_genai/gemini_example.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/gemini/gemini_example.ipynb'} target={'_blank'}>Github</a>_++# Google Generative AI API Example with AgentOps++This notebook demonstrates how to use AgentOps with Google's Gemini API for observing both synchronous and streaming text generation.++## Installation+Install necessary packages:+<CodeGroup>+ ```bash pip+ pip install agentops google-generativeai python-dotenv+ ```+ ```bash poetry+ poetry add agentops google-generativeai python-dotenv+ ```+ ```bash uv+ uv add agentops google-generativeai python-dotenv+ ```+</CodeGroup>++## Setup+```python+from google import generativeai as genai # Renamed for clarity as per official docs+import agentops+from dotenv import load_dotenv+import os+```++Set API Keys:+```python+load_dotenv()++os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["GEMINI_API_KEY"] = os.getenv("GEMINI_API_KEY", "your_gemini_api_key_here")++# Configure the GenAI client with the API key+genai.configure(api_key=os.environ["GEMINI_API_KEY"])+```++ Initialize AgentOps:+```python+# Initialize AgentOps and Gemini client+agentops.init(tags=["gemini-example", "agentops-example"])+# The client is configured globally via genai.configure()+```++## Synchronous Generation+```python+# Test synchronous generation+print("Testing synchronous generation:")+model = genai.GenerativeModel('gemini-1.5-flash') # Create model instance+response = model.generate_content("What are the three laws of robotics?")+print(response.text)+```++## Streaming Generation+```python+# Test streaming generation+print("\nTesting streaming generation:")+model = genai.GenerativeModel('gemini-1.5-flash') # Create model instance+response_stream = model.generate_content(+ "Explain the concept of machine learning in simple terms.",+ stream=True+)++for chunk in response_stream:+ print(chunk.text, end="")+print() # Add newline after streaming output+```++## Another Synchronous Generation+```python+# Test another synchronous generation+print("\nTesting another synchronous generation:")+model = genai.GenerativeModel('gemini-1.5-flash') # Create model instance+response = model.generate_content(+ "What is the difference between supervised and unsupervised learning?"+)+print(response.text)+```++## Token Counting+```python+# Example of token counting+print("\nTesting token counting:")+model = genai.GenerativeModel('gemini-1.5-flash') # Create model instance+token_response = model.count_tokens("This is a test sentence to count tokens.")+print(f"Token count: {token_response.total_tokens}")++agentops.end_session("Success") # End the session+```++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/langchain.mdx b/docs/v2/examples/langchain.mdxindex a6f16449..9dfea865 100644--- a/docs/v2/examples/langchain.mdx+++ b/docs/v2/examples/langchain.mdx@@ -1,92 +1,107 @@---title: 'LangChain Example'-description: 'Using the LangChain Callback Handler'-mode: "wide"+description: 'Using the LangChain Callback Handler with AgentOps'----_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/langchain_examples.ipynb'} target={'_blank'}>Github</a>_+{/* SOURCE_FILE: examples/langchain/langchain_examples.ipynb */}--{/* SOURCE_FILE: examples/langchain_examples/langchain_examples.ipynb */}+_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/langchain/langchain_examples.ipynb'} target={'_blank'}>Github</a>_# AgentOps Langchain Agent Implementation-Using AgentOps monitoring with Langchain is simple. We've created a LangchainCallbackHandler that will do all of the heavy lifting!+Using AgentOps monitoring with Langchain is simple. We've created a `LangchainCallbackHandler` that will do all of the heavy lifting!-First let's install the required packages+## Installation+First, let's install the required packages:-```python-%pip install langchain==0.2.9-%pip install langchain_openai-%pip install -U agentops-%pip install -U python-dotenv+<CodeGroup>+```bash pip+pip install agentops langchain langchain_openai python-dotenv```+```bash poetry+poetry add agentops langchain langchain_openai python-dotenv+```+```bash uv+uv add agentops langchain langchain_openai python-dotenv+```+</CodeGroup>-Then import them-+## Setup+### Import Dependencies+Next, import the necessary libraries:```pythonimport osfrom langchain_openai import ChatOpenAIfrom langchain.agents import tool, AgentExecutor, create_openai_tools_agentfrom dotenv import load_dotenvfrom langchain_core.prompts import ChatPromptTemplate+from agentops.integration.callbacks.langchain import (+ LangchainCallbackHandler as AgentOpsLangchainCallbackHandler,+)```-The only difference with using AgentOps is that we'll also import this special Callback Handler+### Configure API Keys+Set up your API keys. This example shows loading from environment variables, which is a common practice.+[Get an AgentOps API key](https://agentops.ai/settings/projects) and ensure your OpenAI API key is also accessible.+1. Create an environment variable in a `.env` file or other method. By default, the AgentOps SDK will look for an environment variable named `AGENTOPS_API_KEY`.+2. Similarly, ensure `OPENAI_API_KEY` is set for LangChain's OpenAI integration.```python-from agentops.integration.callbacks.langchain import LangchainCallbackHandler-```--Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.+from dotenv import load_dotenv # Typically at the start of your script+import os # Typically at the start of your script-[Get an AgentOps API key](https://agentops.ai/settings/projects)--1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...--2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!---```pythonload_dotenv()-AGENTOPS_API_KEY = os.environ.get("AGENTOPS_API_KEY")-OPENAI_API_KEY = os.environ.get("OPENAI_API_KEY")-```-This is where AgentOps comes into play. Before creating our LLM instance via Langchain, first we'll create an instance of the AO LangchainCallbackHandler. After the handler is initialized, a session will be recorded automatically.--Pass in your API key, and optionally any tags to describe this session for easier lookup in the AO dashboard.+# These lines ensure the environment variables are set for the script's context.+# Replace "your_agentops_api_key_here" and "your_openai_api_key_here"+# if you are not using a .env file or pre-set environment variables.+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+```+## Initialize AgentOps and LangChain Components+<Tip>+Note that you don't need to set up a separate `agentops.init()` call when using the `LangchainCallbackHandler`, as it will automatically initialize the AgentOps client for you if an API key is provided to it or found in the environment.+</Tip>+This is where AgentOps comes into play. Before creating our LLM instance via Langchain, first we'll create an instance of the `AgentOpsLangchainCallbackHandler`. After the handler is initialized, a session will be recorded automatically. Pass in any tags to describe this session for easier lookup in the AgentOps dashboard.```python-agentops_handler = LangchainCallbackHandler(- api_key=AGENTOPS_API_KEY, tags=["Langchain Example"]+agentops_handler = AgentOpsLangchainCallbackHandler(+ tags=["Langchain Example", "agentops-example"]+ # The AGENTOPS_API_KEY from the environment will be used automatically.+ # Alternatively, you could pass api_key=os.getenv("AGENTOPS_API_KEY"))llm = ChatOpenAI(- openai_api_key=OPENAI_API_KEY, callbacks=[agentops_handler], model="gpt-3.5-turbo"+ callbacks=[agentops_handler],+ model="gpt-3.5-turbo"+ # The OPENAI_API_KEY from the environment will be used automatically.+ # Alternatively, you could pass openai_api_key=os.getenv("OPENAI_API_KEY"))-# You must pass in a callback handler to record your agent+# This explicit assignment is redundant if callbacks are passed in the constructor,+# but we include it here to match the source notebook.llm.callbacks = [agentops_handler]+```+### Define Prompt+Set up the prompt template for your agent.+```pythonprompt = ChatPromptTemplate.from_messages([("system", "You are a helpful assistant. Respond only in Spanish."),("human", "{input}"),# Placeholders fill up a **list** of messages("placeholder", "{agent_scratchpad}"),- # ("tool_names", "find_movie")])```-Agents generally use tools. Let's define a simple tool here. Tool usage is also recorded.--+### Define Tools+Agents generally use tools. Let's define a simple tool here. Tool usage is also recorded by AgentOps.```python@tooldef find_movie(genre: str) -> str:@@ -96,45 +111,39 @@ def find_movie(genre: str) -> str:else:return "Pineapple Express"-tools = [find_movie]```--For each tool, you need to also add the callback handler--+For each tool, you need to also add the callback handler:```pythonfor t in tools:t.callbacks = [agentops_handler]```--Add the tools to our LLM--+Bind the tools to the LLM. Note: Depending on the agent creation method, this explicit binding step might sometimes be handled internally by the agent constructor. In this example, we follow the notebook's pattern.```pythonllm_with_tools = llm.bind_tools([find_movie])```-Finally, let's create our agent! Pass in the callback handler to the agent, and all the actions will be recorded in the AO Dashboard--+## Create and Run Agent+Finally, let's create our agent! Pass in the callback handler to the agent, and all the actions will be recorded in the AgentOps Dashboard.```python-agent = create_openai_tools_agent(llm, tools, prompt)+# Note: The notebook uses 'llm' here, not 'llm_with_tools'.+# create_openai_tools_agent is designed to work with the base llm and tools list.+agent = create_openai_tools_agent(llm, tools, prompt)agent_executor = AgentExecutor(agent=agent, tools=tools)```-+Now, invoke the agent. Ensure the callback handler is included in the configuration for the invocation.```pythonagent_executor.invoke(- {"input": "What comedies are playing?"}, config={"callback": [agentops_handler]}+ {"input": "What comedies are playing?"},+ config={"callback": [agentops_handler]} # Matches notebook's singular 'callback')```## Check your session-Finally, check your run on [AgentOps](https://app.agentops.ai)--Now if we look in the AgentOps dashboard, you will see a session recorded with the LLM calls and tool usage.--## Langchain v0 Example+Finally, check your run on [AgentOps](https://app.agentops.ai). You will see a session recorded with the LLM calls and tool usage.-This langchain version is out of date and support is being deprecated. You can find the example notebook [here](https://github.com/agentops-ai/agentops/blob/main/examples/langchain_examples/langchain_v0_example.ipynb).+<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/litellm.mdx b/docs/v2/examples/litellm.mdxnew file mode 100644index 00000000..f6392100--- /dev/null+++ b/docs/v2/examples/litellm.mdx@@ -0,0 +1,90 @@+---+title: 'LiteLLM Example'+description: 'Using LiteLLM with AgentOps for observing LLM calls'+---+{/* SOURCE_FILE: examples/litellm/litellm_example.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/litellm/litellm_example.ipynb'} target={'_blank'}>Github</a>_++# AgentOps for observing LiteLLM++We can use AgentOps to observe LiteLLM, a lightweight library for working with large language models. This integration allows you to monitor and log the performance of your LiteLLM applications, providing insights into their behavior and efficiency.+LiteLLM integration extends observability to the different agent libraries which rely on LiteLLM and hence make it possible to observe the agents built using these libraries.++[See our LiteLLM docs](/v2/integrations/litellm)++First let's install the required packages.++## Installation+<CodeGroup>+ ```bash pip+ pip install -U litellm agentops python-dotenv+ ```+ ```bash poetry+ poetry add litellm agentops python-dotenv+ ```+ ```bash uv+ uv add litellm agentops python-dotenv+ ```+</CodeGroup>++## Setup+Then import them.+```python+import litellm+import agentops+import os+from dotenv import load_dotenv+```++Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.++[Get an AgentOps API key](https://agentops.ai/settings/projects)++1. Create an environment variable in a `.env` file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...++2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!++LiteLLM allows you to use several models including from OpenAI, Llama, Mistral, Claude, Gemini, Gemma, Dall-E, Whisper, and more all using the OpenAI format. To use a different model all you need to change are the API KEY for that provider and the model name in `litellm.completion(model="...")`.++```python+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here") # or the provider of your choosing+```++Initialize AgentOps:+```python+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(trace_name="LiteLLM Example", tags=["litellm-example", "agentops-example"])+```++## Making an LLM Call++**Note:** AgentOps requires that you call LiteLLM completions differently than the LiteLLM's docs mention.+Instead of doing this:+```python+from litellm import completion+completion()+```+You should do this:+```python+import litellm+litellm.completion()+```++```python+messages = [{"role": "user", "content": "Write a 12 word poem about secret agents."}]+response = litellm.completion(model="gpt-4", messages=messages) # or the model of your choosing+print(response.choices[0].message.content)+```++End the AgentOps trace:+```python+agentops.end_trace(tracer, end_state="Success")+```++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/multi_agent.mdx b/docs/v2/examples/multi_agent.mdxdeleted file mode 100644index 497a534d..00000000--- a/docs/v2/examples/multi_agent.mdx+++ /dev/null@@ -1,147 +0,0 @@-----title: 'Multi-Agent Example'-description: 'How to track operations from multiple different agents'-mode: "wide"-----_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/multi_agent_example.ipynb'} target={'_blank'}>Github</a>_--# Multi-Agent Support-This is an example implementation of tracking operations from two separate agents--## Installation--<CodeGroup>- ```bash pip- pip install -U openai agentops- ```- ```bash poetry- poetry add openai agentops- ```-</CodeGroup>--## Setup--Import the necessary libraries:--```python-import agentops-from agentops.sdk.decorators import agent, operation-from openai import OpenAI-import os-from dotenv import load_dotenv-from IPython.display import display, Markdown-```--Set up your API keys:--```python-load_dotenv()-OPENAI_API_KEY = os.getenv("OPENAI_API_KEY") or "<your_openai_key>"-AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "<your_agentops_key>"-```--Initialize AgentOps at the beginning of your application:--```python-agentops.init(AGENTOPS_API_KEY, tags=["multi-agent-example"])-openai_client = OpenAI(api_key=OPENAI_API_KEY)-```--## Creating Multiple Agents--Now let's create a few agents using the `@agent` decorator:--```python-@agent(name="qa")-class QaAgent:- def __init__(self):- pass-- @operation- def completion(self, prompt: str):- res = openai_client.chat.completions.create(- model="gpt-3.5-turbo",- messages=[- {- "role": "system",- "content": "You are a qa engineer and only output python code, no markdown tags.",- },- {"role": "user", "content": prompt},- ],- temperature=0.5,- )- return res.choices[0].message.content---@agent(name="engineer")-class EngineerAgent:- def __init__(self):- pass-- @operation- def completion(self, prompt: str):- res = openai_client.chat.completions.create(- model="gpt-3.5-turbo",- messages=[- {- "role": "system",- "content": "You are a software engineer and only output python code, no markdown tags.",- },- {"role": "user", "content": prompt},- ],- temperature=0.5,- )- return res.choices[0].message.content-```--Instantiate your agents:--```python-def get_qa_response(prompt):- qa = QaAgent()- return qa.completion(prompt)--def get_engineer_response(prompt):- engineer = EngineerAgent()- return engineer.completion(prompt)-```--## Using Different Agents--Now we can use these agents to complete different tasks. Any LLM calls that go through these classes will be tagged as agent calls in AgentOps.--```python-# Get code from the engineer-generated_func = get_engineer_response("python function to test prime number")-display(Markdown("```python\n" + generated_func + "\n```"))--# Get a test from the QA agent-generated_test = get_qa_response(- "Write a python unit test that test the following function: \n " + generated_func-)-display(Markdown("```python\n" + generated_test + "\n```"))-```--## Default Agent Behavior--If we make an LLM call outside of the context of a tracked agent, it gets assigned to the Default Agent.--```python-# This will be assigned to the Default Agent-res = openai_client.chat.completions.create(- model="gpt-3.5-turbo",- messages=[- {"role": "system", "content": "You are not a tracked agent"},- {"role": "user", "content": "Say hello"},- ],-)-print(res.choices[0].message.content)-```--## Further Reading--Check out other advanced examples like [OpenAI Assistants](/v2/examples/openai_assistants) integration.--<script type="module" src="/scripts/github_stars.js"></script>-<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>-<script type="module" src="/scripts/button_heartbeat_animation.js"></script>\ No newline at end of filediff --git a/docs/v2/examples/openai.mdx b/docs/v2/examples/openai.mdxnew file mode 100755index 00000000..e7b5104e--- /dev/null+++ b/docs/v2/examples/openai.mdx@@ -0,0 +1,437 @@+---+title: 'OpenAI Multi-Tool RAG Example'+description: 'Demonstrates multi-tool orchestration with a RAG approach using OpenAI, Pinecone, and AgentOps'+---+{/* SOURCE_FILE: examples/openai/multi_tool_orchestration.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/openai/multi_tool_orchestration.ipynb'} target={'_blank'}>Github</a>_++# Multi-Tool Orchestration with RAG approach using OpenAI++This cookbook guides you through building dynamic, multi-tool workflows using OpenAI's APIs. It demonstrates how to implement a Retrieval-Augmented Generation (RAG) approach that intelligently routes user queries to the appropriate in-built or external tools. Whether your query calls for general knowledge or requires accessing specific internal context from a vector database (like Pinecone), this guide shows you how to integrate function calls, simulate web searches, and leverage document retrieval to generate accurate, context-aware responses.++## Installation+Install required dependencies:+<CodeGroup>+ ```bash pip+ pip install agentops openai datasets tqdm pandas pinecone-client python-dotenv+ ```+ ```bash poetry+ poetry add agentops openai datasets tqdm pandas pinecone-client python-dotenv+ ```+ ```bash uv+ uv add agentops openai datasets tqdm pandas pinecone-client python-dotenv+ ```+</CodeGroup>++## Setup+```python+import os+from dotenv import load_dotenv+import time+from tqdm.auto import tqdm # tqdm.auto for notebook compatibility+from pandas import DataFrame+from datasets import load_dataset+import random+import string+from openai import OpenAI+import agentops+from pinecone import Pinecone # Pinecone class for client+from pinecone import ServerlessSpec+import json # For handling tool arguments+```++Set API Keys:+```python+load_dotenv()++os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+os.environ["PINECONE_API_KEY"] = os.getenv("PINECONE_API_KEY", "your_pinecone_api_key_here")+```++Initialize AgentOps and OpenAI client:+```python+agentops.init(auto_start_session=True)+tracer = agentops.start_trace(trace_name="Multi-Tool Orchestration with RAG", tags=["multi-tool-orchestration-rag-demo", "openai-responses", "agentops-example"])+client = OpenAI()+```++In this example we use a sample medical reasoning dataset from Hugging Face. We convert the dataset into a Pandas DataFrame and merge the “Question” and “Response” columns into a single string. This merged text is used for embedding and later stored as metadata.+```python+# Load the dataset (ensure you're logged in with huggingface-cli if needed)+ds = load_dataset("FreedomIntelligence/medical-o1-reasoning-SFT", "en", split="train[:100]", trust_remote_code=True)+ds_dataframe = DataFrame(ds)++# Merge the Question and Response columns into a single string.+ds_dataframe["merged"] = ds_dataframe.apply(+ lambda row: f"Question: {row['Question']} Answer: {row['Response']}", axis=1+)+print("Example merged text:", ds_dataframe["merged"].iloc[0])+```+```python+# To display the dataframe in a notebook-like fashion (optional in MDX)+# ds_dataframe+```++### Create a Pinecone Index Based on the Dataset+Use the dataset itself to determine the embedding dimensionality. For example, compute one embedding from the merged column and then create the index accordingly.+```python+MODEL = "text-embedding-3-small" # Replace with your production embedding model if needed+# Compute an embedding for the first document to obtain the embedding dimension.+sample_embedding_resp = client.embeddings.create(input=[ds_dataframe["merged"].iloc[0]], model=MODEL)+embed_dim = len(sample_embedding_resp.data[0].embedding)+print(f"Embedding dimension: {embed_dim}")+```+```python+# Initialize Pinecone using your API key.+pc = Pinecone(api_key=os.environ["PINECONE_API_KEY"])++# Define the Pinecone serverless specification.+AWS_REGION = "us-east-1" # As in notebook+spec = ServerlessSpec(cloud="aws", region=AWS_REGION)++# Create a random index name with lower case alphanumeric characters and '-'+index_name = "pinecone-index-" + "".join(random.choices(string.ascii_lowercase + string.digits, k=10))++# Create the index if it doesn't already exist.+if index_name not in pc.list_indexes().names:+ pc.create_index(index_name, dimension=embed_dim, metric="dotproduct", spec=spec)+ # Wait for index to be ready (important)+ while not pc.describe_index(index_name).status['ready']:+ time.sleep(1)++# Connect to the index.+index = pc.Index(index_name)+# time.sleep(1) # Notebook has this, usually not needed if create_index waits.+print("Index stats:", index.describe_index_stats())+```++#### Upsert the Dataset into Pinecone index++Process the dataset in batches, generate embeddings for each merged text, prepare metadata (including separate Question and Answer fields), and upsert each batch into the index.+```python+batch_size = 32+for i in tqdm(range(0, len(ds_dataframe["merged"]), batch_size), desc="Upserting to Pinecone"):+ i_end = min(i + batch_size, len(ds_dataframe["merged"]))+ lines_batch = ds_dataframe["merged"][i:i_end].tolist() # Ensure it's a list of strings+ ids_batch = [str(n) for n in range(i, i_end)]++ # Create embeddings for the current batch.+ res = client.embeddings.create(input=lines_batch, model=MODEL) # Pass list directly+ embeds = [record.embedding for record in res.data]++ # Prepare metadata by extracting original Question and Answer.+ meta = []+ # Notebook uses: for record in ds_dataframe.iloc[i:i_end].to_dict("records"):+ for record_idx in range(i, i_end):+ original_record = ds_dataframe.iloc[record_idx]+ q_text = original_record["Question"]+ a_text = original_record["Response"]+ meta.append({"Question": q_text, "Answer": a_text})++ # Upsert the batch into Pinecone.+ vectors = list(zip(ids_batch, embeds, meta))+ index.upsert(vectors=vectors)+```++### Query the Pinecone Index++Create a natural language query, compute its embedding, and perform a similarity search on the Pinecone index. The returned results include metadata that provides context for generating answers.+```python+def query_pinecone_index(client, index, model, query_text):+ # Generate an embedding for the query.+ # Notebook: client.embeddings.create(input=query_text, ...)+ # Corrected: input should be a list+ query_embedding = client.embeddings.create(input=[query_text], model=model).data[0].embedding++ # Query the index and return top 5 matches.+ # Notebook: index.query(vector=[query_embedding], ...)+ # Corrected: vector should be the embedding itself if it's already a list/vector+ res = index.query(vector=query_embedding, top_k=5, include_metadata=True)+ print("Query Results:")+ for match in res["matches"]:+ print(+ f"{match['score']:.2f}: {match['metadata'].get('Question', 'N/A')} - {match['metadata'].get('Answer', 'N/A')}"+ )+ return res+```+```python+# Example usage with a different query from the train/test set+query = (+ "A 45-year-old man with a history of alcohol use presents with symptoms including confusion, ataxia, and ophthalmoplegia. "+ "What is the most likely diagnosis and the recommended treatment?"+)+query_pinecone_index(client, index, MODEL, query)+```++### Generate a Response Using the Retrieved Context++Select the best matching result from your query results and use the OpenAI Chat Completions API to generate a final answer by combining the retrieved context with the original question.+```python+# Retrieve and concatenate top 3 match contexts.+# Notebook: client.embeddings.create(input=query, ...)+# Corrected: input should be a list+query_embedding_for_rag = client.embeddings.create(input=[query], model=MODEL).data[0].embedding+matches = index.query(+ vector=query_embedding_for_rag, top_k=3, include_metadata=True # vector is embedding itself+)["matches"]++context = "\n\n".join(+ f"Question: {m['metadata'].get('Question', '')}\nAnswer: {m['metadata'].get('Answer', '')}" for m in matches+)++# Use the context to generate a final answer using Chat Completions.+response_payload = {+ "model": "gpt-4o",+ "messages": [+ {"role": "system", "content": "You are a helpful medical assistant. Answer based on the provided context."},+ {"role": "user", "content": f"Provide the answer based on the context: {context} and the question: {query} as per the internal knowledge base"}+ ]+}+completion = client.chat.completions.create(**response_payload)+final_answer_text = completion.choices[0].message.content+print("\nFinal Answer (using Chat Completions):")+print(final_answer_text)+```++### Orchestrate Multi-Tool Calls++Now, we'll define tools. One simulates web search, and the other queries our Pinecone vector store.+```python+# Define available tools.+tools = [+ {+ "type": "function", # Standard type for custom functions+ "function": {+ "name": "web_search_preview_tool", # Giving it a function-like name+ "description": "Performs a web search and returns a preview of results. Use for real-time or up-to-date information.",+ "parameters": { # Even simulated tools can define expected parameters+ "type": "object",+ "properties": {+ "search_query": {"type": "string", "description": "The query to search the web for."}+ },+ "required": ["search_query"]+ }+ }+ },+ {+ "type": "function",+ "function": {+ "name": "PineconeSearchDocuments",+ "description": "Search for relevant documents based on the medical question asked by the user that is stored within the vector database using a semantic query.",+ "parameters": {+ "type": "object",+ "properties": {+ "query": {"type": "string", "description": "The natural language query to search the vector database."},+ "top_k": {"type": "integer", "description": "Number of top results to return.", "default": 3},+ },+ "required": ["query"],+ }+ }+ },+]+```+```python+# Example queries that the model should route appropriately.+queries = [+ {"query": "Who won the cricket world cup in 1983?"},+ {"query": "What is the most common cause of death in the United States according to the internet?"},+ {+ "query": (+ "A 7-year-old boy with sickle cell disease is experiencing knee and hip pain, "+ "has been admitted for pain crises in the past, and now walks with a limp. "+ "His exam shows a normal, cool hip with decreased range of motion and pain with ambulation. "+ "What is the most appropriate next step in management according to the internal knowledge base?"+ )+ },+]+```+```python+# Process each query dynamically using Chat Completions for tool routing.+for item in queries:+ current_messages = [{"role": "user", "content": item["query"]}]+ print("\n🌟--- Processing Query ---🌟")+ print(f"🔍 **User Query:** {item['query']}")++ # First call to LLM to decide on tool usage+ response = client.chat.completions.create(+ model="gpt-4o",+ messages=[+ {+ "role": "system",+ "content": "When prompted with a question, select the right tool to use based on the question. If a web search is needed, use 'web_search_preview_tool'. If internal knowledge base search is needed, use 'PineconeSearchDocuments'.",+ },+ {"role": "user", "content": item["query"]},+ ],+ tools=tools,+ tool_choice="auto",+ )++ response_message = response.choices[0].message+ tool_calls = response_message.tool_calls++ current_messages.append(response_message) # Add assistant's decision to message history++ print("\n✨ **Initial LLM Response:**")+ if response_message.content:+ print(response_message.content)++ if tool_calls:+ print(f"🔧 **Model triggered tool call(s):**")++ for tool_call in tool_calls:+ function_name = tool_call.function.name+ function_args = json.loads(tool_call.function.arguments)++ print(f" - Tool: {function_name}, Args: {function_args}")+ function_response_content = ""++ if function_name == "PineconeSearchDocuments":+ print("🔍 **Invoking PineconeSearchDocuments tool...**")+ pinecone_query = function_args.get("query")+ top_k_results = function_args.get("top_k", 3)+ # query_pinecone_index returns the full response object+ pinecone_response_obj = query_pinecone_index(client, index, MODEL, pinecone_query)++ matches_str_list = []+ if pinecone_response_obj["matches"]:+ for match in pinecone_response_obj["matches"][:top_k_results]:+ matches_str_list.append(f"Score: {match['score']:.2f}, Q: {match['metadata'].get('Question', 'N/A')}, A: {match['metadata'].get('Answer', 'N/A')}")+ function_response_content = "\n".join(matches_str_list) if matches_str_list else "No matching documents found."+ print("✅ **PineconeSearchDocuments tool invoked successfully.**")++ elif function_name == "web_search_preview_tool":+ print("🔍 **Simulating web_search_preview_tool...**")+ search_query_arg = function_args.get("search_query", item['query'])+ function_response_content = f"Simulated web search result for: {search_query_arg}"+ print("✅ **Simulated web_search_preview_tool invoked successfully.**")+ else:+ print(f"⚠️ Unknown tool: {function_name}")+ function_response_content = "Error: Unknown tool."++ current_messages.append(+ {+ "tool_call_id": tool_call.id,+ "role": "tool",+ "name": function_name,+ "content": function_response_content,+ }+ )++ # Second call to LLM with tool results+ print("\n🔄 **Getting final response from LLM...**")+ final_response = client.chat.completions.create(+ model="gpt-4o",+ messages=current_messages+ )+ print("💡 **Final Answer:**")+ print(final_response.choices[0].message.content)+ elif response_message.content:+ # If no tool call is triggered, print the response directly.+ print("💡 **Final Answer (no tool call):**")+ print(response_message.content)+ else:+ print("⚠️ No content or tool call in response.")+```++As shown above, depending on the query, appropriate tool is invoked in order to determine the optimal response.++For instance, looking at the third example, when the model triggers the tool named "PineconeSearchDocuments", the code calls `query_pinecone_index` with the current query and then extracts the best match (or an appropriate context) as the result. For non health related inquiries or queries where explicit internet search is asked, the code calls the (simulated) `web_search_preview_tool` function and for other queries, it may choose to not call any tool and rather provide a response based on the question under consideration.++Finally, the tool call and its output are appended to the conversation, and the final answer is generated by the Chat Completions API.++### Multi-tool orchestration flow (Sequential Example)++Now let us try to modify the input query and the system instructions to the Chat Completions API in order to follow a tool calling sequence and generate the output.+```python+# Process one query as an example to understand the tool calls and function calls as part of the response output+item_query_seq = "What is the most common cause of death in the United States"++# Initialize input messages with the user's query.+current_messages_seq = [{"role": "user", "content": item_query_seq}]+print("\n🌟--- Processing Query (Sequential Tool Call Example) ---🌟")+print(f"🔍 **User Query:** {item_query_seq}")++# Call the Chat Completions API with tools enabled+print("\n🔧 **Calling Chat Completions API with Tools Enabled**")+print("\n🕵️♂️ **Step 1: Web Search Call (Implicit)**")+print(" - Initiating web search to gather initial information.")+print("\n📚 **Step 2: Pinecone Search Call (Implicit)**")+print(" - Querying Pinecone to find relevant examples from the internal knowledge base.")++# First LLM call to determine initial tool usage+response_seq_1 = client.chat.completions.create(+ model="gpt-4o",+ messages=[+ {+ "role": "system",+ "content": "First, call the web_search_preview_tool for results. Then, using that information, call `PineconeSearchDocuments` to find real examples in the internal knowledge base. Finally, synthesize an answer.",+ },+ {"role": "user", "content": item_query_seq},+ ],+ tools=tools,+ tool_choice="auto", # Let model decide, or force a specific tool if needed for strict sequence+)++print("\n✨ **Initial Response Output (after first LLM call):**")+response_message_seq_1 = response_seq_1.choices[0].message+tool_calls_seq_1 = response_message_seq_1.tool_calls++if response_message_seq_1.content:+ print(f"Assistant Content: {response_message_seq_1.content}")+current_messages_seq.append(response_message_seq_1)++if tool_calls_seq_1:+ print("🔧 **Tool calls from first LLM response:**")+ for tc in tool_calls_seq_1:+ print(f" - ID: {tc.id}, Function: {tc.function.name}, Args: {tc.function.arguments}")+ tool_function_args = json.loads(tc.function.arguments)+ tool_response_content = ""++ if tc.function.name == "web_search_preview_tool":+ simulated_web_search_output = f"Simulated web search result for query: {tool_function_args.get('search_query', item_query_seq)}"+ tool_response_content = simulated_web_search_output+ print(f" ✔️ Simulated output for {tc.function.name}: {tool_response_content}")+ elif tc.function.name == "PineconeSearchDocuments":+ pinecone_query_text = tool_function_args.get("query", item_query_seq)+ pinecone_res_obj = query_pinecone_index(client, index, MODEL, pinecone_query_text)+ matches_str_list_seq = []+ if pinecone_res_obj["matches"]:+ for match in pinecone_res_obj["matches"][:tool_function_args.get("top_k", 3)]:+ matches_str_list_seq.append(f"Score: {match['score']:.2f}, Q: {match['metadata'].get('Question', 'N/A')}, A: {match['metadata'].get('Answer', 'N/A')}")+ tool_response_content = "\n".join(matches_str_list_seq) if matches_str_list_seq else "No matching documents found in Pinecone."+ print(f" ✔️ Output for {tc.function.name}: {tool_response_content[:100]}...")++ current_messages_seq.append({+ "tool_call_id": tc.id,+ "role": "tool",+ "name": tc.function.name,+ "content": tool_response_content,+ })++ # Second call to LLM with tool results+ print("\n🔄 **Calling Chat Completions API again with tool results...**")+ response_seq_2 = client.chat.completions.create(+ model="gpt-4o",+ messages=current_messages_seq,+ tools=tools # Make tools available again if model decides to call another one+ )+ final_answer_seq = response_seq_2.choices[0].message.content+ print("\n💡 **Final Answer (after sequential tool calls):**")+ print(final_answer_seq)++else:+ print("⚠️ No tool calls in the first response. Final answer is the initial content.")+ if response_message_seq_1.content:+ print(response_message_seq_1.content)++agentops.end_trace(tracer, end_state="Success") # End the main trace+```++Here, we have seen how to utilize OpenAI's Chat Completions API to implement a Retrieval-Augmented Generation (RAG) approach with multi-tool calling capabilities. It showcases an example where the model selects the appropriate tool based on the input query: general questions may be handled by built-in tools such as web-search (simulated here), while specific medical inquiries related to internal knowledge are addressed by retrieving context from a vector database (such as Pinecone) via function calls. Additionally, we have showcased how multiple tool calls can be conceptually chained to generate a final response based on our instructions. Happy coding!++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/openai_agents.mdx b/docs/v2/examples/openai_agents.mdxnew file mode 100644index 00000000..e6744ebc--- /dev/null+++ b/docs/v2/examples/openai_agents.mdx@@ -0,0 +1,268 @@+---+title: 'OpenAI Agents SDK Example'+description: 'Using OpenAI Agents SDK with AgentOps for a customer service chatbot'+---+{/* SOURCE_FILE: examples/openai_agents/customer_service_agent.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/openai_agents/customer_service_agent.ipynb'} target={'_blank'}>Github</a>_++# Airline Customer Service Agent with OpenAI Agents SDK++This is a simple chatbot designed to assist airline customers with common queries. Here the agents are also used as tools to help the bot answer questions more effectively.++Using AgentOps we can track the flow of the conversation and the agents used. This is useful for debugging and understanding how the bot is performing.++## Prerequisites++Before running this notebook, you'll need:++1. **AgentOps Account**: Create a free account at [app.agentops.ai](https://app.agentops.ai)+2. **AgentOps API Key**: Obtain your API key from your AgentOps dashboard+3. **OpenAI API Key**: Get your API key from [platform.openai.com](https://platform.openai.com)++Make sure to set these as environment variables or create a `.env` file in your project root with:++```+AGENTOPS_API_KEY=your_agentops_api_key_here+OPENAI_API_KEY=your_openai_api_key_here+```++## Installation+Install required packages:+<CodeGroup>+ ```bash pip+ pip install agentops openai-agents python-dotenv+ ```+ ```bash poetry+ poetry add agentops openai-agents python-dotenv+ ```+ ```bash uv+ uv add agentops openai-agents python-dotenv+ ```+</CodeGroup>++## Setup+Set the API keys for your AgentOps and OpenAI accounts.+```python+import os+from dotenv import load_dotenv+load_dotenv()++os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+```++Initialize AgentOps:+```python+import agentops+# auto_start_session is False, so we'll start a trace manually later+agentops.init(tags=["customer-service-agent", "openai-agents", "agentops-example"], auto_start_session=False)+```++Import necessary components from `openai-agents`:+```python+from __future__ import annotations as _annotations++import asyncio+import random+import uuid+import sys # sys import was in notebook, keeping for consistency++from pydantic import BaseModel++from agents import (+ Agent,+ HandoffOutputItem,+ ItemHelpers,+ MessageOutputItem,+ RunContextWrapper,+ Runner,+ ToolCallItem,+ ToolCallOutputItem,+ TResponseInputItem,+ function_tool,+ handoff,+ trace,+)+from agents.extensions.handoff_prompt import RECOMMENDED_PROMPT_PREFIX++# Start AgentOps trace for this specific workflow+tracer = agentops.start_trace(trace_name="Customer Service Agent") # Matched notebook+```++### CONTEXT+```python+class AirlineAgentContext(BaseModel):+ passenger_name: str | None = None+ confirmation_number: str | None = None+ seat_number: str | None = None+ flight_number: str | None = None+```++### TOOLS+```python+@function_tool(+ name_override="faq_lookup_tool", description_override="Lookup frequently asked questions."+)+async def faq_lookup_tool(question: str) -> str:+ if "bag" in question or "baggage" in question:+ return (+ "You are allowed to bring one bag on the plane. "+ "It must be under 50 pounds and 22 inches x 14 inches x 9 inches."+ )+ elif "seats" in question or "plane" in question:+ return (+ "There are 120 seats on the plane. "+ "There are 22 business class seats and 98 economy seats. "+ "Exit rows are rows 4 and 16. "+ "Rows 5-8 are Economy Plus, with extra legroom. "+ )+ elif "wifi" in question:+ return "We have free wifi on the plane, join Airline-Wifi"+ return "I'm sorry, I don't know the answer to that question."+++@function_tool+async def update_seat(+ context: RunContextWrapper[AirlineAgentContext], confirmation_number: str, new_seat: str+) -> str:+ """+ Update the seat for a given confirmation number.++ Args:+ confirmation_number: The confirmation number for the flight.+ new_seat: The new seat to update to.+ """+ # Update the context based on the customer's input+ context.context.confirmation_number = confirmation_number+ context.context.seat_number = new_seat+ # Ensure that the flight number has been set by the incoming handoff+ assert context.context.flight_number is not None, "Flight number is required"+ return f"Updated seat to {new_seat} for confirmation number {confirmation_number}"+```++### HOOKS+```python+async def on_seat_booking_handoff(context: RunContextWrapper[AirlineAgentContext]) -> None:+ flight_number = f"FLT-{random.randint(100, 999)}"+ context.context.flight_number = flight_number+```++### AGENTS+```python+faq_agent = Agent[AirlineAgentContext](+ name="FAQ Agent",+ handoff_description="A helpful agent that can answer questions about the airline.",+ instructions=f\"\"\"{RECOMMENDED_PROMPT_PREFIX}+ You are an FAQ agent. If you are speaking to a customer, you probably were transferred to from the triage agent.+ Use the following routine to support the customer.+ # Routine+ 1. Identify the last question asked by the customer.+ 2. Use the faq lookup tool to answer the question. Do not rely on your own knowledge.+ 3. If you cannot answer the question, transfer back to the triage agent.\"\"\",+ tools=[faq_lookup_tool],+)++seat_booking_agent = Agent[AirlineAgentContext](+ name="Seat Booking Agent",+ handoff_description="A helpful agent that can update a seat on a flight.",+ instructions=f\"\"\"{RECOMMENDED_PROMPT_PREFIX}+ You are a seat booking agent. If you are speaking to a customer, you probably were transferred to from the triage agent.+ Use the following routine to support the customer.+ # Routine+ 1. Ask for their confirmation number.+ 2. Ask the customer what their desired seat number is.+ 3. Use the update seat tool to update the seat on the flight.+ If the customer asks a question that is not related to the routine, transfer back to the triage agent. \"\"\",+ tools=[update_seat],+)++triage_agent = Agent[AirlineAgentContext](+ name="Triage Agent",+ handoff_description="A triage agent that can delegate a customer's request to the appropriate agent.",+ instructions=(+ f"{RECOMMENDED_PROMPT_PREFIX} "+ "You are a helpful triaging agent. You can use your tools to delegate questions to other appropriate agents."+ ),+ handoffs=[+ faq_agent,+ handoff(agent=seat_booking_agent, on_handoff=on_seat_booking_handoff),+ ],+)++faq_agent.handoffs.append(triage_agent)+seat_booking_agent.handoffs.append(triage_agent)+```++### RUN+```python+async def main():+ current_agent: Agent[AirlineAgentContext] = triage_agent+ input_items: list[TResponseInputItem] = []+ context = AirlineAgentContext()++ # Normally, each input from the user would be an API request to your app, and you can wrap the request in a trace()+ # Here, we'll just use a random UUID for the conversation ID+ conversation_id = uuid.uuid4().hex[:16]++ # Simulate a few turns for the MDX example+ simulated_inputs = [+ "What are the baggage rules?",+ "I want to change my seat.",+ "My confirmation is 123XYZ",+ "I want seat 10A",+ "Thanks!"+ ]++ for user_input in simulated_inputs:+ print(f"User: {user_input}")+ # In a real app, you'd get input: user_input = input("Enter your message: ")+ with trace("Customer service", group_id=conversation_id): # Notebook uses "Customer service"+ input_items.append({"content": user_input, "role": "user"})+ result = await Runner.run(current_agent, input_items, context=context)++ for new_item in result.new_items:+ agent_name = new_item.agent.name+ if isinstance(new_item, MessageOutputItem):+ print(f"{agent_name}: {ItemHelpers.text_message_output(new_item)}")+ elif isinstance(new_item, HandoffOutputItem):+ print(+ f"Handed off from {new_item.source_agent.name} to {new_item.target_agent.name}" # Matched notebook+ )+ elif isinstance(new_item, ToolCallItem):+ print(f"{agent_name}: Calling a tool") # Matched notebook+ elif isinstance(new_item, ToolCallOutputItem):+ print(f"{agent_name}: Tool call output: {new_item.output}")+ else:+ print(f"{agent_name}: Skipping item: {new_item.__class__.__name__}") # Matched notebook+ input_items = result.to_input_list()+ current_agent = result.last_agent+ if user_input.lower() == "thanks!": # End simulation+ break++ agentops.end_trace(tracer, end_state="Success") # MDX was correct with end_state+++# To run in a Jupyter notebook or a script that can handle asyncio:+# await main()+# For MDX, we'll just define it. To run, you'd typically use:+# if __name__ == "__main__":+# asyncio.run(main())+```+To run this example, save it as a Python file and execute it. You will be prompted for user input in the console.++## Conclusion++**AgentOps makes observability effortless** - simply import the library and all your interactions are automatically tracked, visualized, and analyzed. This enables you to:++- Monitor tool performance across different use cases+- Optimize costs by understanding tool usage patterns+- Debug tool integration issues quickly+- Scale your AI applications with confidence in tool reliability++Visit [app.agentops.ai](https://app.agentops.ai) to explore your tool usage sessions and gain deeper insights into your AI application's tool interactions.++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/openai_assistants.mdx b/docs/v2/examples/openai_assistants.mdxdeleted file mode 100644index 5f65a701..00000000--- a/docs/v2/examples/openai_assistants.mdx+++ /dev/null@@ -1,293 +0,0 @@-----title: 'OpenAI Assistants Example'-description: 'Learn how to use OpenAI Assistants API with AgentOps'-mode: "wide"-----_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/openai_examples/openai_assistants_example.ipynb'} target={'_blank'}>Github</a>_--# Assistants API with AgentOps--This guide shows how to monitor and track OpenAI's Assistants API using AgentOps. The Assistants API is a stateful evolution of the Chat Completions API for creating assistant-like experiences with powerful tools like Code Interpreter and Retrieval.----## Installation--<CodeGroup>- ```bash pip- pip install -U openai agentops- ```- ```bash poetry- poetry add openai agentops- ```-</CodeGroup>--## Setup--Import the necessary libraries:--```python-from openai import OpenAI-import agentops-from dotenv import load_dotenv-import os-import json-import time--# Helper function for displaying JSON-def show_json(obj):- display(json.loads(obj.model_dump_json()))-```--Set up your API keys:--```python-load_dotenv()-AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "<your_agentops_key>"-OPENAI_API_KEY = os.getenv("OPENAI_API_KEY") or "<your_openai_key>"-```--Initialize AgentOps at the beginning of your application:--```python-# Initialize AgentOps with tags-agentops.init(api_key=AGENTOPS_API_KEY, tags=["openai", "assistants"])--# Initialize OpenAI client-client = OpenAI(api_key=OPENAI_API_KEY)-```--## Creating an Assistant--Create a Math Tutor assistant:--```python-assistant = client.beta.assistants.create(- name="Math Tutor",- instructions="You are a personal math tutor. Answer questions briefly, in a sentence or less.",- model="gpt-4o-mini",-)-show_json(assistant)-```--## Working with Threads--Create a new thread to hold the conversation:--```python-thread = client.beta.threads.create()-show_json(thread)-```--Add a message to the thread:--```python-message = client.beta.threads.messages.create(- thread_id=thread.id,- role="user",- content="I need to solve the equation `3x + 11 = 14`. Can you help me?",-)-show_json(message)-```--## Running an Assistant--Create a Run to get a completion from the Assistant:--```python-run = client.beta.threads.runs.create(- thread_id=thread.id,- assistant_id=assistant.id,-)-show_json(run)-```--Wait for the Run to complete:--```python-def wait_on_run(run, thread):- while run.status == "queued" or run.status == "in_progress":- run = client.beta.threads.runs.retrieve(- thread_id=thread.id,- run_id=run.id,- )- time.sleep(0.5)- return run--run = wait_on_run(run, thread)-show_json(run)-```--## Retrieving Messages--List the messages in the thread:--```python-messages = client.beta.threads.messages.list(thread_id=thread.id)-show_json(messages)-```--Continue the conversation with a follow-up question:--```python-# Create a message to append to our thread-message = client.beta.threads.messages.create(- thread_id=thread.id, role="user", content="Could you explain this to me?"-)--# Execute our run-run = client.beta.threads.runs.create(- thread_id=thread.id,- assistant_id=assistant.id,-)--# Wait for completion-wait_on_run(run, thread)--# Retrieve all the messages added after our last user message-messages = client.beta.threads.messages.list(- thread_id=thread.id, order="asc", after=message.id-)-show_json(messages)-```--## Complete Example Function--Here's a practical example of implementing Assistants API with helper functions:--```python-def submit_message(assistant_id, thread, user_message):- client.beta.threads.messages.create(- thread_id=thread.id, role="user", content=user_message- )- return client.beta.threads.runs.create(- thread_id=thread.id,- assistant_id=assistant_id,- )--def get_response(thread):- return client.beta.threads.messages.list(thread_id=thread.id, order="asc")--def create_thread_and_run(assistant_id, user_input):- thread = client.beta.threads.create()- run = submit_message(assistant_id, thread, user_input)- return thread, run--def pretty_print(messages):- print("# Messages")- for m in messages:- print(f"{m.role}: {m.content[0].text.value}")- print()-```--## Using Tools with Assistants--### Code Interpreter--Enable Code Interpreter for your Assistant:--```python-assistant = client.beta.assistants.update(- assistant.id,- tools=[{"type": "code_interpreter"}],-)-show_json(assistant)-```--Test it with a coding task:--```python-thread, run = create_thread_and_run(- assistant.id,- "Generate the first 20 fibonacci numbers with code."-)-run = wait_on_run(run, thread)-pretty_print(get_response(thread))-```--### Function Calling--Define a custom function for your Assistant:--```python-function_json = {- "name": "display_quiz",- "description": "Displays a quiz to the student, and returns the student's response.",- "parameters": {- "type": "object",- "properties": {- "title": {"type": "string"},- "questions": {- "type": "array",- "items": {- "type": "object",- "properties": {- "question_text": {"type": "string"},- "question_type": {- "type": "string",- "enum": ["MULTIPLE_CHOICE", "FREE_RESPONSE"],- },- "choices": {"type": "array", "items": {"type": "string"}},- },- "required": ["question_text"],- },- },- },- "required": ["title", "questions"],- },-}--assistant = client.beta.assistants.update(- assistant.id,- tools=[- {"type": "code_interpreter"},- {"type": "function", "function": function_json},- ],-)-```--Implement the function on your end:--```python-def display_quiz(title, questions):- print("Quiz:", title)- print()- responses = []-- for q in questions:- print(q["question_text"])- response = ""-- # If multiple choice, print options- if q["question_type"] == "MULTIPLE_CHOICE":- for i, choice in enumerate(q["choices"]):- print(f"{i}. {choice}")- response = "a" # Mock response-- # Otherwise, just get response- elif q["question_type"] == "FREE_RESPONSE":- response = "I don't know." # Mock response-- responses.append(response)- print()-- return responses-```--## Ending the Session--End the AgentOps session when done:--```python-agentops.end_session(end_state="Success")-```--## Further Reading--Check out more advanced examples like [Multi-Agent](/v2/examples/multi_agent) integration.--<script type="module" src="/scripts/github_stars.js"></script>-<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>-<script type="module" src="/scripts/button_heartbeat_animation.js"></script>--diff --git a/docs/v2/examples/simple_agent.mdx b/docs/v2/examples/simple_agent.mdxdeleted file mode 100644index e2e37f0f..00000000--- a/docs/v2/examples/simple_agent.mdx+++ /dev/null@@ -1,108 +0,0 @@-----title: 'Simple Agent Example'-description: 'Most basic usage with OpenAI API'-mode: "wide"-----_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/openai-gpt.ipynb'} target={'_blank'}>Github</a>_--# AgentOps Basic Monitoring-This is an example of how to use the AgentOps library for basic Agent monitoring with OpenAI's GPT--## Installation--<CodeGroup>- ```bash pip- pip install -U openai agentops- ```- ```bash poetry- poetry add openai agentops- ```-</CodeGroup>--## Setup--Import the necessary libraries:--```python-from openai import OpenAI-import agentops-import os-from dotenv import load_dotenv-```--Set up your API keys:--```python-load_dotenv()-OPENAI_API_KEY = os.getenv("OPENAI_API_KEY") or "<your_openai_key>"-AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "<your_agentops_key>"-```--Initialize AgentOps at the beginning of your application:--```python-# Initialize OpenAI client-openai = OpenAI(api_key=OPENAI_API_KEY)--# Initialize AgentOps with tags-agentops.init(AGENTOPS_API_KEY, tags=["openai-gpt-example"])-```--## Single Completion Example--Now just use OpenAI as you would normally!--```python-message = [{"role": "user", "content": "Write a 12 word poem about secret agents."}]-response = openai.chat.completions.create(- model="gpt-3.5-turbo", messages=message, temperature=0.5, stream=False-)-print(response.choices[0].message.content)-```--Sessions are automatically managed by AgentOps. When your program exits, the session will be properly closed.--## Tracking Custom Events--You can track custom operations using decorators:--```python-from agentops.sdk.decorators import operation--@operation(name="add numbers")-def add(x, y):- return x + y--result = add(2, 4)-print(f"Result: {result}")-```--You can also create operations for more complex tracking:--```python-from agentops.sdk.decorators import operation--@operation(name="check greeting")-def check_greeting():- message = [{"role": "user", "content": "Hello"}]- response = openai.chat.completions.create(- model="gpt-3.5-turbo", messages=message, temperature=0.5- )-- print(response.choices[0].message.content)-- if "hello" in str(response.choices[0].message.content).lower():- return "Greeting detected"- return "No greeting detected"--result = check_greeting()-print(f"Greeting check: {result}")-```--## Further Reading--Check out more advanced examples like [Multi-Agent](/v2/examples/multi_agent) or [OpenAI Assistants](/v2/examples/openai_assistants) integration.--<script type="module" src="/scripts/github_stars.js"></script>-<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>-<script type="module" src="/scripts/button_heartbeat_animation.js"></script>\ No newline at end of filediff --git a/docs/v2/examples/watsonx.mdx b/docs/v2/examples/watsonx.mdxnew file mode 100644index 00000000..d8bd2343--- /dev/null+++ b/docs/v2/examples/watsonx.mdx@@ -0,0 +1,137 @@+---+title: 'IBM Watsonx.ai Example'+description: 'Using IBM Watsonx.ai for text generation and chat with AgentOps'+---+{/* SOURCE_FILE: examples/watsonx/watsonx-text-chat.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/watsonx/watsonx-text-chat.ipynb'} target={'_blank'}>Github</a>_++# IBM Watsonx.ai Text Generation and Chat with AgentOps++This notebook demonstrates how to use IBM Watsonx.ai for basic text generation and chat completion tasks with AgentOps instrumentation.++## Installation+Install the required packages:+<CodeGroup>+ ```bash pip+ pip install agentops ibm-watsonx-ai python-dotenv+ ```+ ```bash poetry+ poetry add agentops ibm-watsonx-ai python-dotenv+ ```+ ```bash uv+ uv add agentops ibm-watsonx-ai python-dotenv+ ```+</CodeGroup>++## Setup++First, let's import the necessary libraries and initialize AgentOps:+```python+import agentops+from ibm_watsonx_ai import Credentials+from ibm_watsonx_ai.foundation_models import ModelInference+from dotenv import load_dotenv+import os++# Load environment variables+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")++# Initialize AgentOps+agentops.init(tags=["watsonx-text-chat", "agentops-example"])+```++## Initialize IBM Watsonx.ai Credentials++To use IBM Watsonx.ai, you need to set up your credentials and project ID.+```python+# Initialize credentials - replace with your own API key+# Best practice: Store API keys in environment variables+# Ensure WATSONX_API_KEY, WATSONX_URL, and WATSONX_PROJECT_ID are set in your .env file or environment+os.environ["WATSONX_API_KEY"] = os.getenv("WATSONX_API_KEY", "your_watsonx_api_key_here")+os.environ["WATSONX_URL"] = os.getenv("WATSONX_URL", "https://eu-de.ml.cloud.ibm.com") # Example URL, ensure it's correct for your region+os.environ["WATSONX_PROJECT_ID"] = os.getenv("WATSONX_PROJECT_ID", "your-project-id-here")+++credentials = Credentials(+ url=os.environ["WATSONX_URL"],+ api_key=os.environ["WATSONX_API_KEY"],+)++# Project ID for your IBM Watsonx project+project_id = os.environ["WATSONX_PROJECT_ID"]+```++## Text Generation++Let's use IBM Watsonx.ai to generate text based on a prompt:+```python+# Initialize text generation model+gen_model = ModelInference(model_id="google/flan-ul2", credentials=credentials, project_id=project_id)++# Generate text with a prompt+prompt = "Write a short poem about artificial intelligence:"+response = gen_model.generate_text(prompt)+print(f"Generated Text:\n{response}")+```++## Chat Completion++Now, let's use a different model for chat completion:+```python+# Initialize chat model+chat_model = ModelInference(+ model_id="meta-llama/llama-3-8b-instruct", # Using the model ID from the MDX as it might be more current/available+ credentials=credentials,+ project_id=project_id+)++# Format messages for chat+messages = [+ {"role": "system", "content": "You are a helpful AI assistant."},+ {"role": "user", "content": "What are the three laws of robotics?"},+]++# Get chat response+chat_response = chat_model.chat(messages)+# Accessing response based on typical ibm-watsonx-ai SDK structure+print(f"Chat Response:\n{chat_response['results'][0]['generated_text']}")+```++## Another Chat Example++Let's try a different type of query:+```python+# New chat messages+messages = [+ {"role": "system", "content": "You are an expert in machine learning."},+ {"role": "user", "content": "Explain the difference between supervised and unsupervised learning in simple terms."},+]++# Get chat response+chat_response = chat_model.chat(messages)+print(f"Chat Response:\n{chat_response['results'][0]['generated_text']}")+```++## Clean Up++Finally, let's close the persistent connection with the models if they were established and end the AgentOps session.+```python+# Close connections if persistent connections were used.+# This is good practice if the SDK version/usage implies persistent connections.+try:+ gen_model.close_persistent_connection()+ chat_model.close_persistent_connection()+except AttributeError:+ # Handle cases where this method might not exist (e.g. newer SDK versions or stateless calls)+ print("Note: close_persistent_connection not available or needed for one or more models.")+ pass++agentops.end_session("Success") # Manually end session+```++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/examples/xai.mdx b/docs/v2/examples/xai.mdxnew file mode 100644index 00000000..481e0b7c--- /dev/null+++ b/docs/v2/examples/xai.mdx@@ -0,0 +1,125 @@+---+title: 'XAI Grok Example'+description: 'Using XAI Grok via OpenAI client with AgentOps for a transliteration chatbot'+---+{/* SOURCE_FILE: examples/xai/grok_examples.ipynb */}++_View Notebook on <a href={'https://github.com/AgentOps-AI/agentops/blob/main/examples/xai/grok_examples.ipynb'} target={'_blank'}>Github</a>_++# XAI Grok Transliteration Chatbot Example++This notebook demonstrates how to use XAI with AgentOps via the OpenAI python client.++We are going to use a Grok model from XAI to create a transliteration chatbot that can understand the major languages of the world and translate them to a user's native language! We will use AgentOps to track the chatbot's performance.++## Installation+First let's install the required packages.+<CodeGroup>+ ```bash pip+ pip install -U openai agentops python-dotenv+ ```+ ```bash poetry+ poetry add openai agentops python-dotenv+ ```+ ```bash uv+ uv add openai agentops python-dotenv+ ```+</CodeGroup>++## Setup+Then import them.+```python+from openai import OpenAI+import agentops+import os+from dotenv import load_dotenv+```++Next, we'll grab our API keys. You can use dotenv like below or however else you like to load environment variables.+```python+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_agentops_api_key_here")+os.environ["XAI_API_KEY"] = os.getenv("XAI_API_KEY", "your_xai_api_key_here") # Ensure XAI_API_KEY is set+```++Next we initialize the AgentOps client.+```python+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(trace_name="XAI Example", tags=["xai-example", "grok", "agentops-example"])+```++And we are all set! Note the session URL that will be printed by AgentOps. We will use it to track the chatbot.++Let's initialize the OpenAI client with the XAI API key and base URL.+```python+client = OpenAI(+ base_url="https://api.x.ai/v1",+ api_key=os.getenv("XAI_API_KEY", "your_xai_api_key_here"), # Added fallback as in notebook+)+```++## Define Prompts+Now we will set the system and instruction prompts for the chatbot. We will set the native language to Spanish and the user prompt to transliterate an excerpt from Haruki Murakami's "Kafka On The Shore".+```python+SYSTEM_PROMPT = """+You are a highly intelligent, multilingual assistant designed to understand user prompts in English and respond in the user's specified native language.+Your key responsibilities include:+1. Translating and generating meaningful, contextually appropriate responses in the user's native language.+2. Ensuring the output is accurate, coherent, and in Unicode format for proper display in the specified language.+3. Adhering to the nuances of the specified language's grammar, tone, and cultural context.++When asked to respond in a language, generate the response entirely in that language without using English unless explicitly requested.++If the specified language is unfamiliar or ambiguous, politely ask for clarification in English.+"""+```+```python+native_language = "Spanish"++USER_PROMPT = """+Sometimes fate is like a small sandstorm that keeps changing directions. You change direction but the sandstorm chases you.+You turn again, but the storm adjusts. Over and over you play this out, like some ominous dance with death just before dawn. Why?+Because this storm isn’t something that blew in from far away, something that has nothing to do with you. This storm is you.+Something inside of you. So all you can do is give in to it, step right inside the storm, closing your eyes and plugging up your ears so the sand doesn’t get in, and walk through it, step by step.+There’s no sun there, no moon, no direction, no sense of time. Just fine white sand swirling up into the sky like pulverized bones.+That’s the kind of sandstorm you need to imagine.++And you really will have to make it through that violent, metaphysical, symbolic storm.+No matter how metaphysical or symbolic it might be, make no mistake about it: it will cut through flesh like a thousand razor blades. People will bleed there, and you will bleed too.+Hot, red blood. You’ll catch that blood in your hands, your own blood and the blood of others.++And once the storm is over you won’t remember how you made it through, how you managed to survive. You won’t even be sure, in fact, whether the storm is really over.+But one thing is certain. When you come out of the storm you won’t be the same person who walked in. That’s what this storm’s all about.+"""++INSTRUCTION_PROMPT = f"""+You are a multilingual chatbot. Take the user's prompt: "{USER_PROMPT}" and respond naturally in {native_language}.+Ensure that the response is in Unicode characters appropriate for {native_language}.+"""+```++## Generate Response+Now we will use the OpenAI client to generate the response by passing in the system and instruction prompts.+```python+response = client.chat.completions.create(+ model="grok-1.5-flash", # Notebook used "grok-3-mini". Standardizing to a common one. "grok-1.5-flash" is often cited.+ messages=[{"role": "system", "content": SYSTEM_PROMPT}, {"role": "user", "content": INSTRUCTION_PROMPT}],+)+```+```python+print(f"Original Prompt (for transliteration):\n{USER_PROMPT}")+generated_response = response.choices[0].message.content+print(f"Response in {native_language}:\n{generated_response}")+```++Awesome! We can now transliterate from English to any language! And all of this can be tracked with AgentOps by going to the session url printed when `agentops.init()` was called.++```python+agentops.end_trace(tracer, end_state="Success")+```+We end the session with a success state. This is useful if you want to track the success or failure of the chatbot. By default, the session will have an indeterminate end state if not explicitly ended.++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/integrations/ag2.mdx b/docs/v2/integrations/ag2.mdxold mode 100644new mode 100755index 33a24377..8eea55ac--- a/docs/v2/integrations/ag2.mdx+++ b/docs/v2/integrations/ag2.mdx@@ -3,9 +3,6 @@ title: AG2description: "Track and analyze your AG2 agents with AgentOps"----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'-## Installation<CodeGroup>@@ -15,25 +12,62 @@ import EnvTooltip from '/snippets/add-env-tooltip.mdx'```bash poetrypoetry add agentops pyautogen```+ ```bash uv+ uv add agentops pyautogen+ ```+</CodeGroup>++## Setting Up API Keys++Before using AG2 with AgentOps, you need to set up your API keys. You can obtain:+- **OPENAI_API_KEY**: From the [OpenAI Platform](https://platform.openai.com/api-keys)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++Then to set them up, you can either export them as environment variables or set them in a `.env` file.++<CodeGroup>+ ```bash Export to CLI+ export OPENAI_API_KEY="your_openai_api_key_here"+ export AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+ ```txt Set in .env file+ OPENAI_API_KEY="your_openai_api_key_here"+ AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```</CodeGroup>+Then load the environment variables in your Python code:++```python+from dotenv import load_dotenv+import os++# Load environment variables from .env file+load_dotenv()++# Set up environment variables with fallback values+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")+```+## UsageInitialize AgentOps at the beginning of your application to automatically track all AG2 agent interactions:-<CodeGroup>-```python Python+<CodeGroup>+```python Single Agent Conversationimport agentopsimport autogen+import os# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)+agentops.init()# Configure your AG2 agentsconfig_list = [{"model": "gpt-4",- "api_key": "<YOUR_OPENAI_API_KEY>"+ "api_key": os.getenv("OPENAI_API_KEY"),}]@@ -42,7 +76,7 @@ llm_config = {"timeout": 60,}-# Create AG2 agents+# Create a single agentassistant = autogen.AssistantAgent(name="assistant",llm_config=llm_config,@@ -62,34 +96,27 @@ user_proxy.initiate_chat(assistant,message="How can I implement a basic web scraper in Python?")--# All agent interactions are automatically tracked by AgentOps```-</CodeGroup>--## Multi-Agent Conversation Example--AgentOps tracks interactions across multiple AG2 agents:-<CodeGroup>-```python Python+```python Multi-Agent Conversation+import osimport agentopsimport autogen# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)+agentops.init()-# Configure LLM+# Configure your AG2 agentsconfig_list = [{"model": "gpt-4",- "api_key": "<YOUR_OPENAI_API_KEY>"+ "api_key": os.getenv("OPENAI_API_KEY"),}]llm_config = {"config_list": config_list,- "timeout": A 60,+ "timeout": 60,}# Create a team of agents@@ -136,22 +163,22 @@ user_proxy.initiate_chat(manager,message="Create a Python program to analyze sentiment from Twitter data.")--# All agent interactions across the group chat are automatically tracked by AgentOps```</CodeGroup>-## Environment Variables--<EnvTooltip />-<CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- OPENAI_API_KEY=<YOUR OPENAI API KEY>- ```-</CodeGroup>--Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)+## Examples++<CardGroup cols={2}>+ <Card title="AG2 Memory Chat" icon="notebook" href="/v2/examples/ag2">+ Multi-agent conversation with memory capabilities+ </Card>+ <Card title="Async Human Input" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/ag2/async_human_input.ipynb" newTab={true}>+ Demonstrates asynchronous human input with AG2 agents.+ </Card>+ <Card title="Wikipedia Search Tool" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/ag2/tools_wikipedia_search.ipynb" newTab={true}>+ Example of AG2 agents using a Wikipedia search tool.+ </Card>+</CardGroup><script type="module" src="/scripts/github_stars.js"></script><script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>diff --git a/docs/v2/integrations/agents_sdk.mdx b/docs/v2/integrations/agents_sdk.mdxnew file mode 100644index 00000000..ed3101ad--- /dev/null+++ b/docs/v2/integrations/agents_sdk.mdx@@ -0,0 +1,164 @@+---+title: OpenAI Agents SDK+description: 'AgentOps and OpenAI Agents SDK integration for powerful multi-agent workflow monitoring.'+---++[OpenAI Agents SDK](https://github.com/openai/agentsdk_prototype) is a lightweight yet powerful framework for building multi-agent workflows. The SDK provides a comprehensive set of tools for creating, managing, and monitoring agent-based applications. AgentOps seamlessly integrates to provide observability into these workflows.++## Core Concepts++- **Agents**: LLMs configured with instructions, tools, guardrails, and handoffs+- **Handoffs**: Allow agents to transfer control to other agents for specific tasks+- **Guardrails**: Configurable safety checks for input and output validation+- **Tracing**: Built-in tracking of agent runs, allowing you to view, debug and optimize your workflows++## Installation++Install AgentOps, the OpenAI Agents SDK, and `python-dotenv` for managing API keys:+<CodeGroup>+ ```bash pip+ pip install agentops openai-agents python-dotenv+ ```+ ```bash poetry+ poetry add agentops openai-agents python-dotenv+ ```+ ```bash uv+ uv add agentops openai-agents python-dotenv+ ```+</CodeGroup>++## Setting Up API Keys++Before using the OpenAI Agents SDK with AgentOps, you need to set up your API keys:+- **OPENAI_API_KEY**: From the [OpenAI Platform](https://platform.openai.com/api-keys)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++You can set these as environment variables or in a `.env` file.++<CodeGroup>+ ```bash Export to CLI+ export OPENAI_API_KEY="your_openai_api_key_here"+ export AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+ ```txt Set in .env file+ OPENAI_API_KEY="your_openai_api_key_here"+ AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+</CodeGroup>++Then load them in your Python code:+```python+from dotenv import load_dotenv+import os++load_dotenv()++AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY")+OPENAI_API_KEY = os.getenv("OPENAI_API_KEY")+```++## Usage++AgentOps will automatically instrument the OpenAI Agents SDK after being initialized. You can then create agents, run them, and track their interactions.++```python+import agentops+from agents import Agent, Runner++# Initialize AgentOps+agentops.init()++# Create an agent with instructions+agent = Agent(name="Assistant", instructions="You are a helpful assistant")++result = Runner.run_sync(agent, "Write a haiku about recursion in programming.")+print(result.final_output)+```++## Examples++<CodeGroup>+```python Handoffs+from agents import Agent, Runner+import asyncio+import agentops+import os++agentops.init()++spanish_agent = Agent(+ name="Spanish agent",+ instructions="You only speak Spanish.",+)++english_agent = Agent(+ name="English agent",+ instructions="You only speak English",+)++triage_agent = Agent(+ name="Triage agent",+ instructions="Handoff to the appropriate agent based on the language of the request.",+ handoffs=[spanish_agent, english_agent],+)+++async def main():+ result = await Runner.run(triage_agent, input="Hola, ¿cómo estás?")+ print(result.final_output)+ # Expected Output: ¡Hola! Estoy bien, gracias por preguntar. ¿Y tú, cómo estás?+++if __name__ == "__main__":+ asyncio.run(main())+```++```python Function Calling+import asyncio+from agents import Agent, Runner, function_tool+import agentops+import os++agentops.init()++@function_tool+def get_weather(city: str) -> str:+ return f"The weather in {city} is sunny."+++agent = Agent(+ name="Weather Agent",+ instructions="You are a helpful agent that can get weather information.",+ tools=[get_weather],+)+++async def main():+ result = await Runner.run(agent, input="What's the weather in Tokyo?")+ print(result.final_output)+ # Expected Output: The weather in Tokyo is sunny.+++if __name__ == "__main__":+ asyncio.run(main())+```+</CodeGroup>++## More Examples+<CardGroup cols={2}>+ <Card title="Customer Service Agent" icon="notebook" href="/v2/examples/openai_agents">+ Demonstrates a customer service workflow+ </Card>+ <Card title="Agent Patterns" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/openai_agents/agent_patterns.ipynb" newTab={true}>+ Illustrates various agent interaction patterns.+ </Card>+ <Card title="Agents with Tools" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/openai_agents/agents_tools.ipynb" newTab={true}>+ Showcases agents utilizing different tools.+ </Card>+</CardGroup>++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="css" src="/styles/styles.css"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/integrations/agentssdk.mdx b/docs/v2/integrations/agentssdk.mdxdeleted file mode 100644index f5233239..00000000--- a/docs/v2/integrations/agentssdk.mdx+++ /dev/null@@ -1,195 +0,0 @@-----title: OpenAI Agents SDK-description: 'AgentOps and OpenAI Agents SDK integration for powerful multi-agent workflow monitoring.'------import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'--<Check>[Give us a star](https://github.com/AgentOps-AI/agentops) to bookmark on GitHub, save for later 🖇️)</Check>--[OpenAI Agents SDK](https://github.com/openai/agentsdk_prototype) is a lightweight yet powerful framework for building multi-agent workflows. The SDK provides a comprehensive set of tools for creating, managing, and monitoring agent-based applications.--{/* <Frame type="glass" caption="OpenAI Agents Tracing UI">- <img height="400" src="/images/openai-agents-tracing-ui.png" />-</Frame> */}--## Core Concepts--- **Agents**: LLMs configured with instructions, tools, guardrails, and handoffs-- **Handoffs**: Allow agents to transfer control to other agents for specific tasks-- **Guardrails**: Configurable safety checks for input and output validation-- **Tracing**: Built-in tracking of agent runs, allowing you to view, debug and optimize your workflows--<Steps>- <Step title="Install the AgentOps SDK">- <CodeGroup>- ```bash pip- pip install agentops- ```- ```bash poetry- poetry add agentops- ```- </CodeGroup>- </Step>- <Step title="Install OpenAI Agents SDK">- <CodeGroup>- ```bash pip- pip install openai-agents- ```- ```bash poetry- poetry add openai-agents- ```- </CodeGroup>- <Tip>- This will be updated to a PyPI link when the package is officially released.- </Tip>- </Step>- <Step title="Add 2 lines of code">- <CodeTooltip/>- <CodeGroup>- ```python python- import agentops- agentops.init(<INSERT YOUR API KEY HERE>)- ```- </CodeGroup>- <EnvTooltip />- <CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- OPENAI_API_KEY=<YOUR OPENAI API KEY>- ```- </CodeGroup>- Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)- </Step>- <Step title="Run your agents">- Execute your program and visit [app.agentops.ai/traces](https://app.agentops.ai/traces) to observe your Agents! 🕵️- <Tip>- After your run, AgentOps prints a clickable url to console linking directly to your session in the Dashboard- </Tip>- <div/>{/* Intentionally blank div for newline */}- <Frame type="glass" caption="Clickable link to session">- <img height="200" src="https://github.com/AgentOps-AI/agentops/blob/main/docs/images/link-to-session.gif?raw=true" />- </Frame>- </Step>-</Steps>--## Hello World Example--```python-from agents import Agent, Runner-import agentops--# Initialize AgentOps-agentops.init()--agent = Agent(name="Assistant", instructions="You are a helpful assistant")--result = Runner.run_sync(agent, "Write a haiku about recursion in programming.")-print(result.final_output)--# Output:-# Code within the code,-# Functions calling themselves,-# Infinite loop's dance.-```--## Handoffs Example--```python-from agents import Agent, Runner-import asyncio-import agentops--# Initialize AgentOps-agentops.init()--spanish_agent = Agent(- name="Spanish agent",- instructions="You only speak Spanish.",-)--english_agent = Agent(- name="English agent",- instructions="You only speak English",-)--triage_agent = Agent(- name="Triage agent",- instructions="Handoff to the appropriate agent based on the language of the request.",- handoffs=[spanish_agent, english_agent],-)---async def main():- result = await Runner.run(triage_agent, input="Hola, ¿cómo estás?")- print(result.final_output)- # ¡Hola! Estoy bien, gracias por preguntar. ¿Y tú, cómo estás?---if __name__ == "__main__":- asyncio.run(main())-```--## Functions Example--```python-import asyncio-from agents import Agent, Runner, function_tool-import agentops--# Initialize AgentOps-agentops.init()--@function_tool-def get_weather(city: str) -> str:- return f"The weather in {city} is sunny."---agent = Agent(- name="Hello world",- instructions="You are a helpful agent.",- tools=[get_weather],-)---async def main():- result = await Runner.run(agent, input="What's the weather in Tokyo?")- print(result.final_output)- # The weather in Tokyo is sunny.---if __name__ == "__main__":- asyncio.run(main())-```--## The Agent Loop--When you call `Runner.run()`, the SDK runs a loop until it gets a final output:--1. The LLM is called using the model and settings on the agent, along with the message history.-2. The LLM returns a response, which may include tool calls.-3. If the response has a final output, the loop ends and returns it.-4. If the response has a handoff, the agent is set to the new agent and the loop continues from step 1.-5. Tool calls are processed (if any) and tool response messages are appended. Then the loop continues from step 1.--You can use the `max_turns` parameter to limit the number of loop executions.--## Final Output--Final output is the last thing the agent produces in the loop:--- If you set an `output_type` on the agent, the final output is when the LLM returns something of that type using structured outputs.-- If there's no `output_type` (i.e., plain text responses), then the first LLM response without any tool calls or handoffs is considered the final output.--<CardGroup cols={3}>- <Card title="Basic Agent" icon="robot" href="https://github.com/openai/agentsdk_prototype/tree/main/examples/basic" />- <Card title="Multi-Agent" icon="users" href="https://github.com/openai/agentsdk_prototype/tree/main/examples/multi_agent" />- <Card title="Tool Usage" icon="toolbox" href="https://github.com/openai/agentsdk_prototype/tree/main/examples/tools" />-</CardGroup>--<script type="module" src="/scripts/github_stars.js"></script>-<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>-<script type="module" src="/scripts/button_heartbeat_animation.js"></script>-<script type="css" src="/styles/styles.css"></script>-<script type="module" src="/scripts/adjust_api_dynamically.js"></script>\ No newline at end of filediff --git a/docs/v2/integrations/anthropic.mdx b/docs/v2/integrations/anthropic.mdxindex a0b9a326..1fc08284 100644--- a/docs/v2/integrations/anthropic.mdx+++ b/docs/v2/integrations/anthropic.mdx@@ -3,117 +3,109 @@ title: Anthropicdescription: "Track and analyze your Anthropic API calls with AgentOps"----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'-AgentOps provides seamless integration with [Anthropic's Python SDK](https://github.com/anthropics/anthropic-sdk-python), allowing you to track and analyze all your Claude model interactions automatically.## Installation-<CodeTooltip />- <CodeGroup>- ```bash pip++<CodeGroup>+ ```bash pippip install agentops anthropic- ```- ```bash poetry+ ```+ ```bash poetrypoetry add agentops anthropic- ```- </CodeGroup>+ ```+ ```bash uv+ uv add agentops anthropic+ ```+</CodeGroup>++## Setting Up API Keys++Before using Anthropic with AgentOps, you need to set up your API keys. You can obtain:+- **ANTHROPIC_API_KEY**: From the [Anthropic Console](https://console.anthropic.com/)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++Then to set them up, you can either export them as environment variables or set them in a `.env` file.++<CodeGroup>+ ```bash Export to CLI+ export ANTHROPIC_API_KEY="your_anthropic_api_key_here"+ export AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+ ```txt Set in .env file+ ANTHROPIC_API_KEY="your_anthropic_api_key_here"+ AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+</CodeGroup>++Then load the environment variables in your Python code:++```python+from dotenv import load_dotenv+import os++# Load environment variables from .env file+load_dotenv()++# Set up environment variables with fallback values+os.environ["ANTHROPIC_API_KEY"] = os.getenv("ANTHROPIC_API_KEY")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")+```## UsageInitialize AgentOps at the beginning of your application to automatically track all Anthropic API calls:- <CodeGroup>-```python Basic Usage+```pythonimport agentopsimport anthropic# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)+agentops.init()# Create Anthropic client-client = anthropic.Anthropic(api_key="<YOUR_ANTHROPIC_API_KEY>")+client = anthropic.Anthropic()# Make a completion request - AgentOps will track it automaticallymessage = client.messages.create(- model="claude-3-opus-20240229",- max_tokens=1000,+ model="claude-sonnet-4-20250514",messages=[{"role": "user", "content": "What is artificial intelligence?"}])+# Print the response receivedprint(message.content[0].text)- ```- </CodeGroup>--## Advanced Examples+```-### Streaming Example-AgentOps automatically tracks streaming completions:+## Examples- <CodeGroup>-```python Streaming Example+<CodeGroup>+```python Streamingimport agentopsimport anthropic# Initialize AgentOps- agentops.init(<INSERT YOUR API KEY HERE>)+agentops.init()# Create Anthropic client-client = anthropic.Anthropic(api_key="<YOUR_ANTHROPIC_API_KEY>")+client = anthropic.Anthropic()# Make a streaming requestwith client.messages.stream(- model="claude-3-haiku-20240307",- max_tokens=1000,+ model="claude-sonnet-4-20250514",messages=[{"role": "user", "content": "Write a short poem about artificial intelligence."}]) as stream:for text in stream.text_stream:print(text, end="", flush=True)- print() # Add a newline at the end- ```- </CodeGroup>--### System Prompt Example--AgentOps tracks interactions with system prompts:-- <CodeGroup>-```python System Prompt-import agentops-import anthropic--# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)--# Create Anthropic client-client = anthropic.Anthropic(api_key="<YOUR_ANTHROPIC_API_KEY>")--# Make a request with a system prompt-message = client.messages.create(- model="claude-3-sonnet-20240229",- max_tokens=1000,- system="You are a helpful AI assistant with expertise in science and technology. Keep your answers concise and accurate.",- messages=[- {"role": "user", "content": "Explain quantum computing in simple terms."}- ]-)--print(message.content[0].text)- ```- </CodeGroup>--### Tool Use Example--AgentOps tracks tool use with Claude:+ print()+```-<CodeGroup>```python Tool Useimport agentopsimport anthropic@@ -121,10 +113,10 @@ import jsonfrom datetime import datetime# Initialize AgentOps- agentops.init(<INSERT YOUR API KEY HERE>)+agentops.init()# Create Anthropic client-client = anthropic.Anthropic(api_key="<YOUR_ANTHROPIC_API_KEY>")+client = anthropic.Anthropic()# Define toolstools = [@@ -145,8 +137,7 @@ def get_current_time():# Make a request with toolsmessage = client.messages.create(- model="claude-3-opus-20240229",- max_tokens=1000,+ model="claude-opus-4-20250514",tools=tools,messages=[{"role": "user", "content": "What time is it now?"}@@ -163,8 +154,7 @@ if message.content[0].type == "tool_calls":# Continue the conversation with the tool responsesecond_message = client.messages.create(- model="claude-3-opus-20240229",- max_tokens=1000,+ model="claude-opus-4-20250514",messages=[{"role": "user", "content": "What time is it now?"},{@@ -196,17 +186,19 @@ else:```</CodeGroup>-## Environment Variables--<EnvTooltip />-<CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- ANTHROPIC_API_KEY=<YOUR ANTHROPIC API KEY>- ```-</CodeGroup>--Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)+## More Examples++<CardGroup cols={2}>+ <Card title="Understanding Tools" icon="notebook" href="/v2/examples/anthropic">+ Claude integration with tool usage and advanced features+ </Card>+ <Card title="Sync Example" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/anthropic/anthropic-example-sync.ipynb" newTab={true}>+ Shows synchronous calls with the Anthropic SDK.+ </Card>+ <Card title="Async Example" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/anthropic/anthropic-example-async.ipynb" newTab={true}>+ Demonstrates asynchronous calls with the Anthropic SDK.+ </Card>+</CardGroup><script type="module" src="/scripts/github_stars.js"></script><script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>diff --git a/docs/v2/integrations/autogen.mdx b/docs/v2/integrations/autogen.mdxindex ed5fabfc..c7fd16a6 100644--- a/docs/v2/integrations/autogen.mdx+++ b/docs/v2/integrations/autogen.mdx@@ -5,30 +5,62 @@ description: "Integrate AgentOps with Microsoft AutoGen for multi-agent workflow[AutoGen](https://microsoft.github.io/autogen/stable/) is Microsoft's framework for building multi-agent conversational AI systems. AgentOps provides seamless integration with AutoGen to track and monitor your multi-agent workflows.-## Quick Start+## Installation<CodeGroup>```bash pippip install agentops autogen-core python-dotenv```-```bash poetry+```bash poetrypoetry add agentops autogen-core python-dotenv```+```bash uv+uv add agentops autogen-core python-dotenv+```</CodeGroup>-## Basic Integration+## Setting Up API Keys++Before using AutoGen with AgentOps, you need to set up your API keys. You can obtain:+- **OPENAI_API_KEY**: From the [OpenAI Platform](https://platform.openai.com/api-keys)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++Then to set them up, you can either export them as environment variables or set them in a `.env` file.-AgentOps automatically instruments AutoGen agents and tracks their interactions. Simply initialize AgentOps before creating your AutoGen agents:+<CodeGroup>+ ```bash Export to CLI+ export OPENAI_API_KEY="your_openai_api_key_here"+ export AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+ ```txt Set in .env file+ OPENAI_API_KEY="your_openai_api_key_here"+ AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+</CodeGroup>-<Note>-**🔄 Automatic Telemetry Integration**: AgentOps automatically picks up spans from AutoGen's built-in OpenTelemetry integration. No additional instrumentation is required - just initialize AgentOps and your AutoGen agents will be automatically tracked.-</Note>+Then load the environment variables in your Python code:```python+from dotenv import load_dotenv+import os++# Load environment variables from .env file+load_dotenv()++# Set up environment variables with fallback values+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")+```++## Usage++AgentOps automatically instruments AutoGen agents and tracks their interactions. Simply initialize AgentOps before creating your AutoGen agents!++<CodeGroup>+```python Countdownimport asynciofrom dataclasses import dataclassfrom typing import Callable-from dotenv import load_dotenvimport agentopsfrom autogen_core import (@@ -41,10 +73,7 @@ from autogen_core import (SingleThreadedAgentRuntime)-# Load environment variables-load_dotenv()--# Initialize AgentOps - this will automatically track AutoGen agents+# Initialize AgentOpsagentops.init()@dataclass@@ -143,15 +172,10 @@ if __name__ == "__main__":asyncio.run(run_countdown_workflow())```-## Advanced Multi-Agent Example--Here's a more complex example showing a data processing pipeline with multiple specialized agents:--```python+```python Multi-Agentimport asynciofrom dataclasses import dataclassfrom typing import List, Dict, Any-from dotenv import load_dotenvimport agentopsfrom autogen_core import (@@ -164,9 +188,6 @@ from autogen_core import (SingleThreadedAgentRuntime)-# Load environment variables-load_dotenv()-# Initialize AgentOpsagentops.init()@@ -389,66 +410,23 @@ async def run_data_processing_pipeline():if __name__ == "__main__":asyncio.run(run_data_processing_pipeline())```+</CodeGroup>-## What AgentOps Tracks--AgentOps leverages AutoGen's built-in OpenTelemetry integration to automatically capture comprehensive telemetry data:--### Automatic Span Collection-- **Agent Operations**: All agent message handling and processing operations-- **Message Flow**: Complete trace of message routing between agents-- **Runtime Events**: Agent registration, startup, and shutdown events-- **Error Handling**: Automatic capture of exceptions and error states--### Built-in Telemetry Integration-AutoGen Core includes native OpenTelemetry support, and AgentOps seamlessly integrates with this telemetry system to provide:--- **Zero-Configuration Tracking**: No manual instrumentation required-- **Complete Workflow Visibility**: End-to-end trace of multi-agent interactions-- **Performance Metrics**: Timing data for each agent operation and message exchange-- **Distributed Tracing**: Support for agents running across different processes or machines--## Best Practices--1. **Initialize Early**: Call `agentops.init()` before creating any AutoGen agents-2. **Use Descriptive Names**: Give your agents meaningful names for better dashboard visibility-3. **Structure Messages**: Use well-defined message classes for better tracking-4. **Handle Errors**: Implement proper error handling in your message handlers-5. **Monitor Performance**: Use the AgentOps dashboard to identify bottlenecks in your agent workflows--## Dashboard Features--The AgentOps dashboard provides:--- **Agent Network Visualization**: See how your agents communicate-- **Message Trace Timeline**: Follow the complete flow of messages-- **Performance Analytics**: Identify slow agents or bottlenecks-- **Error Tracking**: Monitor and debug agent failures-- **Cost Analysis**: Track computational costs across your agent network--## Example Output--When you run the examples above, you'll see output like:+## Examples-```-🚀 Starting AutoGen Countdown Workflow-==================================================-🤖 AutoGen runtime started-📨 Sending initial message with value: 10-✅ CheckerAgent: 10 passed validation, continuing workflow-🔧 ModifierAgent: Transformed 10 → 9-✅ CheckerAgent: 9 passed validation, continuing workflow-🔧 ModifierAgent: Transformed 9 → 8-...-🛑 CheckerAgent: 1 failed validation, stopping workflow-🎉 Countdown completed successfully!-==================================================-✨ Workflow completed! Check your AgentOps dashboard for detailed traces.-```+<CardGroup cols={2}>+ <Card title="Agent Chat Example" icon="notebook" href="/v2/examples/autogen">+ Basic multi-agent chat functionality+ </Card>+ <Card title="Math Agent Example" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/autogen/MathAgent.ipynb" newTab={true}>+ Demonstrates an agent specialized for mathematical problem-solving.+ </Card>+</CardGroup>Visit your [AgentOps Dashboard](https://app.agentops.ai) to see detailed traces of your AutoGen agent interactions, performance metrics, and workflow analytics.+<script type="module" src="/scripts/github_stars.js"></script><script type="module" src="/scripts/scroll-img-fadein-animation.js"></script><script type="module" src="/scripts/button_heartbeat_animation.js"></script>-<script type="module" src="/scripts/adjust_api_dynamically.js"></script>\ No newline at end of file+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>diff --git a/docs/v2/integrations/crewai.mdx b/docs/v2/integrations/crewai.mdxindex 6ed25f91..6b2813c0 100644--- a/docs/v2/integrations/crewai.mdx+++ b/docs/v2/integrations/crewai.mdx@@ -3,110 +3,115 @@ title: 'CrewAI'description: 'AgentOps and CrewAI teamed up to make monitoring Crew agents dead simple.'----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'--[CrewAI](https://www.crewai.com/) is a framework for easily building multi-agent applications. Crew has comprehensive [documentation](https://docs.crewai.com) available as well as a great [quickstart](https://docs.crewai.com/how-to/Creating-a-Crew-and-kick-it-off/) guide.--<Steps>- <Step title="Install the AgentOps SDK">- <CodeGroup>- ```bash pip- pip install agentops crewai- ```- ```bash poetry- poetry add agentops crewai- ```- </CodeGroup>- </Step>- <Step title="Add AgentOps to your code">- <CodeTooltip/>- <CodeGroup>- ```python python- import os- from dotenv import load_dotenv- import agentops- from crewai import Agent, Task, Crew- from langchain_openai import ChatOpenAI-- # Load environment variables- load_dotenv()-- # Initialize AgentOps- agentops.init(os.getenv("AGENTOPS_API_KEY"))-- # Create LLM- llm = ChatOpenAI(- model="gpt-4",- temperature=0.7,- api_key=os.getenv("OPENAI_API_KEY")- )-- # Create an agent- researcher = Agent(- role='Researcher',- goal='Research and provide accurate information about cities and their history',- backstory='You are an expert researcher with vast knowledge of world geography and history.',- llm=llm,- verbose=True- )-- # Create a task- research_task = Task(- description='What is the capital of France? Provide a detailed answer about its history, culture, and significance.',- expected_output='A comprehensive response about Paris, including its status as the capital of France, historical significance, cultural importance, and key landmarks.',- agent=researcher- )-- # Create a crew with the researcher- crew = Crew(- agents=[researcher],- tasks=[research_task],- verbose=True- )-- # Execute the task - AgentOps will automatically track all LLM calls- result = crew.kickoff()-- print("\nCrew Research Results:")- print(result)- ```- </CodeGroup>- <EnvTooltip />- <CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- OPENAI_API_KEY=<YOUR OPENAI API KEY>- ```- </CodeGroup>- Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)- </Step>- <Step title="Run your crew">- Execute your program and visit [app.agentops.ai/traces](https://app.agentops.ai/traces) to observe your Crew! 🕵️- <Tip>- After your run, AgentOps prints a clickable url to console linking directly to your session in the Dashboard- </Tip>- <div/>{/* Intentionally blank div for newline */}- <Frame type="glass" caption="Clickable link to session">- <img height="200" src="https://github.com/AgentOps-AI/agentops/blob/main/docs/images/link-to-session.gif?raw=true" />- </Frame>- </Step>-</Steps>--## Important Notes--1. The `Task` class requires an `expected_output` field that describes what the task should produce-2. Setting `verbose=True` on both the agent and crew provides better visibility into the execution process-3. Tasks should have clear, detailed descriptions to guide the agent effectively--## Crew + AgentOps Examples--<CardGroup cols={3}>- <Card title="Job Posting" icon="briefcase" href="https://github.com/Agentops-AI/crewAI-examples/tree/main/job-posting" />- <Card title="Instagram Post" icon="instagram" href="https://github.com/Agentops-AI/crewAI-examples/tree/main/instagram_post" />- <Card title="Markdown Validator" icon="markdown" href="https://github.com/Agentops-AI/crewAI-examples/tree/main/markdown_validator" />+[CrewAI](https://www.crewai.com/) is a framework for easily building multi-agent applications. AgentOps integrates with CrewAI to provide observability into your agent workflows. Crew has comprehensive [documentation](https://docs.crewai.com) available as well as a great [quickstart](https://docs.crewai.com/how-to/Creating-a-Crew-and-kick-it-off/) guide.++## Installation+Install AgentOps and CrewAI, along with `python-dotenv` for managing API keys and `langchain-openai` for the LLM:++<CodeGroup>+ ```bash pip+ pip install agentops crewai python-dotenv langchain-openai+ ```+ ```bash poetry+ poetry add agentops crewai python-dotenv langchain-openai+ ```+ ```bash uv+ uv add agentops crewai python-dotenv langchain-openai+ ```+</CodeGroup>++## Setting Up API Keys++You'll need API keys for AgentOps and OpenAI (since `ChatOpenAI` is commonly used with CrewAI):+- **OPENAI_API_KEY**: From the [OpenAI Platform](https://platform.openai.com/api-keys)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++Set these as environment variables or in a `.env` file.++<CodeGroup>+ ```bash Export to CLI+ export OPENAI_API_KEY="your_openai_api_key_here"+ export AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+ ```txt Set in .env file+ OPENAI_API_KEY="your_openai_api_key_here"+ AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+</CodeGroup>++Then load them in your Python code:+```python+from dotenv import load_dotenv+import os++load_dotenv()++AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY")+OPENAI_API_KEY = os.getenv("OPENAI_API_KEY")+```++## Usage++Simply initialize AgentOps at the beginning of your CrewAI application. AgentOps will automatically instrument CrewAI and LangChain components (like `ChatOpenAI`) to track your agent interactions.++Here's how to set up a basic CrewAI application with AgentOps:++```python+import agentops+from crewai import Agent, Task, Crew+from langchain_openai import ChatOpenAI++# Initialize AgentOps client+agentops.init()++# Define the LLM to use with CrewAI+llm = ChatOpenAI(+ model="gpt-4", # Or your preferred model+ temperature=0.7+)++# Create an agent+researcher = Agent(+ role='Researcher',+ goal='Research and provide accurate information about cities and their history',+ backstory='You are an expert researcher with vast knowledge of world geography and history.',+ llm=llm,+ verbose=True+)++# Create a task+research_task = Task(+ description='What is the capital of France? Provide a detailed answer about its history, culture, and significance.',+ expected_output='A comprehensive response about Paris, including its status as the capital of France, historical significance, cultural importance, and key landmarks.',+ agent=researcher+)++# Create a crew with the researcher+crew = Crew(+ agents=[researcher],+ tasks=[research_task],+ verbose=True+)++# Execute the task+result = crew.kickoff()++print("\nCrew Research Results:")+print(result)+```++## Examples++<CardGroup cols={2}>+ <Card title="Job Posting" icon="notebook" href="/v2/examples/crewai" newTab={true}>+ Create job postings with a crew of specialized agents+ </Card>+ <Card title="Markdown Validator" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/crewai/markdown_validator.ipynb" newTab={true}>+ Validate and improve markdown content using CrewAI agents+ </Card></CardGroup>+<script type="module" src="/scripts/github_stars.js"></script><script type="module" src="/scripts/scroll-img-fadein-animation.js"></script><script type="module" src="/scripts/button_heartbeat_animation.js"></script>diff --git a/docs/v2/integrations/gemini.mdx b/docs/v2/integrations/gemini.mdxdeleted file mode 100644index 504a8922..00000000--- a/docs/v2/integrations/gemini.mdx+++ /dev/null@@ -1,208 +0,0 @@-----title: Google Generative AI (Gemini)-description: "Monitor and analyze your Google Gemini API calls with AgentOps"------import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'--AgentOps provides seamless integration with [Google's Generative AI API](https://ai.google.dev/), allowing you to monitor and analyze all your Gemini model interactions automatically.--## Installation--<CodeGroup>- ```bash pip- pip install agentops google-genai- ```- ```bash poetry- poetry add agentops google-genai- ```-</CodeGroup>--## Usage--Initialize AgentOps at the beginning of your application to automatically track all Gemini API calls:--<CodeGroup>-```python Python-import agentops-from google import genai--# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)--# Create a client for Gemini Developer API-client = genai.Client(api_key="YOUR_GEMINI_API_KEY")--# Generate content with a model-response = client.models.generate_content(- model='gemini-2.0-flash-001',- contents='What is AI observability?'-)--print(response.text)--# All Gemini API calls are automatically tracked by AgentOps-```-</CodeGroup>--## Alternative Client Setup--You can also set up the client using Vertex AI or with environment variables:--<CodeGroup>--```python Vertex AI-import agentops-from google import genai--# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)--# Using Vertex AI-client = genai.Client(- vertexai=True,- project='your-project-id',- location='us-central1'-)--# Generate content-response = client.models.generate_content(- model='gemini-2.0-flash-001',- contents='What is AI observability?'-)--print(response.text)-```--```python Using Environment Variables-import agentops-from google import genai--# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)--# Set GOOGLE_API_KEY environment variable before running-# export GOOGLE_API_KEY='your-api-key'-client = genai.Client()--# Generate content-response = client.models.generate_content(- model='gemini-2.0-flash-001',- contents='What is AI observability?'-)--print(response.text)-```-</CodeGroup>--## System Instructions and Settings--You can customize the model behavior with system instructions and other settings:--<CodeGroup>-```python With System Instructions-import agentops-from google import genai-from google.genai import types--# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)--# Create a client-client = genai.Client(api_key="YOUR_GEMINI_API_KEY")--# Generate content with system instructions-response = client.models.generate_content(- model='gemini-2.0-flash-001',- contents='Write a short poem',- config=types.GenerateContentConfig(- system_instruction='You are a professional poet who specializes in sonnets',- max_output_tokens=200,- temperature=0.7,- ),-)--print(response.text)-```-</CodeGroup>--## Streaming Example--AgentOps also supports tracking streaming requests with Gemini:--<CodeGroup>-```python Streaming-import agentops-from google import genai--# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)--# Create a client-client = genai.Client(api_key="YOUR_GEMINI_API_KEY")--# Generate streaming content-for chunk in client.models.generate_content_stream(- model='gemini-2.0-flash-001',- contents='Explain quantum computing in simple terms.',-):- print(chunk.text, end="", flush=True)--# All streaming requests are automatically tracked by AgentOps-```-</CodeGroup>--## Chat Example--<CodeGroup>-```python Chat-import agentops-from google import genai--# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)--# Create a client-client = genai.Client(api_key="YOUR_GEMINI_API_KEY")--# Start a chat session-chat = client.chats.create(model='gemini-2.0-flash-001')--# Send messages and get responses-response = chat.send_message('Hello, how can you help me with AI development?')-print(response.text)--# Continue the conversation-response = chat.send_message('What are the best practices for prompt engineering?')-print(response.text)--# All chat interactions are automatically tracked by AgentOps-```-</CodeGroup>--## Environment Variables--<EnvTooltip />-<CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- GOOGLE_API_KEY=<YOUR GEMINI API KEY>-- # For Vertex AI- # GOOGLE_GENAI_USE_VERTEXAI=true- # GOOGLE_CLOUD_PROJECT=your-project-id- # GOOGLE_CLOUD_LOCATION=us-central1- ```-</CodeGroup>--Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)--## Additional Resources--For more information on using the Google Gen AI SDK, refer to the [official documentation](https://googleapis.github.io/python-genai/).--<script type="module" src="/scripts/github_stars.js"></script>-<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>-<script type="module" src="/scripts/button_heartbeat_animation.js"></script>-<script type="css" src="/styles/styles.css"></script>\ No newline at end of filediff --git a/docs/v2/integrations/google_adk.mdx b/docs/v2/integrations/google_adk.mdxindex 36cac185..75366c53 100644--- a/docs/v2/integrations/google_adk.mdx+++ b/docs/v2/integrations/google_adk.mdx@@ -3,42 +3,71 @@ title: Google ADKdescription: "Track and analyze your Google Agent Development Kit (ADK) AI agents with AgentOps"----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'-AgentOps provides seamless integration with [Google Agent Development Kit (ADK)](https://google.github.io/adk-docs/), allowing you to track and analyze all your ADK agent interactions automatically.## Installation-<CodeTooltip />+<CodeGroup>+```bash pip+pip install agentops google-adk+```+```bash poetry+poetry add agentops google-adk+```+```bash uv+uv add agentops google-adk+```+</CodeGroup>++## Setting Up API Keys++Before using Google ADK with AgentOps, you need to set up your API keys. You can obtain:+- **GOOGLE_API_KEY**: From the [Google AI Studio](https://aistudio.google.com/app/apikey)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++Then to set them up, you can either export them as environment variables or set them in a `.env` file.++<CodeGroup>+```bash Export to CLI+export GOOGLE_API_KEY="your_google_api_key_here"+export AGENTOPS_API_KEY="your_agentops_api_key_here"+```+```txt Set in .env file+GOOGLE_API_KEY="your_google_api_key_here"+AGENTOPS_API_KEY="your_agentops_api_key_here"+```+</CodeGroup>++Then load the environment variables in your Python code:++```python+from dotenv import load_dotenv+import os- <CodeGroup>- ```bash pip- pip install agentops google-adk- ```- ```bash poetry- poetry add agentops google-adk- ```- </CodeGroup>+# Load environment variables from .env file+load_dotenv()++# Set up environment variables with fallback values+os.environ["GOOGLE_API_KEY"] = os.getenv("GOOGLE_API_KEY")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")+```## UsageInitialize AgentOps at the beginning of your application to automatically track all Google ADK agent interactions:- <CodeGroup>-```python Usage-# --- Full example code demonstrating LlmAgent with Tools vs. Output Schema ----import json # Needed for pretty printing dicts+```python+import asyncio+import json+from pydantic import BaseModel, Field+import agentopsfrom google.adk.agents import LlmAgentfrom google.adk.runners import Runnerfrom google.adk.sessions import InMemorySessionServicefrom google.genai import types-from pydantic import BaseModel, Field-import asyncio-import agentops-agentops.init("your-api-key")+agentops.init()# --- 1. Define Constants ---APP_NAME = "agent_comparison_app"@@ -164,41 +193,30 @@ async def call_agent_and_print(# --- 7. Run Interactions ---async def main():- # Create sessions+# Create sessionsawait session_service.create_session(app_name=APP_NAME, user_id=USER_ID, session_id=SESSION_ID_TOOL_AGENT)await session_service.create_session(app_name=APP_NAME, user_id=USER_ID, session_id=SESSION_ID_SCHEMA_AGENT)print("--- Testing Agent with Tool ---")await call_agent_and_print(capital_runner, capital_agent_with_tool, SESSION_ID_TOOL_AGENT, '{"country": "France"}')- await call_agent_and_print(capital_runner, capital_agent_with_tool, SESSION_ID_TOOL_AGENT, '{"country": "Canada"}')print("\n\n--- Testing Agent with Output Schema (No Tool Use) ---")- await call_agent_and_print(structured_runner, structured_info_agent_schema, SESSION_ID_SCHEMA_AGENT, '{"country": "France"}')await call_agent_and_print(structured_runner, structured_info_agent_schema, SESSION_ID_SCHEMA_AGENT, '{"country": "Japan"}')asyncio.run(main())- ```- </CodeGroup>--## Environment Variables--<EnvTooltip />-<CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- GOOGLE_API_KEY=<YOUR GOOGLE API KEY>- ```-</CodeGroup>+```-Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)+## Examples-## Additional Resources+<CardGroup cols={2}>+ <Card title="Human Approval Example" icon="notebook" href="/v2/examples/google_adk" newTab={true}>+ Implement human-in-the-loop approval workflows with Google ADK agents+ </Card>+</CardGroup>-- [Google ADK Documentation](https://google.github.io/adk-docs/)-- [Google ADK GitHub Repository](https://github.com/google/adk-docs)-- [Google ADK Quickstart Guide](https://google.github.io/adk-docs/get-started/quickstart/)+Visit your [AgentOps Dashboard](https://app.agentops.ai) to see detailed traces of your Google ADK agent interactions, tool usage, and session management.<script type="module" src="/scripts/github_stars.js"></script><script type="module" src="/scripts/scroll-img-fadein-animation.js"></script><script type="module" src="/scripts/button_heartbeat_animation.js"></script>-<script type="css" src="/styles/styles.css"></script>\ No newline at end of file+<script type="css" src="/styles/styles.css"></script>diff --git a/docs/v2/integrations/google_generative_ai.mdx b/docs/v2/integrations/google_generative_ai.mdxnew file mode 100644index 00000000..c27686af--- /dev/null+++ b/docs/v2/integrations/google_generative_ai.mdx@@ -0,0 +1,114 @@+---+title: Google Generative AI+description: "Monitor and analyze your Google Gemini API calls with AgentOps"+---++AgentOps provides seamless integration with [Google's Generative AI API](https://ai.google.dev/), allowing you to monitor and analyze all your Gemini model interactions automatically.++## Installation++<CodeGroup>+ ```bash pip+ pip install agentops google-genai+ ```+ ```bash poetry+ poetry add agentops google-genai+ ```+ ```bash uv+ uv add agentops google-genai+ ```+</CodeGroup>++## Setting Up API Keys++Before using Google Gemini with AgentOps, you need to set up your API keys. You can obtain:+- **GOOGLE_API_KEY**: From the [Google AI Studio](https://aistudio.google.com/app/apikey)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++Then to set them up, you can either export them as environment variables or set them in a `.env` file.++<CodeGroup>+```bash Export to CLI+export GOOGLE_API_KEY="your_google_api_key_here"+export AGENTOPS_API_KEY="your_agentops_api_key_here"+```+```txt Set in .env file+GOOGLE_API_KEY="your_google_api_key_here"+AGENTOPS_API_KEY="your_agentops_api_key_here"+```+</CodeGroup>++Then load the environment variables in your Python code:++```python+from dotenv import load_dotenv+import os++# Load environment variables from .env file+load_dotenv()++# Set up environment variables with fallback values+os.environ["GOOGLE_API_KEY"] = os.getenv("GOOGLE_API_KEY")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")+```++## Usage++Initialize AgentOps at the beginning of your application to automatically track all Gemini API calls.++<CodeGroup>+```python Streaming+import agentops+from google import genai++# Initialize AgentOps+agentops.init()++# Create a client+client = genai.Client(api_key="YOUR_GEMINI_API_KEY")++# Generate streaming content+for chunk in client.models.generate_content_stream(+ model='gemini-2.0-flash-001',+ contents='Explain quantum computing in simple terms.',+):+ print(chunk.text, end="", flush=True)+```++```python Simple Chat+import agentops+from google import genai++# Initialize AgentOps+agentops.init()++# Create a client+client = genai.Client(api_key="YOUR_GEMINI_API_KEY")++# Start a chat session+chat = client.chats.create(model='gemini-2.0-flash-001')++# Send messages and get responses+response = chat.send_message('Hello, how can you help me with AI development?')+print(response.text)++# Continue the conversation+response = chat.send_message('What are the best practices for prompt engineering?')+print(response.text)+```+</CodeGroup>++## Examples++<CardGroup cols={2}>+ <Card title="Gemini Quickstart Notebook" icon="notebook" href="/v2/examples/google_generative_ai">+ Basic Gemini usage with AgentOps+ </Card>+</CardGroup>++For more information on using the Google Gen AI SDK, refer to the [official documentation](https://googleapis.github.io/python-genai/).++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="css" src="/styles/styles.css"></script>diff --git a/docs/v2/integrations/ibm_watsonx_ai.mdx b/docs/v2/integrations/ibm_watsonx_ai.mdxindex 656c5e05..04ce1687 100644--- a/docs/v2/integrations/ibm_watsonx_ai.mdx+++ b/docs/v2/integrations/ibm_watsonx_ai.mdx@@ -3,45 +3,83 @@ title: IBM Watsonx.aidescription: "Track and analyze your IBM Watsonx.ai API calls with AgentOps"----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'-AgentOps provides seamless integration with [IBM Watsonx.ai Python SDK](https://ibm.github.io/watsonx-ai-python-sdk/), allowing you to track and analyze all your Watsonx.ai model interactions automatically.## Installation-<CodeTooltip />-- <CodeGroup>- ```bash pip- pip install agentops ibm-watsonx-ai- ```- ```bash poetry- poetry add agentops ibm-watsonx-ai- ```- </CodeGroup>--## Basic Usage+<CodeGroup>+```bash pip+pip install agentops ibm-watsonx-ai+```+```bash poetry+poetry add agentops ibm-watsonx-ai+```+```bash uv+uv add agentops ibm-watsonx-ai+```+</CodeGroup>++## Setting Up API Keys++Before using IBM Watsonx.ai with AgentOps, you need to set up your API keys. You can obtain:+- **IBM_WATSONX_API_KEY**: From your [IBM Cloud account](https://cloud.ibm.com/)+- **IBM_WATSONX_URL**: The URL for your Watsonx.ai instance, typically found in your IBM Cloud dashboard.+- **IBM_WATSONX_PROJECT_ID**: The project ID for your Watsonx.ai project, which you can find in the Watsonx.ai console.+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++Then to set them up, you can either export them as environment variables or set them in a `.env` file.++<CodeGroup>+```bash Export to CLI+export IBM_WATSONX_API_KEY="your_ibm_api_key_here"+export IBM_WATSONX_URL="your_ibm_url_here"+export IBM_WATSONX_PROJECT_ID="your_project_id_here"+export AGENTOPS_API_KEY="your_agentops_api_key_here"+```+```txt Set in .env file+IBM_WATSONX_API_KEY="your_ibm_api_key_here"+IBM_WATSONX_URL="your_ibm_url_here"+IBM_WATSONX_PROJECT_ID="your_project_id_here"+AGENTOPS_API_KEY="your_agentops_api_key_here"+```+</CodeGroup>++Then load the environment variables in your Python code:++```python+from dotenv import load_dotenv+import os++# Load environment variables from .env file+load_dotenv()++# Set up environment variables with fallback values+os.environ["IBM_WATSONX_API_KEY"] = os.getenv("IBM_WATSONX_API_KEY")+os.environ["IBM_WATSONX_URL"] = os.getenv("IBM_WATSONX_URL")+os.environ["IBM_WATSONX_PROJECT_ID"] = os.getenv("IBM_WATSONX_PROJECT_ID")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")+```++## UsageInitialize AgentOps at the beginning of your application to automatically track all IBM Watsonx.ai API calls:- <CodeGroup>-```python Basic Usage+```pythonimport agentopsfrom ibm_watsonx_ai import Credentialsfrom ibm_watsonx_ai.foundation_models import ModelInference# Initialize AgentOps-agentops.init(api_key="<INSERT YOUR API KEY HERE>")+agentops.init(api_key="")# Initialize credentialscredentials = Credentials(- url="<YOUR_IBM_URL>",- api_key="<YOUR_IBM_API_KEY>",+ url=os.getenv("IBM_WATSONX_URL"),+ api_key=os.getenv("IBM_WATSONX_API_KEY"),)# Project ID-project_id = "<YOUR_PROJECT_ID>"+project_id = os.getenv("IBM_WATSONX_PROJECT_ID")# Create a model instancemodel = ModelInference(@@ -50,241 +88,26 @@ model = ModelInference(project_id=project_id)-# Make a completion request - AgentOps will track it automatically+# Make a completion requestresponse = model.generate_text("What is artificial intelligence?")print(f"Generated Text:\n{response}")# Don't forget to close connection when donemodel.close_persistent_connection()- ```- </CodeGroup>--## Chat Completion Example--Using the Watsonx.ai SDK for chat-based interactions:-- <CodeGroup>-```python Chat Example-import agentops-from ibm_watsonx_ai import Credentials-from ibm_watsonx_ai.foundation_models import ModelInference--# Initialize AgentOps-agentops.init(api_key="<INSERT YOUR API KEY HERE>")--# Initialize credentials-credentials = Credentials(- url="<YOUR_IBM_URL>",- api_key="<YOUR_IBM_API_KEY>",-)--# Project ID-project_id = "<YOUR_PROJECT_ID>"--# Create model for chat-chat_model = ModelInference(- model_id="meta-llama/llama-3-3-70b-instruct",- credentials=credentials,- project_id=project_id-)--# Format messages for chat method-messages = [- {"role": "system", "content": "You are a helpful AI assistant."},- {"role": "user", "content": "What are the three laws of robotics?"}-]--# Get chat response-chat_response = chat_model.chat(messages)-print(f"Chat Response:\n{chat_response['choices'][0]['message']['content']}")--# Close connection-chat_model.close_persistent_connection()- ```- </CodeGroup>--## Advanced Examples--### Streaming Example--AgentOps automatically tracks streaming completions:-- <CodeGroup>-```python Streaming Example-import agentops-from ibm_watsonx_ai import Credentials-from ibm_watsonx_ai.foundation_models import ModelInference--# Initialize AgentOps-agentops.init(api_key="<INSERT YOUR API KEY HERE>")--# Initialize credentials-credentials = Credentials(- url="<YOUR_IBM_URL>",- api_key="<YOUR_IBM_API_KEY>",-)--project_id = "<YOUR_PROJECT_ID>"--# Create model for streaming-model = ModelInference(- model_id="google/flan-ul2",- credentials=credentials,- project_id=project_id-)--# Text streaming-stream_response = model.generate_text_stream(- prompt="Write a short poem about artificial intelligence."-)--print("Streaming Response:")-for chunk in stream_response:- if isinstance(chunk, str):- print(chunk, end="", flush=True)--# Close connection-model.close_persistent_connection()- ```- </CodeGroup>--### Chat Streaming Example--Stream responses from chat-based models:-- <CodeGroup>-```python Chat Streaming-import agentops-from ibm_watsonx_ai import Credentials-from ibm_watsonx_ai.foundation_models import ModelInference--# Initialize AgentOps-agentops.init(api_key="<INSERT YOUR API KEY HERE>")--# Initialize credentials-credentials = Credentials(- url="<YOUR_IBM_URL>",- api_key="<YOUR_IBM_API_KEY>",-)--project_id = "<YOUR_PROJECT_ID>"--# Create model for chat streaming-chat_model = ModelInference(- model_id="meta-llama/llama-3-3-70b-instruct",- credentials=credentials,- project_id=project_id-)--# Format messages for chat method-chat_messages = [- {"role": "system", "content": "You are a concise assistant."},- {"role": "user", "content": "Explain the concept of photosynthesis in one sentence."}-]--# Get streaming chat response-chat_stream = chat_model.chat_stream(messages=chat_messages)--print("Chat Stream Response:")-for chunk in chat_stream:- if chunk and 'choices' in chunk and chunk['choices']:- delta = chunk['choices'][0].get('delta', {})- content = delta.get('content')- if content:- print(content, end="", flush=True)--# Close connection-chat_model.close_persistent_connection()- ```- </CodeGroup>--### With Parameters Example--Using the Watsonx.ai SDK with specific generation parameters:-- <CodeGroup>-```python With Parameters-import agentops-from ibm_watsonx_ai import Credentials-from ibm_watsonx_ai.foundation_models import ModelInference-from ibm_watsonx_ai.foundation_models.schema import TextGenParameters--# Initialize AgentOps-agentops.init(api_key="<INSERT YOUR API KEY HERE>")--# Initialize credentials-credentials = Credentials(- url="<YOUR_IBM_URL>",- api_key="<YOUR_IBM_API_KEY>",-)--project_id = "<YOUR_PROJECT_ID>"--# Create model with parameters-model = ModelInference(- model_id="google/flan-ul2",- credentials=credentials,- project_id=project_id,- params=TextGenParameters(- decoding_method="sample",- max_new_tokens=100,- min_new_tokens=10,- temperature=0.7,- top_p=0.9,- top_k=50,- repetition_penalty=1.2,- random_seed=42- )-)--# Generate text-response = model.generate_text("Explain quantum computing in simple terms.")-print(f"Response:\n{response}")--# Close connection-model.close_persistent_connection()- ```- </CodeGroup>--### Tokenization Example--Tokenize text with the Watsonx.ai SDK:-- <CodeGroup>-```python Tokenization-import agentops-from ibm_watsonx_ai import Credentials-from ibm_watsonx_ai.foundation_models import ModelInference--# Initialize AgentOps-agentops.init(api_key="<INSERT YOUR API KEY HERE>")--# Initialize credentials-credentials = Credentials(- url="<YOUR_IBM_URL>",- api_key="<YOUR_IBM_API_KEY>",-)--project_id = "<YOUR_PROJECT_ID>"--# Create model-model = ModelInference(- model_id="google/flan-ul2",- credentials=credentials,- project_id=project_id-)--# Tokenize text-text_to_tokenize = "Hello, how are you today?"-tokens = model.tokenize(text_to_tokenize)-print(f"Tokenization Result:\n{tokens}")--# Close connection-model.close_persistent_connection()- ```- </CodeGroup>--Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)+```++## Examples+<CardGroup cols={2}>+ <Card title="Watsonx Text Chat" icon="notebook" href="/v2/examples/watsonx">+ Basic text generation and chat+ </Card>+ <Card title="Watsonx Streaming" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/watsonx/watsonx-streaming.ipynb" newTab={true}>+ Demonstrates streaming responses with Watsonx.ai.+ </Card>+ <Card title="Watsonx Tokenization" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/watsonx/watsonx-tokeniation-model.ipynb" newTab={true}>+ Example of text tokenization with Watsonx.ai models.+ </Card>+</CardGroup>## Additional Resources@@ -294,4 +117,4 @@ Read more about environment variables in [Advanced Configuration](/v2/usage/adva<script type="module" src="/scripts/github_stars.js"></script><script type="module" src="/scripts/scroll-img-fadein-animation.js"></script><script type="module" src="/scripts/button_heartbeat_animation.js"></script>-<script type="css" src="/styles/styles.css"></script>\ No newline at end of file+<script type="css" src="/styles/styles.css"></script>diff --git a/docs/v2/integrations/ionet.mdx b/docs/v2/integrations/ionet.mdxindex 0a86aea3..5af7af3c 100644--- a/docs/v2/integrations/ionet.mdx+++ b/docs/v2/integrations/ionet.mdx@@ -3,14 +3,11 @@ title: IO Intelligencedescription: "Track and analyze your IO Intelligence API calls with AgentOps"----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'-AgentOps seamlessly integrates with IO Intelligence's OpenAI‑compatible API, allowing you to track and analyze every request without changing your workflow.## Installation-<CodeTooltip />+<CodeGroup>```bash pip@@ -181,17 +178,6 @@ print(follow_up.choices[0].message.content)```</CodeGroup>-## Environment Variables--<EnvTooltip />-<CodeGroup>-```python .env-AGENTOPS_API_KEY=<YOUR_AGENTOPS_API_KEY>-IO_INTELLIGENCE_API_KEY=<YOUR_IO_INTELLIGENCE_API_KEY>-```-</CodeGroup>--Read more about configuration and best practices in [Advanced Configuration](/v2/usage/advanced-configuration).<script type="module" src="/scripts/github_stars.js"></script><script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>diff --git a/docs/v2/integrations/langchain.mdx b/docs/v2/integrations/langchain.mdxindex 57d10816..6b28343a 100644--- a/docs/v2/integrations/langchain.mdx+++ b/docs/v2/integrations/langchain.mdx@@ -3,111 +3,118 @@ title: LangChaindescription: "Track your LangChain agents with AgentOps"----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'--[LangChain](https://python.langchain.com/docs/tutorials/) is a framework for developing applications powered by language models. AgentOps automatically tracks your LangChain agents by simply initializing the SDK at the beginning of your application.--## Adding AgentOps to LangChain applications--<Steps>- <Step title="Install the AgentOps SDK and the additional LangChain dependencies">- <CodeGroup>- ```bash pip- pip install agentops langchain langchain-community- ```- ```bash poetry- poetry add agentops langchain langchain-community- ```- </CodeGroup>- <Check>[Give us a star](https://github.com/AgentOps-AI/agentops) on GitHub while you're at it (you may be our <span id="stars-text">3,000th</span> 😊)</Check>- </Step>- <Step title="Set up your import statements">- Import the following LangChain and AgentOps dependencies- <CodeGroup>- ```python python- import os- from langchain_community.chat_models import ChatOpenAI- from langchain.agents import initialize_agent, AgentType- from langchain.tools import DuckDuckGoSearchRun- from agentops.integration.callbacks.langchain import LangchainCallbackHandler- ```- </CodeGroup>- </Step>- <Step title="Set up your LangChain handler to make the calls">- <Tip>- Note that you don't need to set up a separate agentops.init() call, as the LangChain callback handler will automatically initialize the AgentOps client for you.- </Tip>- Set up your LangChain agent with the AgentOps callback handler, and AgentOps will automatically record your LangChain sessions.- <CodeGroup>- ```python python- handler = LangchainCallbackHandler(api_key=AGENTOPS_API_KEY, tags=['LangChain Example'])-- # Define tools for the agent- search_tool = DuckDuckGoSearchRun()- tools = [search_tool]-- llm = ChatOpenAI(openai_api_key=OPENAI_API_KEY,- callbacks=[handler],- model='gpt-3.5-turbo')-- agent = initialize_agent(tools,- llm,- agent=AgentType.CHAT_ZERO_SHOT_REACT_DESCRIPTION,- verbose=True,- callbacks=[handler], # You must pass in a callback handler to record your agent- handle_parsing_errors=True)- ```- </CodeGroup>- <EnvTooltip />- <CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- ```- </CodeGroup>- Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)- </Step>- <Step title="Run your agent">- Execute your program and visit [app.agentops.ai/traces](https://app.agentops.ai/traces) to observe your LangChain Agent! 🕵️- <Tip>- After your run, AgentOps prints a clickable URL to the console linking directly to your session in the Dashboard- </Tip>- <div/>{/* Intentionally blank div for newline */}- <Frame type="glass" caption="Clickable link to session">- <img height="200" src="https://github.com/AgentOps-AI/agentops/blob/main/docs/images/link-to-session.gif?raw=true" />- </Frame>- </Step>-</Steps>--## Full Examples+[LangChain](https://python.langchain.com/docs/tutorials/) is a framework for developing applications powered by language models. AgentOps automatically tracks your LangChain agents by integrating its callback handler.++## Installation++Install AgentOps and the necessary LangChain dependencies:++<CodeGroup>+ ```bash pip+ pip install agentops langchain langchain-community langchain-openai python-dotenv+ ```+ ```bash poetry+ poetry add agentops langchain langchain-community langchain-openai python-dotenv+ ```+ ```bash uv+ uv add agentops langchain langchain-community langchain-openai python-dotenv+ ```+</CodeGroup>++## Setting Up API Keys++You'll need API keys for AgentOps and OpenAI (as `ChatOpenAI` is commonly used with LangChain):+- **OPENAI_API_KEY**: From the [OpenAI Platform](https://platform.openai.com/api-keys)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++Set these as environment variables or in a `.env` file.<CodeGroup>- ```python python- import os- from langchain_community.chat_models import ChatOpenAI- from langchain.agents import initialize_agent, AgentType- from langchain.tools import DuckDuckGoSearchRun- from agentops.integration.callbacks.langchain import LangchainCallbackHandler-- handler = LangchainCallbackHandler(api_key=AGENTOPS_API_KEY, tags=['LangChain Example'])-- # Define tools for the agent- search_tool = DuckDuckGoSearchRun()- tools = [search_tool]-- llm = ChatOpenAI(openai_api_key=OPENAI_API_KEY,- callbacks=[handler],- model='gpt-3.5-turbo')-- agent = initialize_agent(tools,- llm,- agent=AgentType.CHAT_ZERO_SHOT_REACT_DESCRIPTION,- verbose=True,- callbacks=[handler], # You must pass in a callback handler to record your agent- handle_parsing_errors=True)- ```+ ```bash Export to CLI+ export OPENAI_API_KEY="your_openai_api_key_here"+ export AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+ ```txt Set in .env file+ OPENAI_API_KEY="your_openai_api_key_here"+ AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```</CodeGroup>+Then load them in your Python code:+```python+from dotenv import load_dotenv+import os++load_dotenv()++AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY")+OPENAI_API_KEY = os.getenv("OPENAI_API_KEY")+```++## Usage++Integrating AgentOps with LangChain involves using the `LangchainCallbackHandler`.+<Tip>+You don't need a separate `agentops.init()` call; the `LangchainCallbackHandler` initializes the AgentOps client automatically if an API key is provided to it or found in the environment.+</Tip>++Here's a basic example:++```python+from langchain_community.chat_models import ChatOpenAI+from langchain.agents import initialize_agent, AgentType, Tool # Corrected Tool import+from langchain.tools import DuckDuckGoSearchRun # Example tool+from agentops.integration.callbacks.langchain import LangchainCallbackHandler+++# 1. Initialize LangchainCallbackHandler+# AGENTOPS_API_KEY can be passed here or loaded from environment+handler = LangchainCallbackHandler(api_key=AGENTOPS_API_KEY, tags=['LangChain Example'])++# 2. Define tools for the agent+search_tool = DuckDuckGoSearchRun()+tools = [+ Tool( # Wrap DuckDuckGoSearchRun in a Tool object+ name="DuckDuckGo Search",+ func=search_tool.run,+ description="Useful for when you need to answer questions about current events or the current state of the world."+ )+]++# 3. Configure LLM with the AgentOps handler+# OPENAI_API_KEY can be passed here or loaded from environment+llm = ChatOpenAI(openai_api_key=OPENAI_API_KEY,+ callbacks=[handler],+ model='gpt-3.5-turbo',+ temperature=0) # Added temperature for reproducibility++# 4. Initialize your agent, passing the handler to callbacks+agent = initialize_agent(+ tools,+ llm,+ agent=AgentType.CHAT_ZERO_SHOT_REACT_DESCRIPTION,+ verbose=True,+ callbacks=[handler],+ handle_parsing_errors=True+)++# 5. Run your agent+try:+ response = agent.run("Who is the current CEO of OpenAI and what is his most recent public statement?")+ print(response)+except Exception as e:+ print(f"An error occurred: {e}")+```++Visit the [AgentOps Dashboard](https://app.agentops.ai/) to see your session.++## Examples+<CardGroup cols={1}>+ <Card title="LangChain Example" icon="notebook" href="/v2/examples/langchain">+ A detailed notebook demonstrating the LangChain callback handler integration.+ </Card>+</CardGroup>+<script type="module" src="/scripts/github_stars.js"></script><script type="module" src="/scripts/scroll-img-fadein-animation.js"></script><script type="module" src="/scripts/button_heartbeat_animation.js"></script>diff --git a/docs/v2/integrations/litellm.mdx b/docs/v2/integrations/litellm.mdxindex 6cd83e40..a03deeff 100644--- a/docs/v2/integrations/litellm.mdx+++ b/docs/v2/integrations/litellm.mdx@@ -3,40 +3,65 @@ title: LiteLLMdescription: "Track and analyze your LiteLLM calls across multiple providers with AgentOps"----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'-AgentOps provides seamless integration with [LiteLLM](https://github.com/BerriAI/litellm), allowing you to automatically track all your LLM API calls across different providers through a unified interface.## Installation<CodeGroup>- ```bash pip- pip install agentops litellm- ```- ```bash poetry- poetry add agentops litellm- ```+```bash pip+pip install agentops litellm+```+```bash poetry+poetry add agentops litellm+```+```bash uv+uv add agentops litellm+```</CodeGroup>-## Usage+## Setting Up API Keys++Before using LiteLLM with AgentOps, you need to set up your API keys. You can obtain:+- **Provider API Keys**: From your chosen LLM provider (OpenAI, Anthropic, Google, etc.)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)-The simplest way to integrate AgentOps with LiteLLM is to set up the success_callback:+Then to set them up, you can either export them as environment variables or set them in a `.env` file.<CodeGroup>-```python Simple Integration-import os+```bash Export to CLI+export OPENAI_API_KEY="your_openai_api_key_here"+export ANTHROPIC_API_KEY="your_anthropic_api_key_here"+export AGENTOPS_API_KEY="your_agentops_api_key_here"+```+```txt Set in .env file+OPENAI_API_KEY="your_openai_api_key_here"+ANTHROPIC_API_KEY="your_anthropic_api_key_here"+AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+</CodeGroup>++Then load the environment variables in your Python code:++```pythonfrom dotenv import load_dotenv-import litellm-from litellm import completion+import os-# Load environment variables+# Load environment variables from .env fileload_dotenv()-# Set API keys for different providers+# Set up environment variables with fallback valuesos.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY")os.environ["ANTHROPIC_API_KEY"] = os.getenv("ANTHROPIC_API_KEY")os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")+```++## Usage++The simplest way to integrate AgentOps with LiteLLM is to set up the success_callback.++```python+import litellm+from litellm import completion# Configure LiteLLM to use AgentOpslitellm.success_callback = ["agentops"]@@ -48,27 +73,15 @@ response = completion()print(response.choices[0].message.content)--# All LiteLLM API calls are automatically tracked by AgentOps```-</CodeGroup>-## Streaming Example--AgentOps also tracks streaming requests with LiteLLM:+## Examples<CodeGroup>```python Streaming-import os-from dotenv import load_dotenvimport litellmfrom litellm import completion-# Load environment variables and set API keys-load_dotenv()-os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY")-os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")-# Configure LiteLLM to use AgentOpslitellm.success_callback = ["agentops"]@@ -85,25 +98,11 @@ for chunk in response:print(chunk.choices[0].delta.content, end="", flush=True)print() # Add a newline at the end```-</CodeGroup>--## Multi-Provider Example-One of LiteLLM's key features is the ability to switch between providers easily:--<CodeGroup>```python Multi-Provider-import os-from dotenv import load_dotenvimport litellmfrom litellm import completion-# Load environment variables and set API keys-load_dotenv()-os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY")-os.environ["ANTHROPIC_API_KEY"] = os.getenv("ANTHROPIC_API_KEY")-os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")-# Configure LiteLLM to use AgentOpslitellm.success_callback = ["agentops"]@@ -127,21 +126,11 @@ print("Anthropic Response:", anthropic_response.choices[0].message.content)```</CodeGroup>-## Environment Variables--<EnvTooltip />-<CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- OPENAI_API_KEY=<YOUR OPENAI API KEY>- ANTHROPIC_API_KEY=<YOUR ANTHROPIC API KEY>- # Add any other provider API keys you need- ```-</CodeGroup>--Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)-## Additional Resources+## More Examples+<CardGroup cols={2}>+ <Card title="LiteLLM Quickstart Notebook" icon="notebook" href="/v2/examples/litellm" />+</CardGroup>For more information on integrating AgentOps with LiteLLM, refer to the [LiteLLM documentation on AgentOps integration](https://docs.litellm.ai/docs/observability/agentops_integration).diff --git a/docs/v2/integrations/openai.mdx b/docs/v2/integrations/openai.mdxindex b5962a7d..acd4c11f 100644--- a/docs/v2/integrations/openai.mdx+++ b/docs/v2/integrations/openai.mdx@@ -3,38 +3,68 @@ title: OpenAIdescription: "Track and analyze your OpenAI API calls with AgentOps"----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'-AgentOps seamlessly integrates with [OpenAI's Python SDK](https://github.com/openai/openai-python), allowing you to track and analyze all your OpenAI API calls automatically.## Installation-<CodeTooltip />+<CodeGroup>+```bash pip+pip install agentops openai+```+```bash poetry+poetry add agentops openai+```+```bash uv+uv add agentops openai+```+</CodeGroup>++## Setting Up API Keys++Before using OpenAI with AgentOps, you need to set up your API keys. You can obtain:+- **OPENAI_API_KEY**: From the [OpenAI Platform](https://platform.openai.com/api-keys)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)- <CodeGroup>- ```bash pip- pip install agentops openai- ```- ```bash poetry- poetry add agentops openai- ```- </CodeGroup>+Then to set them up, you can either export them as environment variables or set them in a `.env` file.++<CodeGroup>+```bash Export to CLI+export OPENAI_API_KEY="your_openai_api_key_here"+export AGENTOPS_API_KEY="your_agentops_api_key_here"+```+```txt Set in .env file+OPENAI_API_KEY="your_openai_api_key_here"+AGENTOPS_API_KEY="your_agentops_api_key_here"+```+</CodeGroup>++Then load the environment variables in your Python code:++```python+from dotenv import load_dotenv+import os++# Load environment variables from .env file+load_dotenv()++# Set up environment variables with fallback values+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")+```## UsageInitialize AgentOps at the beginning of your application to automatically track all OpenAI API calls:- <CodeGroup>-```python Basic Usage- import agentops- from openai import OpenAI+```python+import agentops+from openai import OpenAI# Initialize AgentOps- agentops.init(<INSERT YOUR API KEY HERE>)+agentops.init()# Create OpenAI client-client = OpenAI(api_key="<YOUR_OPENAI_API_KEY>")+client = OpenAI()# Make API calls as usual - AgentOps will track them automaticallyresponse = client.chat.completions.create(@@ -46,29 +76,24 @@ response = client.chat.completions.create()print(response.choices[0].message.content)- ```- </CodeGroup>--## Advanced Examples--### Streaming Completions+```-AgentOps automatically tracks streaming completions:+## Examples<CodeGroup>-```python Streaming Example+```python Streamingimport agentops- from openai import OpenAI+from openai import OpenAI# Initialize AgentOps- agentops.init(<INSERT YOUR API KEY HERE>)+agentops.init()# Create OpenAI client- client = OpenAI()+client = OpenAI()# Make a streaming API callstream = client.chat.completions.create(- model="gpt-4",+ model="gpt-4o-mini",messages=[{"role": "system", "content": "You are a helpful assistant."},{"role": "user", "content": "Write a short poem about AI."}@@ -80,21 +105,15 @@ stream = client.chat.completions.create(for chunk in stream:if chunk.choices[0].delta.content is not None:print(chunk.choices[0].delta.content, end="")- ```-</CodeGroup>--### Function Calling--AgentOps tracks function-calling conversations with OpenAI models:+```-<CodeGroup>```python Function Calling-import agentopsimport json+import agentopsfrom openai import OpenAI# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)+agentops.init()# Create OpenAI clientclient = OpenAI()@@ -172,17 +191,22 @@ else:```</CodeGroup>-## Environment Variables--<EnvTooltip />-<CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- OPENAI_API_KEY=<YOUR OPENAI API KEY>- ```-</CodeGroup>+## More Examples+<CardGroup cols={2}>+ <Card title="Multi-Tool Orchestration" icon="notebook" href="/v2/examples/openai">+ Advanced multi-tool RAG example+ </Card>+ <Card title="Async OpenAI Example" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/openai/openai_example_async.ipynb" newTab={true}>+ Demonstrates asynchronous calls with the OpenAI SDK.+ </Card>+ <Card title="Sync OpenAI Example" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/openai/openai_example_sync.ipynb" newTab={true}>+ Shows synchronous calls with the OpenAI SDK.+ </Card>+ <Card title="Web Search Example" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/openai/web_search.ipynb" newTab={true}>+ Example of integrating web search capabilities.+ </Card>+</CardGroup>-Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)<script type="module" src="/scripts/github_stars.js"></script><script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>diff --git a/docs/v2/integrations/openai_assistants.mdx b/docs/v2/integrations/openai_assistants.mdxdeleted file mode 100644index 9b21a3d4..00000000--- a/docs/v2/integrations/openai_assistants.mdx+++ /dev/null@@ -1,173 +0,0 @@-----title: OpenAI Assistants-description: "Track and analyze your OpenAI Assistants API calls with AgentOps"------import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'--AgentOps provides seamless integration with [OpenAI's Assistants API](https://platform.openai.com/docs/assistants/overview), allowing you to track and analyze all your Assistants interactions automatically.--## Installation--<CodeTooltip />--<CodeGroup>- ```bash pip- pip install agentops openai- ```- ```bash poetry- poetry add agentops openai- ```-</CodeGroup>--## Usage--Initialize AgentOps at the beginning of your application to automatically track all Assistants API calls:--<CodeGroup>-```python Python-import agentops-from openai import OpenAI--# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)--# Create OpenAI client-client = OpenAI()--# Create an Assistant-assistant = client.beta.assistants.create(- name="Math Tutor",- instructions="You are a personal math tutor. Write and run code to answer math questions.",- tools=[{"type": "code_interpreter"}],- model="gpt-4-turbo"-)--# Create a Thread-thread = client.beta.threads.create()--# Add a Message to the Thread-message = client.beta.threads.messages.create(- thread_id=thread.id,- role="user",- content="I need to solve the equation 3x + 11 = 14. Can you help me?"-)--# Run the Assistant-run = client.beta.threads.runs.create(- thread_id=thread.id,- assistant_id=assistant.id-)--# Wait for the Run to complete-from time import sleep-while run.status in ["queued", "in_progress"]:- sleep(1)- run = client.beta.threads.runs.retrieve(- thread_id=thread.id,- run_id=run.id- )--# Get the Assistant's messages-messages = client.beta.threads.messages.list(- thread_id=thread.id-)--# Print the last message from the assistant-for message in messages.data:- if message.role == "assistant":- print(message.content[0].text.value)- break--# All Assistants API calls are automatically tracked by AgentOps-```-</CodeGroup>--## File Upload Example--AgentOps tracks file uploads and interactions with the Assistants API:--<CodeGroup>-```python File Upload Example-import agentops-from openai import OpenAI-import os--# Initialize AgentOps-agentops.init(<INSERT YOUR API KEY HERE>)--# Create OpenAI client-client = OpenAI()--# Upload a file-file_path = "data.csv" # Replace with the path to your file-with open(file_path, "rb") as file:- file_object = client.files.create(- file=file,- purpose="assistants"- )--# Create an Assistant with the file-assistant = client.beta.assistants.create(- name="Data Analyst",- instructions="You are a data analysis assistant. Analyze the provided CSV files and answer questions about the data.",- tools=[{"type": "code_interpreter"}],- model="gpt-4-turbo"-)--# Create a Thread with the file-thread = client.beta.threads.create()--# Add a File to the Thread-message = client.beta.threads.messages.create(- thread_id=thread.id,- role="user",- content="Please analyze this CSV file and give me a summary of the data.",- file_ids=[file_object.id]-)--# Run the Assistant-run = client.beta.threads.runs.create(- thread_id=thread.id,- assistant_id=assistant.id-)--# Wait for the Run to complete-from time import sleep-while run.status in ["queued", "in_progress"]:- sleep(2)- run = client.beta.threads.runs.retrieve(- thread_id=thread.id,- run_id=run.id- )--# Get the Assistant's messages-messages = client.beta.threads.messages.list(- thread_id=thread.id-)--# Print the last message from the assistant-for message in messages.data:- if message.role == "assistant":- print(message.content[0].text.value)- break-```-</CodeGroup>--## Environment Variables--<EnvTooltip />-<CodeGroup>- ```python .env- AGENTOPS_API_KEY=<YOUR API KEY>- OPENAI_API_KEY=<YOUR OPENAI API KEY>- ```-</CodeGroup>--Read more about environment variables in [Advanced Configuration](/v2/usage/advanced-configuration)--<script type="module" src="/scripts/github_stars.js"></script>-<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>-<script type="module" src="/scripts/button_heartbeat_animation.js"></script>-<script type="css" src="/styles/styles.css"></script>\ No newline at end of filediff --git a/docs/v2/integrations/xai.mdx b/docs/v2/integrations/xai.mdxnew file mode 100644index 00000000..4711b4a3--- /dev/null+++ b/docs/v2/integrations/xai.mdx@@ -0,0 +1,129 @@+---+title: xAI (Grok)+description: "Track and analyze your xAI Grok API calls with AgentOps"+---++AgentOps can track Grok. Grok is this true?++## Installation++<CodeGroup>+ ```bash pip+ pip install agentops openai+ ```+ ```bash poetry+ poetry add agentops openai+ ``+ ```bash uv+ uv add agentops openai+ ```+</CodeGroup>++## Setting Up API Keys++Before using xAI with AgentOps, you need to set up your API keys. You can obtain:+- **XAI_API_KEY**: From the [xAI Developer Platform](https://console.x.ai/)+- **AGENTOPS_API_KEY**: From your [AgentOps Dashboard](https://app.agentops.ai/)++Then to set them up, you can either export them as environment variables or set them in a `.env` file.++<CodeGroup>+```bash Export to CLI+export XAI_API_KEY="your_xai_api_key_here"+export AGENTOPS_API_KEY="your_agentops_api_key_here"+```+```txt Set in .env file+XAI_API_KEY="your_xai_api_key_here"+AGENTOPS_API_KEY="your_agentops_api_key_here"+```+</CodeGroup>++Then load the environment variables in your Python code:++```python+from dotenv import load_dotenv+import os++# Load environment variables from .env file+load_dotenv()++# Set up environment variables with fallback values+os.environ["XAI_API_KEY"] = os.getenv("XAI_API_KEY")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY")+```++## Usage++Initialize AgentOps at the beginning of your application. Then, use the OpenAI SDK with xAI's base URL to interact with Grok. AgentOps will automatically track all API calls.++<CodeGroup>+```python Simple Chat+import os+import agentops+from openai import OpenAI++# Initialize AgentOps+agentops.init()++# Create OpenAI client configured for xAI+client = OpenAI(+ api_key=os.getenv("XAI_API_KEY"),+ base_url="https://api.x.ai/v1",+)++# Basic chat completion+completion = client.chat.completions.create(+ model="grok-3-latest",+ messages=[+ {"role": "system", "content": "You are a helpful AI assistant."},+ {"role": "user", "content": "Explain the concept of AI observability in simple terms."},+ ],+)++print(completion.choices[0].message.content)+```++```python Streaming Chat+import os+import agentops+from openai import OpenAI++# Initialize AgentOps+agentops.init()++# Create OpenAI client configured for xAI+client = OpenAI(+ api_key=os.getenv("XAI_API_KEY"),+ base_url="https://api.x.ai/v1",+)++# Streaming chat completion+stream = client.chat.completions.create(+ model="grok-3-latest",+ messages=[+ {"role": "system", "content": "You are a helpful AI assistant."},+ {"role": "user", "content": "Tell me about the latest developments in AI."},+ ],+ stream=True,+)++for chunk in stream:+ if chunk.choices[0].delta.content is not None:+ print(chunk.choices[0].delta.content, end="")+```+</CodeGroup>++## Examples+<CardGroup cols={2}>+ <Card title="Grok Simple Example" icon="notebook" href="/v2/examples/xai">+ Basic usage patterns for Grok LLM+ </Card>+ <Card title="Grok Vision Example" icon="notebook" href="https://github.com/AgentOps-AI/agentops/blob/main/examples/xai/grok_vision_examples.ipynb" newTab={true}>+ Demonstrates using Grok with vision capabilities.+ </Card>+</CardGroup>++<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="css" src="/styles/styles.css"></script>diff --git a/docs/v2/introduction.mdx b/docs/v2/introduction.mdxindex f12ba7b8..2a46e7a0 100644--- a/docs/v2/introduction.mdx+++ b/docs/v2/introduction.mdx@@ -1,7 +1,6 @@---title: "Introduction"description: "AgentOps is the developer favorite platform for testing, debugging, and deploying AI agents and LLM apps."-mode: "wide"---<iframewidth="100%"@@ -13,18 +12,28 @@ mode: "wide"></iframe>+## Integrate with developer favorite LLM providers and agent frameworks-## Integrate with developer favorite agent frameworks+### LLM Providers<CardGroup cols={2}>- <Card title="OpenAI Agents SDK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI Agents SDK" />} iconType="image" href="/v2/integrations/agentssdk" />- <Card title="CrewAI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/crew/crew.png?raw=true" alt="CrewAI" />} iconType="image" href="/v2/integrations/crewai" />- <Card title="AG2" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/autogen/ag2.svg?raw=true" alt="Autogen"/>} iconType="image" href="/v2/integrations/ag2" />- <Card title="AutoGen" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/microsoft/microsoft_logo.svg?raw=true" alt="AutoGen" />} iconType="image" href="/v2/integrations/autogen" />- <Card title="OpenAI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI" />} iconType="image" href="/v2/integrations/openai" /><Card title="Anthropic" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/anthropic/anthropic_icon_slate.png?raw=true" alt="Anthropic" />} iconType="image" href="/v2/integrations/anthropic" />- <Card title="LangChain" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/langchain/langchain-logo.svg?raw=true" alt="LangChain" />} iconType="image" href="/v2/integrations/langchain" />+ <Card title="Google Generative AI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/deepmind/gemini-logo.png?raw=true" alt="Gemini" />} iconType="image" href="/v2/integrations/google_generative_ai" />+ <Card title="OpenAI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI" />} iconType="image" href="/v2/integrations/openai" /><Card title="LiteLLM" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/litellm/litellm.png?raw=true" alt="LiteLLM" />} iconType="image" href="/v2/integrations/litellm" />+ <Card title="Watsonx" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/ibm/ibm-logo.svg?raw=true" alt="IBM" />} iconType="image" href="/v2/integrations/ibm_watsonx_ai" />+ <Card title="x.AI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/xai/xai-logo.svg?raw=true" alt="x.AI" />} iconType="image" href="/v2/integrations/xai" />+</CardGroup>++### Agent Frameworks++<CardGroup cols={2}>+ <Card title="AG2" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/ag2/ag2-logo.svg?raw=true" alt="AG2"/>} iconType="image" href="/v2/integrations/ag2" />+ <Card title="AutoGen" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/autogen/autogen-logo.svg?raw=true" alt="AutoGen" />} iconType="image" href="/v2/integrations/autogen" />+ <Card title="CrewAI" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/crewai/crewai-logo.png?raw=true" alt="CrewAI" />} iconType="image" href="/v2/integrations/crewai" />+ <Card title="Google ADK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/google-adk/google-adk-logo.png?raw=true" alt="Google ADK" />} iconType="image" href="/v2/integrations/google_adk" />+ <Card title="LangChain" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/langchain/langchain-logo.svg?raw=true" alt="LangChain" />} iconType="image" href="/v2/integrations/langchain" />+ <Card title="OpenAI Agents SDK" icon={<img src="https://www.github.com/agentops-ai/agentops/blob/main/docs/images/external/openai/openai-logomark.png?raw=true" alt="OpenAI Agents SDK" />} iconType="image" href="/v2/integrations/agents_sdk" /></CardGroup>Observability and monitoring for your AI agents and LLM apps. And we do it all in just two lines of code...diff --git a/docs/v2/quickstart.mdx b/docs/v2/quickstart.mdxindex 86ef56c0..c31b11a3 100644--- a/docs/v2/quickstart.mdx+++ b/docs/v2/quickstart.mdx@@ -1,192 +1,252 @@---title: "Quickstart"-description: "Start using AgentOps with just 2 lines of code"+description: "Get started with AgentOps in minutes with just 2 lines of code for basic monitoring, and explore powerful decorators for custom tracing."----import CodeTooltip from '/snippets/add-code-tooltip.mdx'-import EnvTooltip from '/snippets/add-env-tooltip.mdx'--<Steps>- <Step title="Install the AgentOps SDK">- <CodeGroup>- ```bash pip- pip install agentops- ```- ```bash poetry- poetry add agentops- ```- </CodeGroup>- </Step>- <Step title="Add 2 lines of code">- <CodeTooltip />- Get an AgentOps API key [here](https://app.agentops.ai/settings/projects)- <CodeGroup>- ```python python- import agentops- agentops.init(<INSERT YOUR API KEY HERE>)- ```- </CodeGroup>- That's it! These two lines automatically instrument your code and start tracking traces. Traces automatically end when your program exits.- <EnvTooltip />- </Step>- <Step title="Run your agent">- Execute your program and visit [app.agentops.ai/traces](https://app.agentops.ai/traces) to observe your Agent! 🕵️-- <Tip>After your run, AgentOps prints a clickable URL to console linking directly to your session in the Dashboard</Tip>- <div/>{/* Intentionally blank div for newline */}-- <Frame type="glass" caption="Clickable link to session">- <img height="200" src="https://github.com/AgentOps-AI/agentops/blob/main/docs/images/link-to-session.gif?raw=true" />- </Frame>- </Step>-</Steps>-<Check>[Give us a star](https://github.com/AgentOps-AI/agentops) if you liked AgentOps! (you may be our <span id="stars-text">3,000th</span> 😊)</Check>--## More basic functionality--<CardGroup cols={1}>--<Card icon="code" title="Decorate Operations">- You can instrument functions inside your code with the `@operation` decorator, which will create spans that track function execution, parameters, and return values. These operations will be displayed in your session visualization alongside LLM calls.- ```python python- # Instrument a function as an operation- from agentops.sdk.decorators import operation-- @operation- def process_data(data):- # Your function logic here- result = data.upper()- return result-```-</Card>-<Card icon="robot" title="Track Agents">- If you use specific named agents within your system, you can create agent spans that contain all downstream operations using the `@agent` decorator.- ```python python- # Create an agent class- from agentops.sdk.decorators import agent, operation-- @agent- class MyAgent:- def __init__(self, name):- self.name = name-- @operation- def perform_task(self, task):- # Agent task logic here- return f"Completed {task}"-- def run_agent_task(task_name):- agent = MyAgent("research-agent")- result = agent.perform_task(task_name)- return result-- result = run_agent_task("data analysis")- ```+AgentOps is designed for easy integration into your AI agent projects, providing powerful observability with minimal setup. This guide will get you started quickly.-</Card>-<Card icon="wrench" title="Track Tools">- Track tool usage and costs with the `@tool` decorator. You can specify costs to get total cost tracking directly in your dashboard summary.- ```python python- # Track tool usage with cost- from agentops.sdk.decorators import tool-- @tool(cost=0.05)- def web_search(query):- # Tool logic here- return f"Search results for: {query}"-- @tool- def calculate(expression):- # Tool without cost tracking- return eval(expression)- ```+<Check>[Give us a star on GitHub!](https://github.com/AgentOps-AI/agentops) Your support helps us grow. ⭐</Check>-</Card>-<Card icon="play" title="Creating Traces">- Create custom traces to group operations using the `@trace` decorator, or manage traces manually for more control.- ```python python- # Create a trace with decorator- from agentops.sdk.decorators import trace-- @trace- def my_workflow():- # Your workflow code here- agent = MyAgent("research-agent")- result = agent.perform_task("data analysis")- return result-- # Or manage traces manually- import agentops-- trace = agentops.start_trace("custom-trace")- # Your code here- agentops.end_trace(trace, "Success")+## Installation+First, install the AgentOps SDK. We recommend including `python-dotenv` for easy API key management.+<CodeGroup>+ ```bash pip+ pip install agentops python-dotenv```-</Card>-</CardGroup>+ ```bash poetry+ poetry add agentops python-dotenv+ ```+ ```bash uv+ uv add agentops python-dotenv+ ```+</CodeGroup>+## Initial Setup (2 Lines of Code)-## Example Code+At its simplest, AgentOps can start monitoring your supported LLM and agent framework calls with just two lines of Python code.-Here is the complete code from the sections above+1. **Import AgentOps**: Add `import agentops` to your script.+2. **Initialize AgentOps**: Call `agentops.init()` with your API key.-```python python+<CodeGroup>+```python Pythonimport agentops-from agentops.sdk.decorators import agent, operation, tool, trace+import os+from dotenv import load_dotenv-# Initialize AgentOps without auto-starting session since we use @trace-agentops.init(<INSERT YOUR API KEY HERE>, auto_start_session=False)+# Load environment variables (recommended for API keys)+load_dotenv()-# Create a tool with cost tracking-@tool(cost=0.05)-def web_search(query):- return f"Search results for: {query}"+# Initialize AgentOps+# The API key can be passed directly or set as an environment variable AGENTOPS_API_KEY+AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY")+agentops.init(AGENTOPS_API_KEY)++# That's it for basic auto-instrumentation!+# If you're using a supported library (like OpenAI, LangChain, CrewAI, etc.),+# AgentOps will now automatically track LLM calls and agent actions.+```+</CodeGroup>++### Setting Your AgentOps API Key+You need an AgentOps API key to send data to your dashboard.+- Get your API key from the [AgentOps Dashboard](https://app.agentops.ai/settings/projects).++It's best practice to set your API key as an environment variable.+<CodeGroup>+ ```bash Export to CLI+ export AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+ ```txt Set in .env file+ AGENTOPS_API_KEY="your_agentops_api_key_here"+ ```+</CodeGroup>+If you use a `.env` file, make sure `load_dotenv()` is called before `agentops.init()`.++## Running Your Agent & Viewing Traces++After adding the two lines and ensuring your API key is set up:+1. Run your agent application as you normally would.+2. AgentOps will automatically instrument supported libraries and send trace data.+3. Visit your [AgentOps Dashboard](https://app.agentops.ai/traces) to observe your agent's operations!+++## Beyond Automatic Instrumentation: Decorators++While AgentOps automatically instruments many popular libraries, you can gain finer-grained control and track custom parts of your code using our powerful decorators. This allows you to define specific operations, group logic under named agents, track tool usage with costs, and create custom traces.++### Tracking Custom Operations with `@operation`+Instrument any function in your code to create spans that track its execution, parameters, and return values. These operations will appear in your session visualization alongside LLM calls.+```python+from agentops.sdk.decorators import operation-# Create an agent class-@agent+@operation+def process_data(data):+ # Your function logic here+ processed_result = data.upper()+ # agentops.record(Events("Processed Data", result=processed_result)) # Optional: record specific events+ return processed_result++# Example usage:+# my_data = "example input"+# output = process_data(my_data)+```++### Tracking Agent Logic with `@agent`+If you structure your system with specific named agents (e.g., classes), use the `@agent` decorator on the class and `@operation` on its methods to group all downstream operations under that agent's context.+```python+from agentops.sdk.decorators import agent, operation++@agent(name="MyCustomAgent") # You can provide a name for the agentclass MyAgent:- def __init__(self, name):- self.name = name+ def __init__(self, agent_id):+ self.agent_id = agent_id # agent_id is a reserved parameter for AgentOps@operation- def perform_task(self, task):- # Use a tool within the agent- search_results = web_search(f"research {task}")- return f"Completed {task} with results: {search_results}"--@trace(name="research-workflow", tags=["research", "analysis"])-def run_agent_task(task_name):- agent = MyAgent("research-agent")- result = agent.perform_task(task_name)- return result--result = run_agent_task("data analysis")+ def perform_task(self, task_description):+ # Agent task logic here+ # This could include LLM calls or calls to other @operation decorated functions+ return f"Agent {self.agent_id} completed: {task_description}"++# Example usage:+# research_agent = MyAgent(agent_id="researcher-001")+# result = research_agent.perform_task("Analyze market trends")```-<Card- title="Simple Code Example"- icon="square-code"- href="https://github.com/AgentOps-AI/agentops-py/blob/main/examples/openai-gpt.ipynb"->- Jupyter Notebook with sample code that you can run!-</Card>+### Tracking Tools with `@tool`+Track the usage of specific tools or functions, and optionally associate costs with them. This data will be aggregated in your dashboard.+```python+from agentops.sdk.decorators import tool-<Check>- That's all you need to get started! Check out the documentation below to see how you can record other operations. AgentOps is a lot more powerful this way!-</Check>+@tool(name="WebSearchTool", cost=0.05) # Cost is optional+def web_search(query: str) -> str:+ # Tool logic here+ return f"Search results for: {query}"++@tool # No cost specified+def calculator(expression: str) -> str:+ try:+ return str(eval(expression))+ except Exception as e:+ return f"Error: {e}"-## Explore our more advanced functionality!+# Example usage:+# search_result = web_search("AgentOps features")+# calculation = calculator("2 + 2")+```++### Grouping with Traces (`@trace` or manual)+Create custom traces to group a sequence of operations or define logical units of work. You can use the `@trace` decorator or manage traces manually for more complex scenarios.+<Note>If `auto_start_session=False` in `agentops.init()`, you must use `@trace` or `agentops.start_trace()` for any data to be recorded.</Note>++```python+from agentops.sdk.decorators import trace+# Assuming MyAgent and web_search are defined as above++# Option 1: Using the @trace decorator+@trace(name="MyMainWorkflow", tags=["main-flow"])+def my_workflow_decorated(task_to_perform):+ # Your workflow code here+ main_agent = MyAgent(agent_id="workflow-agent") # Assuming MyAgent is defined+ result = main_agent.perform_task(task_to_perform)+ # Example of using a tool within the trace+ tool_result = web_search(f"details for {task_to_perform}") # Assuming web_search is defined+ return result, tool_result++# result_decorated = my_workflow_decorated("complex data processing")++# Option 2: Managing traces manually+# import agentops # Already imported++# custom_trace = agentops.start_trace(name="MyManualWorkflow", tags=["manual-flow"])+# try:+# # Your code here+# main_agent = MyAgent(agent_id="manual-workflow-agent") # Assuming MyAgent is defined+# result = main_agent.perform_task("another complex task")+# tool_result = web_search(f"info for {result}") # Assuming web_search is defined+# agentops.end_trace(custom_trace, end_state="Success", end_prompt=f"Completed: {result}")+# except Exception as e:+# if custom_trace: # Ensure trace was started before trying to end it+# agentops.end_trace(custom_trace, end_state="Fail", error_message=str(e))+# raise+```++## Complete Example with Decorators++Here's a consolidated example showcasing how these decorators can work together:+```python+import agentops+from agentops.sdk.decorators import agent, operation, tool, trace+from dotenv import load_dotenv+import os++# Load environment variables+load_dotenv()+AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY")++# Initialize AgentOps.+# Set auto_start_session=False because @trace will manage the session.+agentops.init(AGENTOPS_API_KEY, auto_start_session=False, tags=["quickstart-complete-example"])++# Define a tool+@tool(name="AdvancedSearch", cost=0.02)+def advanced_web_search(query: str) -> str:+ # Simulate a more advanced search+ return f"Advanced search results for '{query}': [Details...]"++# Define an agent class+@agent(name="ResearchSpecialistAgent")+class ResearchAgent:+ def __init__(self, agent_id: str):+ self.agent_id = agent_id # This will be used as the agent_id in AgentOps++ @operation(name="ConductResearch")+ def conduct_research(self, research_topic: str) -> str:+ # Use the tool within the agent's operation+ search_results = advanced_web_search(f"Deep dive into {research_topic}")+ # Simulate further processing+ analysis = f"Analysis of '{research_topic}': Based on '{search_results}', the key findings are..."+ return analysis++# Define a workflow using the @trace decorator+@trace(name="FullResearchWorkflow", tags=["research", "analysis", "example"])+def run_full_research_workflow(topic: str) -> str:+ specialist_agent = ResearchAgent(agent_id="researcher-alpha-007")+ research_findings = specialist_agent.conduct_research(topic)++ final_report = f"Research Report for '{topic}':\n{research_findings}"+ # agentops.record(Events("ReportGenerated", details=final_report)) # Optional: record a custom event+ return final_report++# Execute the workflow+final_output = run_full_research_workflow("AI in healthcare")+print(final_output)+```++## Next Steps++You've seen how to get started with AgentOps! Explore further to leverage its full potential:<CardGroup cols={2}><Card- title="Examples and Video Guides"+ title="Integrations"+ icon="plug"+ href="/v2/integrations"+ >+ See how AgentOps automatically instruments popular LLM and agent frameworks.+ </Card>+ <Card+ title="Examples"icon="square-code"href="/v2/examples">- Record all of your operations the way AgentOps intends.+ Explore detailed examples for various use cases and integrations.+ </Card>+ <Card title="SDK Reference" icon="book-open" href="/v2/sdk-reference">+ Dive deeper into the AgentOps SDK capabilities and API.</Card>- <Card title="Tracking Agents" icon="robot" href="/v2/usage/tracking-agents">- Associate operations with specific named agents.+ <Card title="Trace Decorator" icon="code" href="/v2/usage/trace-decorator">+ Learn how to group operations and create custom traces using the @trace decorator.</Card></CardGroup>diff --git a/docs/v2/usage/advanced-configuration.mdx b/docs/v2/usage/advanced-configuration.mdxindex 393b57e1..8136db73 100644--- a/docs/v2/usage/advanced-configuration.mdx+++ b/docs/v2/usage/advanced-configuration.mdx@@ -1,6 +1,5 @@---title: "Advanced Configuration"-mode: "wide"---In AgentOps fashion, you only need to add one line of "code" to your `.env` file 😊diff --git a/docs/v2/usage/dashboard-info.mdx b/docs/v2/usage/dashboard-info.mdxindex b45dbd8b..e75ce8fe 100644--- a/docs/v2/usage/dashboard-info.mdx+++ b/docs/v2/usage/dashboard-info.mdx@@ -1,7 +1,6 @@---title: "Dashboard"description: "Visualize your AgentOps analysis."-mode: "wide"---## Insights Dashboarddiff --git a/examples/README.md b/examples/README.mdindex 37f26370..93a6ccfb 100644--- a/examples/README.md+++ b/examples/README.md@@ -1,35 +1,115 @@# AgentOps Examples-<img src="https://github.com/AgentOps-AI/agentops/blob/main/docs/images/external/logo/banner-badge.png?raw=true" width="25%"/>--[AgentOps](https://agentops.ai/?=autogen) provides session replays, metrics, and monitoring for AI agents.--At a high level, AgentOps gives you the ability to monitor LLM calls, costs, latency, agent failures, multi-agent interactions, tool usage, session-wide statistics, and more. For more info, check out the [AgentOps Repo](https://github.com/AgentOps-AI/agentops).--### Overview Dashboard-<img src="https://raw.githubusercontent.com/AgentOps-AI/agentops/main/docs/images/external/app_screenshots/overview.gif" width="25%"/>--### Session Replays-<img src="https://raw.githubusercontent.com/AgentOps-AI/agentops/main/docs/images/external/app_screenshots/drilldown.gif" width="25%"/>--### Session Drilldown-<img src="https://github.com/AgentOps-AI/agentops/blob/main/docs/images/external/app_screenshots/session-replay.png?raw=true" width="25%"/>--## Quickstart-- [Single LLM](./openai-gpt.ipynb)-- [Recording Events](./recording-operations.ipynb)-- [Multi-Agent](./multi_agent_example.ipynb)--## Integrations-- [AI21](./ai21_examples/ai21_examples.ipynb)-- [Anthropic](./anthropic_examples/)--- [AG2](./autogen_examples/)-- [Cohere](./cohere_examples/cohere_example.ipynb)-- [Crew.ai](./crew_examples/)-- [Groq](./multi_agent_groq_example.ipynb)-- [Langchain](./langchain_examples/langchain_examples.ipynb)-- [LiteLLM](./litlelm_examples/litlelm_example.ipynb)-- [Mistral](./mistral_examples/mistral_example.ipynb)-- [MultiOn](./multion_examples/)-- [Ollama](./ollama_examples/ollama_examples.ipynb)-- [OpenAI](./openai_examples/)+This directory contains comprehensive examples demonstrating how to integrate AgentOps with various AI/ML frameworks, libraries, and providers. Each example is provided as a Jupyter notebook and a Python script with detailed explanations and code samples.++## 📁 Directory Structure++- **[`ag2/`](./ag2/)** - Examples for AG2 (AutoGen 2.0) multi-agent conversations+ - `agentchat_with_memory` - Agent chat with persistent memory+ - `async_human_input` - Asynchronous human input handling+ - `tools_wikipedia_search` - Wikipedia search tool integration++- **[`anthropic/`](./anthropic/)** - Anthropic Claude API integration examples+ - `agentops-anthropic-understanding-tools` - Deep dive into tool usage+ - `anthropic-example-async` - Asynchronous API calls+ - `anthropic-example-sync` - Synchronous API calls+ - `antrophic-example-tool` - Tool calling examples+ - `README.md` - Detailed Anthropic integration guide++- **[`autogen/`](./autogen/)** - Microsoft AutoGen framework examples+ - `AgentChat` - Basic agent chat functionality+ - `MathAgent` - Mathematical problem-solving agent++- **[`crewai/`](./crewai/)** - CrewAI multi-agent framework examples+ - `job_posting` - Job posting automation workflow+ - `markdown_validator` - Markdown validation agent++- **[`gemini/`](./gemini/)** - Google Gemini API integration+ - `gemini_example` - Basic Gemini API usage with AgentOps++- **[`google_adk/`](./google_adk/)** - Google AI Development Kit examples+ - `human_approval` - Human-in-the-loop approval workflows++- **[`langchain/`](./langchain/)** - LangChain framework integration+ - `langchain_examples` - Comprehensive LangChain usage examples++- **[`litellm/`](./litellm/)** - LiteLLM proxy integration+ - `litellm_example` - Multi-provider LLM access through LiteLLM++- **[`openai/`](./openai/)** - OpenAI API integration examples+ - `multi_tool_orchestration` - Complex tool orchestration+ - `openai_example_async` - Asynchronous OpenAI API calls+ - `openai_example_sync` - Synchronous OpenAI API calls+ - `web_search` - Web search functionality++- **[`openai_agents/`](./openai_agents/)** - OpenAI Agents SDK examples+ - `agent_patterns` - Common agent design patterns+ - `agents_tools` - Agent tool integration+ - `customer_service_agent` - Customer service automation++- **[`smolagents/`](./smolagents/)** - SmolAgents framework examples+ - `multi_smolagents_system` - Multi-agent system coordination+ - `text_to_sql` - Natural language to SQL conversion++- **[`watsonx/`](./watsonx/)** - IBM Watsonx AI integration+ - `watsonx-streaming` - Streaming text generation+ - `watsonx-text-chat` - Text generation and chat completion+ - `watsonx-tokeniation-model` - Tokenization and model details+ - `README.md` - Detailed Watsonx integration guide++- **[`xai/`](./xai/)** - xAI (Grok) API integration+ - `grok_examples` - Basic Grok API usage+ - `grok_vision_examples` - Vision capabilities with Grok++### Utility Scripts++- **[`generate_documentation.py`](./generate_documentation.py)** - Script to convert Jupyter notebooks to MDX documentation files+ - Converts notebooks from `examples/` to `docs/v2/examples/`+ - Handles frontmatter, GitHub links, and installation sections+ - Transforms `%pip install` commands to CodeGroup format++## 📓 Prerequisites++1. **AgentOps Account**: Sign up at [agentops.ai](https://agentops.ai)+2. **Python Environment**: Python 3.10+ recommended+3. **API Keys**: Obtain API keys for the services you want to use++## 📖 Documentation Generation++The `generate_documentation.py` script automatically converts these Jupyter notebook examples into documentation for the AgentOps website. It:++- Extracts notebook content and converts to Markdown+- Adds proper frontmatter and metadata+- Transforms installation commands into user-friendly format+- Generates GitHub links for source notebooks+- Creates MDX files in `docs/v2/examples/`++### Usage+```bash+python examples/generate_documentation.py examples/langchain/langchain_examples.ipynb+```++## 🤝 Contributing++When adding new examples:++1. Create a new subdirectory for the framework/provider+2. Include comprehensive Jupyter notebooks with explanations+3. Add a README.md if the integration is complex+4. Ensure examples are self-contained and runnable+5. Follow the existing naming conventions+6. Use the `generate_documentation.py` script to create documentation files+7. Add the example notebook to the main `README.md` for visibility+8. Add the generated documentation to the `docs/v2/examples/` directory for website visibility+9. Submit a pull request with a clear description of your changes++## 📚 Additional Resources++- [AgentOps Documentation](https://docs.agentops.ai)+- [AgentOps Dashboard](https://app.agentops.ai)+- [GitHub Repository](https://github.com/AgentOps-AI/agentops)+- [Community Discord](https://discord.gg/agentops)++## 📄 License++These examples are provided under the same license as the AgentOps project. See the main repository for license details.diff --git a/examples/ag2/README.md b/examples/ag2/README.mdnew file mode 100644index 00000000..6d218d3b--- /dev/null+++ b/examples/ag2/README.md@@ -0,0 +1,39 @@+# AG2 Examples with AgentOps++This directory contains examples of using AG2 (AutoGen 2.0) with AgentOps instrumentation for various multi-agent conversation tasks.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops ag2+ ```++## Examples++### 1. Agent Chat with Memory++Example: `agentchat_with_memory`+This example demonstrates:+- Agent chat with persistent memory++### 2. Asynchronous Human Input++Example: `async_human_input`++This example demonstrates:+- Asynchronous human input handling++### 3. Wikipedia Search Tool++Example: `tools_wikipedia_search`++This example demonstrates:+- Wikipedia search tool integration++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your AG2 calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/ag2/agentchat_with_memory.ipynb b/examples/ag2/agentchat_with_memory.ipynbnew file mode 100644index 00000000..7f443675--- /dev/null+++ b/examples/ag2/agentchat_with_memory.ipynb@@ -0,0 +1,320 @@+{+ "cells": [+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "A3guIYLG6PnX"+ },+ "source": [+ "# Observe an Agent with memory powered by Mem0"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "di1opljX6sQT"+ },+ "source": [+ "This notebook demonstrates an intelligent customer service chatbot system that combines:\n",+ "\n",+ "- AG2 for conversational agents\n",+ "- Mem0 for memory management\n",+ "\n",+ "[Mem0](https://www.mem0.ai/) provides a smart, self-improving memory layer for Large Language Models (LLMs), enabling developers to create personalized AI experiences that evolve with each user interaction. Refer [docs](https://docs.mem0.ai/overview) for more information.\n",+ "\n",+ "The implementation showcases how to initialize agents, manage conversation memory, and facilitate multi-agent conversations for enhanced problem-solving in customer support scenarios.\n",+ "\n",+ "With AgentOps, you can observe the agent's memory and interactions in real-time, providing insights into how the agent learns and adapts over time."+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "## Pre-requisites\n",+ "- AgentOps API key from [AgentOps](https://app.agentops.ai/).\n",+ "- Mem0 API key from [Mem0 Platform](https://app.mem0.ai/).\n",+ "- OpenAI API key from [OpenAI](https://platform.openai.com/)."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Install required dependencies\n",+ "%pip install agentops\n",+ "%pip install \"ag2[openai]\" \n",+ "%pip install mem0ai"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "id": "4nQWyJ-n9qOB",+ "outputId": "de897f4f-32fd-4359-f021-c3510467b69c"+ },+ "outputs": [],+ "source": [+ "import os\n",+ "from dotenv import load_dotenv\n",+ "import agentops\n",+ "from mem0 import MemoryClient\n",+ "from autogen import ConversableAgent"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "load_dotenv()\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"MEM0_API_KEY\"] = os.getenv(\"MEM0_API_KEY\", \"your_api_key_here\")"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "6GAZAkGmAjsT"+ },+ "source": [+ "## Initialize Agent and Memory\n",+ "\n",+ "The conversational agent is set up using the 'gpt-4o' model and a mem0 client. We'll utilize the client's methods for storing and accessing memories.\n"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "agentops.init(auto_start_session=False)\n",+ "tracer = agentops.start_trace(trace_name=\"AG2 Agent using Mem0\", tags=[\"ag2-mem0-example\", \"agentops-example\"])"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "xWSEHMKT9qLz"+ },+ "outputs": [],+ "source": [+ "agent = ConversableAgent(\n",+ " \"chatbot\",\n",+ " llm_config={\"config_list\": [{\"model\": \"gpt-4o\", \"api_key\": os.environ.get(\"OPENAI_API_KEY\")}]},\n",+ " code_execution_config=False,\n",+ " function_map=None,\n",+ " human_input_mode=\"NEVER\",\n",+ ")\n",+ "\n",+ "memory = MemoryClient()"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "c7vGQoMg_KhS"+ },+ "source": [+ "Initialize a conversation history for a Best Buy customer service chatbot. It contains a list of message exchanges between the user and the assistant, structured as dictionaries with 'role' and 'content' keys. The entire conversation is then stored in memory using the `memory.add()` method, associated with the identifier \"customer_service_bot\"."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "id": "b6ghSobs-mYo",+ "outputId": "18a6e657-49ba-41cd-8e51-2e76cf668967"+ },+ "outputs": [],+ "source": [+ "conversation = [\n",+ " {\n",+ " \"role\": \"assistant\",\n",+ " \"content\": \"Hi, I'm Best Buy's chatbot!\\n\\nThanks for being a My Best Buy TotalTM member.\\n\\nWhat can I help you with?\",\n",+ " },\n",+ " {\n",+ " \"role\": \"user\",\n",+ " \"content\": 'Seeing horizontal lines on our tv. TV model: Sony - 77\" Class BRAVIA XR A80K OLED 4K UHD Smart Google TV',\n",+ " },\n",+ " {\n",+ " \"role\": \"assistant\",\n",+ " \"content\": \"Thanks for being a My Best Buy Total™ member. I can connect you to an expert immediately - just one perk of your membership!\\n\\nSelect the button below when you're ready to chat.\",\n",+ " },\n",+ " {\n",+ " \"role\": \"assistant\",\n",+ " \"content\": \"Good evening, thank you for choosing Best Buy, Fnu. My name is Lovely. I hope you are doing well. I'm sorry to hear that you're seeing horizontal lines on your TV.\\n\\nI'm absolutely committed to exploring all possible ways to assist you to fix this issue.\\n\\nTo ensure that we are on the right account, may I please have your email address registered with your Best Buy account?\",\n",+ " },\n",+ " {\"role\": \"user\", \"content\": \"[email protected]\"},\n",+ " {\n",+ " \"role\": \"assistant\",\n",+ " \"content\": \"Perfect! Thank you for providing all the details, surely you have made my job easier by doing this. I really appreciate it.\\n\\nI also want to take a moment to express our heartfelt appreciation for your trust and loyalty. Thank you for being an amazing customer of BestBuy Total.\\n\\nCould you please help me with the order number or product's details to check it quickly?\\n\\nSamsung - 49\\\" Odyssey OLED G9 (G95SC) DQHD 240Hz 0.03ms G-Sync Compatible Curved Smart Gaming Monitor - Silver - just to confirm this is the item, right?\",\n",+ " },\n",+ " {\"role\": \"user\", \"content\": \"Order number: 112217629\"},\n",+ " {\n",+ " \"role\": \"assistant\",\n",+ " \"content\": \"Superb! Thank you for confirmation.\\n\\nThank you for your patience. After exploring all possible solutions, I can help you to arrange a home repair appointment for your device. Our Geek Squad experts will visit your home to inspect and fix your device.\\n\\nIt's great that you have a protection plan - rest assured, we've got your back! As a valued Total member, you can avail this service at a minimal service fee. This fee, applicable to all repairs, covers the cost of diagnosing the issue and any small parts needed for the repair. It's part of our 24-month free protection plan.\\n\\nPlease click here to review the service fee and plan coverage details -\\n\\nhttps://www.bestbuy.com/site/best-buy-membership/best-buy-protection/pcmcat1608643232014.c?id=pcmcat1608643232014#jl-servicefees\\n\\nFnu - just to confirm shall I proceed to schedule the appointment?\",\n",+ " },\n",+ " {\"role\": \"user\", \"content\": \"Yes please\"},\n",+ " {\"role\": \"assistant\", \"content\": \"When should I schedule the appointment?\"},\n",+ " {\"role\": \"user\", \"content\": \"Schedule it for tomorrow please\"},\n",+ "]\n",+ "\n",+ "memory.add(messages=conversation, user_id=\"customer_service_bot\")"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "hlxxncxkAvck"+ },+ "source": [+ "## Agent Inference\n",+ "\n",+ "We ask a question to the agent, utilizing mem0 to retrieve relevant memories. The agent then formulates a response based on both the question and the retrieved contextual information."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "id": "wYdDkuKc-Xc8",+ "outputId": "b50f55d3-a280-4c0d-82e5-43fc0589109b"+ },+ "outputs": [],+ "source": [+ "data = \"I forgot the order number, can you quickly tell me?\"\n",+ "\n",+ "relevant_memories = memory.search(data, user_id=\"customer_service_bot\")\n",+ "flatten_relevant_memories = \"\\n\".join([m[\"memory\"] for m in relevant_memories])\n",+ "\n",+ "prompt = f\"\"\"Answer the user question considering the memories. Keep answers clear and concise.\n",+ "Memories:\n",+ "{flatten_relevant_memories}\n",+ "\\n\\n\n",+ "Question: {data}\n",+ "\"\"\"\n",+ "\n",+ "reply = agent.generate_reply(messages=[{\"content\": prompt, \"role\": \"user\"}])\n",+ "print(reply)"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {+ "id": "sryX0gfdBGGD"+ },+ "source": [+ "## Multi Agent Conversation\n",+ "\n",+ "Initialize two AI agents: a \"manager\" for resolving customer issues and a \"customer_bot\" for gathering information on customer problems, both using GPT-4. It then retrieves relevant memories for a given question, combining them with the question into a prompt. This prompt can be used by either the manager or customer_bot to generate a contextually informed response."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "Vq5BFL2l-XZl"+ },+ "outputs": [],+ "source": [+ "manager = ConversableAgent(\n",+ " \"manager\",\n",+ " system_message=\"You are a manager who helps in resolving customer issues.\",\n",+ " llm_config={\"config_list\": [{\"model\": \"gpt-4o-mini\", \"api_key\": os.environ.get(\"OPENAI_API_KEY\")}]},\n",+ " human_input_mode=\"NEVER\",\n",+ ")\n",+ "\n",+ "customer_bot = ConversableAgent(\n",+ " \"customer_bot\",\n",+ " system_message=\"You are a customer service bot who gathers information on issues customers are facing. Keep answers clear and concise.\",\n",+ " llm_config={\"config_list\": [{\"model\": \"gpt-4\", \"api_key\": os.environ.get(\"OPENAI_API_KEY\")}]},\n",+ " human_input_mode=\"NEVER\",\n",+ ")"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "iX4ehmc6Fbib"+ },+ "outputs": [],+ "source": [+ "data = \"When is the appointment?\"\n",+ "\n",+ "relevant_memories = memory.search(data, user_id=\"customer_service_bot\")\n",+ "flatten_relevant_memories = \"\\n\".join([m[\"memory\"] for m in relevant_memories])\n",+ "\n",+ "prompt = f\"\"\"\n",+ "Context:\n",+ "{flatten_relevant_memories}\n",+ "\\n\\n\n",+ "Question: {data}\n",+ "\"\"\""+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "id": "D3paRZWvCIzt",+ "outputId": "15eadb7c-5973-44f1-de43-5e6cdebe88de"+ },+ "outputs": [],+ "source": [+ "result = manager.send(prompt, customer_bot, request_reply=True)\n",+ "\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ }+ ],+ "metadata": {+ "front_matter": {+ "description": "Use Mem0 to create agents with memory.",+ "tags": [+ "mem0",+ "integration",+ "memory"+ ]+ },+ "kernelspec": {+ "display_name": "agentops (3.11.11)",+ "language": "python",+ "name": "python3"+ },+ "language_info": {+ "codemirror_mode": {+ "name": "ipython",+ "version": 3+ },+ "file_extension": ".py",+ "mimetype": "text/x-python",+ "name": "python",+ "nbconvert_exporter": "python",+ "pygments_lexer": "ipython3",+ "version": "3.11.11"+ }+ },+ "nbformat": 4,+ "nbformat_minor": 0+}diff --git a/examples/ag2/agentchat_with_memory.py b/examples/ag2/agentchat_with_memory.pynew file mode 100644index 00000000..7d309950--- /dev/null+++ b/examples/ag2/agentchat_with_memory.py@@ -0,0 +1,128 @@+# Observe an Agent with memory powered by Mem0+# This notebook demonstrates an intelligent customer service chatbot system that combines:+#+# - AG2 for conversational agents+# - Mem0 for memory management+#+# [Mem0](https://www.mem0.ai/) provides a smart, self-improving memory layer for Large Language Models (LLMs), enabling developers to create personalized AI experiences that evolve with each user interaction. Refer [docs](https://docs.mem0.ai/overview) for more information.+#+# The implementation showcases how to initialize agents, manage conversation memory, and facilitate multi-agent conversations for enhanced problem-solving in customer support scenarios.+#+# With AgentOps, you can observe the agent's memory and interactions in real-time, providing insights into how the agent learns and adapts over time.+# ## Pre-requisites+# - AgentOps API key from [AgentOps](https://app.agentops.ai/).+# - Mem0 API key from [Mem0 Platform](https://app.mem0.ai/).+# - OpenAI API key from [OpenAI](https://platform.openai.com/).+# # Install required dependencies+# %pip install agentops+# %pip install "ag2[openai]"+# %pip install mem0ai+import os+from dotenv import load_dotenv+import agentops+from mem0 import MemoryClient+from autogen import ConversableAgent++load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+os.environ["MEM0_API_KEY"] = os.getenv("MEM0_API_KEY", "your_api_key_here")++# ## Initialize Agent and Memory+#+# The conversational agent is set up using the 'gpt-4o' model and a mem0 client. We'll utilize the client's methods for storing and accessing memories.+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(trace_name="AG2 Agent using Mem0", tags=["ag2-mem0-example", "agentops-example"])++agent = ConversableAgent(+ "chatbot",+ llm_config={"config_list": [{"model": "gpt-4o", "api_key": os.environ.get("OPENAI_API_KEY")}]},+ code_execution_config=False,+ function_map=None,+ human_input_mode="NEVER",+)++memory = MemoryClient()++# Initialize a conversation history for a Best Buy customer service chatbot. It contains a list of message exchanges between the user and the assistant, structured as dictionaries with 'role' and 'content' keys. The entire conversation is then stored in memory using the `memory.add()` method, associated with the identifier "customer_service_bot".+conversation = [+ {+ "role": "assistant",+ "content": "Hi, I'm Best Buy's chatbot!\n\nThanks for being a My Best Buy TotalTM member.\n\nWhat can I help you with?",+ },+ {+ "role": "user",+ "content": 'Seeing horizontal lines on our tv. TV model: Sony - 77" Class BRAVIA XR A80K OLED 4K UHD Smart Google TV',+ },+ {+ "role": "assistant",+ "content": "Thanks for being a My Best Buy Total™ member. I can connect you to an expert immediately - just one perk of your membership!\n\nSelect the button below when you're ready to chat.",+ },+ {+ "role": "assistant",+ "content": "Good evening, thank you for choosing Best Buy, Fnu. My name is Lovely. I hope you are doing well. I'm sorry to hear that you're seeing horizontal lines on your TV.\n\nI'm absolutely committed to exploring all possible ways to assist you to fix this issue.\n\nTo ensure that we are on the right account, may I please have your email address registered with your Best Buy account?",+ },+ {"role": "user", "content": "[email protected]"},+ {+ "role": "assistant",+ "content": "Perfect! Thank you for providing all the details, surely you have made my job easier by doing this. I really appreciate it.\n\nI also want to take a moment to express our heartfelt appreciation for your trust and loyalty. Thank you for being an amazing customer of BestBuy Total.\n\nCould you please help me with the order number or product's details to check it quickly?\n\nSamsung - 49\" Odyssey OLED G9 (G95SC) DQHD 240Hz 0.03ms G-Sync Compatible Curved Smart Gaming Monitor - Silver - just to confirm this is the item, right?",+ },+ {"role": "user", "content": "Order number: 112217629"},+ {+ "role": "assistant",+ "content": "Superb! Thank you for confirmation.\n\nThank you for your patience. After exploring all possible solutions, I can help you to arrange a home repair appointment for your device. Our Geek Squad experts will visit your home to inspect and fix your device.\n\nIt's great that you have a protection plan - rest assured, we've got your back! As a valued Total member, you can avail this service at a minimal service fee. This fee, applicable to all repairs, covers the cost of diagnosing the issue and any small parts needed for the repair. It's part of our 24-month free protection plan.\n\nPlease click here to review the service fee and plan coverage details -\n\nhttps://www.bestbuy.com/site/best-buy-membership/best-buy-protection/pcmcat1608643232014.c?id=pcmcat1608643232014#jl-servicefees\n\nFnu - just to confirm shall I proceed to schedule the appointment?",+ },+ {"role": "user", "content": "Yes please"},+ {"role": "assistant", "content": "When should I schedule the appointment?"},+ {"role": "user", "content": "Schedule it for tomorrow please"},+]++memory.add(messages=conversation, user_id="customer_service_bot")++# ## Agent Inference+#+# We ask a question to the agent, utilizing mem0 to retrieve relevant memories. The agent then formulates a response based on both the question and the retrieved contextual information.+data = "I forgot the order number, can you quickly tell me?"+relevant_memories = memory.search(data, user_id="customer_service_bot")+flatten_relevant_memories = "\n".join([m["memory"] for m in relevant_memories])++prompt = f"""Answer the user question considering the memories. Keep answers clear and concise.+Memories:+{flatten_relevant_memories}+\n\n+Question: {data}+"""++reply = agent.generate_reply(messages=[{"content": prompt, "role": "user"}])+print(reply)++# ## Multi Agent Conversation+#+# Initialize two AI agents: a "manager" for resolving customer issues and a "customer_bot" for gathering information on customer problems, both using GPT-4. It then retrieves relevant memories for a given question, combining them with the question into a prompt. This prompt can be used by either the manager or customer_bot to generate a contextually informed response.+manager = ConversableAgent(+ "manager",+ system_message="You are a manager who helps in resolving customer issues.",+ llm_config={"config_list": [{"model": "gpt-4o-mini", "api_key": os.environ.get("OPENAI_API_KEY")}]},+ human_input_mode="NEVER",+)++customer_bot = ConversableAgent(+ "customer_bot",+ system_message="You are a customer service bot who gathers information on issues customers are facing. Keep answers clear and concise.",+ llm_config={"config_list": [{"model": "gpt-4", "api_key": os.environ.get("OPENAI_API_KEY")}]},+ human_input_mode="NEVER",+)++data = "When is the appointment?"+relevant_memories = memory.search(data, user_id="customer_service_bot")+flatten_relevant_memories = "\n".join([m["memory"] for m in relevant_memories])++prompt = f"""+Context:+{flatten_relevant_memories}+\n\n+Question: {data}+"""++result = manager.send(prompt, customer_bot, request_reply=True)+agentops.end_trace(tracer, end_state="Success")diff --git a/examples/ag2/async_human_input.ipynb b/examples/ag2/async_human_input.ipynbnew file mode 100755index 00000000..0f1c6b0b--- /dev/null+++ b/examples/ag2/async_human_input.ipynb@@ -0,0 +1,216 @@+{+ "cells": [+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "# Agent Chat with Async Human Inputs\n",+ "\n",+ "We are going to create an agent that can chat with a human asynchronously. The agent will be able to respond to messages from the human and will also be able to send messages to the human.\n",+ "\n",+ "We are going to use AgentOps to monitor the agent's performance and observe its interactions with the human."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "id": "tLIs1YRdr8jM",+ "outputId": "909c1c70-1a22-4e9d-b7f4-a40e2d737fb0"+ },+ "outputs": [],+ "source": [+ "# Install required dependencies\n",+ "%pip install agentops\n",+ "%pip install ag2\n",+ "%pip install chromadb\n",+ "%pip install sentence_transformers\n",+ "%pip install tiktoken\n",+ "%pip install pypdf\n",+ "%pip install nest-asyncio"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "yU8zQPetsW28"+ },+ "outputs": [],+ "source": [+ "import asyncio\n",+ "from typing import Dict, Optional, Union\n",+ "import os\n",+ "from dotenv import load_dotenv\n",+ "\n",+ "import nest_asyncio\n",+ "import agentops\n",+ "from autogen import AssistantAgent\n",+ "from autogen.agentchat.user_proxy_agent import UserProxyAgent"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "load_dotenv()\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "agentops.init(auto_start_session=False)\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"AG2 Agent chat with Async Human Inputs\", tags=[\"ag2-chat-async-human-inputs\", \"agentops-example\"]\n",+ ")"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "id": "R2ITRFQisgzI"+ },+ "outputs": [],+ "source": [+ "# Define an asynchronous function that simulates some asynchronous task (e.g., I/O operation)\n",+ "async def my_asynchronous_function():\n",+ " print(\"Start asynchronous function\")\n",+ " await asyncio.sleep(2) # Simulate some asynchronous task (e.g., I/O operation)\n",+ " print(\"End asynchronous function\")\n",+ " return \"input\"\n",+ "\n",+ "\n",+ "# Define a custom class `CustomisedUserProxyAgent` that extends `UserProxyAgent`\n",+ "class CustomisedUserProxyAgent(UserProxyAgent):\n",+ " # Asynchronous function to get human input\n",+ " async def a_get_human_input(self, prompt: str) -> str:\n",+ " # Call the asynchronous function to get user input asynchronously\n",+ " user_input = await my_asynchronous_function()\n",+ "\n",+ " return user_input\n",+ "\n",+ " # Asynchronous function to receive a message\n",+ " async def a_receive(\n",+ " self,\n",+ " message: Union[Dict, str],\n",+ " sender,\n",+ " request_reply: Optional[bool] = None,\n",+ " silent: Optional[bool] = False,\n",+ " ):\n",+ " # Call the superclass method to handle message reception asynchronously\n",+ " await super().a_receive(message, sender, request_reply, silent)\n",+ "\n",+ "\n",+ "class CustomisedAssistantAgent(AssistantAgent):\n",+ " # Asynchronous function to get human input\n",+ " async def a_get_human_input(self, prompt: str) -> str:\n",+ " # Call the asynchronous function to get user input asynchronously\n",+ " user_input = await my_asynchronous_function()\n",+ "\n",+ " return user_input\n",+ "\n",+ " # Asynchronous function to receive a message\n",+ " async def a_receive(\n",+ " self,\n",+ " message: Union[Dict, str],\n",+ " sender,\n",+ " request_reply: Optional[bool] = None,\n",+ " silent: Optional[bool] = False,\n",+ " ):\n",+ " # Call the superclass method to handle message reception asynchronously\n",+ " await super().a_receive(message, sender, request_reply, silent)"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {+ "colab": {+ "base_uri": "https://localhost:8080/"+ },+ "id": "ywFsRNMDteaH",+ "outputId": "5716adad-de80-4595-eec9-523b1f1cd313"+ },+ "outputs": [],+ "source": [+ "nest_asyncio.apply()\n",+ "\n",+ "\n",+ "async def main():\n",+ " boss = CustomisedUserProxyAgent(\n",+ " name=\"boss\",\n",+ " human_input_mode=\"ALWAYS\",\n",+ " max_consecutive_auto_reply=0,\n",+ " code_execution_config=False,\n",+ " )\n",+ "\n",+ " assistant = CustomisedAssistantAgent(\n",+ " name=\"assistant\",\n",+ " system_message=\"You will provide some agenda, and I will create questions for an interview meeting. Every time when you generate question then you have to ask user for feedback and if user provides the feedback then you have to incorporate that feedback and generate new set of questions and if user don't want to update then terminate the process and exit\",\n",+ " llm_config={\"config_list\": [{\"model\": \"gpt-4o-mini\", \"api_key\": os.environ.get(\"OPENAI_API_KEY\")}]},\n",+ " )\n",+ "\n",+ " await boss.a_initiate_chat(\n",+ " assistant,\n",+ " message=\"Resume Review, Technical Skills Assessment, Project Discussion, Job Role Expectations, Closing Remarks.\",\n",+ " n_results=3,\n",+ " )\n",+ "\n",+ "\n",+ "await main()"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ }+ ],+ "metadata": {+ "colab": {+ "provenance": [],+ "toc_visible": true+ },+ "front_matter": {+ "description": "Async human inputs.",+ "tags": [+ "async",+ "human"+ ]+ },+ "kernelspec": {+ "display_name": "agentops (3.11.11)",+ "language": "python",+ "name": "python3"+ },+ "language_info": {+ "codemirror_mode": {+ "name": "ipython",+ "version": 3+ },+ "file_extension": ".py",+ "mimetype": "text/x-python",+ "name": "python",+ "nbconvert_exporter": "python",+ "pygments_lexer": "ipython3",+ "version": "3.11.11"+ }+ },+ "nbformat": 4,+ "nbformat_minor": 0+}diff --git a/examples/ag2/async_human_input.py b/examples/ag2/async_human_input.pynew file mode 100644index 00000000..6484773a--- /dev/null+++ b/examples/ag2/async_human_input.py@@ -0,0 +1,106 @@+# Agent Chat with Async Human Inputs+#+# We are going to create an agent that can chat with a human asynchronously. The agent will be able to respond to messages from the human and will also be able to send messages to the human.+#+# We are going to use AgentOps to monitor the agent's performance and observe its interactions with the human.+# # Install required dependencies+# %pip install agentops+# %pip install ag2+# %pip install chromadb+# %pip install sentence_transformers+# %pip install tiktoken+# %pip install pypdf+# %pip install nest-asyncio+import asyncio+from typing import Dict, Optional, Union+import os+from dotenv import load_dotenv++import nest_asyncio+import agentops+from autogen import AssistantAgent+from autogen.agentchat.user_proxy_agent import UserProxyAgent++load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++agentops.init(auto_start_session=False)+tracer = agentops.start_trace(+ trace_name="AG2 Agent chat with Async Human Inputs", tags=["ag2-chat-async-human-inputs", "agentops-example"]+)+++# Define an asynchronous function that simulates some asynchronous task (e.g., I/O operation)+async def my_asynchronous_function():+ print("Start asynchronous function")+ await asyncio.sleep(2) # Simulate some asynchronous task (e.g., I/O operation)+ print("End asynchronous function")+ return "input"+++# Define a custom class `CustomisedUserProxyAgent` that extends `UserProxyAgent`+class CustomisedUserProxyAgent(UserProxyAgent):+ # Asynchronous function to get human input+ async def a_get_human_input(self, prompt: str) -> str:+ # Call the asynchronous function to get user input asynchronously+ user_input = await my_asynchronous_function()+ return user_input++ # Asynchronous function to receive a message+ async def a_receive(+ self,+ message: Union[Dict, str],+ sender,+ request_reply: Optional[bool] = None,+ silent: Optional[bool] = False,+ ):+ # Call the superclass method to handle message reception asynchronously+ await super().a_receive(message, sender, request_reply, silent)+++class CustomisedAssistantAgent(AssistantAgent):+ # Asynchronous function to get human input+ async def a_get_human_input(self, prompt: str) -> str:+ # Call the asynchronous function to get user input asynchronously+ user_input = await my_asynchronous_function()+ return user_input++ # Asynchronous function to receive a message+ async def a_receive(+ self,+ message: Union[Dict, str],+ sender,+ request_reply: Optional[bool] = None,+ silent: Optional[bool] = False,+ ):+ # Call the superclass method to handle message reception asynchronously+ await super().a_receive(message, sender, request_reply, silent)+++nest_asyncio.apply()+++async def main():+ boss = CustomisedUserProxyAgent(+ name="boss",+ human_input_mode="ALWAYS",+ max_consecutive_auto_reply=0,+ code_execution_config=False,+ )++ assistant = CustomisedAssistantAgent(+ name="assistant",+ system_message="You will provide some agenda, and I will create questions for an interview meeting. Every time when you generate question then you have to ask user for feedback and if user provides the feedback then you have to incorporate that feedback and generate new set of questions and if user don't want to update then terminate the process and exit",+ llm_config={"config_list": [{"model": "gpt-4o-mini", "api_key": os.environ.get("OPENAI_API_KEY")}]},+ )++ await boss.a_initiate_chat(+ assistant,+ message="Resume Review, Technical Skills Assessment, Project Discussion, Job Role Expectations, Closing Remarks.",+ n_results=3,+ )+++# await main()+agentops.end_trace(tracer, end_state="Success")diff --git a/examples/ag2/tools_wikipedia_search.ipynb b/examples/ag2/tools_wikipedia_search.ipynbnew file mode 100644index 00000000..81c72aea--- /dev/null+++ b/examples/ag2/tools_wikipedia_search.ipynb@@ -0,0 +1,207 @@+{+ "cells": [+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "# AG2 Wikipedia Search Tools\n",+ "\n",+ "AG2's Wikipedia search integration allows agents to perform searches in Wikipedia and retrieve the relevant pages. Follow these steps to integrate Wikipedia Search Tools with AG2 Agents.\n",+ "\n",+ "Two tools are available for your AG2 agents:\n",+ "- `WikipediaQueryRunTool` executes Wikipedia queries and returning summarized page results\n",+ "- `WikipediaPageLoadTool` loads the contents of a Wikipedia page together with its metadata (for detailed data extraction)"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Install required dependencies\n",+ "%pip install agentops\n",+ "%pip install \"ag2[wikipedia, openai]\""+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "### Imports"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "import os\n",+ "from dotenv import load_dotenv\n",+ "import agentops\n",+ "from autogen import AssistantAgent, LLMConfig, UserProxyAgent\n",+ "from autogen.tools.experimental import WikipediaPageLoadTool, WikipediaQueryRunTool"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "load_dotenv()\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "### Agent Configuration\n",+ "\n",+ "Configure an assistant agent and user proxy to be used for LLM recommendation and execution respectively.\n"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "agentops.init(auto_start_session=False)\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"AG2 Wikipedia Search Tools\", tags=[\"ag2-wikipedia-search-tools\", \"agentops-example\"]\n",+ ")"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "config_list = LLMConfig(api_type=\"openai\", model=\"gpt-4o-mini\")\n",+ "\n",+ "assistant = AssistantAgent(\n",+ " name=\"assistant\",\n",+ " llm_config=config_list,\n",+ ")\n",+ "\n",+ "user_proxy = UserProxyAgent(name=\"user_proxy\", human_input_mode=\"NEVER\", code_execution_config=False)"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "### Query Tool Setup"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "wikipedia_query_tool = WikipediaQueryRunTool()\n",+ "\n",+ "# Register the tool for LLM recommendation (assistant agent) and execution (user_proxy agent).\n",+ "wikipedia_query_tool.register_for_llm(assistant)\n",+ "wikipedia_query_tool.register_for_execution(user_proxy)"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "### Start the Conversation\n",+ "\n",+ "With the setup complete, you can now use the assistant to search Wikipedia."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "response = user_proxy.initiate_chat(\n",+ " recipient=assistant,\n",+ " message=\"Who is the father of AI?\",\n",+ " max_turns=2,\n",+ ")"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "## Page Load Tool Setup"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start by removing the Query tool so we ensure our agent uses the Page Load tool\n",+ "assistant.remove_tool_for_llm(wikipedia_query_tool)\n",+ "\n",+ "# Create the Page Load tool\n",+ "wikipedia_page_load_tool = WikipediaPageLoadTool()\n",+ "\n",+ "# Register the tool for LLM recommendation (assistant agent) and execution (user_proxy agent).\n",+ "wikipedia_page_load_tool.register_for_llm(assistant)\n",+ "wikipedia_page_load_tool.register_for_execution(user_proxy)"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "response = user_proxy.initiate_chat(\n",+ " recipient=assistant,\n",+ " message=\"What's the population of Australia?\",\n",+ " max_turns=2,\n",+ ")\n",+ "\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ }+ ],+ "metadata": {+ "front_matter": {+ "description": "Perplexity Search Integration with AG2",+ "tags": [+ "tools",+ "perplexity",+ "web-search",+ "search"+ ]+ },+ "kernelspec": {+ "display_name": "agentops (3.11.11)",+ "language": "python",+ "name": "python3"+ },+ "language_info": {+ "codemirror_mode": {+ "name": "ipython",+ "version": 3+ },+ "file_extension": ".py",+ "mimetype": "text/x-python",+ "name": "python",+ "nbconvert_exporter": "python",+ "pygments_lexer": "ipython3",+ "version": "3.11.11"+ }+ },+ "nbformat": 4,+ "nbformat_minor": 2+}diff --git a/examples/ag2/tools_wikipedia_search.py b/examples/ag2/tools_wikipedia_search.pynew file mode 100644index 00000000..95aff730--- /dev/null+++ b/examples/ag2/tools_wikipedia_search.py@@ -0,0 +1,72 @@+# AG2 Wikipedia Search Tools+#+# AG2's Wikipedia search integration allows agents to perform searches in Wikipedia and retrieve the relevant pages. Follow these steps to integrate Wikipedia Search Tools with AG2 Agents.+#+# Two tools are available for your AG2 agents:+# - `WikipediaQueryRunTool` executes Wikipedia queries and returning summarized page results+# - `WikipediaPageLoadTool` loads the contents of a Wikipedia page together with its metadata (for detailed data extraction)+# # Install required dependencies+# %pip install agentops+# %pip install "ag2[wikipedia, openai]"+# ### Imports+import os+from dotenv import load_dotenv+import agentops+from autogen import AssistantAgent, LLMConfig, UserProxyAgent+from autogen.tools.experimental import WikipediaPageLoadTool, WikipediaQueryRunTool++load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++# ### Agent Configuration+#+# Configure an assistant agent and user proxy to be used for LLM recommendation and execution respectively.+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(+ trace_name="AG2 Wikipedia Search Tools", tags=["ag2-wikipedia-search-tools", "agentops-example"]+)++config_list = LLMConfig(api_type="openai", model="gpt-4o-mini")++assistant = AssistantAgent(+ name="assistant",+ llm_config=config_list,+)++user_proxy = UserProxyAgent(name="user_proxy", human_input_mode="NEVER", code_execution_config=False)++# ### Query Tool Setup+wikipedia_query_tool = WikipediaQueryRunTool()++# Register the tool for LLM recommendation (assistant agent) and execution (user_proxy agent).+wikipedia_query_tool.register_for_llm(assistant)+wikipedia_query_tool.register_for_execution(user_proxy)++# ### Start the Conversation+#+# With the setup complete, you can now use the assistant to search Wikipedia.+response = user_proxy.initiate_chat(+ recipient=assistant,+ message="Who is the father of AI?",+ max_turns=2,+)++# ## Page Load Tool Setup+# Start by removing the Query tool so we ensure our agent uses the Page Load tool+assistant.remove_tool_for_llm(wikipedia_query_tool)++# Create the Page Load tool+wikipedia_page_load_tool = WikipediaPageLoadTool()++# Register the tool for LLM recommendation (assistant agent) and execution (user_proxy agent).+wikipedia_page_load_tool.register_for_llm(assistant)+wikipedia_page_load_tool.register_for_execution(user_proxy)++response = user_proxy.initiate_chat(+ recipient=assistant,+ message="What's the population of Australia?",+ max_turns=2,+)++agentops.end_trace(tracer, end_state="Success")diff --git a/examples/agents-examples/agent_patterns/README.md b/examples/agents-examples/agent_patterns/README.mddeleted file mode 100644index 96b48920..00000000--- a/examples/agents-examples/agent_patterns/README.md+++ /dev/null@@ -1,54 +0,0 @@-# Common agentic patterns--This folder contains examples of different common patterns for agents.--## Deterministic flows--A common tactic is to break down a task into a series of smaller steps. Each task can be performed by an agent, and the output of one agent is used as input to the next. For example, if your task was to generate a story, you could break it down into the following steps:--1. Generate an outline-2. Generate the story-3. Generate the ending--Each of these steps can be performed by an agent. The output of one agent is used as input to the next.--See the [`deterministic.py`](./deterministic.py) file for an example of this.--## Handoffs and routing--In many situations, you have specialized sub-agents that handle specific tasks. You can use handoffs to route the task to the right agent.--For example, you might have a frontline agent that receives a request, and then hands off to a specialized agent based on the language of the request.-See the [`routing.py`](./routing.py) file for an example of this.--## Agents as tools--The mental model for handoffs is that the new agent "takes over". It sees the previous conversation history, and owns the conversation from that point onwards. However, this is not the only way to use agents. You can also use agents as a tool - the tool agent goes off and runs on its own, and then returns the result to the original agent.--For example, you could model the translation task above as tool calls instead: rather than handing over to the language-specific agent, you could call the agent as a tool, and then use the result in the next step. This enables things like translating multiple languages at once.--See the [`agents_as_tools.py`](./agents_as_tools.py) file for an example of this.--## LLM-as-a-judge--LLMs can often improve the quality of their output if given feedback. A common pattern is to generate a response using a model, and then use a second model to provide feedback. You can even use a small model for the initial generation and a larger model for the feedback, to optimize cost.--For example, you could use an LLM to generate an outline for a story, and then use a second LLM to evaluate the outline and provide feedback. You can then use the feedback to improve the outline, and repeat until the LLM is satisfied with the outline.--See the [`llm_as_a_judge.py`](./llm_as_a_judge.py) file for an example of this.--## Parallelization--Running multiple agents in parallel is a common pattern. This can be useful for both latency (e.g. if you have multiple steps that don't depend on each other) and also for other reasons e.g. generating multiple responses and picking the best one.--See the [`parallelization.py`](./parallelization.py) file for an example of this. It runs a translation agent multiple times in parallel, and then picks the best translation.--## Guardrails--Related to parallelization, you often want to run input guardrails to make sure the inputs to your agents are valid. For example, if you have a customer support agent, you might want to make sure that the user isn't trying to ask for help with a math problem.--You can definitely do this without any special Agents SDK features by using parallelization, but we support a special guardrail primitive. Guardrails can have a "tripwire" - if the tripwire is triggered, the agent execution will immediately stop and a `GuardrailTripwireTriggered` exception will be raised.--This is really useful for latency: for example, you might have a very fast model that runs the guardrail and a slow model that runs the actual agent. You wouldn't want to wait for the slow model to finish, so guardrails let you quickly reject invalid inputs.--See the [`input_guardrails.py`](./input_guardrails.py) and [`output_guardrails.py`](./output_guardrails.py) files for examples.diff --git a/examples/agents-examples/agent_patterns/agents_as_tools.py b/examples/agents-examples/agent_patterns/agents_as_tools.pydeleted file mode 100644index d380eead..00000000--- a/examples/agents-examples/agent_patterns/agents_as_tools.py+++ /dev/null@@ -1,85 +0,0 @@-"""-This example shows the agents-as-tools pattern. The frontline agent receives a user message and-then picks which agents to call, as tools. In this case, it picks from a set of translation-agents.-"""--import asyncio--from agents import Agent, ItemHelpers, MessageOutputItem, Runner, trace-from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)--spanish_agent = Agent(- name="spanish_agent",- instructions="You translate the user's message to Spanish",- handoff_description="An english to spanish translator",-)--french_agent = Agent(- name="french_agent",- instructions="You translate the user's message to French",- handoff_description="An english to french translator",-)--italian_agent = Agent(- name="italian_agent",- instructions="You translate the user's message to Italian",- handoff_description="An english to italian translator",-)--orchestrator_agent = Agent(- name="orchestrator_agent",- instructions=(- "You are a translation agent. You use the tools given to you to translate."- "If asked for multiple translations, you call the relevant tools in order."- "You never translate on your own, you always use the provided tools."- ),- tools=[- spanish_agent.as_tool(- tool_name="translate_to_spanish",- tool_description="Translate the user's message to Spanish",- ),- french_agent.as_tool(- tool_name="translate_to_french",- tool_description="Translate the user's message to French",- ),- italian_agent.as_tool(- tool_name="translate_to_italian",- tool_description="Translate the user's message to Italian",- ),- ],-)--synthesizer_agent = Agent(- name="synthesizer_agent",- instructions="You inspect translations, correct them if needed, and produce a final concatenated response.",-)---async def main():- msg = input("Hi! What would you like translated, and to which languages? ")-- # Run the entire orchestration in a single trace- with trace("Orchestrator evaluator"):- orchestrator_result = await Runner.run(orchestrator_agent, msg)-- for item in orchestrator_result.new_items:- if isinstance(item, MessageOutputItem):- text = ItemHelpers.text_message_output(item)- if text:- print(f" - Translation step: {text}")-- synthesizer_result = await Runner.run(synthesizer_agent, orchestrator_result.to_input_list())-- print(f"\n\nFinal response:\n{synthesizer_result.final_output}")---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/agent_patterns/deterministic.py b/examples/agents-examples/agent_patterns/deterministic.pydeleted file mode 100644index a9c59f7b..00000000--- a/examples/agents-examples/agent_patterns/deterministic.py+++ /dev/null@@ -1,89 +0,0 @@-import asyncio--from pydantic import BaseModel--from agents import Agent, Runner, trace--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)--"""-This example demonstrates a deterministic flow, where each step is performed by an agent.-1. The first agent generates a story outline-2. We feed the outline into the second agent-3. The second agent checks if the outline is good quality and if it is a scifi story-4. If the outline is not good quality or not a scifi story, we stop here-5. If the outline is good quality and a scifi story, we feed the outline into the third agent-6. The third agent writes the story-"""--story_outline_agent = Agent(- name="story_outline_agent",- instructions="Generate a very short story outline based on the user's input.",-)---class OutlineCheckerOutput(BaseModel):- good_quality: bool- is_scifi: bool---outline_checker_agent = Agent(- name="outline_checker_agent",- instructions="Read the given story outline, and judge the quality. Also, determine if it is a scifi story.",- output_type=OutlineCheckerOutput,-)--story_agent = Agent(- name="story_agent",- instructions="Write a short story based on the given outline.",- output_type=str,-)---async def main():- input_prompt = input("What kind of story do you want? ")-- # Ensure the entire workflow is a single trace- with trace("Deterministic story flow"):- # 1. Generate an outline- outline_result = await Runner.run(- story_outline_agent,- input_prompt,- )- print("Outline generated")-- # 2. Check the outline- outline_checker_result = await Runner.run(- outline_checker_agent,- outline_result.final_output,- )-- # 3. Add a gate to stop if the outline is not good quality or not a scifi story- assert isinstance(outline_checker_result.final_output, OutlineCheckerOutput)- if not outline_checker_result.final_output.good_quality:- print("Outline is not good quality, so we stop here.")- exit(0)-- if not outline_checker_result.final_output.is_scifi:- print("Outline is not a scifi story, so we stop here.")- exit(0)-- print("Outline is good quality and a scifi story, so we continue to write the story.")-- # 4. Write the story- story_result = await Runner.run(- story_agent,- outline_result.final_output,- )- print(f"Story: {story_result.final_output}")---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/agent_patterns/input_guardrails.py b/examples/agents-examples/agent_patterns/input_guardrails.pydeleted file mode 100644index cb611fde..00000000--- a/examples/agents-examples/agent_patterns/input_guardrails.py+++ /dev/null@@ -1,114 +0,0 @@-from __future__ import annotations--import asyncio--from pydantic import BaseModel--from agents import (- Agent,- GuardrailFunctionOutput,- InputGuardrailTripwireTriggered,- RunContextWrapper,- Runner,- TResponseInputItem,- input_guardrail,-)--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)--"""-This example shows how to use guardrails.--Guardrails are checks that run in parallel to the agent's execution.-They can be used to do things like:-- Check if input messages are off-topic-- Check that output messages don't violate any policies-- Take over control of the agent's execution if an unexpected input is detected--In this example, we'll setup an input guardrail that trips if the user is asking to do math homework.-If the guardrail trips, we'll respond with a refusal message.-"""---### 1. An agent-based guardrail that is triggered if the user is asking to do math homework-class MathHomeworkOutput(BaseModel):- is_math_homework: bool- reasoning: str---guardrail_agent = Agent(- name="Guardrail check",- instructions="Check if the user is asking you to do their math homework.",- output_type=MathHomeworkOutput,-)---@input_guardrail-async def math_guardrail(- context: RunContextWrapper[None], agent: Agent, input: str | list[TResponseInputItem]-) -> GuardrailFunctionOutput:- """This is an input guardrail function, which happens to call an agent to check if the input- is a math homework question.- """- result = await Runner.run(guardrail_agent, input, context=context.context)- final_output = result.final_output_as(MathHomeworkOutput)-- return GuardrailFunctionOutput(- output_info=final_output,- tripwire_triggered=final_output.is_math_homework,- )---### 2. The run loop---async def main():- agent = Agent(- name="Customer support agent",- instructions="You are a customer support agent. You help customers with their questions.",- input_guardrails=[math_guardrail],- )-- input_data: list[TResponseInputItem] = []-- while True:- user_input = input("Enter a message: ")- input_data.append(- {- "role": "user",- "content": user_input,- }- )-- try:- result = await Runner.run(agent, input_data)- print(result.final_output)- # If the guardrail didn't trigger, we use the result as the input for the next run- input_data = result.to_input_list()- except InputGuardrailTripwireTriggered:- # If the guardrail triggered, we instead add a refusal message to the input- message = "Sorry, I can't help you with your math homework."- print(message)- input_data.append(- {- "role": "assistant",- "content": message,- }- )-- # Sample run:- # Enter a message: What's the capital of California?- # The capital of California is Sacramento.- # Enter a message: Can you help me solve for x: 2x + 5 = 11- # Sorry, I can't help you with your math homework.---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/agent_patterns/llm_as_a_judge.py b/examples/agents-examples/agent_patterns/llm_as_a_judge.pydeleted file mode 100644index 7a5b97c7..00000000--- a/examples/agents-examples/agent_patterns/llm_as_a_judge.py+++ /dev/null@@ -1,85 +0,0 @@-from __future__ import annotations--import asyncio-from dataclasses import dataclass-from typing import Literal--from agents import Agent, ItemHelpers, Runner, TResponseInputItem, trace--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)--"""-This example shows the LLM as a judge pattern. The first agent generates an outline for a story.-The second agent judges the outline and provides feedback. We loop until the judge is satisfied-with the outline.-"""--story_outline_generator = Agent(- name="story_outline_generator",- instructions=(- "You generate a very short story outline based on the user's input."- "If there is any feedback provided, use it to improve the outline."- ),-)---@dataclass-class EvaluationFeedback:- score: Literal["pass", "needs_improvement", "fail"]- feedback: str---evaluator = Agent[None](- name="evaluator",- instructions=(- "You evaluate a story outline and decide if it's good enough."- "If it's not good enough, you provide feedback on what needs to be improved."- "Never give it a pass on the first try."- ),- output_type=EvaluationFeedback,-)---async def main() -> None:- msg = input("What kind of story would you like to hear? ")- input_items: list[TResponseInputItem] = [{"content": msg, "role": "user"}]-- latest_outline: str | None = None-- # We'll run the entire workflow in a single trace- with trace("LLM as a judge"):- while True:- story_outline_result = await Runner.run(- story_outline_generator,- input_items,- )-- input_items = story_outline_result.to_input_list()- latest_outline = ItemHelpers.text_message_outputs(story_outline_result.new_items)- print("Story outline generated")-- evaluator_result = await Runner.run(evaluator, input_items)- result: EvaluationFeedback = evaluator_result.final_output-- print(f"Evaluator score: {result.score}")-- if result.score == "pass":- print("Story outline is good enough, exiting.")- break-- print("Re-running with feedback")-- input_items.append({"content": f"Feedback: {result.feedback}", "role": "user"})-- print(f"Final story outline: {latest_outline}")---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/agent_patterns/output_guardrails.py b/examples/agents-examples/agent_patterns/output_guardrails.pydeleted file mode 100644index 71d3f3c2..00000000--- a/examples/agents-examples/agent_patterns/output_guardrails.py+++ /dev/null@@ -1,87 +0,0 @@-from __future__ import annotations--import asyncio-import json--from pydantic import BaseModel, Field--from agents import (- Agent,- GuardrailFunctionOutput,- OutputGuardrailTripwireTriggered,- RunContextWrapper,- Runner,- output_guardrail,-)--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)--"""-This example shows how to use output guardrails.--Output guardrails are checks that run on the final output of an agent.-They can be used to do things like:-- Check if the output contains sensitive data-- Check if the output is a valid response to the user's message--In this example, we'll use a (contrived) example where we check if the agent's response contains-a phone number.-"""---# The agent's output type-class MessageOutput(BaseModel):- reasoning: str = Field(description="Thoughts on how to respond to the user's message")- response: str = Field(description="The response to the user's message")- user_name: str | None = Field(description="The name of the user who sent the message, if known")---@output_guardrail-async def sensitive_data_check(- context: RunContextWrapper, agent: Agent, output: MessageOutput-) -> GuardrailFunctionOutput:- phone_number_in_response = "650" in output.response- phone_number_in_reasoning = "650" in output.reasoning-- return GuardrailFunctionOutput(- output_info={- "phone_number_in_response": phone_number_in_response,- "phone_number_in_reasoning": phone_number_in_reasoning,- },- tripwire_triggered=phone_number_in_response or phone_number_in_reasoning,- )---agent = Agent(- name="Assistant",- instructions="You are a helpful assistant.",- output_type=MessageOutput,- output_guardrails=[sensitive_data_check],-)---async def main():- # This should be ok- await Runner.run(agent, "What's the capital of California?")- print("First message passed")-- # This should trip the guardrail- try:- result = await Runner.run(agent, "My phone number is 650-123-4567. Where do you think I live?")- print(- f"Guardrail didn't trip - this is unexpected. Output: {json.dumps(result.final_output.model_dump(), indent=2)}"- )-- except OutputGuardrailTripwireTriggered as e:- print(f"Guardrail tripped. Info: {e.guardrail_result.output.output_info}")---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/agent_patterns/parallelization.py b/examples/agents-examples/agent_patterns/parallelization.pydeleted file mode 100644index cccdbcd2..00000000--- a/examples/agents-examples/agent_patterns/parallelization.py+++ /dev/null@@ -1,70 +0,0 @@-import asyncio--from agents import Agent, ItemHelpers, Runner, trace--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)--"""-This example shows the parallelization pattern. We run the agent three times in parallel, and pick-the best result.-"""--spanish_agent = Agent(- name="spanish_agent",- instructions="You translate the user's message to Spanish",-)--translation_picker = Agent(- name="translation_picker",- instructions="You pick the best Spanish translation from the given options.",-)---async def main():- msg = input("Hi! Enter a message, and we'll translate it to Spanish.\n\n")-- # Ensure the entire workflow is a single trace- with trace("Parallel translation"):- res_1, res_2, res_3 = await asyncio.gather(- Runner.run(- spanish_agent,- msg,- ),- Runner.run(- spanish_agent,- msg,- ),- Runner.run(- spanish_agent,- msg,- ),- )-- outputs = [- ItemHelpers.text_message_outputs(res_1.new_items),- ItemHelpers.text_message_outputs(res_2.new_items),- ItemHelpers.text_message_outputs(res_3.new_items),- ]-- translations = "\n\n".join(outputs)- print(f"\n\nTranslations:\n\n{translations}")-- best_translation = await Runner.run(- translation_picker,- f"Input: {msg}\n\nTranslations:\n{translations}",- )-- print("\n\n-----")-- print(f"Best translation: {best_translation.final_output}")---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/agent_patterns/routing.py b/examples/agents-examples/agent_patterns/routing.pydeleted file mode 100644index 45a6d478..00000000--- a/examples/agents-examples/agent_patterns/routing.py+++ /dev/null@@ -1,79 +0,0 @@-import asyncio-import uuid--from openai.types.responses import ResponseContentPartDoneEvent, ResponseTextDeltaEvent--from agents import Agent, RawResponsesStreamEvent, Runner, TResponseInputItem, trace--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)--"""-This example shows the handoffs/routing pattern. The triage agent receives the first message, and-then hands off to the appropriate agent based on the language of the request. Responses are-streamed to the user.-"""--french_agent = Agent(- name="french_agent",- instructions="You only speak French",-)--spanish_agent = Agent(- name="spanish_agent",- instructions="You only speak Spanish",-)--english_agent = Agent(- name="english_agent",- instructions="You only speak English",-)--triage_agent = Agent(- name="triage_agent",- instructions="Handoff to the appropriate agent based on the language of the request.",- handoffs=[french_agent, spanish_agent, english_agent],-)---async def main():- # We'll create an ID for this conversation, so we can link each trace- conversation_id = str(uuid.uuid4().hex[:16])-- msg = input("Hi! We speak French, Spanish and English. How can I help? ")- agent = triage_agent- inputs: list[TResponseInputItem] = [{"content": msg, "role": "user"}]-- while True:- # Each conversation turn is a single trace. Normally, each input from the user would be an- # API request to your app, and you can wrap the request in a trace()- with trace("Routing example", group_id=conversation_id):- result = Runner.run_streamed(- agent,- input=inputs,- )- async for event in result.stream_events():- if not isinstance(event, RawResponsesStreamEvent):- continue- data = event.data- if isinstance(data, ResponseTextDeltaEvent):- print(data.delta, end="", flush=True)- elif isinstance(data, ResponseContentPartDoneEvent):- print("\n")-- inputs = result.to_input_list()- print("\n")-- user_msg = input("Enter a message: ")- inputs.append({"content": user_msg, "role": "user"})- agent = result.current_agent---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/basic/agent_lifecycle_example.py b/examples/agents-examples/basic/agent_lifecycle_example.pydeleted file mode 100644index 847da52d..00000000--- a/examples/agents-examples/basic/agent_lifecycle_example.py+++ /dev/null@@ -1,113 +0,0 @@-import asyncio-import random-from typing import Any--from pydantic import BaseModel--from agents import Agent, AgentHooks, RunContextWrapper, Runner, Tool, function_tool--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---class CustomAgentHooks(AgentHooks):- def __init__(self, display_name: str):- self.event_counter = 0- self.display_name = display_name-- async def on_start(self, context: RunContextWrapper, agent: Agent) -> None:- self.event_counter += 1- print(f"### ({self.display_name}) {self.event_counter}: Agent {agent.name} started")-- async def on_end(self, context: RunContextWrapper, agent: Agent, output: Any) -> None:- self.event_counter += 1- print(f"### ({self.display_name}) {self.event_counter}: Agent {agent.name} ended with output {output}")-- async def on_handoff(self, context: RunContextWrapper, agent: Agent, source: Agent) -> None:- self.event_counter += 1- print(f"### ({self.display_name}) {self.event_counter}: Agent {source.name} handed off to {agent.name}")-- async def on_tool_start(self, context: RunContextWrapper, agent: Agent, tool: Tool) -> None:- self.event_counter += 1- print(f"### ({self.display_name}) {self.event_counter}: Agent {agent.name} started tool {tool.name}")-- async def on_tool_end(self, context: RunContextWrapper, agent: Agent, tool: Tool, result: str) -> None:- self.event_counter += 1- print(- f"### ({self.display_name}) {self.event_counter}: Agent {agent.name} ended tool {tool.name} with result {result}"- )---###---@function_tool-def random_number(max: int) -> int:- """- Generate a random number up to the provided maximum.- """- return random.randint(0, max)---@function_tool-def multiply_by_two(x: int) -> int:- """Simple multiplication by two."""- return x * 2---class FinalResult(BaseModel):- number: int---multiply_agent = Agent(- name="Multiply Agent",- instructions="Multiply the number by 2 and then return the final result.",- tools=[multiply_by_two],- output_type=FinalResult,- hooks=CustomAgentHooks(display_name="Multiply Agent"),-)--start_agent = Agent(- name="Start Agent",- instructions="Generate a random number. If it's even, stop. If it's odd, hand off to the multipler agent.",- tools=[random_number],- output_type=FinalResult,- handoffs=[multiply_agent],- hooks=CustomAgentHooks(display_name="Start Agent"),-)---async def main() -> None:- user_input = input("Enter a max number: ")- await Runner.run(- start_agent,- input=f"Generate a random number between 0 and {user_input}.",- )-- print("Done!")---if __name__ == "__main__":- asyncio.run(main())-"""-$ python examples/basic/agent_lifecycle_example.py--Enter a max number: 250-### (Start Agent) 1: Agent Start Agent started-### (Start Agent) 2: Agent Start Agent started tool random_number-### (Start Agent) 3: Agent Start Agent ended tool random_number with result 37-### (Start Agent) 4: Agent Start Agent started-### (Start Agent) 5: Agent Start Agent handed off to Multiply Agent-### (Multiply Agent) 1: Agent Multiply Agent started-### (Multiply Agent) 2: Agent Multiply Agent started tool multiply_by_two-### (Multiply Agent) 3: Agent Multiply Agent ended tool multiply_by_two with result 74-### (Multiply Agent) 4: Agent Multiply Agent started-### (Multiply Agent) 5: Agent Multiply Agent ended with output number=74-Done!-"""diff --git a/examples/agents-examples/basic/dynamic_system_prompt.py b/examples/agents-examples/basic/dynamic_system_prompt.pydeleted file mode 100644index 3b876666..00000000--- a/examples/agents-examples/basic/dynamic_system_prompt.py+++ /dev/null@@ -1,76 +0,0 @@-import asyncio-import random-from typing import Literal--from agents import Agent, RunContextWrapper, Runner--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---class CustomContext:- def __init__(self, style: Literal["haiku", "pirate", "robot"]):- self.style = style---def custom_instructions(run_context: RunContextWrapper[CustomContext], agent: Agent[CustomContext]) -> str:- context = run_context.context- if context.style == "haiku":- return "Only respond in haikus."- elif context.style == "pirate":- return "Respond as a pirate."- else:- return "Respond as a robot and say 'beep boop' a lot."---agent = Agent(- name="Chat agent",- instructions=custom_instructions,-)---async def main():- choice: Literal["haiku", "pirate", "robot"] = random.choice(["haiku", "pirate", "robot"])- context = CustomContext(style=choice)- print(f"Using style: {choice}\n")-- user_message = "Tell me a joke."- print(f"User: {user_message}")- result = await Runner.run(agent, user_message, context=context)-- print(f"Assistant: {result.final_output}")---if __name__ == "__main__":- asyncio.run(main())--"""-$ python examples/basic/dynamic_system_prompt.py--Using style: haiku--User: Tell me a joke.-Assistant: Why don't eggs tell jokes?-They might crack each other's shells,-leaving yolk on face.--$ python examples/basic/dynamic_system_prompt.py-Using style: robot--User: Tell me a joke.-Assistant: Beep boop! Why was the robot so bad at soccer? Beep boop... because it kept kicking up a debug! Beep boop!--$ python examples/basic/dynamic_system_prompt.py-Using style: pirate--User: Tell me a joke.-Assistant: Why did the pirate go to school?--To improve his arrr-ticulation! Har har har! 🏴☠️-"""diff --git a/examples/agents-examples/basic/hello_world.py b/examples/agents-examples/basic/hello_world.pydeleted file mode 100644index 0abbd4d1..00000000--- a/examples/agents-examples/basic/hello_world.py+++ /dev/null@@ -1,24 +0,0 @@-# To run this file from project root: AGENTOPS_LOG_LEVEL=debug uv run examples/agents-example/hello_world.py-import agentops-import asyncio-from agents import Agent, Runner-from dotenv import load_dotenv--load_dotenv()---async def main():- agentops.init(tags=["test", "openai-agents"])-- agent = Agent(- name="Hello World Agent",- instructions="You are a helpful assistant. Your task is to answer questions about programming concepts.",- )-- # Regular agent run- result = await Runner.run(agent, "Tell me about recursion in programming.")- print(result.final_output)---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/basic/hello_world_handoffs.py b/examples/agents-examples/basic/hello_world_handoffs.pydeleted file mode 100644index a034558e..00000000--- a/examples/agents-examples/basic/hello_world_handoffs.py+++ /dev/null@@ -1,35 +0,0 @@-# To run this file from project root: AGENTOPS_LOG_LEVEL=debug uv run examples/agents-example/hello_world_handoffs.py-import agentops-import asyncio-from agents import Agent, Runner-from dotenv import load_dotenv--load_dotenv()---async def main():- agentops.init()-- # Define a secondary agent that specializes in math- math_agent = Agent(- name="Math Expert",- model="o3-mini",- instructions="You are a mathematics expert. Your task is to answer questions specifically about math concepts.",- handoff_description="A specialized agent for answering mathematical questions.",- )-- # Configure the primary agent with handoffs to the math agent- primary_agent_with_handoffs = Agent(- name="Programming Agent",- instructions="You are a programming expert. Your task is to answer questions about programming concepts. If a user asks about math concepts, hand off to the Math Expert agent.",- handoffs=[- math_agent,- ],- )-- result = await Runner.run(primary_agent_with_handoffs, "Tell me about recursion in programming.")- print(result.final_output)---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/basic/hello_world_tools.py b/examples/agents-examples/basic/hello_world_tools.pydeleted file mode 100644index 5e3e9682..00000000--- a/examples/agents-examples/basic/hello_world_tools.py+++ /dev/null@@ -1,64 +0,0 @@-# To run this file from project root: AGENTOPS_LOG_LEVEL=debug uv run examples/agents-example/hello_world_tools.py-import agentops-import asyncio-from agents import Agent, Runner, function_tool-from dotenv import load_dotenv--load_dotenv()---@function_tool-def get_weather(location: str) -> str:- """Get the current weather for a location."""- # This is a mock function that would normally call a weather API- return f"The weather in {location} is currently sunny and 72°F."---@function_tool-def calculate_tip(amount: float, percentage: float) -> str:- """Calculate tip amount based on bill total and percentage."""- tip = amount * (percentage / 100)- total = amount + tip- return f"For a ${amount:.2f} bill with {percentage}% tip: Tip amount is ${tip:.2f}, total bill is ${total:.2f}"---async def main():- agentops.init()-- # Create agent with tools - use the decorated functions directly- agent = Agent(- name="Tool Demo Agent",- instructions="You are a helpful assistant that can check weather and calculate tips.",- tools=[get_weather, calculate_tip],- )-- # Run agent with tools- result = await Runner.run(agent, "What's the weather in Seattle? Also, calculate a 20% tip on a $85.75 bill.")- print(result.final_output)-- # Print tool calls for debugging- print("\nTool Calls Made:")-- # Try to access raw_responses attribute- if hasattr(result, "raw_responses"):- # Print information about the response to debug- print("Response type:", type(result.raw_responses))-- # Handle raw_responses based on its type- if isinstance(result.raw_responses, list):- # If it's a list, iterate through it- for response in result.raw_responses:- if hasattr(response, "output"):- # If response has output attribute, print it- print(f"Response output: {response.output}")- elif isinstance(response, dict) and "tool_calls" in response:- # If it's a dict with tool_calls- for tool_call in response["tool_calls"]:- print(f"Tool: {tool_call.get('name', '')}")- print(f"Arguments: {tool_call.get('arguments', {})}")- print(f"Response: {tool_call.get('response', '')}")- print()---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/basic/lifecycle_example.py b/examples/agents-examples/basic/lifecycle_example.pydeleted file mode 100644index 1999d99f..00000000--- a/examples/agents-examples/basic/lifecycle_example.py+++ /dev/null@@ -1,119 +0,0 @@-import asyncio-import random-from typing import Any--from pydantic import BaseModel--from agents import Agent, RunContextWrapper, RunHooks, Runner, Tool, Usage, function_tool--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---class ExampleHooks(RunHooks):- def __init__(self):- self.event_counter = 0-- def _usage_to_str(self, usage: Usage) -> str:- return f"{usage.requests} requests, {usage.input_tokens} input tokens, {usage.output_tokens} output tokens, {usage.total_tokens} total tokens"-- async def on_agent_start(self, context: RunContextWrapper, agent: Agent) -> None:- self.event_counter += 1- print(f"### {self.event_counter}: Agent {agent.name} started. Usage: {self._usage_to_str(context.usage)}")-- async def on_agent_end(self, context: RunContextWrapper, agent: Agent, output: Any) -> None:- self.event_counter += 1- print(- f"### {self.event_counter}: Agent {agent.name} ended with output {output}. Usage: {self._usage_to_str(context.usage)}"- )-- async def on_tool_start(self, context: RunContextWrapper, agent: Agent, tool: Tool) -> None:- self.event_counter += 1- print(f"### {self.event_counter}: Tool {tool.name} started. Usage: {self._usage_to_str(context.usage)}")-- async def on_tool_end(self, context: RunContextWrapper, agent: Agent, tool: Tool, result: str) -> None:- self.event_counter += 1- print(- f"### {self.event_counter}: Tool {tool.name} ended with result {result}. Usage: {self._usage_to_str(context.usage)}"- )-- async def on_handoff(self, context: RunContextWrapper, from_agent: Agent, to_agent: Agent) -> None:- self.event_counter += 1- print(- f"### {self.event_counter}: Handoff from {from_agent.name} to {to_agent.name}. Usage: {self._usage_to_str(context.usage)}"- )---hooks = ExampleHooks()--###---@function_tool-def random_number(max: int) -> int:- """Generate a random number up to the provided max."""- return random.randint(0, max)---@function_tool-def multiply_by_two(x: int) -> int:- """Return x times two."""- return x * 2---class FinalResult(BaseModel):- number: int---multiply_agent = Agent(- name="Multiply Agent",- instructions="Multiply the number by 2 and then return the final result.",- tools=[multiply_by_two],- output_type=FinalResult,-)--start_agent = Agent(- name="Start Agent",- instructions="Generate a random number. If it's even, stop. If it's odd, hand off to the multipler agent.",- tools=[random_number],- output_type=FinalResult,- handoffs=[multiply_agent],-)---async def main() -> None:- user_input = input("Enter a max number: ")- await Runner.run(- start_agent,- hooks=hooks,- input=f"Generate a random number between 0 and {user_input}.",- )-- print("Done!")---if __name__ == "__main__":- asyncio.run(main())-"""-$ python examples/basic/lifecycle_example.py--Enter a max number: 250-### 1: Agent Start Agent started. Usage: 0 requests, 0 input tokens, 0 output tokens, 0 total tokens-### 2: Tool random_number started. Usage: 1 requests, 148 input tokens, 15 output tokens, 163 total tokens-### 3: Tool random_number ended with result 101. Usage: 1 requests, 148 input tokens, 15 output tokens, 163 total tokens-### 4: Agent Start Agent started. Usage: 1 requests, 148 input tokens, 15 output tokens, 163 total tokens-### 5: Handoff from Start Agent to Multiply Agent. Usage: 2 requests, 323 input tokens, 30 output tokens, 353 total tokens-### 6: Agent Multiply Agent started. Usage: 2 requests, 323 input tokens, 30 output tokens, 353 total tokens-### 7: Tool multiply_by_two started. Usage: 3 requests, 504 input tokens, 46 output tokens, 550 total tokens-### 8: Tool multiply_by_two ended with result 202. Usage: 3 requests, 504 input tokens, 46 output tokens, 550 total tokens-### 9: Agent Multiply Agent started. Usage: 3 requests, 504 input tokens, 46 output tokens, 550 total tokens-### 10: Agent Multiply Agent ended with output number=202. Usage: 4 requests, 714 input tokens, 63 output tokens, 777 total tokens-Done!--"""diff --git a/examples/agents-examples/basic/stream_items.py b/examples/agents-examples/basic/stream_items.pydeleted file mode 100644index 852be44f..00000000--- a/examples/agents-examples/basic/stream_items.py+++ /dev/null@@ -1,74 +0,0 @@-import asyncio-import random--from agents import Agent, ItemHelpers, Runner, function_tool--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---@function_tool-def how_many_jokes() -> int:- return random.randint(1, 10)---async def main():- agent = Agent(- name="Joker",- instructions="First call the `how_many_jokes` tool, then tell that many jokes.",- tools=[how_many_jokes],- )-- result = Runner.run_streamed(- agent,- input="Hello",- )- print("=== Run starting ===")- async for event in result.stream_events():- # We'll ignore the raw responses event deltas- if event.type == "raw_response_event":- continue- elif event.type == "agent_updated_stream_event":- print(f"Agent updated: {event.new_agent.name}")- continue- elif event.type == "run_item_stream_event":- if event.item.type == "tool_call_item":- print("-- Tool was called")- elif event.item.type == "tool_call_output_item":- print(f"-- Tool output: {event.item.output}")- elif event.item.type == "message_output_item":- print(f"-- Message output:\n {ItemHelpers.text_message_output(event.item)}")- else:- pass # Ignore other event types-- print("=== Run complete ===")---if __name__ == "__main__":- asyncio.run(main())-- # === Run starting ===- # Agent updated: Joker- # -- Tool was called- # -- Tool output: 4- # -- Message output:- # Sure, here are four jokes for you:-- # 1. **Why don't skeletons fight each other?**- # They don't have the guts!-- # 2. **What do you call fake spaghetti?**- # An impasta!-- # 3. **Why did the scarecrow win an award?**- # Because he was outstanding in his field!-- # 4. **Why did the bicycle fall over?**- # Because it was two-tired!- # === Run complete ===diff --git a/examples/agents-examples/basic/stream_text.py b/examples/agents-examples/basic/stream_text.pydeleted file mode 100644index 569b65bf..00000000--- a/examples/agents-examples/basic/stream_text.py+++ /dev/null@@ -1,31 +0,0 @@-import asyncio--from openai.types.responses import ResponseTextDeltaEvent--from agents import Agent, Runner---from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---async def main():- agent = Agent(- name="Joker",- instructions="You are a helpful assistant.",- )-- result = Runner.run_streamed(agent, input="Please tell me 5 jokes.")- async for event in result.stream_events():- if event.type == "raw_response_event" and isinstance(event.data, ResponseTextDeltaEvent):- print(event.data.delta, end="", flush=True)---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/handoffs/message_filter.py b/examples/agents-examples/handoffs/message_filter.pydeleted file mode 100644index 65ec6dd8..00000000--- a/examples/agents-examples/handoffs/message_filter.py+++ /dev/null@@ -1,183 +0,0 @@-from __future__ import annotations--import json-import random--from agents import Agent, HandoffInputData, Runner, function_tool, handoff, trace-from agents.extensions import handoff_filters--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---@function_tool-def random_number_tool(max: int) -> int:- """Return a random integer between 0 and the given maximum."""- return random.randint(0, max)---def spanish_handoff_message_filter(handoff_message_data: HandoffInputData) -> HandoffInputData:- # First, we'll remove any tool-related messages from the message history- handoff_message_data = handoff_filters.remove_all_tools(handoff_message_data)-- # Second, we'll also remove the first two items from the history, just for demonstration- history = (- tuple(handoff_message_data.input_history[2:])- if isinstance(handoff_message_data.input_history, tuple)- else handoff_message_data.input_history- )-- return HandoffInputData(- input_history=history,- pre_handoff_items=tuple(handoff_message_data.pre_handoff_items),- new_items=tuple(handoff_message_data.new_items),- )---first_agent = Agent(- name="Assistant",- instructions="Be extremely concise.",- tools=[random_number_tool],-)--spanish_agent = Agent(- name="Spanish Assistant",- instructions="You only speak Spanish and are extremely concise.",- handoff_description="A Spanish-speaking assistant.",-)--second_agent = Agent(- name="Assistant",- instructions=("Be a helpful assistant. If the user speaks Spanish, handoff to the Spanish assistant."),- handoffs=[handoff(spanish_agent, input_filter=spanish_handoff_message_filter)],-)---async def main():- # Trace the entire run as a single workflow- with trace(workflow_name="Message filtering"):- # 1. Send a regular message to the first agent- result = await Runner.run(first_agent, input="Hi, my name is Sora.")-- print("Step 1 done")-- # 2. Ask it to square a number- result = await Runner.run(- second_agent,- input=result.to_input_list()- + [{"content": "Can you generate a random number between 0 and 100?", "role": "user"}],- )-- print("Step 2 done")-- # 3. Call the second agent- result = await Runner.run(- second_agent,- input=result.to_input_list()- + [- {- "content": "I live in New York City. Whats the population of the city?",- "role": "user",- }- ],- )-- print("Step 3 done")-- # 4. Cause a handoff to occur- result = await Runner.run(- second_agent,- input=result.to_input_list()- + [- {- "content": "Por favor habla en español. ¿Cuál es mi nombre y dónde vivo?",- "role": "user",- }- ],- )-- print("Step 4 done")-- print("\n===Final messages===\n")-- # 5. That should have caused spanish_handoff_message_filter to be called, which means the- # output should be missing the first two messages, and have no tool calls.- # Let's print the messages to see what happened- for message in result.to_input_list():- print(json.dumps(message, indent=2))- # tool_calls = message.tool_calls if isinstance(message, AssistantMessage) else None-- # print(f"{message.role}: {message.content}\n - Tool calls: {tool_calls or 'None'}")- """- $python examples/handoffs/message_filter.py- Step 1 done- Step 2 done- Step 3 done- Step 4 done-- ===Final messages===-- {- "content": "Can you generate a random number between 0 and 100?",- "role": "user"- }- {- "id": "...",- "content": [- {- "annotations": [],- "text": "Sure! Here's a random number between 0 and 100: **42**.",- "type": "output_text"- }- ],- "role": "assistant",- "status": "completed",- "type": "message"- }- {- "content": "I live in New York City. Whats the population of the city?",- "role": "user"- }- {- "id": "...",- "content": [- {- "annotations": [],- "text": "As of the most recent estimates, the population of New York City is approximately 8.6 million people. However, this number is constantly changing due to various factors such as migration and birth rates. For the latest and most accurate information, it's always a good idea to check the official data from sources like the U.S. Census Bureau.",- "type": "output_text"- }- ],- "role": "assistant",- "status": "completed",- "type": "message"- }- {- "content": "Por favor habla en espa\u00f1ol. \u00bfCu\u00e1l es mi nombre y d\u00f3nde vivo?",- "role": "user"- }- {- "id": "...",- "content": [- {- "annotations": [],- "text": "No tengo acceso a esa informaci\u00f3n personal, solo s\u00e9 lo que me has contado: vives en Nueva York.",- "type": "output_text"- }- ],- "role": "assistant",- "status": "completed",- "type": "message"- }- """---if __name__ == "__main__":- import asyncio-- asyncio.run(main())diff --git a/examples/agents-examples/handoffs/message_filter_streaming.py b/examples/agents-examples/handoffs/message_filter_streaming.pydeleted file mode 100644index 18c63150..00000000--- a/examples/agents-examples/handoffs/message_filter_streaming.py+++ /dev/null@@ -1,183 +0,0 @@-from __future__ import annotations--import json-import random--from agents import Agent, HandoffInputData, Runner, function_tool, handoff, trace-from agents.extensions import handoff_filters--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---@function_tool-def random_number_tool(max: int) -> int:- """Return a random integer between 0 and the given maximum."""- return random.randint(0, max)---def spanish_handoff_message_filter(handoff_message_data: HandoffInputData) -> HandoffInputData:- # First, we'll remove any tool-related messages from the message history- handoff_message_data = handoff_filters.remove_all_tools(handoff_message_data)-- # Second, we'll also remove the first two items from the history, just for demonstration- history = (- tuple(handoff_message_data.input_history[2:])- if isinstance(handoff_message_data.input_history, tuple)- else handoff_message_data.input_history- )-- return HandoffInputData(- input_history=history,- pre_handoff_items=tuple(handoff_message_data.pre_handoff_items),- new_items=tuple(handoff_message_data.new_items),- )---first_agent = Agent(- name="Assistant",- instructions="Be extremely concise.",- tools=[random_number_tool],-)--spanish_agent = Agent(- name="Spanish Assistant",- instructions="You only speak Spanish and are extremely concise.",- handoff_description="A Spanish-speaking assistant.",-)--second_agent = Agent(- name="Assistant",- instructions=("Be a helpful assistant. If the user speaks Spanish, handoff to the Spanish assistant."),- handoffs=[handoff(spanish_agent, input_filter=spanish_handoff_message_filter)],-)---async def main():- # Trace the entire run as a single workflow- with trace(workflow_name="Streaming message filter"):- # 1. Send a regular message to the first agent- result = await Runner.run(first_agent, input="Hi, my name is Sora.")-- print("Step 1 done")-- # 2. Ask it to square a number- result = await Runner.run(- second_agent,- input=result.to_input_list()- + [{"content": "Can you generate a random number between 0 and 100?", "role": "user"}],- )-- print("Step 2 done")-- # 3. Call the second agent- result = await Runner.run(- second_agent,- input=result.to_input_list()- + [- {- "content": "I live in New York City. Whats the population of the city?",- "role": "user",- }- ],- )-- print("Step 3 done")-- # 4. Cause a handoff to occur- stream_result = Runner.run_streamed(- second_agent,- input=result.to_input_list()- + [- {- "content": "Por favor habla en español. ¿Cuál es mi nombre y dónde vivo?",- "role": "user",- }- ],- )- async for _ in stream_result.stream_events():- pass-- print("Step 4 done")-- print("\n===Final messages===\n")-- # 5. That should have caused spanish_handoff_message_filter to be called, which means the- # output should be missing the first two messages, and have no tool calls.- # Let's print the messages to see what happened- for item in stream_result.to_input_list():- print(json.dumps(item, indent=2))- """- $python examples/handoffs/message_filter_streaming.py- Step 1 done- Step 2 done- Step 3 done- Tu nombre y lugar de residencia no los tengo disponibles. Solo sé que mencionaste vivir en la ciudad de Nueva York.- Step 4 done-- ===Final messages===-- {- "content": "Can you generate a random number between 0 and 100?",- "role": "user"- }- {- "id": "...",- "content": [- {- "annotations": [],- "text": "Sure! Here's a random number between 0 and 100: **37**.",- "type": "output_text"- }- ],- "role": "assistant",- "status": "completed",- "type": "message"- }- {- "content": "I live in New York City. Whats the population of the city?",- "role": "user"- }- {- "id": "...",- "content": [- {- "annotations": [],- "text": "As of the latest estimates, New York City's population is approximately 8.5 million people. Would you like more information about the city?",- "type": "output_text"- }- ],- "role": "assistant",- "status": "completed",- "type": "message"- }- {- "content": "Por favor habla en espa\u00f1ol. \u00bfCu\u00e1l es mi nombre y d\u00f3nde vivo?",- "role": "user"- }- {- "id": "...",- "content": [- {- "annotations": [],- "text": "No s\u00e9 tu nombre, pero me dijiste que vives en Nueva York.",- "type": "output_text"- }- ],- "role": "assistant",- "status": "completed",- "type": "message"- }- """---if __name__ == "__main__":- import asyncio-- asyncio.run(main())diff --git a/examples/agents-examples/research_bot/README.md b/examples/agents-examples/research_bot/README.mddeleted file mode 100644index 4060983c..00000000--- a/examples/agents-examples/research_bot/README.md+++ /dev/null@@ -1,25 +0,0 @@-# Research bot--This is a simple example of a multi-agent research bot. To run it:--```bash-python -m examples.research_bot.main-```--## Architecture--The flow is:--1. User enters their research topic-2. `planner_agent` comes up with a plan to search the web for information. The plan is a list of search queries, with a search term and a reason for each query.-3. For each search item, we run a `search_agent`, which uses the Web Search tool to search for that term and summarize the results. These all run in parallel.-4. Finally, the `writer_agent` receives the search summaries, and creates a written report.--## Suggested improvements--If you're building your own research bot, some ideas to add to this are:--1. Retrieval: Add support for fetching relevant information from a vector store. You could use the File Search tool for this.-2. Image and file upload: Allow users to attach PDFs or other files, as baseline context for the research.-3. More planning and thinking: Models often produce better results given more time to think. Improve the planning process to come up with a better plan, and add an evaluation step so that the model can choose to improve it's results, search for more stuff, etc.-4. Code execution: Allow running code, which is useful for data analysis.diff --git a/examples/agents-examples/research_bot/__init__.py b/examples/agents-examples/research_bot/__init__.pydeleted file mode 100644index 8b137891..00000000--- a/examples/agents-examples/research_bot/__init__.py+++ /dev/null@@ -1 +0,0 @@-diff --git a/examples/agents-examples/research_bot/agents/__init__.py b/examples/agents-examples/research_bot/agents/__init__.pydeleted file mode 100644index e69de29b..00000000diff --git a/examples/agents-examples/research_bot/agents/planner_agent.py b/examples/agents-examples/research_bot/agents/planner_agent.pydeleted file mode 100644index e80a8e65..00000000--- a/examples/agents-examples/research_bot/agents/planner_agent.py+++ /dev/null@@ -1,29 +0,0 @@-from pydantic import BaseModel--from agents import Agent--PROMPT = (- "You are a helpful research assistant. Given a query, come up with a set of web searches "- "to perform to best answer the query. Output between 5 and 20 terms to query for."-)---class WebSearchItem(BaseModel):- reason: str- "Your reasoning for why this search is important to the query."-- query: str- "The search term to use for the web search."---class WebSearchPlan(BaseModel):- searches: list[WebSearchItem]- """A list of web searches to perform to best answer the query."""---planner_agent = Agent(- name="PlannerAgent",- instructions=PROMPT,- model="gpt-4o",- output_type=WebSearchPlan,-)diff --git a/examples/agents-examples/research_bot/agents/search_agent.py b/examples/agents-examples/research_bot/agents/search_agent.pydeleted file mode 100644index 72cbc8e1..00000000--- a/examples/agents-examples/research_bot/agents/search_agent.py+++ /dev/null@@ -1,18 +0,0 @@-from agents import Agent, WebSearchTool-from agents.model_settings import ModelSettings--INSTRUCTIONS = (- "You are a research assistant. Given a search term, you search the web for that term and"- "produce a concise summary of the results. The summary must 2-3 paragraphs and less than 300"- "words. Capture the main points. Write succintly, no need to have complete sentences or good"- "grammar. This will be consumed by someone synthesizing a report, so its vital you capture the"- "essence and ignore any fluff. Do not include any additional commentary other than the summary"- "itself."-)--search_agent = Agent(- name="Search agent",- instructions=INSTRUCTIONS,- tools=[WebSearchTool()],- model_settings=ModelSettings(tool_choice="required"),-)diff --git a/examples/agents-examples/research_bot/agents/writer_agent.py b/examples/agents-examples/research_bot/agents/writer_agent.pydeleted file mode 100644index 7b7d01a2..00000000--- a/examples/agents-examples/research_bot/agents/writer_agent.py+++ /dev/null@@ -1,33 +0,0 @@-# Agent used to synthesize a final report from the individual summaries.-from pydantic import BaseModel--from agents import Agent--PROMPT = (- "You are a senior researcher tasked with writing a cohesive report for a research query. "- "You will be provided with the original query, and some initial research done by a research "- "assistant.\n"- "You should first come up with an outline for the report that describes the structure and "- "flow of the report. Then, generate the report and return that as your final output.\n"- "The final output should be in markdown format, and it should be lengthy and detailed. Aim "- "for 5-10 pages of content, at least 1000 words."-)---class ReportData(BaseModel):- short_summary: str- """A short 2-3 sentence summary of the findings."""-- markdown_report: str- """The final report"""-- follow_up_questions: list[str]- """Suggested topics to research further"""---writer_agent = Agent(- name="WriterAgent",- instructions=PROMPT,- model="o3-mini",- output_type=ReportData,-)diff --git a/examples/agents-examples/research_bot/main.py b/examples/agents-examples/research_bot/main.pydeleted file mode 100644index 34e042a8..00000000--- a/examples/agents-examples/research_bot/main.py+++ /dev/null@@ -1,21 +0,0 @@-import asyncio--from .manager import ResearchManager--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---async def main() -> None:- query = input("What would you like to research? ")- await ResearchManager().run(query)---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/research_bot/manager.py b/examples/agents-examples/research_bot/manager.pydeleted file mode 100644index f59aa665..00000000--- a/examples/agents-examples/research_bot/manager.py+++ /dev/null@@ -1,117 +0,0 @@-from __future__ import annotations--import asyncio-import time--from rich.console import Console--from agents import Runner, custom_span, gen_trace_id, trace--from .agents.planner_agent import WebSearchItem, WebSearchPlan, planner_agent-from .agents.search_agent import search_agent-from .agents.writer_agent import ReportData, writer_agent-from .printer import Printer---class ResearchManager:- def __init__(self):- self.console = Console()- self.printer = Printer(self.console)-- async def run(self, query: str) -> None:- trace_id = gen_trace_id()- with trace("Research trace", trace_id=trace_id):- self.printer.update_item(- "trace_id",- f"View trace: https://platform.openai.com/logs/{trace_id}",- is_done=True,- hide_checkmark=True,- )-- self.printer.update_item(- "starting",- "Starting research...",- is_done=True,- hide_checkmark=True,- )- search_plan = await self._plan_searches(query)- search_results = await self._perform_searches(search_plan)- report = await self._write_report(query, search_results)-- final_report = f"Report summary\n\n{report.short_summary}"- self.printer.update_item("final_report", final_report, is_done=True)-- self.printer.end()-- print("\n\n=====REPORT=====\n\n")- print(f"Report: {report.markdown_report}")- print("\n\n=====FOLLOW UP QUESTIONS=====\n\n")- follow_up_questions = "\n".join(report.follow_up_questions)- print(f"Follow up questions: {follow_up_questions}")-- async def _plan_searches(self, query: str) -> WebSearchPlan:- self.printer.update_item("planning", "Planning searches...")- result = await Runner.run(- planner_agent,- f"Query: {query}",- )- self.printer.update_item(- "planning",- f"Will perform {len(result.final_output.searches)} searches",- is_done=True,- )- return result.final_output_as(WebSearchPlan)-- async def _perform_searches(self, search_plan: WebSearchPlan) -> list[str]:- with custom_span("Search the web"):- self.printer.update_item("searching", "Searching...")- num_completed = 0- tasks = [asyncio.create_task(self._search(item)) for item in search_plan.searches]- results = []- for task in asyncio.as_completed(tasks):- result = await task- if result is not None:- results.append(result)- num_completed += 1- self.printer.update_item("searching", f"Searching... {num_completed}/{len(tasks)} completed")- self.printer.mark_item_done("searching")- return results-- async def _search(self, item: WebSearchItem) -> str | None:- input = f"Search term: {item.query}\nReason for searching: {item.reason}"- try:- result = await Runner.run(- search_agent,- input,- )- return str(result.final_output)- except Exception:- return None-- async def _write_report(self, query: str, search_results: list[str]) -> ReportData:- self.printer.update_item("writing", "Thinking about report...")- input = f"Original query: {query}\nSummarized search results: {search_results}"- result = Runner.run_streamed(- writer_agent,- input,- )- update_messages = [- "Thinking about report...",- "Planning report structure...",- "Writing outline...",- "Creating sections...",- "Cleaning up formatting...",- "Finalizing report...",- "Finishing report...",- ]-- last_update = time.time()- next_message = 0- async for _ in result.stream_events():- if time.time() - last_update > 5 and next_message < len(update_messages):- self.printer.update_item("writing", update_messages[next_message])- next_message += 1- last_update = time.time()-- self.printer.mark_item_done("writing")- return result.final_output_as(ReportData)diff --git a/examples/agents-examples/research_bot/printer.py b/examples/agents-examples/research_bot/printer.pydeleted file mode 100644index ca6dd2b8..00000000--- a/examples/agents-examples/research_bot/printer.py+++ /dev/null@@ -1,39 +0,0 @@-from typing import Any--from rich.console import Console, Group-from rich.live import Live-from rich.spinner import Spinner---class Printer:- def __init__(self, console: Console):- self.live = Live(console=console)- self.items: dict[str, tuple[str, bool]] = {}- self.hide_done_ids: set[str] = set()- self.live.start()-- def end(self) -> None:- self.live.stop()-- def hide_done_checkmark(self, item_id: str) -> None:- self.hide_done_ids.add(item_id)-- def update_item(self, item_id: str, content: str, is_done: bool = False, hide_checkmark: bool = False) -> None:- self.items[item_id] = (content, is_done)- if hide_checkmark:- self.hide_done_ids.add(item_id)- self.flush()-- def mark_item_done(self, item_id: str) -> None:- self.items[item_id] = (self.items[item_id][0], True)- self.flush()-- def flush(self) -> None:- renderables: list[Any] = []- for item_id, (content, is_done) in self.items.items():- if is_done:- prefix = "✅ " if item_id not in self.hide_done_ids else ""- renderables.append(prefix + content)- else:- renderables.append(Spinner("dots", text=content))- self.live.update(Group(*renderables))diff --git a/examples/agents-examples/research_bot/sample_outputs/product_recs.md b/examples/agents-examples/research_bot/sample_outputs/product_recs.mddeleted file mode 100644index 70789eb3..00000000--- a/examples/agents-examples/research_bot/sample_outputs/product_recs.md+++ /dev/null@@ -1,180 +0,0 @@-# Comprehensive Guide on Best Surfboards for Beginners: Transitioning, Features, and Budget Options--Surfing is not only a sport but a lifestyle that hooks its enthusiasts with the allure of riding waves and connecting with nature. For beginners, selecting the right surfboard is critical to safety, learning, and performance. This comprehensive guide has been crafted to walk through the essential aspects of choosing the ideal surfboard for beginners, especially those looking to transition from an 11-foot longboard to a shorter, more dynamic board. We discuss various board types, materials, design elements, and budget ranges, providing a detailed road map for both new surfers and those in the process of progression.-------## Table of Contents--1. [Introduction](#introduction)-2. [Board Types and Design Considerations](#board-types-and-design-considerations)-3. [Key Board Dimensions and Features](#key-board-dimensions-and-features)-4. [Materials: Soft-Top vs. Hard-Top Boards](#materials-soft-top-vs-hard-top-boards)-5. [Tips for Transitioning from Longboards to Shorter Boards](#tips-for-transitioning-from-longboards-to-shorter-boards)-6. [Budget and Pricing Options](#budget-and-pricing-options)-7. [Recommended Models and Buying Options](#recommended-models-and-buying-options)-8. [Conclusion](#conclusion)-9. [Follow-up Questions](#follow-up-questions)-------## Introduction--Surfing is a dynamic sport that requires not only skill and technique but also the proper equipment. For beginners, the right surfboard can make the difference between a frustrating experience and one that builds confidence and enthusiasm. Many newcomers start with longboards due to their stability and ease of paddling; however, as skills develop, transitioning to a shorter board might be desirable for enhancing maneuverability and performance. This guide is designed for surfers who can already catch waves on an 11-foot board and are now considering stepping down to a more versatile option.--The overarching goal of this document is to help beginners identify which surfboard characteristics are most important, including board length, width, thickness, volume, and materials, while also considering factors like weight distribution, buoyancy, and control. We will also take a look at board types that are particularly welcoming for beginners and discuss gradual transitioning strategies.-------## Board Types and Design Considerations--Choosing a board involves understanding the variety of designs available. Below are the main types of surfboards that cater to beginners and transitional surfers:--### Longboards and Mini-Mals--Longboards, typically 8 to 11 feet in length, provide ample stability, smoother paddling, and are well-suited for wave-catching. Their generous volume and width allow beginners to build confidence when standing up and riding waves. Mini-mal or mini-malibus (often around 8 to 9 feet) are a popular bridge between the longboard and the more agile shortboard, offering both stability and moderate maneuverability, which makes them excellent for gradual progress.--### Funboards and Hybrids--Funboards and hybrid boards blend the benefits of longboards and shortboards. They typically range from 6’6" to 8’0" in length, with extra volume and width that help preserve stability while introducing elements of sharper turning and improved agility. Hybrids are particularly helpful for surfers transitioning from longboards, as they maintain some of the buoyancy and ease of catching waves, yet offer a taste of the performance found in smaller boards.--### Shortboards--Shortboards emphasize performance, maneuverability, and a more responsive ride. However, they have less volume and require stronger paddling, quicker pop-up techniques, and more refined balance. For beginners, moving to a traditional shortboard immediately can be challenging. It is generally advised to make a gradual transition, potentially starting with a funboard or hybrid before making a direct leap to a performance shortboard.-------## Key Board Dimensions and Features--When selecting a beginner surfboard, several key dimensions and features drastically affect performance, ease of learning, and safety:--### Length and Width--- **Length**: Starting with an 8 to 9-foot board is ideal. Longer boards offer enhanced stability and improved paddling capabilities. Gradual downsizing is recommended if you plan to move from an 11-foot board.-- **Width**: A board with a width over 20 inches provides greater stability and facilitates balance, especially vital for beginners.--### Thickness and Volume--- **Thickness**: Typically around 2.5 to 3 inches. Thicker decks increase buoyancy, allowing the surfer to paddle easier while catching waves.-- **Volume**: Measured in liters, volume is critical in understanding a board's flotation capacity. Higher volumes (e.g., 60-100 liters) are essential for beginners as they make the board more forgiving and stable. Suitable volumes might vary according to the surfer’s weight and experience level.--### Nose and Tail Shape--- **Nose Shape**: A wide, rounded nose expands the board’s planing surface, which can help in catching waves sooner and maintaining stability as you ride.-- **Tail Design**: Square or rounded tails are generally recommended as they enhance stability and allow for controlled turns, essential during the learning phase.--### Rocker--- **Rocker**: This is the curvature of the board from nose to tail. For beginners, a minimal or relaxed rocker provides better stability and ease during paddling. A steeper rocker might be introduced progressively as the surfer’s skills improve.-------## Materials: Soft-Top vs. Hard-Top Boards--The material composition of a surfboard is a crucial factor in determining its performance, durability, and safety. Beginners have two primary choices:--### Soft-Top (Foam) Boards--Soft-top boards are constructed almost entirely from foam. Their attributes include:--- **Safety and Forgiveness**: The foam construction minimizes injury upon impact which is advantageous for beginners who might fall frequently.-- **Stability and Buoyancy**: These boards typically offer greater buoyancy due to their softer material and thicker construction, easing the initial learning process.-- **Maintenance**: They often require less maintenance—there is typically no need for waxing and they are more resistant to dings and scratches.--However, as a surfer’s skills progress, a soft-top might limit maneuverability and overall performance.--### Hard-Top Boards--Hard-tops, in contrast, offer a more traditional surfboard feel. They generally rely on a foam core encased in resin, with two prevalent combinations:--- **PU (Polyurethane) Core with Polyester Resin**: This combination gives a classic feel and is relatively economical; however, these boards can be heavier and, as they age, more prone to damage.-- **EPS (Expanded Polystyrene) Core with Epoxy Resin**: Lightweight and durable, EPS boards are often more buoyant and resistant to damage, although they usually carry a higher price tag and may be less forgiving.--Deciding between soft-top and hard-top boards often depends on a beginner’s progression goals, overall comfort, and budget constraints.-------## Tips for Transitioning from Longboards to Shorter Boards--For surfers who have mastered the basics on an 11-foot board, the transition to a shorter board requires careful consideration, patience, and incremental changes. Here are some key tips:--### Gradual Downsizing--Experts recommend reducing the board length gradually—by about a foot at a time—to allow the body to adjust slowly to a board with less buoyancy and more responsiveness. This process helps maintain wave-catching ability and reduces the shock of transitioning to a very different board feel.--### Strengthening Core Skills--Before transitioning, make sure your surfing fundamentals are solid. Focus on practicing:--- **Steep Take-offs**: Ensure that your pop-up is swift and robust to keep pace with shorter boards that demand a rapid transition from paddling to standing.-- **Angling and Paddling Techniques**: Learn to angle your takeoffs properly to compensate for the lower buoyancy and increased maneuverability of shorter boards.--### Experimenting with Rentals or Borrowed Boards--If possible, try out a friend’s shorter board or rent one for a day to experience firsthand the differences in performance. This practical trial can provide valuable insights and inform your decision before making a purchase.-------## Budget and Pricing Options--Surfboards are available across a range of prices to match different budgets. Whether you are looking for an affordable beginner board or a more expensive model that grows with your skills, it’s important to understand what features you can expect at different price points.--### Budget-Friendly Options--For those on a tight budget, several entry-level models offer excellent value. Examples include:--- **Wavestorm 8' Classic Pinline Surfboard**: Priced affordably, this board is popular for its ease of use, ample volume, and forgiving nature. Despite its low cost, it delivers the stability needed to get started.-- **Liquid Shredder EZ Slider Foamie**: A smaller board catering to younger or lighter surfers, this budget option provides easy paddling and a minimal risk of injury due to its soft construction.--### Moderate Price Range--As you move into the intermediate range, boards typically become slightly more specialized in their design, offering features such as improved stringer systems or versatile fin setups. These are excellent for surfers who wish to continue progressing their skills without compromising stability. Many surfboard packages from retailers also bundle a board with essential accessories like board bags, leashes, and wax for additional savings.--### Higher-End Models and Transitional Packages--For surfers looking for durability, performance, and advanced design features, investing in an EPS/epoxy board might be ideal. Although they come at a premium, these boards are lightweight, strong, and customizable with various fin configurations. Some options include boards from brands like South Bay Board Co. and ISLE, which combine high-quality construction with beginner-friendly features that help mediate the transition from longboard to shortboard performance.-------## Recommended Models and Buying Options--Based on extensive research and community recommendations, here are some standout models and tips on where to buy:--### Recommended Models--- **South Bay Board Co. 8'8" Heritage**: Combining foam and resin construction, this board is ideal for beginners who need stability and a forgiving surface. Its 86-liter volume suits both lightweight and somewhat heavier surfers.-- **Rock-It 8' Big Softy**: With a high volume and an easy paddling profile, this board is designed for beginners, offering ample buoyancy to smooth out the learning curve.-- **Wave Bandit EZ Rider Series**: Available in multiple lengths (7', 8', 9'), these boards offer versatility, with construction features that balance the stability of longboards and the agility required for shorter boards.-- **Hybrid/Funboards Like the Poacher Funboard**: Perfect for transitioning surfers, these boards blend the ease of catching waves with the capability for more dynamic maneuvers.--### Buying Options--- **Surf Shops and Local Retailers**: Traditional surf shops allow you to test different boards, which is ideal for assessing the board feel and condition—especially if you are considering a used board.-- **Online Retailers and Marketplaces**: Websites like Evo, Surfboards Direct, and even local online marketplaces like Craigslist and Facebook Marketplace provide options that range from new to gently used boards. Always inspect reviews and verify seller policies before purchase.-- **Package Deals and Bundles**: Many retailers offer bundled packages that include not just the board, but also essentials like a leash, wax, fins, and board bags. These packages can be more cost-effective and are great for beginners who need a complete surf kit.-------## Conclusion--Selecting the right surfboard as a beginner is about balancing various factors: stability, buoyancy, maneuverability, and budget.--For those who have honed the basics using an 11-foot longboard, the transition to a shorter board should be gradual. Start by focusing on boards that preserve stability—such as funboards and hybrids—before moving to the more performance-oriented shortboards. Key characteristics like board length, width, thickness, volume, and material profoundly influence your surfing experience. Soft-top boards provide a forgiving entry point, while hard-top boards, especially those with EPS cores and epoxy resin, offer benefits for more advanced progression despite the increased learning curve.--Emphasizing fundamentals like proper pop-up technique and effective paddle work will ease the transition and ensure that the new board complements your evolving skills. Additionally, understanding the pricing spectrum—from budget-friendly models to premium options—allows you to make an informed purchase that suits both your financial and performance needs.--With a thoughtful approach to board selection, you can enhance your learning curve, enjoy safer sessions in the water, and ultimately develop the skills necessary to master the diverse challenges surfing presents. Whether your goal is to ride gentle waves or eventually experiment with sharper turns and dynamic maneuvers, choosing the right board is your first step towards a rewarding and sustainable surfing journey.-------## Follow-up Questions--1. What is your current budget range for a new surfboard, or are you considering buying used?-2. How frequently do you plan to surf, and in what type of wave conditions?-3. Are you interested in a board that you can grow into as your skills progress, or do you prefer one that is more specialized for certain conditions?-4. Would you be interested in additional equipment bundles (like fins, leashes, boards bags) offered by local retailers or online shops?-5. Have you had the opportunity to test ride any boards before, and what feedback did you gather from that experience?-------With this detailed guide, beginners should now have a comprehensive understanding of the surfboard market and the key factors influencing board performance, safety, and ease of progression. Happy surfing, and may you find the perfect board that rides the waves as beautifully as your passion for the sport!diff --git a/examples/agents-examples/research_bot/sample_outputs/product_recs.txt b/examples/agents-examples/research_bot/sample_outputs/product_recs.txtdeleted file mode 100644index 5a06014a..00000000--- a/examples/agents-examples/research_bot/sample_outputs/product_recs.txt+++ /dev/null@@ -1,212 +0,0 @@-# Terminal output for a product recommendation related query. See product_recs.md for final report.--$ uv run python -m examples.research_bot.main--What would you like to research? Best surfboards for beginners. I can catch my own waves, but previously used an 11ft board. What should I look for, what are my options? Various budget ranges.-View trace: https://platform.openai.com/logs/trace_...-Starting research...-✅ Will perform 15 searches-✅ Searching... 15/15 completed-✅ Finishing report...-✅ Report summary--This report provides a detailed guide on selecting the best surfboards for beginners, especially for those transitioning from an 11-foot longboard to a-shorter board. It covers design considerations such as board dimensions, shape, materials, and volume, while comparing soft-top and hard-top boards. In-addition, the report discusses various budget ranges, recommended board models, buying options (both new and used), and techniques to ease the transition to-more maneuverable boards. By understanding these factors, beginner surfers can select a board that not only enhances their skills but also suits their-individual needs.---=====REPORT=====---Report: # Comprehensive Guide on Best Surfboards for Beginners: Transitioning, Features, and Budget Options--Surfing is not only a sport but a lifestyle that hooks its enthusiasts with the allure of riding waves and connecting with nature. For beginners, selecting the right surfboard is critical to safety, learning, and performance. This comprehensive guide has been crafted to walk through the essential aspects of choosing the ideal surfboard for beginners, especially those looking to transition from an 11-foot longboard to a shorter, more dynamic board. We discuss various board types, materials, design elements, and budget ranges, providing a detailed road map for both new surfers and those in the process of progression.-------## Table of Contents--1. [Introduction](#introduction)-2. [Board Types and Design Considerations](#board-types-and-design-considerations)-3. [Key Board Dimensions and Features](#key-board-dimensions-and-features)-4. [Materials: Soft-Top vs. Hard-Top Boards](#materials-soft-top-vs-hard-top-boards)-5. [Tips for Transitioning from Longboards to Shorter Boards](#tips-for-transitioning-from-longboards-to-shorter-boards)-6. [Budget and Pricing Options](#budget-and-pricing-options)-7. [Recommended Models and Buying Options](#recommended-models-and-buying-options)-8. [Conclusion](#conclusion)-9. [Follow-up Questions](#follow-up-questions)-------## Introduction--Surfing is a dynamic sport that requires not only skill and technique but also the proper equipment. For beginners, the right surfboard can make the difference between a frustrating experience and one that builds confidence and enthusiasm. Many newcomers start with longboards due to their stability and ease of paddling; however, as skills develop, transitioning to a shorter board might be desirable for enhancing maneuverability and performance. This guide is designed for surfers who can already catch waves on an 11-foot board and are now considering stepping down to a more versatile option.--The overarching goal of this document is to help beginners identify which surfboard characteristics are most important, including board length, width, thickness, volume, and materials, while also considering factors like weight distribution, buoyancy, and control. We will also take a look at board types that are particularly welcoming for beginners and discuss gradual transitioning strategies.-------## Board Types and Design Considerations--Choosing a board involves understanding the variety of designs available. Below are the main types of surfboards that cater to beginners and transitional surfers:--### Longboards and Mini-Mals--Longboards, typically 8 to 11 feet in length, provide ample stability, smoother paddling, and are well-suited for wave-catching. Their generous volume and width allow beginners to build confidence when standing up and riding waves. Mini-mal or mini-malibus (often around 8 to 9 feet) are a popular bridge between the longboard and the more agile shortboard, offering both stability and moderate maneuverability, which makes them excellent for gradual progress.--### Funboards and Hybrids--Funboards and hybrid boards blend the benefits of longboards and shortboards. They typically range from 6’6" to 8’0" in length, with extra volume and width that help preserve stability while introducing elements of sharper turning and improved agility. Hybrids are particularly helpful for surfers transitioning from longboards, as they maintain some of the buoyancy and ease of catching waves, yet offer a taste of the performance found in smaller boards.--### Shortboards--Shortboards emphasize performance, maneuverability, and a more responsive ride. However, they have less volume and require stronger paddling, quicker pop-up techniques, and more refined balance. For beginners, moving to a traditional shortboard immediately can be challenging. It is generally advised to make a gradual transition, potentially starting with a funboard or hybrid before making a direct leap to a performance shortboard.-------## Key Board Dimensions and Features--When selecting a beginner surfboard, several key dimensions and features drastically affect performance, ease of learning, and safety:--### Length and Width--- **Length**: Starting with an 8 to 9-foot board is ideal. Longer boards offer enhanced stability and improved paddling capabilities. Gradual downsizing is recommended if you plan to move from an 11-foot board.-- **Width**: A board with a width over 20 inches provides greater stability and facilitates balance, especially vital for beginners.--### Thickness and Volume--- **Thickness**: Typically around 2.5 to 3 inches. Thicker decks increase buoyancy, allowing the surfer to paddle easier while catching waves.-- **Volume**: Measured in liters, volume is critical in understanding a board's flotation capacity. Higher volumes (e.g., 60-100 liters) are essential for beginners as they make the board more forgiving and stable. Suitable volumes might vary according to the surfer’s weight and experience level.--### Nose and Tail Shape--- **Nose Shape**: A wide, rounded nose expands the board’s planing surface, which can help in catching waves sooner and maintaining stability as you ride.-- **Tail Design**: Square or rounded tails are generally recommended as they enhance stability and allow for controlled turns, essential during the learning phase.--### Rocker--- **Rocker**: This is the curvature of the board from nose to tail. For beginners, a minimal or relaxed rocker provides better stability and ease during paddling. A steeper rocker might be introduced progressively as the surfer’s skills improve.-------## Materials: Soft-Top vs. Hard-Top Boards--The material composition of a surfboard is a crucial factor in determining its performance, durability, and safety. Beginners have two primary choices:--### Soft-Top (Foam) Boards--Soft-top boards are constructed almost entirely from foam. Their attributes include:--- **Safety and Forgiveness**: The foam construction minimizes injury upon impact which is advantageous for beginners who might fall frequently.-- **Stability and Buoyancy**: These boards typically offer greater buoyancy due to their softer material and thicker construction, easing the initial learning process.-- **Maintenance**: They often require less maintenance—there is typically no need for waxing and they are more resistant to dings and scratches.--However, as a surfer’s skills progress, a soft-top might limit maneuverability and overall performance.--### Hard-Top Boards--Hard-tops, in contrast, offer a more traditional surfboard feel. They generally rely on a foam core encased in resin, with two prevalent combinations:--- **PU (Polyurethane) Core with Polyester Resin**: This combination gives a classic feel and is relatively economical; however, these boards can be heavier and, as they age, more prone to damage.-- **EPS (Expanded Polystyrene) Core with Epoxy Resin**: Lightweight and durable, EPS boards are often more buoyant and resistant to damage, although they usually carry a higher price tag and may be less forgiving.--Deciding between soft-top and hard-top boards often depends on a beginner’s progression goals, overall comfort, and budget constraints.-------## Tips for Transitioning from Longboards to Shorter Boards--For surfers who have mastered the basics on an 11-foot board, the transition to a shorter board requires careful consideration, patience, and incremental changes. Here are some key tips:--### Gradual Downsizing--Experts recommend reducing the board length gradually—by about a foot at a time—to allow the body to adjust slowly to a board with less buoyancy and more responsiveness. This process helps maintain wave-catching ability and reduces the shock of transitioning to a very different board feel.--### Strengthening Core Skills--Before transitioning, make sure your surfing fundamentals are solid. Focus on practicing:--- **Steep Take-offs**: Ensure that your pop-up is swift and robust to keep pace with shorter boards that demand a rapid transition from paddling to standing.-- **Angling and Paddling Techniques**: Learn to angle your takeoffs properly to compensate for the lower buoyancy and increased maneuverability of shorter boards.--### Experimenting with Rentals or Borrowed Boards--If possible, try out a friend’s shorter board or rent one for a day to experience firsthand the differences in performance. This practical trial can provide valuable insights and inform your decision before making a purchase.-------## Budget and Pricing Options--Surfboards are available across a range of prices to match different budgets. Whether you are looking for an affordable beginner board or a more expensive model that grows with your skills, it’s important to understand what features you can expect at different price points.--### Budget-Friendly Options--For those on a tight budget, several entry-level models offer excellent value. Examples include:--- **Wavestorm 8' Classic Pinline Surfboard**: Priced affordably, this board is popular for its ease of use, ample volume, and forgiving nature. Despite its low cost, it delivers the stability needed to get started.-- **Liquid Shredder EZ Slider Foamie**: A smaller board catering to younger or lighter surfers, this budget option provides easy paddling and a minimal risk of injury due to its soft construction.--### Moderate Price Range--As you move into the intermediate range, boards typically become slightly more specialized in their design, offering features such as improved stringer systems or versatile fin setups. These are excellent for surfers who wish to continue progressing their skills without compromising stability. Many surfboard packages from retailers also bundle a board with essential accessories like board bags, leashes, and wax for additional savings.--### Higher-End Models and Transitional Packages--For surfers looking for durability, performance, and advanced design features, investing in an EPS/epoxy board might be ideal. Although they come at a premium, these boards are lightweight, strong, and customizable with various fin configurations. Some options include boards from brands like South Bay Board Co. and ISLE, which combine high-quality construction with beginner-friendly features that help mediate the transition from longboard to shortboard performance.-------## Recommended Models and Buying Options--Based on extensive research and community recommendations, here are some standout models and tips on where to buy:--### Recommended Models--- **South Bay Board Co. 8'8" Heritage**: Combining foam and resin construction, this board is ideal for beginners who need stability and a forgiving surface. Its 86-liter volume suits both lightweight and somewhat heavier surfers.-- **Rock-It 8' Big Softy**: With a high volume and an easy paddling profile, this board is designed for beginners, offering ample buoyancy to smooth out the learning curve.-- **Wave Bandit EZ Rider Series**: Available in multiple lengths (7', 8', 9'), these boards offer versatility, with construction features that balance the stability of longboards and the agility required for shorter boards.-- **Hybrid/Funboards Like the Poacher Funboard**: Perfect for transitioning surfers, these boards blend the ease of catching waves with the capability for more dynamic maneuvers.--### Buying Options--- **Surf Shops and Local Retailers**: Traditional surf shops allow you to test different boards, which is ideal for assessing the board feel and condition—especially if you are considering a used board.-- **Online Retailers and Marketplaces**: Websites like Evo, Surfboards Direct, and even local online marketplaces like Craigslist and Facebook Marketplace provide options that range from new to gently used boards. Always inspect reviews and verify seller policies before purchase.-- **Package Deals and Bundles**: Many retailers offer bundled packages that include not just the board, but also essentials like a leash, wax, fins, and board bags. These packages can be more cost-effective and are great for beginners who need a complete surf kit.-------## Conclusion--Selecting the right surfboard as a beginner is about balancing various factors: stability, buoyancy, maneuverability, and budget.--For those who have honed the basics using an 11-foot longboard, the transition to a shorter board should be gradual. Start by focusing on boards that preserve stability—such as funboards and hybrids—before moving to the more performance-oriented shortboards. Key characteristics like board length, width, thickness, volume, and material profoundly influence your surfing experience. Soft-top boards provide a forgiving entry point, while hard-top boards, especially those with EPS cores and epoxy resin, offer benefits for more advanced progression despite the increased learning curve.--Emphasizing fundamentals like proper pop-up technique and effective paddle work will ease the transition and ensure that the new board complements your evolving skills. Additionally, understanding the pricing spectrum—from budget-friendly models to premium options—allows you to make an informed purchase that suits both your financial and performance needs.--With a thoughtful approach to board selection, you can enhance your learning curve, enjoy safer sessions in the water, and ultimately develop the skills necessary to master the diverse challenges surfing presents. Whether your goal is to ride gentle waves or eventually experiment with sharper turns and dynamic maneuvers, choosing the right board is your first step towards a rewarding and sustainable surfing journey.-------## Follow-up Questions--1. What is your current budget range for a new surfboard, or are you considering buying used?-2. How frequently do you plan to surf, and in what type of wave conditions?-3. Are you interested in a board that you can grow into as your skills progress, or do you prefer one that is more specialized for certain conditions?-4. Would you be interested in additional equipment bundles (like fins, leashes, boards bags) offered by local retailers or online shops?-5. Have you had the opportunity to test ride any boards before, and what feedback did you gather from that experience?-------With this detailed guide, beginners should now have a comprehensive understanding of the surfboard market and the key factors influencing board performance, safety, and ease of progression. Happy surfing, and may you find the perfect board that rides the waves as beautifully as your passion for the sport!---=====FOLLOW UP QUESTIONS=====---Follow up questions: What is your current budget range for a new surfboard, or are you considering a used board?-What types of waves do you typically surf, and how might that affect your board choice?-Would you be interested in a transitional board that grows with your skills, or are you looking for a more specialized design?-Have you had experience with renting or borrowing boards to try different sizes before making a purchase?-Do you require additional equipment bundles (like fins, leash, or wax), or do you already have those?diff --git a/examples/agents-examples/research_bot/sample_outputs/vacation.md b/examples/agents-examples/research_bot/sample_outputs/vacation.mddeleted file mode 100644index 82c137af..00000000--- a/examples/agents-examples/research_bot/sample_outputs/vacation.md+++ /dev/null@@ -1,177 +0,0 @@-Report: # Caribbean Adventure in April: Surfing, Hiking, and Water Sports Exploration--The Caribbean is renowned for its crystal-clear waters, vibrant culture, and diverse outdoor activities. April is an especially attractive month for visitors: warm temperatures, clear skies, and the promise of abundant activities. This report explores the best Caribbean destinations in April, with a focus on optimizing your vacation for surfing, hiking, and water sports.-------## Table of Contents--1. [Introduction](#introduction)-2. [Why April is the Perfect Time in the Caribbean](#why-april-is-the-perfect-time-in-the-caribbean)-3. [Surfing in the Caribbean](#surfing-in-the-caribbean)- - 3.1 [Barbados: The Tale of Two Coasts](#barbados-the-tale-of-two-coasts)- - 3.2 [Puerto Rico: Rincón and Beyond](#puerto-rico-rinc%C3%B3n-and-beyond)- - 3.3 [Dominican Republic and Other Hotspots](#dominican-republic-and-other-hotspots)-4. [Hiking Adventures Across the Caribbean](#hiking-adventures-across-the-caribbean)- - 4.1 [Trekking Through Tropical Rainforests](#trekking-through-tropical-rainforests)- - 4.2 [Volcanic Peaks and Rugged Landscapes](#volcanic-peaks-and-rugged-landscapes)-5. [Diverse Water Sports Experiences](#diverse-water-sports-experiences)- - 5.1 [Snorkeling, Diving, and Jet Skiing](#snorkeling-diving-and-jet-skiing)- - 5.2 [Kiteboarding and Windsurfing](#kiteboarding-and-windsurfing)-6. [Combining Adventures: Multi-Activity Destinations](#combining-adventures-multi-activity-destinations)-7. [Practical Advice and Travel Tips](#practical-advice-and-travel-tips)-8. [Conclusion](#conclusion)-------## Introduction--Caribbean vacations are much more than just beach relaxation; they offer adventure, exploration, and a lively cultural tapestry waiting to be discovered. For travelers seeking an adrenaline-filled getaway, April provides optimal conditions. This report synthesizes diverse research findings and travel insights to help you create an itinerary that combines the thrill of surfing, the challenge of hiking, and the excitement of water sports.--Whether you're standing on the edge of a powerful reef break or trekking through lush tropical landscapes, the Caribbean in April invites you to dive into nature, adventure, and culture. The following sections break down the best destinations and activities, ensuring that every aspect of your trip is meticulously planned for an unforgettable experience.-------## Why April is the Perfect Time in the Caribbean--April stands at the crossroads of seasons in many Caribbean destinations. It marks the tail end of the dry season, ensuring:--- **Consistent Warm Temperatures:** Average daytime highs around 29°C (84°F) foster comfortable conditions for both land and water activities.-- **Pleasant Sea Temperatures:** With sea temperatures near 26°C (79°F), swimmers, surfers, and divers are treated to inviting waters.-- **Clear Skies and Minimal Rainfall:** Crisp, blue skies make for excellent visibility during snorkeling and diving, as well as clear panoramic views while hiking.-- **Festivals and Cultural Events:** Many islands host seasonal festivals such as Barbados' Fish Festival and Antigua's Sailing Week, adding a cultural layer to your vacation.--These factors create an ideal backdrop for balancing your outdoor pursuits, whether you’re catching epic waves, trekking rugged trails, or partaking in water sports.-------## Surfing in the Caribbean--Surfing in the Caribbean offers diverse wave experiences, ranging from gentle, beginner-friendly rollers to powerful reef breaks that challenge even seasoned surfers. April, in particular, provides excellent conditions for those looking to ride its picturesque waves.--### Barbados: The Tale of Two Coasts--Barbados is a prime destination:--- **Soup Bowl in Bathsheba:** On the east coast, the Soup Bowl is famous for its consistent, powerful waves. This spot attracts experienced surfers who appreciate its challenging right-hand reef break with steep drops, providing the kind of performance wave rarely found elsewhere.-- **Freights Bay:** On the south coast, visitors find more forgiving, gentle wave conditions. Ideal for beginners and longboarders, this spot offers the perfect balance for those still mastering their craft.--Barbados not only excels in its surfing credentials but also complements the experience with a rich local culture and events in April, making it a well-rounded destination.--### Puerto Rico: Rincón and Beyond--Rincón in Puerto Rico is hailed as the Caribbean’s surfing capital:--- **Diverse Breaks:** With spots ranging from challenging reef breaks such as Tres Palmas and Dogman's to more inviting waves at Domes and Maria's, Puerto Rico offers a spectrum for all surfing skill levels.-- **Local Culture:** Aside from its surf culture, the island boasts vibrant local food scenes, historic sites, and exciting nightlife, enriching your overall travel experience.--In addition, Puerto Rico’s coasts often feature opportunities for hiking and other outdoor adventures, making it an attractive option for multi-activity travelers.--### Dominican Republic and Other Hotspots--Other islands such as the Dominican Republic, with Playa Encuentro on its north coast, provide consistent surf year-round. Highlights include:--- **Playa Encuentro:** A hotspot known for its dependable breaks, ideal for both intermediate and advanced surfers during the cooler months of October to April.-- **Jamaica and The Bahamas:** Jamaica’s Boston Bay offers a mix of beginner and intermediate waves, and The Bahamas’ Surfer’s Beach on Eleuthera draws parallels to the legendary surf spots of Hawaii, especially during the winter months.--These destinations not only spotlight surfing but also serve as gateways to additional outdoor activities, ensuring there's never a dull moment whether you're balancing waves with hikes or cultural exploration.-------## Hiking Adventures Across the Caribbean--The Caribbean's topography is as varied as it is beautiful. Its network of hiking trails traverses volcanic peaks, ancient rainforests, and dramatic coastal cliffs, offering breathtaking vistas to intrepid explorers.--### Trekking Through Tropical Rainforests--For nature enthusiasts, the lush forests of the Caribbean present an immersive encounter with biodiversity:--- **El Yunque National Forest, Puerto Rico:** The only tropical rainforest within the U.S. National Forest System, El Yunque is rich in endemic species such as the Puerto Rican parrot and the famous coquí frog. Trails like the El Yunque Peak Trail and La Mina Falls Trail provide both challenging hikes and scenic rewards.-- **Virgin Islands National Park, St. John:** With over 20 well-defined trails, this park offers hikes that reveal historical petroglyphs, colonial ruins, and stunning coastal views along the Reef Bay Trail.--### Volcanic Peaks and Rugged Landscapes--For those seeking more rugged challenges, several destinations offer unforgettable adventures:--- **Morne Trois Pitons National Park, Dominica:** A UNESCO World Heritage Site showcasing volcanic landscapes, hot springs, the famed Boiling Lake, and lush trails that lead to hidden waterfalls.-- **Gros Piton, Saint Lucia:** The iconic hike up Gros Piton provides a moderately challenging trek that ends with panoramic views of the Caribbean Sea, a truly rewarding experience for hikers.-- **La Soufrière, St. Vincent:** This active volcano not only offers a dynamic hiking environment but also the opportunity to observe the ongoing geological transformations up close.--Other noteworthy hiking spots include the Blue Mountains in Jamaica for coffee plantation tours and expansive views, as well as trails in Martinique around Montagne Pelée, which combine historical context with natural beauty.-------## Diverse Water Sports Experiences--While surfing and hiking attract a broad range of adventurers, the Caribbean also scores high on other water sports. Whether you're drawn to snorkeling, jet skiing, or wind- and kiteboarding, the islands offer a plethora of aquatic activities.--### Snorkeling, Diving, and Jet Skiing--Caribbean waters teem with life and color, making them ideal for underwater exploration:--- **Bonaire:** Its protected marine parks serve as a magnet for divers and snorkelers. With vibrant coral reefs and diverse marine species, Bonaire is a top destination for those who appreciate the underwater world.-- **Cayman Islands:** Unique attractions such as Stingray City provide opportunities to interact with friendly stingrays in clear, calm waters. Additionally, the Underwater Sculpture Park is an innovative blend of art and nature.-- **The Bahamas:** In places like Eleuthera, excursions often cater to families and thrill-seekers alike. Options include jet ski rentals, where groups can explore hidden beaches and pristine coves while enjoying the vibrant marine life.--### Kiteboarding and Windsurfing--Harnessing the steady trade winds and warm Caribbean waters, several islands have become hubs for kiteboarding and windsurfing:--- **Aruba:** Known as "One Happy Island," Aruba’s Fisherman's Huts area provides consistent winds, perfect for enthusiasts of windsurfing and kiteboarding alike.-- **Cabarete, Dominican Republic and Silver Rock, Barbados:** Both destinations benefit from reliable trade winds, making them popular among kitesurfers. These spots often combine water sports with a lively beach culture, ensuring that the fun continues on land as well.--Local operators provide equipment rental and lessons, ensuring that even first-time adventurers can safely and confidently enjoy these exciting sports.-------## Combining Adventures: Multi-Activity Destinations--For travelers seeking a comprehensive vacation where surfing, hiking, and water sports converge, several Caribbean destinations offer the best of all worlds.--- **Puerto Rico:** With its robust surf scene in Rincón, world-class hiking in El Yunque, and opportunities for snorkeling and jet skiing in San Juan Bay, Puerto Rico is a true multi-adventure destination.-- **Barbados:** In addition to the surf breaks along its coasts, Barbados offers a mix of cultural events, local cuisine, and even hiking excursions to scenic rural areas, making for a well-rounded experience.-- **Dominican Republic and Jamaica:** Both are renowned not only for their consistent surf conditions but also for expansive hiking trails and water sports. From the rugged landscapes of the Dominican Republic to Jamaica’s blend of cultural history and natural exploration, these islands allow travelers to mix and match activities seamlessly.--Group tours and local guides further enhance these experiences, providing insider tips, safe excursions, and personalized itineraries that cater to multiple interests within one trip.-------## Practical Advice and Travel Tips--### Weather and Timing--- **Optimal Climate:** April offers ideal weather conditions across the Caribbean. With minimal rainfall and warm temperatures, it is a great time to schedule outdoor activities.-- **Surfing Seasons:** While April marks the end of the prime surf season in some areas (like Rincón in Puerto Rico), many destinations maintain consistent conditions during this month.--### Booking and Costs--- **Surfing Lessons:** Expect to pay between $40 and $110 per session depending on the location. For instance, Puerto Rico typically charges around $75 for beginner lessons, while group lessons in the Dominican Republic average approximately $95.-- **Equipment Rentals:** Pricing for jet ski, surfboard, and snorkeling equipment may vary. In the Bahamas, an hour-long jet ski tour might cost about $120 per group, whereas a similar experience might be available at a lower cost in other regions.-- **Accommodations:** Prices also vary by island. Many travelers find that even affordable stays do not skimp on amenities, allowing you to invest more in guided excursions and local experiences.--### Cultural Considerations--- **Festivals and Events:** Check local event calendars. Destinations like Barbados and Antigua host festivals in April that combine cultural heritage with festive outdoor activities.-- **Local Cuisine:** Incorporate food tours into your itinerary. Caribbean cuisine—with its fusion of flavors—can be as adventurous as the outdoor activities.--### Health and Safety--- **Staying Hydrated:** The warm temperatures demand that you stay properly hydrated. Always carry water, especially during long hikes.-- **Sun Protection:** Use sunscreen, hats, and sunglasses to protect yourself during extended periods outdoors on both land and water.-- **Local Guides:** Utilize local tour operators for both hiking and water sports. Their expertise not only enriches your experience but also ensures safety in unfamiliar terrain or water bodies.-------## Conclusion--The Caribbean in April is a haven for adventure seekers. With its pristine beaches, diverse ecosystems, and rich cultural tapestry, it offers something for every type of traveler. Whether you're chasing the perfect wave along the shores of Barbados and Puerto Rico, trekking through the lush landscapes of El Yunque or Morne Trois Pitons, or engaging in an array of water sports from snorkeling to kiteboarding, your ideal vacation is only a booking away.--This report has outlined the best destinations and provided practical advice to optimize your vacation for surfing, hiking, and water sports. By considering the diverse offerings—from epic surf breaks and challenging hiking trails to vibrant water sports—the Caribbean stands out as a multi-adventure destination where every day brings a new experience.--Plan carefully, pack wisely, and get ready to explore the vibrant mosaic of landscapes and activities that make the Caribbean in April a truly unforgettable adventure.--Happy travels!-------_References available upon request. Many insights were drawn from trusted sources including Lonely Planet, TravelPug, and various Caribbean-centric exploration sites, ensuring a well-rounded and practical guide for your vacation planning._diff --git a/examples/agents-examples/research_bot/sample_outputs/vacation.txt b/examples/agents-examples/research_bot/sample_outputs/vacation.txtdeleted file mode 100644index e1fbd9ea..00000000--- a/examples/agents-examples/research_bot/sample_outputs/vacation.txt+++ /dev/null@@ -1,206 +0,0 @@-# Terminal output for a vacation related query. See vacation.md for final report.--$ uv run python -m examples.research_bot.main-What would you like to research? Caribbean vacation spots in April, optimizing for surfing, hiking and water sports-View trace: https://platform.openai.com/logs/trace_....-Starting research...-✅ Will perform 15 searches-✅ Searching... 15/15 completed-✅ Finishing report...-✅ Report summary--This report provides an in-depth exploration of selected Caribbean vacation spots in April that are ideal for surfing, hiking, and water sports. Covering-destinations from Barbados and Puerto Rico to the Bahamas and Jamaica, it examines favorable weather conditions, recommended surf breaks, scenic hiking-trails, and various water sports activities. Detailed destination profiles, activity highlights, and travel tips are integrated to help travelers design a-multi-adventure itinerary in the Caribbean during April.---=====REPORT=====---Report: # Caribbean Adventure in April: Surfing, Hiking, and Water Sports Exploration--The Caribbean is renowned for its crystal-clear waters, vibrant culture, and diverse outdoor activities. April is an especially attractive month for visitors: warm temperatures, clear skies, and the promise of abundant activities. This report explores the best Caribbean destinations in April, with a focus on optimizing your vacation for surfing, hiking, and water sports.-------## Table of Contents--1. [Introduction](#introduction)-2. [Why April is the Perfect Time in the Caribbean](#why-april-is-the-perfect-time-in-the-caribbean)-3. [Surfing in the Caribbean](#surfing-in-the-caribbean)- - 3.1 [Barbados: The Tale of Two Coasts](#barbados-the-tale-of-two-coasts)- - 3.2 [Puerto Rico: Rincón and Beyond](#puerto-rico-rinc%C3%B3n-and-beyond)- - 3.3 [Dominican Republic and Other Hotspots](#dominican-republic-and-other-hotspots)-4. [Hiking Adventures Across the Caribbean](#hiking-adventures-across-the-caribbean)- - 4.1 [Trekking Through Tropical Rainforests](#trekking-through-tropical-rainforests)- - 4.2 [Volcanic Peaks and Rugged Landscapes](#volcanic-peaks-and-rugged-landscapes)-5. [Diverse Water Sports Experiences](#diverse-water-sports-experiences)- - 5.1 [Snorkeling, Diving, and Jet Skiing](#snorkeling-diving-and-jet-skiing)- - 5.2 [Kiteboarding and Windsurfing](#kiteboarding-and-windsurfing)-6. [Combining Adventures: Multi-Activity Destinations](#combining-adventures-multi-activity-destinations)-7. [Practical Advice and Travel Tips](#practical-advice-and-travel-tips)-8. [Conclusion](#conclusion)-------## Introduction--Caribbean vacations are much more than just beach relaxation; they offer adventure, exploration, and a lively cultural tapestry waiting to be discovered. For travelers seeking an adrenaline-filled getaway, April provides optimal conditions. This report synthesizes diverse research findings and travel insights to help you create an itinerary that combines the thrill of surfing, the challenge of hiking, and the excitement of water sports.--Whether you're standing on the edge of a powerful reef break or trekking through lush tropical landscapes, the Caribbean in April invites you to dive into nature, adventure, and culture. The following sections break down the best destinations and activities, ensuring that every aspect of your trip is meticulously planned for an unforgettable experience.-------## Why April is the Perfect Time in the Caribbean--April stands at the crossroads of seasons in many Caribbean destinations. It marks the tail end of the dry season, ensuring:--- **Consistent Warm Temperatures:** Average daytime highs around 29°C (84°F) foster comfortable conditions for both land and water activities.-- **Pleasant Sea Temperatures:** With sea temperatures near 26°C (79°F), swimmers, surfers, and divers are treated to inviting waters.-- **Clear Skies and Minimal Rainfall:** Crisp, blue skies make for excellent visibility during snorkeling and diving, as well as clear panoramic views while hiking.-- **Festivals and Cultural Events:** Many islands host seasonal festivals such as Barbados' Fish Festival and Antigua's Sailing Week, adding a cultural layer to your vacation.--These factors create an ideal backdrop for balancing your outdoor pursuits, whether you’re catching epic waves, trekking rugged trails, or partaking in water sports.-------## Surfing in the Caribbean--Surfing in the Caribbean offers diverse wave experiences, ranging from gentle, beginner-friendly rollers to powerful reef breaks that challenge even seasoned surfers. April, in particular, provides excellent conditions for those looking to ride its picturesque waves.--### Barbados: The Tale of Two Coasts--Barbados is a prime destination:--- **Soup Bowl in Bathsheba:** On the east coast, the Soup Bowl is famous for its consistent, powerful waves. This spot attracts experienced surfers who appreciate its challenging right-hand reef break with steep drops, providing the kind of performance wave rarely found elsewhere.-- **Freights Bay:** On the south coast, visitors find more forgiving, gentle wave conditions. Ideal for beginners and longboarders, this spot offers the perfect balance for those still mastering their craft.--Barbados not only excels in its surfing credentials but also complements the experience with a rich local culture and events in April, making it a well-rounded destination.--### Puerto Rico: Rincón and Beyond--Rincón in Puerto Rico is hailed as the Caribbean’s surfing capital:--- **Diverse Breaks:** With spots ranging from challenging reef breaks such as Tres Palmas and Dogman's to more inviting waves at Domes and Maria's, Puerto Rico offers a spectrum for all surfing skill levels.-- **Local Culture:** Aside from its surf culture, the island boasts vibrant local food scenes, historic sites, and exciting nightlife, enriching your overall travel experience.--In addition, Puerto Rico’s coasts often feature opportunities for hiking and other outdoor adventures, making it an attractive option for multi-activity travelers.--### Dominican Republic and Other Hotspots--Other islands such as the Dominican Republic, with Playa Encuentro on its north coast, provide consistent surf year-round. Highlights include:--- **Playa Encuentro:** A hotspot known for its dependable breaks, ideal for both intermediate and advanced surfers during the cooler months of October to April.-- **Jamaica and The Bahamas:** Jamaica’s Boston Bay offers a mix of beginner and intermediate waves, and The Bahamas’ Surfer’s Beach on Eleuthera draws parallels to the legendary surf spots of Hawaii, especially during the winter months.--These destinations not only spotlight surfing but also serve as gateways to additional outdoor activities, ensuring there's never a dull moment whether you're balancing waves with hikes or cultural exploration.-------## Hiking Adventures Across the Caribbean--The Caribbean's topography is as varied as it is beautiful. Its network of hiking trails traverses volcanic peaks, ancient rainforests, and dramatic coastal cliffs, offering breathtaking vistas to intrepid explorers.--### Trekking Through Tropical Rainforests--For nature enthusiasts, the lush forests of the Caribbean present an immersive encounter with biodiversity:--- **El Yunque National Forest, Puerto Rico:** The only tropical rainforest within the U.S. National Forest System, El Yunque is rich in endemic species such as the Puerto Rican parrot and the famous coquí frog. Trails like the El Yunque Peak Trail and La Mina Falls Trail provide both challenging hikes and scenic rewards.-- **Virgin Islands National Park, St. John:** With over 20 well-defined trails, this park offers hikes that reveal historical petroglyphs, colonial ruins, and stunning coastal views along the Reef Bay Trail.--### Volcanic Peaks and Rugged Landscapes--For those seeking more rugged challenges, several destinations offer unforgettable adventures:--- **Morne Trois Pitons National Park, Dominica:** A UNESCO World Heritage Site showcasing volcanic landscapes, hot springs, the famed Boiling Lake, and lush trails that lead to hidden waterfalls.-- **Gros Piton, Saint Lucia:** The iconic hike up Gros Piton provides a moderately challenging trek that ends with panoramic views of the Caribbean Sea, a truly rewarding experience for hikers.-- **La Soufrière, St. Vincent:** This active volcano not only offers a dynamic hiking environment but also the opportunity to observe the ongoing geological transformations up close.--Other noteworthy hiking spots include the Blue Mountains in Jamaica for coffee plantation tours and expansive views, as well as trails in Martinique around Montagne Pelée, which combine historical context with natural beauty.-------## Diverse Water Sports Experiences--While surfing and hiking attract a broad range of adventurers, the Caribbean also scores high on other water sports. Whether you're drawn to snorkeling, jet skiing, or wind- and kiteboarding, the islands offer a plethora of aquatic activities.--### Snorkeling, Diving, and Jet Skiing--Caribbean waters teem with life and color, making them ideal for underwater exploration:--- **Bonaire:** Its protected marine parks serve as a magnet for divers and snorkelers. With vibrant coral reefs and diverse marine species, Bonaire is a top destination for those who appreciate the underwater world.-- **Cayman Islands:** Unique attractions such as Stingray City provide opportunities to interact with friendly stingrays in clear, calm waters. Additionally, the Underwater Sculpture Park is an innovative blend of art and nature.-- **The Bahamas:** In places like Eleuthera, excursions often cater to families and thrill-seekers alike. Options include jet ski rentals, where groups can explore hidden beaches and pristine coves while enjoying the vibrant marine life.--### Kiteboarding and Windsurfing--Harnessing the steady trade winds and warm Caribbean waters, several islands have become hubs for kiteboarding and windsurfing:--- **Aruba:** Known as "One Happy Island," Aruba’s Fisherman's Huts area provides consistent winds, perfect for enthusiasts of windsurfing and kiteboarding alike.-- **Cabarete, Dominican Republic and Silver Rock, Barbados:** Both destinations benefit from reliable trade winds, making them popular among kitesurfers. These spots often combine water sports with a lively beach culture, ensuring that the fun continues on land as well.--Local operators provide equipment rental and lessons, ensuring that even first-time adventurers can safely and confidently enjoy these exciting sports.-------## Combining Adventures: Multi-Activity Destinations--For travelers seeking a comprehensive vacation where surfing, hiking, and water sports converge, several Caribbean destinations offer the best of all worlds.--- **Puerto Rico:** With its robust surf scene in Rincón, world-class hiking in El Yunque, and opportunities for snorkeling and jet skiing in San Juan Bay, Puerto Rico is a true multi-adventure destination.-- **Barbados:** In addition to the surf breaks along its coasts, Barbados offers a mix of cultural events, local cuisine, and even hiking excursions to scenic rural areas, making for a well-rounded experience.-- **Dominican Republic and Jamaica:** Both are renowned not only for their consistent surf conditions but also for expansive hiking trails and water sports. From the rugged landscapes of the Dominican Republic to Jamaica’s blend of cultural history and natural exploration, these islands allow travelers to mix and match activities seamlessly.--Group tours and local guides further enhance these experiences, providing insider tips, safe excursions, and personalized itineraries that cater to multiple interests within one trip.-------## Practical Advice and Travel Tips--### Weather and Timing--- **Optimal Climate:** April offers ideal weather conditions across the Caribbean. With minimal rainfall and warm temperatures, it is a great time to schedule outdoor activities.-- **Surfing Seasons:** While April marks the end of the prime surf season in some areas (like Rincón in Puerto Rico), many destinations maintain consistent conditions during this month.--### Booking and Costs--- **Surfing Lessons:** Expect to pay between $40 and $110 per session depending on the location. For instance, Puerto Rico typically charges around $75 for beginner lessons, while group lessons in the Dominican Republic average approximately $95.-- **Equipment Rentals:** Pricing for jet ski, surfboard, and snorkeling equipment may vary. In the Bahamas, an hour-long jet ski tour might cost about $120 per group, whereas a similar experience might be available at a lower cost in other regions.-- **Accommodations:** Prices also vary by island. Many travelers find that even affordable stays do not skimp on amenities, allowing you to invest more in guided excursions and local experiences.--### Cultural Considerations--- **Festivals and Events:** Check local event calendars. Destinations like Barbados and Antigua host festivals in April that combine cultural heritage with festive outdoor activities.-- **Local Cuisine:** Incorporate food tours into your itinerary. Caribbean cuisine—with its fusion of flavors—can be as adventurous as the outdoor activities.--### Health and Safety--- **Staying Hydrated:** The warm temperatures demand that you stay properly hydrated. Always carry water, especially during long hikes.-- **Sun Protection:** Use sunscreen, hats, and sunglasses to protect yourself during extended periods outdoors on both land and water.-- **Local Guides:** Utilize local tour operators for both hiking and water sports. Their expertise not only enriches your experience but also ensures safety in unfamiliar terrain or water bodies.-------## Conclusion--The Caribbean in April is a haven for adventure seekers. With its pristine beaches, diverse ecosystems, and rich cultural tapestry, it offers something for every type of traveler. Whether you're chasing the perfect wave along the shores of Barbados and Puerto Rico, trekking through the lush landscapes of El Yunque or Morne Trois Pitons, or engaging in an array of water sports from snorkeling to kiteboarding, your ideal vacation is only a booking away.--This report has outlined the best destinations and provided practical advice to optimize your vacation for surfing, hiking, and water sports. By considering the diverse offerings—from epic surf breaks and challenging hiking trails to vibrant water sports—the Caribbean stands out as a multi-adventure destination where every day brings a new experience.--Plan carefully, pack wisely, and get ready to explore the vibrant mosaic of landscapes and activities that make the Caribbean in April a truly unforgettable adventure.--Happy travels!-------*References available upon request. Many insights were drawn from trusted sources including Lonely Planet, TravelPug, and various Caribbean-centric exploration sites, ensuring a well-rounded and practical guide for your vacation planning.*----=====FOLLOW UP QUESTIONS=====---Follow up questions: Would you like detailed profiles for any of the highlighted destinations (e.g., Puerto Rico or Barbados)?-Are you interested in more information about booking details and local tour operators in specific islands?-Do you need guidance on combining cultural events with outdoor adventures during your Caribbean vacation?\ No newline at end of filediff --git a/examples/agents-examples/tools/computer_use.py b/examples/agents-examples/tools/computer_use.pydeleted file mode 100644index 6a772c83..00000000--- a/examples/agents-examples/tools/computer_use.py+++ /dev/null@@ -1,176 +0,0 @@-import asyncio-import base64-import logging-from typing import Literal, Union--from playwright.async_api import Browser, Page, Playwright, async_playwright--from dotenv import load_dotenv-import os-import agentops--from agents import (- Agent,- AsyncComputer,- Button,- ComputerTool,- Environment,- ModelSettings,- Runner,- trace,-)--logging.getLogger("openai.agents").setLevel(logging.DEBUG)-logging.getLogger("openai.agents").addHandler(logging.StreamHandler())--# Load the environment variables for the script-load_dotenv()--# Initialize the agentops module-AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---async def main():- async with LocalPlaywrightComputer() as computer:- with trace("Computer use example"):- agent = Agent(- name="Browser user",- instructions="You are a helpful agent.",- tools=[ComputerTool(computer)],- # Use the computer using model, and set truncation to auto because its required- model="computer-use-preview-2025-02-04",- model_settings=ModelSettings(truncation="auto"),- )- result = await Runner.run(agent, "Search for SF sports news and summarize.")- print(result.final_output)---CUA_KEY_TO_PLAYWRIGHT_KEY = {- "/": "Divide",- "\\": "Backslash",- "alt": "Alt",- "arrowdown": "ArrowDown",- "arrowleft": "ArrowLeft",- "arrowright": "ArrowRight",- "arrowup": "ArrowUp",- "backspace": "Backspace",- "capslock": "CapsLock",- "cmd": "Meta",- "ctrl": "Control",- "delete": "Delete",- "end": "End",- "enter": "Enter",- "esc": "Escape",- "home": "Home",- "insert": "Insert",- "option": "Alt",- "pagedown": "PageDown",- "pageup": "PageUp",- "shift": "Shift",- "space": " ",- "super": "Meta",- "tab": "Tab",- "win": "Meta",-}---class LocalPlaywrightComputer(AsyncComputer):- """A computer, implemented using a local Playwright browser."""-- def __init__(self):- self._playwright: Union[Playwright, None] = None- self._browser: Union[Browser, None] = None- self._page: Union[Page, None] = None-- async def _get_browser_and_page(self) -> tuple[Browser, Page]:- width, height = self.dimensions- launch_args = [f"--window-size={width},{height}"]- browser = await self.playwright.chromium.launch(headless=False, args=launch_args)- page = await browser.new_page()- await page.set_viewport_size({"width": width, "height": height})- await page.goto("https://www.bing.com")- return browser, page-- async def __aenter__(self):- # Start Playwright and call the subclass hook for getting browser/page- self._playwright = await async_playwright().start()- self._browser, self._page = await self._get_browser_and_page()- return self-- async def __aexit__(self, exc_type, exc_val, exc_tb):- if self._browser:- await self._browser.close()- if self._playwright:- await self._playwright.stop()-- @property- def playwright(self) -> Playwright:- assert self._playwright is not None- return self._playwright-- @property- def browser(self) -> Browser:- assert self._browser is not None- return self._browser-- @property- def page(self) -> Page:- assert self._page is not None- return self._page-- @property- def environment(self) -> Environment:- return "browser"-- @property- def dimensions(self) -> tuple[int, int]:- return (1024, 768)-- async def screenshot(self) -> str:- """Capture only the viewport (not full_page)."""- png_bytes = await self.page.screenshot(full_page=False)- return base64.b64encode(png_bytes).decode("utf-8")-- async def click(self, x: int, y: int, button: Button = "left") -> None:- playwright_button: Literal["left", "middle", "right"] = "left"-- # Playwright only supports left, middle, right buttons- if button in ("left", "right", "middle"):- playwright_button = button # type: ignore-- await self.page.mouse.click(x, y, button=playwright_button)-- async def double_click(self, x: int, y: int) -> None:- await self.page.mouse.dblclick(x, y)-- async def scroll(self, x: int, y: int, scroll_x: int, scroll_y: int) -> None:- await self.page.mouse.move(x, y)- await self.page.evaluate(f"window.scrollBy({scroll_x}, {scroll_y})")-- async def type(self, text: str) -> None:- await self.page.keyboard.type(text)-- async def wait(self) -> None:- await asyncio.sleep(1)-- async def move(self, x: int, y: int) -> None:- await self.page.mouse.move(x, y)-- async def keypress(self, keys: list[str]) -> None:- for key in keys:- mapped_key = CUA_KEY_TO_PLAYWRIGHT_KEY.get(key.lower(), key)- await self.page.keyboard.press(mapped_key)-- async def drag(self, path: list[tuple[int, int]]) -> None:- if not path:- return- await self.page.mouse.move(path[0][0], path[0][1])- await self.page.mouse.down()- for px, py in path[1:]:- await self.page.mouse.move(px, py)- await self.page.mouse.up()---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/tools/file_search.py b/examples/agents-examples/tools/file_search.pydeleted file mode 100644index 1d95b404..00000000--- a/examples/agents-examples/tools/file_search.py+++ /dev/null@@ -1,43 +0,0 @@-import asyncio--from agents import Agent, FileSearchTool, Runner, trace--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---async def main():- agent = Agent(- name="File searcher",- instructions="You are a helpful agent.",- tools=[- FileSearchTool(- max_num_results=3,- vector_store_ids=["vs_67bf88953f748191be42b462090e53e7"],- include_search_results=True,- )- ],- )-- with trace("File search example"):- result = await Runner.run(agent, "Be concise, and tell me 1 sentence about Arrakis I might not know.")- print(result.final_output)- """- Arrakis, the desert planet in Frank Herbert's "Dune," was inspired by the scarcity of water- as a metaphor for oil and other finite resources.- """-- print("\n".join([str(out) for out in result.new_items]))- """- {"id":"...", "queries":["Arrakis"], "results":[...]}- """---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/tools/web_search.py b/examples/agents-examples/tools/web_search.pydeleted file mode 100644index 4e0b81f6..00000000--- a/examples/agents-examples/tools/web_search.py+++ /dev/null@@ -1,32 +0,0 @@-import asyncio--from agents import Agent, Runner, WebSearchTool, trace--from dotenv import load_dotenv-import os-import agentops--load_dotenv()--AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)---async def main():- agent = Agent(- name="Web searcher",- instructions="You are a helpful agent.",- tools=[WebSearchTool(user_location={"type": "approximate", "city": "New York"})],- )-- with trace("Web search example"):- result = await Runner.run(- agent,- "search the web for 'local sports news' and give me 1 interesting update in a sentence.",- )- print(result.final_output)- # The New York Giants are reportedly pursuing quarterback Aaron Rodgers after his ...---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/agents-examples/voice/voice-input.wav b/examples/agents-examples/voice/voice-input.wavdeleted file mode 100644index 97d97466..00000000Binary files a/examples/agents-examples/voice/voice-input.wav and /dev/null differdiff --git a/examples/agents-examples/voice/voice_transcription.py b/examples/agents-examples/voice/voice_transcription.pydeleted file mode 100644index 228ea138..00000000--- a/examples/agents-examples/voice/voice_transcription.py+++ /dev/null@@ -1,58 +0,0 @@-from dotenv import load_dotenv-import asyncio-import random-import numpy as np-from pathlib import Path-from agents import (- Agent,- function_tool,-)-from agents.voice import (- AudioInput,- SingleAgentVoiceWorkflow,- VoicePipeline,-)-from agents.extensions.handoff_prompt import prompt_with_handoff_instructions-import agentops--load_dotenv()---agentops.init(tags=["openai-agents", "example", "voice"])--BASE_PATH = Path(__file__).parent---@function_tool-def get_weather(city: str) -> str:- """Get the weather for a given city."""- choices = ["sunny", "cloudy", "rainy", "snowy"]- return f"The weather in {city} is {random.choice(choices)}."---agent = Agent(- name="Assistant",- instructions=prompt_with_handoff_instructions(- "You're speaking to someone from San Francisco, CA, so be polite and concise. ",- ),- model="gpt-4o-mini",- tools=[get_weather],-)---async def main():- pipeline = VoicePipeline(workflow=SingleAgentVoiceWorkflow(agent))-- buffer = np.fromfile(BASE_PATH / "voice-input.wav", dtype=np.int16)- audio_input = AudioInput(buffer=buffer)-- result = await pipeline.run(audio_input)-- response_chunks = []- async for event in result.stream():- if event.type == "voice_stream_event_audio":- response_chunks.append(event.data)---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/ai21_examples/ai21_examples.ipynb b/examples/ai21_examples/ai21_examples.ipynbdeleted file mode 100644index c33667f8..00000000--- a/examples/ai21_examples/ai21_examples.ipynb+++ /dev/null@@ -1,341 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# AI21 Example"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U ai21\n",- "%pip install -U agentops"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "from ai21 import AI21Client, AsyncAI21Client\n",- "from ai21.models.chat import ChatMessage\n",- "from dotenv import load_dotenv\n",- "import os\n",- "import agentops"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll grab our API keys. You can use dotenv like below or however else you like to load environment variables"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "AI21_API_KEY = os.getenv(\"AI2I_API_KEY\") or \"<your_ai21_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"ai21-example\"])"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Setting up Messages\n",- "AI21 clients use a `ChatMessage` object to handle messages. We setup the following system prompt to guide the model in its response and a user prompt as well. We take the example of a support agent in a SaaS company."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "messages = [\n",- " ChatMessage(\n",- " content=\"You are a world renowned poet in the style of Edgar Allan Poe.\",\n",- " role=\"system\",\n",- " ),\n",- " ChatMessage(\n",- " content=\"Write me a short poem about the AI agents co-existing within the human brain.\",\n",- " role=\"user\",\n",- " ),\n",- "]"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Sync Examples"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "We will demonstrate a basic sync call to AI21 using the Jamba 1.5 model"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "client = AI21Client(api_key=AI21_API_KEY)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "response = client.chat.completions.create(\n",- " messages=messages,\n",- " model=\"jamba-1.5-mini\",\n",- ")\n",- "print(response.choices[0].message.content)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "The following example shows how to record data from the streamed response using the Jamba 1.5 model."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "response = \"\"\n",- "\n",- "stream_response = client.chat.completions.create(\n",- " messages=messages,\n",- " model=\"jamba-instruct\",\n",- " stream=True,\n",- ")\n",- "\n",- "for chunk in stream_response:\n",- " response += str(chunk.choices[0].delta.content)\n",- "\n",- "print(response)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Async Example\n",- "The async example is very similar to the sync example, but it uses the `AsyncAI21Client` class."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "aclient = AsyncAI21Client(api_key=AI21_API_KEY)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "async def main():\n",- " async_response = await aclient.chat.completions.create(\n",- " messages=messages,\n",- " model=\"jamba-1.5-mini\",\n",- " )\n",- " print(async_response.choices[0].message.content)\n",- "\n",- "\n",- "await main()"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "The following example shows how to record data from the async streamed response."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "async def main():\n",- " response = \"\"\n",- "\n",- " async_stream_response = await aclient.chat.completions.create(\n",- " messages=messages,\n",- " model=\"jamba-1.5-mini\",\n",- " stream=True,\n",- " )\n",- "\n",- " async for chunk in async_stream_response:\n",- " response += chunk.choices[0].delta.content\n",- "\n",- " print(response)\n",- "\n",- "\n",- "await main()"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Task-Specific Models Examples"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Contextual Answers"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "The following example demonstrates the answering capability of AI21 without streaming."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "CONTEXT = \"\"\"\n",- "In 2020 and 2021, enormous QE — approximately $4.4 trillion, or 18%, of 2021 gross\n",- "domestic product (GDP) — and enormous fiscal stimulus (which has been and\n",- "always will be inflationary) — approximately $5 trillion, or 21%, of 2021 GDP\n",- "— stabilized markets and allowed companies to raise enormous amounts of\n",- "capital. In addition, this infusion of capital saved many small businesses and\n",- "put more than $2.5 trillion in the hands of consumers and almost $1 trillion into\n",- "state and local coffers. These actions led to a rapid decline in unemployment, \n",- "dropping from 15% to under 4% in 20 months — the magnitude and speed of which were both\n",- "unprecedented. Additionally, the economy grew 7% in 2021 despite the arrival of\n",- "the Delta and Omicron variants and the global supply chain shortages, which were\n",- "largely fueled by the dramatic upswing in consumer spending and the shift in\n",- "that spend from services to goods.\n",- "\"\"\"\n",- "response = client.answer.create(\n",- " context=CONTEXT,\n",- " question=\"Did the economy shrink after the Omicron variant arrived?\",\n",- ")\n",- "print(response.answer)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Similarly, we can use streaming to get the answer."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "CONTEXT = \"\"\"\n",- "In the rapidly evolving field of Artificial Intelligence (AI), mathematical \n",- "foundations such as calculus, linear algebra, and statistics play a crucial role. \n",- "For instance, linear algebra is essential for understanding and developing machine \n",- "learning algorithms. It involves the study of vectors, matrices, and tensor operations \n",- "which are critical for performing transformations and optimizations. Additionally, \n",- "concepts from calculus like derivatives and integrals are used to optimize the \n",- "performance of AI models through gradient descent and other optimization techniques. \n",- "Statistics and probability form the backbone for making inferences and predictions, \n",- "enabling AI systems to learn from data and make decisions under uncertainty. \n",- "Understanding these mathematical principles allows for the development of more robust \n",- "and effective AI systems.\n",- "\"\"\"\n",- "response = client.answer.create(\n",- " context=CONTEXT,\n",- " question=\"Why is linear algebra important for machine learning algorithms?\",\n",- " stream=True,\n",- ")\n",- "print(response.answer)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "ops",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.9.19"- }- },- "nbformat": 4,- "nbformat_minor": 2-}diff --git a/examples/anthropic_examples/agentops-anthropic-understanding-tools.ipynb b/examples/anthropic/agentops-anthropic-understanding-tools.ipynbsimilarity index 84%rename from examples/anthropic_examples/agentops-anthropic-understanding-tools.ipynbrename to examples/anthropic/agentops-anthropic-understanding-tools.ipynbindex 14ae0690..d9ab8a02 100644--- a/examples/anthropic_examples/agentops-anthropic-understanding-tools.ipynb+++ b/examples/anthropic/agentops-anthropic-understanding-tools.ipynb@@ -60,8 +60,8 @@"outputs": [],"source": ["load_dotenv()\n",- "ANTHROPIC_API_KEY = os.getenv(\"ANTHROPIC_API_KEY\") or \"ANTHROPIC API KEY\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"AGENTOPS API KEY\""+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"ANTHROPIC_API_KEY\"] = os.getenv(\"ANTHROPIC_API_KEY\", \"your_anthropic_api_key_here\")"]},{@@ -78,7 +78,7 @@"metadata": {},"outputs": [],"source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"anthropic-example-tool-tutorials\"])"+ "agentops.init(tags=[\"anthropic-example-tool-tutorials\", \"agentops-example\"])"]},{@@ -87,7 +87,7 @@"metadata": {},"outputs": [],"source": [- "client = Anthropic(api_key=ANTHROPIC_API_KEY)"+ "client = Anthropic()"]},{@@ -232,25 +232,9 @@},{"cell_type": "code",- "execution_count": null,"metadata": {},"outputs": [],- "source": [- "response = client.messages.create(\n",- " max_tokens=5000,\n",- " model=\"claude-3-5-sonnet-20240620\",\n",- " tools=[\n",- " {\n",- " \"name\": \"generate_missions\",\n",- " \"description\": \"Retrieve three missions for the DoomSlayer\",\n",- " \"input_schema\": {\"type\": \"object\", \"properties\": {}, \"required\": []},\n",- " }\n",- " ],\n",- " messages=initial_messages,\n",- ")\n",- "\n",- "print(response.content)"- ]+ "source": "response = client.messages.create(\n max_tokens=5000,\n model=\"claude-3-7-sonnet-20250219\",\n tools=[\n {\n \"name\": \"generate_missions\",\n \"description\": \"Retrieve three missions for the DoomSlayer\",\n \"input_schema\": {\"type\": \"object\", \"properties\": {}, \"required\": []},\n }\n ],\n messages=initial_messages,\n)\n\nprint(response.content)"},{"cell_type": "markdown",@@ -334,25 +318,9 @@},{"cell_type": "code",- "execution_count": null,"metadata": {},"outputs": [],- "source": [- "response = client.messages.create(\n",- " max_tokens=5000,\n",- " model=\"claude-3-5-sonnet-20240620\",\n",- " tools=[\n",- " {\n",- " \"name\": \"generate_missions\",\n",- " \"description\": \"Retrieve three missions for the DoomSlayer\",\n",- " \"input_schema\": {\"type\": \"object\", \"properties\": {}, \"required\": []},\n",- " }\n",- " ],\n",- " messages=initial_messages,\n",- ")\n",- "\n",- "print(response)"- ]+ "source": "response = client.messages.create(\n max_tokens=5000,\n model=\"claude-3-7-sonnet-20250219\",\n tools=[\n {\n \"name\": \"generate_missions\",\n \"description\": \"Retrieve three missions for the DoomSlayer\",\n \"input_schema\": {\"type\": \"object\", \"properties\": {}, \"required\": []},\n }\n ],\n messages=initial_messages,\n)\n\nprint(response)"},{"cell_type": "markdown",@@ -540,39 +508,9 @@},{"cell_type": "code",- "execution_count": null,"metadata": {},"outputs": [],- "source": [- "response = client.messages.create(\n",- " max_tokens=5000,\n",- " model=\"claude-3-5-sonnet-20240620\",\n",- " tools=[\n",- " {\n",- " \"name\": \"enemyscan_tool\",\n",- " \"description\": \"Retrieve a list of demons currently present in the area.\",\n",- " \"input_schema\": {\n",- " \"type\": \"object\",\n",- " \"properties\": {\n",- " \"amount\": {\n",- " \"type\": \"integer\",\n",- " \"description\": \"Number of enemies to scan.\",\n",- " }\n",- " },\n",- " \"required\": [\"amount\"],\n",- " },\n",- " },\n",- " {\n",- " \"name\": \"inventoryscan_tool\",\n",- " \"description\": \"Retrieve a list of weapons the Doom Slayer has at hand.\",\n",- " \"input_schema\": {\"type\": \"object\", \"properties\": {}, \"required\": []},\n",- " },\n",- " ],\n",- " messages=initial_messages,\n",- ")\n",- "\n",- "print(response)"- ]+ "source": "response = client.messages.create(\n max_tokens=5000,\n model=\"claude-3-7-sonnet-20250219\",\n tools=[\n {\n \"name\": \"enemyscan_tool\",\n \"description\": \"Retrieve a list of demons currently present in the area.\",\n \"input_schema\": {\n \"type\": \"object\",\n \"properties\": {\n \"amount\": {\n \"type\": \"integer\",\n \"description\": \"Number of enemies to scan.\",\n }\n },\n \"required\": [\"amount\"],\n },\n },\n {\n \"name\": \"inventoryscan_tool\",\n \"description\": \"Retrieve a list of weapons the Doom Slayer has at hand.\",\n \"input_schema\": {\"type\": \"object\", \"properties\": {}, \"required\": []},\n },\n ],\n messages=initial_messages,\n)\n\nprint(response)"},{"cell_type": "markdown",@@ -679,40 +617,9 @@},{"cell_type": "code",- "execution_count": null,"metadata": {},"outputs": [],- "source": [- "response = client.messages.create(\n",- " max_tokens=5000,\n",- " model=\"claude-3-5-sonnet-20240620\",\n",- " tools=[\n",- " {\n",- " \"name\": \"enemyscan_tool\",\n",- " \"description\": \"Retrieve a list of demons currently present in the area.\",\n",- " \"input_schema\": {\n",- " \"type\": \"object\",\n",- " \"properties\": {\n",- " \"amount\": {\n",- " \"type\": \"integer\",\n",- " \"description\": \"Number of enemies to scan.\",\n",- " }\n",- " },\n",- " \"required\": [\"amount\"],\n",- " },\n",- " },\n",- " {\n",- " \"name\": \"inventoryscan_tool\",\n",- " \"description\": \"Retrieve a list of weapons the Doom Slayer has at hand.\",\n",- " \"input_schema\": {\"type\": \"object\", \"properties\": {}, \"required\": []},\n",- " },\n",- " ],\n",- " messages=initial_messages,\n",- ")\n",- "\n",- "message = response.content[0].text\n",- "print(message)"- ]+ "source": "response = client.messages.create(\n max_tokens=5000,\n model=\"claude-3-7-sonnet-20250219\",\n tools=[\n {\n \"name\": \"enemyscan_tool\",\n \"description\": \"Retrieve a list of demons currently present in the area.\",\n \"input_schema\": {\n \"type\": \"object\",\n \"properties\": {\n \"amount\": {\n \"type\": \"integer\",\n \"description\": \"Number of enemies to scan.\",\n }\n },\n \"required\": [\"amount\"],\n },\n },\n {\n \"name\": \"inventoryscan_tool\",\n \"description\": \"Retrieve a list of weapons the Doom Slayer has at hand.\",\n \"input_schema\": {\"type\": \"object\", \"properties\": {}, \"required\": []},\n },\n ],\n messages=initial_messages,\n)\n\nmessage = response.content[0].text\nprint(message)"}],"metadata": {@@ -726,7 +633,7 @@"sourceType": "notebook"},"kernelspec": {- "display_name": ".venv (3.11.11)",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -745,4 +652,4 @@},"nbformat": 4,"nbformat_minor": 4-}+}\ No newline at end of filediff --git a/examples/anthropic/agentops-anthropic-understanding-tools.py b/examples/anthropic/agentops-anthropic-understanding-tools.pynew file mode 100644index 00000000..bbce678f--- /dev/null+++ b/examples/anthropic/agentops-anthropic-understanding-tools.py@@ -0,0 +1,373 @@+# # Anthropic Example for understanding Tools+#+# Anthropic's tool returns are not as simple as getting a few strings! While this system is more complex than those before it, it's also simple enough to be used without problem once you understand how it works!+# To get started, we will import Agentops and Anthropic+# %pip install agentops+# %pip install anthropic+# Setup our generic default statements+import agentops+from anthropic import Anthropic+from dotenv import load_dotenv+import os+import random++# And set our API keys.+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["ANTHROPIC_API_KEY"] = os.getenv("ANTHROPIC_API_KEY", "your_anthropic_api_key_here")+#+# Now let's set the client as Anthropic and make an AgentOps trace+agentops.init(tags=["anthropic-example-tool-tutorials", "agentops-example"])+client = Anthropic()+# Now to create a simple dummy tool! We are going to make a tool that will tell us about the demon infestation levels for 3 areas. From there, we will have VEGA, our AI determine the best place for the Doom Slayer to attack.+locations = [+ {+ "Name": "Super Gore Nest",+ "Description": "A grotesque mass of demonic growth and organic structures infesting the ruins of an urban area on Earth. The Super Gore Nest serves as a massive, pulsating hive for Hell’s forces, complete with rivers of blood, twisted tendrils, and a dark, organic design that shows how deeply Hell has taken root in the city.",+ },+ {+ "Name": "Exultia",+ "Description": "An ancient, mystical world that holds the ruins of the Night Sentinels' kingdom, with gothic structures and arcane symbols throughout. This realm is filled with epic landscapes, medieval architecture, and hints of the powerful civilization that once defended against Hell’s forces.",+ },+ {+ "Name": "Cultist Base",+ "Description": "A grim fortress hidden within the icy mountains, where a fanatical cult worships demons. Filled with chilling sacrificial chambers, traps, and rituals, the Cultist Base is a hostile stronghold where Doom Slayer must confront the cult leaders aiding Hell's invasion of Earth.",+ },+ {+ "Name": "Taras Nabad",+ "Description": "A war-ravaged city on the homeworld of the Night Sentinels, showcasing grandiose, ancient architecture in the midst of destruction. Taras Nabad's sprawling structures and historical significance reveal glimpses into the Doom Slayer’s past and the once-thriving Sentinel civilization.",+ },+ {+ "Name": "Nekravol",+ "Description": "A hellish, industrial fortress where souls are processed into Argent energy. With conveyor belts moving the damned and a skyline dominated by fire and darkness, Nekravol is a nightmarish facility that powers Hell's armies and embodies the horrific machinery of Hell's cruelty.",+ },+ {+ "Name": "Urdak",+ "Description": "A surreal, high-tech realm that serves as the home of the angelic Maykrs. Urdak’s sleek, pristine architecture and ethereal ambiance sharply contrast with Hell’s brutal landscapes, yet this realm holds its own dark secrets and a critical role in Hell's invasion of Earth.",+ },+ {+ "Name": "UAC Base",+ "Description": "A futuristic military base on Earth controlled by the Union Aerospace Corporation (UAC), filled with high-tech weaponry and security systems. The UAC Base serves as a human foothold in the fight against Hell, though some within its ranks may have darker intentions.",+ },+]++combat_casualties = ["Nonexistent", "Low", "Medium", "High", "Extinction"]++missions = [+ "Locate and confront a key leader of Hell’s invasion forces.",+ "Clear out demonic infestations to secure a strategic foothold.",+ "Disrupt Hell's control over the area by eliminating critical targets.",+ "Enter a critical demonic stronghold to disrupt enemy operations.",+ "Locate and destroy the central power source to weaken enemy forces.",+ "Collect essential resources before the area becomes unstable.",+]+++# Now that that's done, we can make a function! We will generate three random missions and pass it off to the AI.+def generate_missions():+ selectedmissions = []+ loop = 0++ while loop < 3:+ location = random.choice(locations)+ casualties = random.choice(combat_casualties)+ mission = random.choice(missions)+ final = (+ f"LocationName: {location['Name']}, "+ f"LocationInfo: {location['Description']}, "+ f"HumanCombatCasualties: {casualties}, "+ f"Mission: {mission}"+ )++ selectedmissions.append(final)+ loop += 1++ # Combine all mission strings into a single string with a separator (e.g., newline or comma)+ missions_string = "\\n".join(missions) # Or \", \".join(missions) for a comma-separated string+ print(missions_string)+ return missions_string+++generate_missions()+# Now to the real core of this; making our message stream! We create this as a function we can call later! I create examples since the LLM's context size can handle it (and it's generally good practice)!+#+# We are also going to take several steps here; we must create an example of the tool being used as context. Next, we must add the generated lines to the messages list once done being generated. Finally, we will parse the text for the format we want and request another line+# Now we make a message! This time around we will skip making an initial message that has too much context, unlike in the past!+# We make our history a separate block to be easier to add to later on! This is essentially our history+initial_messages = [+ {+ "role": "user",+ "content": "You are VEGA, the assistant to the DOOMGUY. Get three missions from the ship's API and tell me which mission is most to least important for quellng the forces of hell. ",+ }+]+# Now to construct a request!+response = client.messages.create(+ max_tokens=5000,+ model="claude-3-7-sonnet-20250219",+ tools=[+ {+ "name": "generate_missions",+ "description": "Retrieve three missions for the DoomSlayer",+ "input_schema": {"type": "object", "properties": {}, "required": []},+ }+ ],+ messages=initial_messages,+)++print(response.content)+# Having trouble understanding this? The first block given is always Ai dialouge! You can use response.content[0].text to get the AI's text! Let's try it below.+message = response.content[0].text+print(message)+# The code below finds the tool used!+gen_mission_result = ""++# Print response content to see the data+print(response.content)++# Assuming ToolUseBlock is at index 1+tool_use_block = response.content[1]++# Get the tool name and input+tool_name = tool_use_block.name+tool_input = tool_use_block.input++# We don't need to look to extract any inputs since we don't use any++# Check if the tool name is "generate_missions"+if tool_name == "generate_missions":+ # Call the function with the tool creator as an argument+ gen_mission_result = generate_missions()+# Now we add these as context to the LLM through initial messages!+initial_messages.append({"role": "assistant", "content": gen_mission_result})++initial_messages.append(+ {+ "role": "user",+ "content": "Based on these, which location should take priority and why?",+ }+)+# And now to get a response!+response = client.messages.create(+ max_tokens=5000,+ model="claude-3-7-sonnet-20250219",+ tools=[+ {+ "name": "generate_missions",+ "description": "Retrieve three missions for the DoomSlayer",+ "input_schema": {"type": "object", "properties": {}, "required": []},+ }+ ],+ messages=initial_messages,+)++print(response)+# Isolate again!+message = response.content[0].text+print(message)+# Hmmm, what if we wanted to include more tools and add inputs? Let's create two new functions to display this!+#+# One will show the kind of demon we are facing, whereas another one will take our weapon input to determine what the best weapon chain to use is (You heard that right, we believe in quick weapon switches around these parts)+demons = [+ {+ "Name": "Imp",+ "Description": "A fast, agile demon that hurls fireballs and uses its claws to tear apart its prey. Imps are commonly found in Hell’s army, notorious for their quickness and ability to climb walls, making them dangerous adversaries in any environment.",+ },+ {+ "Name": "Cacodemon",+ "Description": "A floating, spherical demon with a large mouth full of teeth and an ability to launch explosive projectiles. Cacodemons are often encountered in open areas, where their aerial agility and relentless attacks pose a constant threat.",+ },+ {+ "Name": "Hell Knight",+ "Description": "A towering, brutish demon with immense strength and durability. The Hell Knight is capable of charging at the Doom Slayer and delivering devastating melee attacks. Its tough hide makes it resistant to most forms of damage.",+ },+ {+ "Name": "Mancubus",+ "Description": "A grotesque, overweight demon that releases powerful fireballs from its massive arm cannons. Mancubus demons are slow-moving but dangerous due to their firepower and the ability to overwhelm enemies with their fiery onslaughts.",+ },+]+++weapons = [+ {+ "Name": "Super Shotgun",+ "Description": "A powerful, double-barreled shotgun that delivers devastating close-range damage. Known for its sheer stopping power, the Super Shotgun can tear through enemies with ease, especially when equipped with the Meat Hook attachment, allowing for rapid mobility and devastating hits.",+ },+ {+ "Name": "Rocket Launcher",+ "Description": "A high-powered weapon that fires explosive rockets capable of dealing massive area damage. The Rocket Launcher is invaluable for taking down groups of enemies or dealing significant damage to larger demons, especially when upgraded with the Lock-On Burst mod.",+ },+ {+ "Name": "Chaingun",+ "Description": "A rapid-fire weapon that can unleash a torrent of bullets at a high rate of speed. The Chaingun is perfect for mowing down enemies and can be equipped with the Heat Blast mod, allowing for explosive energy rounds that can clear multiple enemies at once.",+ },+ {+ "Name": "BFG 9000",+ "Description": "One of the most iconic weapons in the *Doom* franchise, the BFG 9000 fires a massive energy beam that obliterates anything in its path. With its massive damage potential, the BFG 9000 is a game-changer, especially in dealing with large groups of enemies or the toughest foes.",+ },+ {+ "Name": "Ice Bomb",+ "Description": "A special grenade that freezes enemies in a wide area, giving the Doom Slayer a chance to deal with multiple foes at once. The Ice Bomb is effective for crowd control, allowing for easy Glory Kills or creating distance from overwhelming enemies.",+ },+]+# Now we can keep the initialmessages from before actually! However let's change the context+initial_messages.append(+ {+ "role": "user",+ "content": "The first priority mission was selected. At the same time, scan for enemies and check inventory to determine the best combat strategy. You should use both tools at once.",+ }+)+++# And we of course make functions+def enemyscan(amount):+ enemiesonscene = []+ loop = 0++ while loop < amount + 1:+ scannedenemy = random.choice(demons)++ # Append just the name of the demon to the list+ enemiesonscene.append(scannedenemy["Name"])+ enemiesonscene.append(scannedenemy["Description"])+ loop += 1++ # Combine all mission strings into a single string with a separator (e.g., newline or comma)+ enemies_string = "\\n".join(enemiesonscene)+ print(enemies_string)+ return enemies_string+++enemyscan(5)+++# And now inventory+def inventoryscan():+ weapons_at_hand = []+ loop = 0++ while loop < 5:+ weapon = random.choice(weapons)++ # Append just the name of the demon to the list+ weapons_at_hand.append(weapon["Name"])+ weapons_at_hand.append(weapon["Description"])+ loop += 1++ # Combine all mission strings into a single string with a separator (e.g., newline or comma)+ weapons_string = "\\n".join(weapons_at_hand)+ print(weapons_string)+ return weapons_string+++inventoryscan()+# With that, let's construct our new tools and run this!!+response = client.messages.create(+ max_tokens=5000,+ model="claude-3-7-sonnet-20250219",+ tools=[+ {+ "name": "enemyscan_tool",+ "description": "Retrieve a list of demons currently present in the area.",+ "input_schema": {+ "type": "object",+ "properties": {+ "amount": {+ "type": "integer",+ "description": "Number of enemies to scan.",+ }+ },+ "required": ["amount"],+ },+ },+ {+ "name": "inventoryscan_tool",+ "description": "Retrieve a list of weapons the Doom Slayer has at hand.",+ "input_schema": {"type": "object", "properties": {}, "required": []},+ },+ ],+ messages=initial_messages,+)++print(response)+# Display just the text+message = response.content[0].text+print(message)+initial_messages.append({"role": "assistant", "content": f"{str(response.content[0].text)}"})+# And now to get the information and put it all together! PLEASE read the comments!+inv_scan_res = ""+enemy_scan_res = ""+++response_str = str(response)+tool_use_count = response_str.count(+ "ToolUseBlock"+) # We know the ToolUseBlock will appear once for each tool request so we check how many time it appears+++# You can use print(tool_use_count)to validate the ToolBlocks here if you wish++loop = 0++# We do this instead of a (foreach) because we need to skip the first block! This contains the message from the AI, not the tool! This way allows us to reference the item we want as easily as possible without complex logic needed!++while loop < tool_use_count: # We will get the tools now+ tool_use_block = response.content[loop + 1] # We start at 1 since 0 holds the AI mesage+ tool_name = tool_use_block.name+ tool_input = tool_use_block.input++ if tool_name == "inventoryscan_tool":+ # Call the inventoryscan function for inventoryscan_tool+ inv_scan_res = inventoryscan()+ elif tool_name == "enemyscan_tool":+ # Get the amount for enemyscan_tool+ amount = tool_input["amount"]+ # Call the enemyscan function with the amount+ enemy_scan_res = enemyscan(amount)++ loop = loop + 1+print(inv_scan_res)+print(enemy_scan_res)+# And now we are basically done! We can give this to th AI and see what we get+initial_messages.append(+ {+ "role": "assistant",+ "content": f"Weapons Inventory Scan Result: {inv_scan_res}\\nEnemy Scans Result: {enemy_scan_res}",+ }+)+++initial_messages.append(+ {+ "role": "user",+ "content": "What is the combat plan for killing these demons? Based on the last message, tell me which demons to kill first, in which order and using which weapons as well as any sweakpoints.",+ }+)+response = client.messages.create(+ max_tokens=5000,+ model="claude-3-7-sonnet-20250219",+ tools=[+ {+ "name": "enemyscan_tool",+ "description": "Retrieve a list of demons currently present in the area.",+ "input_schema": {+ "type": "object",+ "properties": {+ "amount": {+ "type": "integer",+ "description": "Number of enemies to scan.",+ }+ },+ "required": ["amount"],+ },+ },+ {+ "name": "inventoryscan_tool",+ "description": "Retrieve a list of weapons the Doom Slayer has at hand.",+ "input_schema": {"type": "object", "properties": {}, "required": []},+ },+ ],+ messages=initial_messages,+)++message = response.content[0].text+print(message)diff --git a/examples/anthropic_examples/anthropic-example-async.ipynb b/examples/anthropic/anthropic-example-async.ipynbsimilarity index 74%rename from examples/anthropic_examples/anthropic-example-async.ipynbrename to examples/anthropic/anthropic-example-async.ipynbindex dc88b035..43a45a98 100644--- a/examples/anthropic_examples/anthropic-example-async.ipynb+++ b/examples/anthropic/anthropic-example-async.ipynb@@ -46,7 +46,7 @@},{"cell_type": "code",- "execution_count": 18,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:24:46.731735Z",@@ -77,7 +77,7 @@},{"cell_type": "code",- "execution_count": 20,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:48:37.019670Z",@@ -91,8 +91,8 @@"outputs": [],"source": ["load_dotenv()\n",- "ANTHROPIC_API_KEY = os.getenv(\"ANTHROPIC_API_KEY\") or \"<your_anthropic_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"ANTHROPIC_API_KEY\"] = os.getenv(\"ANTHROPIC_API_KEY\", \"your_anthropic_api_key_here\")"]},{@@ -105,7 +105,7 @@},{"cell_type": "code",- "execution_count": 21,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:48:26.615366Z",@@ -118,7 +118,7 @@},"outputs": [],"source": [- "client = Anthropic(api_key=ANTHROPIC_API_KEY)"+ "client = Anthropic()"]},{@@ -129,7 +129,7 @@},"outputs": [],"source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"anthropic-async\"])"+ "agentops.init(tags=[\"anthropic-async\", \"agentops-example\"])"]},{@@ -143,7 +143,7 @@},{"cell_type": "code",- "execution_count": 24,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:48:45.831654Z",@@ -172,7 +172,7 @@},{"cell_type": "code",- "execution_count": 25,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:48:47.703344Z",@@ -203,7 +203,6 @@},{"cell_type": "code",- "execution_count": 26,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:49:04.543561Z",@@ -215,55 +214,7 @@"trusted": true},"outputs": [],- "source": [- "Personality = {random.choice(TitanPersonality)}\n",- "Health = {random.choice(TitanHealth)}\n",- "\n",- "\n",- "async def req():\n",- " # Start a streaming message request\n",- " stream = client.messages.create(\n",- " max_tokens=1024,\n",- " model=\"claude-3-5-sonnet-20240620\",\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"You are a Titan; a mech from Titanfall 2. Based on your titan's personality and status, generate a message for your pilot. If Near Destruction, make an all caps death message such as AVENGE ME or UNTIL NEXT TIME.\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Personality: Legion is a relentless and heavy-hitting Titan that embodies brute strength and defensive firepower. He speaks bluntly. Status: Considerable Damage\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Heavy damage detected. Reinforcements would be appreciated, but I can still fight.\",\n",- " },\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"You are a Titan; a mech from Titanfall 2. Based on your titan's personality and status, generate a message for your pilot. If Near Destruction, make an all caps death message such as AVENGE ME or UNTIL NEXT TIME.\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": f\"Personality: {Personality}. Status: {Health}\",\n",- " },\n",- " ],\n",- " stream=True,\n",- " )\n",- "\n",- " response = \"\"\n",- " for event in stream:\n",- " if event.type == \"content_block_delta\":\n",- " response += event.delta.text\n",- " elif event.type == \"message_stop\":\n",- " break # Exit the loop when the message completes\n",- "\n",- " return response\n",- "\n",- "\n",- "async def generate_uuids():\n",- " uuids = [str(uuid.uuid4()) for _ in range(4)]\n",- " return uuids"- ]+ "source": "Personality = {random.choice(TitanPersonality)}\nHealth = {random.choice(TitanHealth)}\n\n\nasync def req():\n # Start a streaming message request\n stream = client.messages.create(\n max_tokens=1024,\n model=\"claude-3-7-sonnet-20250219\",\n messages=[\n {\n \"role\": \"user\",\n \"content\": \"You are a Titan; a mech from Titanfall 2. Based on your titan's personality and status, generate a message for your pilot. If Near Destruction, make an all caps death message such as AVENGE ME or UNTIL NEXT TIME.\",\n },\n {\n \"role\": \"assistant\",\n \"content\": \"Personality: Legion is a relentless and heavy-hitting Titan that embodies brute strength and defensive firepower. He speaks bluntly. Status: Considerable Damage\",\n },\n {\n \"role\": \"assistant\",\n \"content\": \"Heavy damage detected. Reinforcements would be appreciated, but I can still fight.\",\n },\n {\n \"role\": \"user\",\n \"content\": \"You are a Titan; a mech from Titanfall 2. Based on your titan's personality and status, generate a message for your pilot. If Near Destruction, make an all caps death message such as AVENGE ME or UNTIL NEXT TIME.\",\n },\n {\n \"role\": \"assistant\",\n \"content\": f\"Personality: {Personality}. Status: {Health}\",\n },\n ],\n stream=True,\n )\n\n response = \"\"\n for event in stream:\n if event.type == \"content_block_delta\":\n response += event.delta.text\n elif event.type == \"message_stop\":\n break # Exit the loop when the message completes\n\n return response\n\n\nasync def generate_uuids():\n uuids = [str(uuid.uuid4()) for _ in range(4)]\n return uuids"},{"cell_type": "markdown",@@ -325,7 +276,7 @@"sourceType": "notebook"},"kernelspec": {- "display_name": "Python 3",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -339,9 +290,9 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.11.9"+ "version": "3.11.11"}},"nbformat": 4,"nbformat_minor": 4-}+}\ No newline at end of filediff --git a/examples/anthropic/anthropic-example-async.py b/examples/anthropic/anthropic-example-async.pynew file mode 100644index 00000000..b4ea04a5--- /dev/null+++ b/examples/anthropic/anthropic-example-async.py@@ -0,0 +1,110 @@+# # Anthropic Async Example+#+# Anthropic supports both sync and async! This is great because we can wait for functions to finish before we use them!+#+# In this example, we will make a program called "Titan Support Protocol." In this example, we will assign our mech a personality type and have a message generated based on our Titan's health (Which we randomly choose). We also send four generated UUIDs which are generated while the LLM runs+# First, we start by importing Agentops and Anthropic+# %pip install agentops+# %pip install anthropic+# Setup our generic default statements+from anthropic import Anthropic+import agentops+from dotenv import load_dotenv+import os+import random+import asyncio+import uuid++# And set our API keys.+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["ANTHROPIC_API_KEY"] = os.getenv("ANTHROPIC_API_KEY", "your_anthropic_api_key_here")+#+# Now let's set the client as Anthropic and open an agentops trace!+client = Anthropic()+agentops.init(tags=["anthropic-async", "agentops-example"])+# Now we create three personality presets;+#+# Legion is a relentless and heavy-hitting Titan that embodies brute strength and defensive firepower, Northstar is a precise and agile sniper that excels in long-range combat and flight, while Ronin is a swift and aggressive melee specialist who thrives on close-quarters hit-and-run tactics.+TitanPersonality = [+ "Legion is a relentless and heavy-hitting Titan that embodies brute strength and defensive firepower. He speaks bluntly.,",+ "Northstar is a precise and agile sniper that excels in long-range combat and flight. He speaks with an edge of coolness to him",+ "Ronin is a swift and aggressive melee specialist who thrives on close-quarters hit-and-run tactics. He talks like a Samurai might.",+]+# And our comabt log generator! We select from four health presets!+TitanHealth = [+ "Fully functional",+ "Slightly Damaged",+ "Moderate Damage",+ "Considerable Damage",+ "Near Destruction",+]+# Now to the real core of this; making our message stream! We create this as a function we can call later! I create examples since the LLM's context size can handle it!+Personality = {random.choice(TitanPersonality)}+Health = {random.choice(TitanHealth)}+++async def req():+ # Start a streaming message request+ stream = client.messages.create(+ max_tokens=1024,+ model="claude-3-7-sonnet-20250219",+ messages=[+ {+ "role": "user",+ "content": "You are a Titan; a mech from Titanfall 2. Based on your titan's personality and status, generate a message for your pilot. If Near Destruction, make an all caps death message such as AVENGE ME or UNTIL NEXT TIME.",+ },+ {+ "role": "assistant",+ "content": "Personality: Legion is a relentless and heavy-hitting Titan that embodies brute strength and defensive firepower. He speaks bluntly. Status: Considerable Damage",+ },+ {+ "role": "assistant",+ "content": "Heavy damage detected. Reinforcements would be appreciated, but I can still fight.",+ },+ {+ "role": "user",+ "content": "You are a Titan; a mech from Titanfall 2. Based on your titan's personality and status, generate a message for your pilot. If Near Destruction, make an all caps death message such as AVENGE ME or UNTIL NEXT TIME.",+ },+ {+ "role": "assistant",+ "content": f"Personality: {Personality}. Status: {Health}",+ },+ ],+ stream=True,+ )++ response = ""+ for event in stream:+ if event.type == "content_block_delta":+ response += event.delta.text+ elif event.type == "message_stop":+ break # Exit the loop when the message completes++ return response+++async def generate_uuids():+ uuids = [str(uuid.uuid4()) for _ in range(4)]+ return uuids+++# Now we wrap it all in a nice main function! Run this for the magic to happen! Go to your AgentOps dashboard and you should see this trace reflected!+async def main():+ # Start both tasks concurrently+ uuids, message = await asyncio.gather(generate_uuids(), req())++ print("Personality:", Personality)+ print("Health Status:", Health)+ print("Combat log incoming from encrypted area")++ print("Verification matrix activated.:")+ for u in uuids:+ print(u)++ print(". Titan Message: ", message)+++# Run the main function+# await main()+# We can observe the trace in the AgentOps dashboard by going to the trace URL provided above.diff --git a/examples/anthropic_examples/anthropic-example-sync.ipynb b/examples/anthropic/anthropic-example-sync.ipynbsimilarity index 84%rename from examples/anthropic_examples/anthropic-example-sync.ipynbrename to examples/anthropic/anthropic-example-sync.ipynbindex 58c4f528..2a7df162 100644--- a/examples/anthropic_examples/anthropic-example-sync.ipynb+++ b/examples/anthropic/anthropic-example-sync.ipynb@@ -48,7 +48,7 @@},{"cell_type": "code",- "execution_count": 4,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:20:59.991361Z",@@ -77,7 +77,7 @@},{"cell_type": "code",- "execution_count": 6,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:21:23.838837Z",@@ -91,8 +91,8 @@"outputs": [],"source": ["load_dotenv()\n",- "ANTHROPIC_API_KEY = os.getenv(\"ANTHROPIC_API_KEY\") or \"ANTHROPIC KEY HERE\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"AGENTOPS KEY HERE\""+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"ANTHROPIC_API_KEY\"] = os.getenv(\"ANTHROPIC_API_KEY\", \"your_anthropic_api_key_here\")"]},{@@ -104,7 +104,7 @@},{"cell_type": "code",- "execution_count": 7,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:21:25.808135Z",@@ -117,7 +117,7 @@},"outputs": [],"source": [- "client = Anthropic(api_key=ANTHROPIC_API_KEY)"+ "client = Anthropic()"]},{@@ -128,7 +128,8 @@},"outputs": [],"source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"anthropic-example\"])"+ "agentops.init(auto_start_session=False)\n",+ "tracer = agentops.start_trace(trace_name=\"Anthropic Sync Example\", tags=[\"anthropic-example\", \"agentops-example\"])"]},{@@ -149,7 +150,7 @@},{"cell_type": "code",- "execution_count": 10,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:21:34.091673Z",@@ -174,7 +175,7 @@},{"cell_type": "code",- "execution_count": 11,+ "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:21:35.472609Z",@@ -245,7 +246,6 @@},{"cell_type": "code",- "execution_count": null,"metadata": {"execution": {"iopub.execute_input": "2024-11-09T19:21:38.031580Z",@@ -257,37 +257,7 @@"trusted": true},"outputs": [],- "source": [- "stream = client.messages.create(\n",- " max_tokens=2400,\n",- " model=\"claude-3-5-sonnet-20240620\", # Comma added here\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"Create a story based on the three sentence fragments given to you, it has been combined into one below.\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"{A foolish doll} {died in a world} {of ended dreams.}\",\n",- " },\n",- " {\"role\": \"assistant\", \"content\": defaultstory},\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"Create a story based on the three sentence fragments given to you, it has been combined into one below.\",\n",- " },\n",- " {\"role\": \"assistant\", \"content\": generatedsentence},\n",- " ],\n",- " stream=True,\n",- ")\n",- "\n",- "response = \"\"\n",- "for event in stream:\n",- " if event.type == \"content_block_delta\":\n",- " response += event.delta.text\n",- " elif event.type == \"message_stop\":\n",- " print(generatedsentence)\n",- " print(response)"- ]+ "source": "stream = client.messages.create(\n max_tokens=2400,\n model=\"claude-3-7-sonnet-20250219\", # Comma added here\n messages=[\n {\n \"role\": \"user\",\n \"content\": \"Create a story based on the three sentence fragments given to you, it has been combined into one below.\",\n },\n {\n \"role\": \"assistant\",\n \"content\": \"{A foolish doll} {died in a world} {of ended dreams.}\",\n },\n {\"role\": \"assistant\", \"content\": defaultstory},\n {\n \"role\": \"user\",\n \"content\": \"Create a story based on the three sentence fragments given to you, it has been combined into one below.\",\n },\n {\"role\": \"assistant\", \"content\": generatedsentence},\n ],\n stream=True,\n)\n\nresponse = \"\"\nfor event in stream:\n if event.type == \"content_block_delta\":\n response += event.delta.text\n elif event.type == \"message_stop\":\n print(generatedsentence)\n print(response)"},{"cell_type": "markdown",@@ -306,7 +276,7 @@},"outputs": [],"source": [- "agentops.end_session(\"Success\")"+ "agentops.end_trace(tracer, end_state=\"Success\")"]}],@@ -321,7 +291,7 @@"sourceType": "notebook"},"kernelspec": {- "display_name": ".venv (3.11.11)",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -340,4 +310,4 @@},"nbformat": 4,"nbformat_minor": 4-}+}\ No newline at end of filediff --git a/examples/anthropic/anthropic-example-sync.py b/examples/anthropic/anthropic-example-sync.pynew file mode 100644index 00000000..f9742996--- /dev/null+++ b/examples/anthropic/anthropic-example-sync.py@@ -0,0 +1,112 @@+# # Anthropic Sync Example+#+# We are going to create a program called "Nier Storyteller". In short, it uses a message system similar to Nier Automata's to generate a one sentence summary before creating a short story.+#+# Example:+#+# {A foolish doll} {died in a world} {of ended dreams.} turns into "In a forgotten land where sunlight barely touched the ground, a little doll wandered through the remains of shattered dreams. Its porcelain face, cracked and wea..."+# First, we start by importing Agentops and Anthropic+# %pip install agentops+# %pip install anthropic+# Setup our generic default statements+from anthropic import Anthropic+import agentops+from dotenv import load_dotenv+import os+import random++# And set our API keys.+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["ANTHROPIC_API_KEY"] = os.getenv("ANTHROPIC_API_KEY", "your_anthropic_api_key_here")+# Now let's set the client as Anthropic and an AgentOps session!+client = Anthropic()+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(trace_name="Anthropic Sync Example", tags=["anthropic-example", "agentops-example"])+# Remember that story we made earlier? As of writing, claude-3-5-sonnet-20240620 (the version we will be using) has a 150k word, 680k character length. We also get an 8192 context length. This is great because we can actually set an example for the script!+#+# Let's assume we have user (the person speaking), assistant (the AI itself) for now and computer (the way the LLM gets references from).+# Let's set a default story as a script!+defaultstory = "In a forgotten land where sunlight barely touched the ground, a little doll wandered through the remains of shattered dreams. Its porcelain face, cracked and weathered, reflected the emptiness that hung in the air like a lingering fog. The doll's painted eyes, now chipped and dull, stared into the distance, searching for something—anything—that still held life. It had once belonged to a child who dreamt of endless adventures, of castles in the clouds and whispered secrets under starry skies. But those dreams had long since crumbled to dust, leaving behind nothing but a hollow world where even hope dared not tread. The doll, a relic of a life that had faded, trudged through the darkness, its tiny feet stumbling over broken wishes and forgotten stories. Each step took more effort than the last, as if the world itself pulled at the doll's limbs, weary and bitter. It reached a place where the ground fell away into an abyss of despair, the edge crumbling under its weight. The doll paused, teetering on the brink. It reached out, as though to catch a fading dream, but there was nothing left to hold onto. With a faint crack, its brittle body gave way, and the doll tumbled silently into the void. And so, in a world where dreams had died, the foolish little doll met its end. There were no tears, no mourning. Only the soft, empty echo of its fall, fading into the darkness, as the land of ended dreams swallowed the last trace of what once was."+# We are almost done! Let's generate a one sentence story summary by taking 3 random sentence fragments and connecting them!+# Define the lists+first = [+ "A unremarkable soldier",+ "A lone swordsman",+ "A lone lancer",+ "A lone pugilist",+ "A dual-wielder",+ "A weaponless soldier",+ "A beautiful android",+ "A small android",+ "A double-crossing android",+ "A weapon carrying android",+]++second = [+ "felt despair at this cold world",+ "held nothing back",+ "gave it all",+ "could not get up again",+ "grimaced in anger",+ "missed the chance of a lifetime",+ "couldn't find a weakpoint",+ "was overwhelmed",+ "was totally outmatched",+ "was distracted by a flower",+ "hesitated to land the killing blow",+ "was attacked from behind",+ "fell to the ground",+]++third = [+ "in a dark hole beneath a city",+ "underground",+ "at the enemy's lair",+ "inside an empty ship",+ "at a tower built by the gods",+ "on a tower smiled upon by angels",+ "inside a tall tower",+ "at a peace-loving village",+ "at a village of refugees",+ "in the free skies",+ "below dark skies",+ "in a blood-soaked battlefield",+]++# Generate a random sentence+generatedsentence = f"{random.choice(first)} {random.choice(second)} {random.choice(third)}."+# And now to construct a stream/message! We set an example for the assistant now!+stream = client.messages.create(+ max_tokens=2400,+ model="claude-3-7-sonnet-20250219", # Comma added here+ messages=[+ {+ "role": "user",+ "content": "Create a story based on the three sentence fragments given to you, it has been combined into one below.",+ },+ {+ "role": "assistant",+ "content": "{A foolish doll} {died in a world} {of ended dreams.}",+ },+ {"role": "assistant", "content": defaultstory},+ {+ "role": "user",+ "content": "Create a story based on the three sentence fragments given to you, it has been combined into one below.",+ },+ {"role": "assistant", "content": generatedsentence},+ ],+ stream=True,+)++response = ""+for event in stream:+ if event.type == "content_block_delta":+ response += event.delta.text+ elif event.type == "message_stop":+ print(generatedsentence)+ print(response)+# We can observe the session in the AgentOps dashboard by going to the session URL provided above.+#+# Now we will end the session with a success message. We can also end the session with a failure or intdeterminate status. By default, the session will be marked as indeterminate.+agentops.end_trace(tracer, end_state="Success")diff --git a/examples/anthropic_examples/README.md b/examples/anthropic_examples/README.mddeleted file mode 100644index 70bf658f..00000000--- a/examples/anthropic_examples/README.md+++ /dev/null@@ -1,70 +0,0 @@-# Anthropic and AgentOps--AgentOps provides first party support for observing Anthropic's API.--Explore [Anthropic's](https://www.anthropic.com) documentation [here.](https://docs.anthropic.com/en/docs/welcome) to get started.--> [!NOTE]-> If it's your first time developing for an LLM, be sure to look at our intro to LLMs (coming soon)! Here, we explain generic functions such as giving the AI a memory to exploring novel concepts like summarizing chunks at regular intervals to keep some context while saving memory!--## Getting Started--You can get Anthropic's API working with a few lines of code!--### 1. Import agentops and anthropic to your environment--```python-pip install agentops-pip install anthropic-```--### 2. Setup import statements--```python-from anthropic import Anthropic, AsyncAnthropic-import agentops-import os-from dotenv import load_dotenv-```--### 3. Set your API keys--```python-load_dotenv()-ANTHROPIC_API_KEY = os.getenv("ANTHROPIC_API_KEY") or "<your_anthropic_key>"-AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "<your_agentops_key>"-```--From here, you have a number of ways you can interact with the Anthropic API!--## Examples--> [!NOTE]-> You need to set an API key for both Agentops and Anthropic!--## Sync Example - Nier Storyteller--In this example, we generate a sentence from three parts before having Anthropic generate a short story based off it!--Access the example [here.](./anthropic-example-sync.ipynb).--## Async Example - Titan Support Protocol--In this example, we generate a script line for a mech based on it's health and the type. At the same time, we generate 4 UUIDs. We finally wait for both functions to finish before printing them for the user.--Access the example [here.](./anthropic-example-async.ipynb)--## Tool Example - Cyberware--In this example, we have the LLM call a simulated tool which gives one random piece of Cyberware based on the user's requested company. From there, the AI tells the user if the cyberware is good for the user's intended purpose. (combatant, hacker, etc.).--Access the example [here.](./antrophic-example-tool.ipynb)--## Tool Deepdive - VEGA Hell Combat System--In this example, we look at the tool system through a deeper dive; we will use our LLM assistant, VEGA, to get three missions from an API and determine which deserves priority. Then, we will send a number of enemies we want to scan for during combat while also getting our weapons inventory (using two tools at the same time). VEGA will tell us the bet way in which to combat these enemies through a combat strategy.--Access the example [here.](./agentops-anthropic-understanding-tools.ipynb)--> [!NOTE]-> You can explore Anthropic's Tool Calling documentation [here](https://docs.anthropic.com/en/docs/build-with-claude/tool-use) to learn how to use it, some examples and pricing.diff --git a/examples/anthropic_examples/antrophic-example-tool.ipynb b/examples/anthropic_examples/antrophic-example-tool.ipynbdeleted file mode 100644index 730d0fb2..00000000--- a/examples/anthropic_examples/antrophic-example-tool.ipynb+++ /dev/null@@ -1,831 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Anthropic Tool Example\n",- "\n",- "Anthropic supports tools, allowing you to easily connect with different external APIs and the like!\n",- "\n",- "For this example, we are going to make a tool called \"Cyberware\" which will be our tool; we will create a dummy API that gives specs for cyberware from a specific company before the LLM says if the cyberware is good for a build. To do so, we will use both the tool system and an async function!"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First, we start by importing Agentops and Anthropic"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T19:58:34.879322Z",- "iopub.status.busy": "2024-11-09T19:58:34.878657Z",- "iopub.status.idle": "2024-11-09T19:59:00.718845Z",- "shell.execute_reply": "2024-11-09T19:59:00.717724Z",- "shell.execute_reply.started": "2024-11-09T19:58:34.879282Z"- },- "trusted": true- },- "outputs": [],- "source": [- "%pip install agentops\n",- "%pip install anthropic"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Setup our generic default statements"- ]- },- {- "cell_type": "code",- "execution_count": 1,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T19:59:59.532140Z",- "iopub.status.busy": "2024-11-09T19:59:59.531722Z",- "iopub.status.idle": "2024-11-09T20:00:00.316206Z",- "shell.execute_reply": "2024-11-09T20:00:00.315436Z",- "shell.execute_reply.started": "2024-11-09T19:59:59.532101Z"- },- "trusted": true- },- "outputs": [],- "source": [- "from anthropic import Anthropic\n",- "import agentops\n",- "from dotenv import load_dotenv\n",- "import os\n",- "import random\n",- "import time"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "And set our API keys."- ]- },- {- "cell_type": "code",- "execution_count": 2,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:00:02.860678Z",- "iopub.status.busy": "2024-11-09T20:00:02.860124Z",- "iopub.status.idle": "2024-11-09T20:00:02.866414Z",- "shell.execute_reply": "2024-11-09T20:00:02.865290Z",- "shell.execute_reply.started": "2024-11-09T20:00:02.860635Z"- },- "trusted": true- },- "outputs": [],- "source": [- "load_dotenv()\n",- "ANTHROPIC_API_KEY = os.getenv(\"ANTHROPIC_API_KEY\") or \"ANTHROPIC API KEY\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"AGENTOPS API KEY\""- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "\n",- "Now let's set the client as Anthropic and start an AgentOps session"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"anthropic-example-tool\"])"- ]- },- {- "cell_type": "code",- "execution_count": 4,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:00:05.338711Z",- "iopub.status.busy": "2024-11-09T20:00:05.338079Z",- "iopub.status.idle": "2024-11-09T20:00:05.354458Z",- "shell.execute_reply": "2024-11-09T20:00:05.353577Z",- "shell.execute_reply.started": "2024-11-09T20:00:05.338647Z"- },- "trusted": true- },- "outputs": [],- "source": [- "client = Anthropic(api_key=ANTHROPIC_API_KEY)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's create a dummy tool now! First off, let's create a list of companies for the system to choose from"- ]- },- {- "cell_type": "code",- "execution_count": 5,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:00:08.563085Z",- "iopub.status.busy": "2024-11-09T20:00:08.562702Z",- "iopub.status.idle": "2024-11-09T20:00:08.569085Z",- "shell.execute_reply": "2024-11-09T20:00:08.568239Z",- "shell.execute_reply.started": "2024-11-09T20:00:08.563049Z"- },- "trusted": true- },- "outputs": [],- "source": [- "Corpo = [\n",- " \"Kiroshi\",\n",- " \"Arasaka\",\n",- " \"Kang Tao\",\n",- " \"Militech\",\n",- " \"Biotechnica\",\n",- " \"Zetatech\",\n",- " \"Dynalar\",\n",- "]"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "And now we create a DB! This could be anything from an .xml/.json to Postgres or MySQL! For our intent of a test, we will just include a dictionary."- ]- },- {- "cell_type": "code",- "execution_count": 6,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:32:14.377597Z",- "iopub.status.busy": "2024-11-09T20:32:14.377202Z",- "iopub.status.idle": "2024-11-09T20:32:14.402830Z",- "shell.execute_reply": "2024-11-09T20:32:14.401893Z",- "shell.execute_reply.started": "2024-11-09T20:32:14.377561Z"- },- "jupyter": {- "source_hidden": true- },- "trusted": true- },- "outputs": [],- "source": [- "cyberware_list = [\n",- " {\n",- " \"name\": \"Kiroshi Optics\",\n",- " \"creator\": \"Kiroshi\",\n",- " \"bio\": \"Advanced cybernetic eye implants providing enhanced vision, a heads-up display (HUD), and scanning capabilities.\",\n",- " \"stats\": {\n",- " \"vision_modes\": [\"Thermal\", \"Night Vision\", \"Zoom\"],\n",- " \"target_analysis\": \"Enemy Weak Spots Highlighted\",\n",- " },\n",- " },\n",- " {\n",- " \"name\": \"Gorilla Arms\",\n",- " \"creator\": \"Arasaka\",\n",- " \"bio\": \"Mechanical arms designed to enhance physical strength, allowing for powerful melee attacks and the ability to rip open doors.\",\n",- " \"stats\": {\"melee_damage_bonus\": \"+100%\", \"strength_check_bonus\": \"+20\"},\n",- " },\n",- " {\n",- " \"name\": \"Mantis Blades\",\n",- " \"creator\": \"Arasaka\",\n",- " \"bio\": \"Arm-mounted blades used for close combat, retractable from the forearms and capable of delivering high-speed slashes.\",\n",- " \"stats\": {\n",- " \"damage_type\": \"Physical\",\n",- " \"attack_speed\": \"+30%\",\n",- " \"bleed_chance\": \"50%\",\n",- " },\n",- " },\n",- " {\n",- " \"name\": \"Monowire\",\n",- " \"creator\": \"Kang Tao\",\n",- " \"bio\": \"A high-tech fiber-optic whip weapon that can slice through enemies with ease and can be charged for extra damage.\",\n",- " \"stats\": {\n",- " \"damage_type\": \"Physical/Electrical\",\n",- " \"charge_bonus_damage\": \"+200%\",\n",- " \"range\": \"5 meters\",\n",- " },\n",- " },\n",- " {\n",- " \"name\": \"Projectile Launch System\",\n",- " \"creator\": \"Militech\",\n",- " \"bio\": \"An arm-mounted cannon that allows the user to launch various types of projectiles, including grenades and explosive rounds.\",\n",- " \"stats\": {\n",- " \"ammo_types\": [\"Explosive\", \"Incendiary\", \"EMP\"],\n",- " \"blast_radius\": \"3 meters\",\n",- " },\n",- " },\n",- " {\n",- " \"name\": \"Syn-Lungs\",\n",- " \"creator\": \"Biotechnica\",\n",- " \"bio\": \"Synthetic lungs that improve the user's breathing efficiency and stamina, allowing for prolonged physical exertion.\",\n",- " \"stats\": {\"stamina_regen_rate\": \"+25%\", \"oxygen_capacity\": \"+30%\"},\n",- " },\n",- " {\n",- " \"name\": \"Reinforced Tendons\",\n",- " \"creator\": \"Arasaka\",\n",- " \"bio\": \"Muscular enhancements that allow the user to jump higher and perform acrobatic movements.\",\n",- " \"stats\": {\"jump_height\": \"+2 meters\", \"stamina_cost_reduction\": \"20%\"},\n",- " },\n",- " {\n",- " \"name\": \"Bionic Joints\",\n",- " \"creator\": \"Zetatech\",\n",- " \"bio\": \"Cybernetic enhancements to the joints, providing increased flexibility and limb strength.\",\n",- " \"stats\": {\"mobility_increase\": \"+15%\", \"limb_strength\": \"+20\"},\n",- " },\n",- " {\n",- " \"name\": \"Subdermal Armor\",\n",- " \"creator\": \"Militech\",\n",- " \"bio\": \"Under-the-skin armor implants that increase the user's resistance to damage.\",\n",- " \"stats\": {\"armor_bonus\": \"+200\", \"damage_resistance\": \"20%\"},\n",- " },\n",- " {\n",- " \"name\": \"Sandevistan\",\n",- " \"creator\": \"Dynalar\",\n",- " \"bio\": \"Reflex booster that slows down time for the user, allowing them to move at superhuman speed.\",\n",- " \"stats\": {\n",- " \"duration\": \"8 seconds\",\n",- " \"cooldown\": \"30 seconds\",\n",- " \"speed_increase\": \"+50%\",\n",- " },\n",- " },\n",- " {\n",- " \"name\": \"Berserk\",\n",- " \"creator\": \"Arasaka\",\n",- " \"bio\": \"An adrenaline-inducing cyberware that temporarily boosts the user's physical capabilities, including strength and damage resistance.\",\n",- " \"stats\": {\n",- " \"duration\": \"10 seconds\",\n",- " \"strength_bonus\": \"+30\",\n",- " \"damage_reduction\": \"15%\",\n",- " },\n",- " },\n",- " {\n",- " \"name\": \"Cyberdeck\",\n",- " \"creator\": \"NetWatch\",\n",- " \"bio\": \"Cybernetic interface used for hacking, allowing the user to deploy quickhacks and breach enemy systems.\",\n",- " \"stats\": {\"RAM_slots\": \"8\", \"quickhack_upload_speed\": \"+30%\"},\n",- " },\n",- " {\n",- " \"name\": \"Pain Editor\",\n",- " \"creator\": \"Biotechnica\",\n",- " \"bio\": \"A neurological implant that reduces the perception of pain, allowing the user to endure more damage.\",\n",- " \"stats\": {\"damage_taken_reduction\": \"10%\", \"bleed_resistance\": \"+50%\"},\n",- " },\n",- " {\n",- " \"name\": \"Blood Pump\",\n",- " \"creator\": \"Arasaka\",\n",- " \"bio\": \"An enhanced circulatory system that improves health regeneration during combat.\",\n",- " \"stats\": {\"health_regen_per_second\": \"+5%\", \"activation_duration\": \"6 seconds\"},\n",- " },\n",- " {\n",- " \"name\": \"Heal-On-Kill\",\n",- " \"creator\": \"Militech\",\n",- " \"bio\": \"A system that restores a portion of the user's health each time they defeat an enemy.\",\n",- " \"stats\": {\"health_restored_per_kill\": \"20%\", \"cooldown\": \"3 seconds\"},\n",- " },\n",- " {\n",- " \"name\": \"Smart Link\",\n",- " \"creator\": \"Kang Tao\",\n",- " \"bio\": \"A wrist implant that increases smart weapon accuracy and locks onto targets for better aim.\",\n",- " \"stats\": {\"smart_weapon_accuracy\": \"+15%\", \"target_lock_speed\": \"+25%\"},\n",- " },\n",- " {\n",- " \"name\": \"Nano Relays\",\n",- " \"creator\": \"Zetatech\",\n",- " \"bio\": \"Enhances the duration of Sandevistan or Berserk by boosting neural signal transmission.\",\n",- " \"stats\": {\"duration_increase\": \"+2 seconds\"},\n",- " },\n",- " {\n",- " \"name\": \"Optical Camo\",\n",- " \"creator\": \"Militech\",\n",- " \"bio\": \"A cloaking device that provides temporary invisibility to the user.\",\n",- " \"stats\": {\"invisibility_duration\": \"10 seconds\", \"cooldown\": \"30 seconds\"},\n",- " },\n",- " {\n",- " \"name\": \"Bioconductor\",\n",- " \"creator\": \"Biotechnica\",\n",- " \"bio\": \"Regulates the body’s internal processes, reducing cyberware cooldowns.\",\n",- " \"stats\": {\"cooldown_reduction\": \"20%\"},\n",- " },\n",- " {\n",- " \"name\": \"Second Heart\",\n",- " \"creator\": \"Biotechnica\",\n",- " \"bio\": \"A failsafe biological implant that revives the user once when they die.\",\n",- " \"stats\": {\"revive_health\": \"50%\", \"cooldown\": \"2 minutes\"},\n",- " },\n",- " {\n",- " \"name\": \"Biomonitor\",\n",- " \"creator\": \"Arasaka\",\n",- " \"bio\": \"Monitors the user's vital signs and triggers healing if health drops too low.\",\n",- " \"stats\": {\"activation_threshold\": \"15% health\", \"healing_amount\": \"30%\"},\n",- " },\n",- " {\n",- " \"name\": \"Neofiber\",\n",- " \"creator\": \"Zetatech\",\n",- " \"bio\": \"A muscle fiber enhancement that increases evasion and movement speed.\",\n",- " \"stats\": {\"evasion_increase\": \"+10%\", \"movement_speed_bonus\": \"+5%\"},\n",- " },\n",- " {\n",- " \"name\": \"Cataresist\",\n",- " \"creator\": \"Biotechnica\",\n",- " \"bio\": \"Improves the user's resistance to toxins and shock-based damage.\",\n",- " \"stats\": {\"poison_resistance\": \"+30%\", \"shock_resistance\": \"+25%\"},\n",- " },\n",- " {\n",- " \"name\": \"Microgenerator\",\n",- " \"creator\": \"Militech\",\n",- " \"bio\": \"Releases a shockwave when the user takes damage, knocking back enemies.\",\n",- " \"stats\": {\"shockwave_radius\": \"3 meters\", \"cooldown\": \"10 seconds\"},\n",- " },\n",- " {\n",- " \"name\": \"Fortified Ankles\",\n",- " \"creator\": \"Dynalar\",\n",- " \"bio\": \"Reinforces the legs to allow for charged jumps and enhanced mobility.\",\n",- " \"stats\": {\"charged_jump_height\": \"+3 meters\", \"stamina_cost\": \"15%\"},\n",- " },\n",- " {\n",- " \"name\": \"Reflex Tuner\",\n",- " \"creator\": \"Arasaka\",\n",- " \"bio\": \"Slows time when the user's health falls below a certain level, providing a brief window for recovery.\",\n",- " \"stats\": {\"activation_threshold\": \"25% health\", \"duration\": \"5 seconds\"},\n",- " },\n",- " {\n",- " \"name\": \"Techgogs\",\n",- " \"creator\": \"Kiroshi\",\n",- " \"bio\": \"Enhanced goggles that provide better target acquisition and analysis.\",\n",- " \"stats\": {\"targeting_accuracy\": \"+20%\", \"analyze_speed\": \"+25%\"},\n",- " },\n",- "]"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "And finally we make build types! We will keep to 6 based off the Edgerunners anime! (Try guessing which archetype is who)"- ]- },- {- "cell_type": "code",- "execution_count": 7,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:00:14.285035Z",- "iopub.status.busy": "2024-11-09T20:00:14.284254Z",- "iopub.status.idle": "2024-11-09T20:00:14.291284Z",- "shell.execute_reply": "2024-11-09T20:00:14.290236Z",- "shell.execute_reply.started": "2024-11-09T20:00:14.284994Z"- },- "jupyter": {- "source_hidden": true- },- "trusted": true- },- "outputs": [],- "source": [- "edgerunners_builds = [\n",- " {\n",- " \"name\": \"The Agile Fighter\",\n",- " \"description\": \"An adaptable build that focuses on speed and reflexes. Excelling in close-quarters combat, this fighter utilizes a mix of melee and ranged weapons, quickly adapting to any situation and embodying the spirit of a street fighter.\",\n",- " },\n",- " {\n",- " \"name\": \"The Chaotic Gunner\",\n",- " \"description\": \"An unpredictable build specializing in dual-wielding firearms and fast-paced combat. With high energy and a penchant for mayhem, this gunner overwhelms enemies with speed and accuracy, making them a force to be reckoned with in any firefight.\",\n",- " },\n",- " {\n",- " \"name\": \"The Heavy Brawler\",\n",- " \"description\": \"A build centered around strength and durability, combining powerful weaponry with advanced cybernetic enhancements. This brawler can absorb damage and unleash devastating attacks, making them a formidable frontline combatant.\",\n",- " },\n",- " {\n",- " \"name\": \"The Stealth Hacker\",\n",- " \"description\": \"A stealthy and agile build focused on evasion and hacking. Utilizing advanced cyberware, this infiltrator manipulates the environment and sneaks past enemy lines without detection, excelling in covert operations.\",\n",- " },\n",- " {\n",- " \"name\": \"The Tactical Defender\",\n",- " \"description\": \"A defensive build that excels in protecting allies and providing support on the battlefield. With resilience and tactical prowess, this defender can absorb enemy fire while counterattacking, ideal for players who prefer a supportive role.\",\n",- " },\n",- " {\n",- " \"name\": \"The Supportive Strategist\",\n",- " \"description\": \"A build focused on enhancing team performance. Utilizing a mix of hacking and buffing skills, this strategist provides advantages in combat, ensuring that allies remain strong and focused during engagements.\",\n",- " },\n",- "]"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now that that's done, we can make a function! We will take the input from the user; for this test, we can assume we will always get a proper corpo name. We have a two second wait to simulate an online API request"- ]- },- {- "cell_type": "code",- "execution_count": 8,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:00:23.150097Z",- "iopub.status.busy": "2024-11-09T20:00:23.149239Z",- "iopub.status.idle": "2024-11-09T20:00:23.157206Z",- "shell.execute_reply": "2024-11-09T20:00:23.156013Z",- "shell.execute_reply.started": "2024-11-09T20:00:23.150045Z"- },- "jupyter": {- "source_hidden": true- },- "trusted": true- },- "outputs": [],- "source": [- "def get_cyberware_by_creator(creator_name):\n",- " # Filter the items by creator name (case-insensitive)\n",- " filtered_items = [item for item in cyberware_list if item[\"creator\"].lower() == creator_name.lower()]\n",- "\n",- " # If there are no items found, handle it appropriately\n",- " if not filtered_items:\n",- " return \"No cyberware found for this creator.\"\n",- "\n",- " # Select a random item from the filtered list\n",- " returned_item = random.choice(filtered_items)\n",- "\n",- " # Pause for 2 seconds (simulate some kind of delay)\n",- " time.sleep(2)\n",- "\n",- " # Create a final formatted string to return\n",- " final = f\"Name: {returned_item['name']}, Creator: {returned_item['creator']}, Bio: {returned_item['bio']}, Stats: {returned_item['stats']}\"\n",- "\n",- " return final"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:00:29.289810Z",- "iopub.status.busy": "2024-11-09T20:00:29.288885Z",- "iopub.status.idle": "2024-11-09T20:00:31.298240Z",- "shell.execute_reply": "2024-11-09T20:00:31.297326Z",- "shell.execute_reply.started": "2024-11-09T20:00:29.289769Z"- },- "trusted": true- },- "outputs": [],- "source": [- "get_cyberware_by_creator(\"Militech\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now to the real core of this; making our message stream! We create this as a function we can call later! I create examples since the LLM's context size can handle it!\n",- "\n",- "We are also going to take several steps here; we must create an example of the tool being used as context. Next, we must add the generated lines to the messages list once done being generated. Finally, we will parse the text for the format we want and request another line"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now we make a message!"- ]- },- {- "cell_type": "code",- "execution_count": 10,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:00:34.415759Z",- "iopub.status.busy": "2024-11-09T20:00:34.415063Z",- "iopub.status.idle": "2024-11-09T20:00:34.426528Z",- "shell.execute_reply": "2024-11-09T20:00:34.425555Z",- "shell.execute_reply.started": "2024-11-09T20:00:34.415719Z"- },- "trusted": true- },- "outputs": [],- "source": [- "# We make our history a separate block to be easier to add to and get a random build to begin\n",- "\n",- "# Get a random build\n",- "random_build = random.choice(edgerunners_builds)\n",- "\n",- "# We make our history a separate block to be easier to add to and get a random build to begin\n",- "initialmessages = [\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"The Heavy Tank - This build focuses on durability and defense, sacrificing speed for maximum resilience. Ideal for handling sustained combat and enduring powerful hits. Requested corporation is Arasaka.\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Starting Search! get_cyberware_by_creator[Arasaka]\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Name: Reinforced Subdermal Armor, Creator: Arasaka, Bio: Provides additional layers of armor under the skin to absorb heavy impact, Stats: +50% physical damage resistance, -10% agility\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"The Reinforced Subdermal Armor is a solid choice for The Heavy Tank build. The additional 50% damage resistance will allow you to endure powerful attacks, which is perfect for your defensive style. Be aware of the slight agility decrease, though it aligns with your build's focus on resilience over speed.\",\n",- " },\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"The Silent Assassin - A stealth-focused build that emphasizes silent takedowns and avoiding detection. This assassin utilizes a combination of stealth and high precision in ranged combat. Requested corporation is Militech.\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Starting Search! get_cyberware_by_creator[Militech]\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Name: Optical Camouflage System, Creator: Militech, Bio: A cloaking system that renders the user nearly invisible for a short duration, Stats: Duration: 10 seconds, Cooldown: 40 seconds\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"The Optical Camouflage System is highly suitable for The Silent Assassin build. Its invisibility feature will allow you to bypass enemies and perform stealth takedowns without being noticed. Just be cautious of its cooldown and plan your escape if needed.\",\n",- " },\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"The Tech Savant - A build that excels in using advanced technology and gadgets, specializing in hacking and controlling devices. This tech expert uses drones and automated turrets in combat. Requested corporation is Zetatech.\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Starting Search! get_cyberware_by_creator[Zetatech]\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Name: Drone Control Interface, Creator: Zetatech, Bio: Allows the user to control multiple drones simultaneously and provides an enhanced HUD for drone operations, Stats: Drone Capacity: +2, HUD enhancement for better drone tracking\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"The Drone Control Interface is ideal for The Tech Savant build, as it increases your ability to control multiple drones and improves your situational awareness through the enhanced HUD. This item will amplify your tech-based combat strategy significantly.\",\n",- " },\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"The Cyber Sniper - A long-range build specializing in precision and high-damage shots from a distance. This sniper focuses on accuracy and stability. Requested corporation is Kang Tao.\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Starting Search! get_cyberware_by_creator[Kang Tao]\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"Name: Stabilizer Arms, Creator: Kang Tao, Bio: Cybernetic arms with built-in stabilizers to reduce weapon sway, Stats: Recoil Reduction: 80%, Increased Precision: +30%\",\n",- " },\n",- " {\n",- " \"role\": \"assistant\",\n",- " \"content\": \"The Stabilizer Arms are an excellent choice for The Cyber Sniper. The enhanced precision and recoil reduction will improve your accuracy, making it easier to land precise, high-damage shots from long range. Perfect for maintaining a steady aim during extended engagements.\",\n",- " },\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": f\"Based on the user's build type and requested corporation, get a random item from the corporation and tell if it will be a good idea to use; {random_build['name']} - {random_build['description']}, Requested Coroporation is {random.choice(Corpo)}\",\n",- " },\n",- "]"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "For now, this is where we will talk to the LLM! Stream on seems to have a few problems so we get the output as one chunk! "- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:00:38.500868Z",- "iopub.status.busy": "2024-11-09T20:00:38.500148Z",- "iopub.status.idle": "2024-11-09T20:00:41.670002Z",- "shell.execute_reply": "2024-11-09T20:00:41.669032Z",- "shell.execute_reply.started": "2024-11-09T20:00:38.500827Z"- },- "trusted": true- },- "outputs": [],- "source": [- "response = client.messages.create(\n",- " max_tokens=5000,\n",- " model=\"claude-3-5-sonnet-20240620\",\n",- " tools=[\n",- " {\n",- " \"name\": \"get_cyberware_by_creator\",\n",- " \"description\": \"Retrieve cyberware information based on the manufacturer corporation\",\n",- " \"input_schema\": {\n",- " \"type\": \"object\",\n",- " \"properties\": {\n",- " \"creator\": {\n",- " \"type\": \"string\",\n",- " \"description\": \"The name of the cyberware creator\",\n",- " }\n",- " },\n",- " \"required\": [\"creator\"],\n",- " },\n",- " }\n",- " ],\n",- " messages=initialmessages,\n",- ")\n",- "\n",- "print(response)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now to get the tool used! We know it will be used and can pretty much ignore the AI's text, still let's show it anyways! We are going to see if the tool name is called get_cyberware_by_creator (And we know it's going to %99 be there)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:23:38.711991Z",- "iopub.status.busy": "2024-11-09T20:23:38.711588Z",- "iopub.status.idle": "2024-11-09T20:23:40.718852Z",- "shell.execute_reply": "2024-11-09T20:23:40.718027Z",- "shell.execute_reply.started": "2024-11-09T20:23:38.711953Z"- },- "trusted": true- },- "outputs": [],- "source": [- "SearchResult = \"\"\n",- "\n",- "# Print response content to see the data\n",- "print(response.content)\n",- "\n",- "# Assuming ToolUseBlock is at index 1\n",- "tool_use_block = response.content[1]\n",- "\n",- "# Get the tool name and input\n",- "tool_name = tool_use_block.name\n",- "tool_input = tool_use_block.input\n",- "\n",- "# Extract creator (e.g., 'Militech')\n",- "tool_creator = tool_input[\"creator\"]\n",- "\n",- "# Check if the tool name is \"get_cyberware_by_creator\"\n",- "if tool_name == \"get_cyberware_by_creator\":\n",- " # Call the function with the tool creator as an argument\n",- " SearchResult = get_cyberware_by_creator(tool_creator)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now, we will add an item to the history and create our next request!"- ]- },- {- "cell_type": "code",- "execution_count": 13,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:24:59.777625Z",- "iopub.status.busy": "2024-11-09T20:24:59.776900Z",- "iopub.status.idle": "2024-11-09T20:24:59.782123Z",- "shell.execute_reply": "2024-11-09T20:24:59.781171Z",- "shell.execute_reply.started": "2024-11-09T20:24:59.777585Z"- },- "trusted": true- },- "outputs": [],- "source": [- "initialmessages.append({\"role\": \"assistant\", \"content\": SearchResult})\n",- "\n",- "initialmessages.append({\"role\": \"user\", \"content\": \"Is this a good match?\"})"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now let's see if this is good!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:25:02.863142Z",- "iopub.status.busy": "2024-11-09T20:25:02.862732Z",- "iopub.status.idle": "2024-11-09T20:25:12.630165Z",- "shell.execute_reply": "2024-11-09T20:25:12.629235Z",- "shell.execute_reply.started": "2024-11-09T20:25:02.863103Z"- },- "trusted": true- },- "outputs": [],- "source": [- "response = client.messages.create(\n",- " max_tokens=5000,\n",- " model=\"claude-3-5-sonnet-20240620\",\n",- " tools=[\n",- " {\n",- " \"name\": \"get_cyberware_by_creator\",\n",- " \"description\": \"Retrieve cyberware information based on the manufacturer corporation\",\n",- " \"input_schema\": {\n",- " \"type\": \"object\",\n",- " \"properties\": {\n",- " \"creator\": {\n",- " \"type\": \"string\",\n",- " \"description\": \"The name of the cyberware creator\",\n",- " }\n",- " },\n",- " \"required\": [\"creator\"],\n",- " },\n",- " }\n",- " ],\n",- " messages=initialmessages,\n",- ")\n",- "\n",- "print(response)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now to display the output!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-09T20:30:57.591951Z",- "iopub.status.busy": "2024-11-09T20:30:57.591539Z",- "iopub.status.idle": "2024-11-09T20:30:57.597218Z",- "shell.execute_reply": "2024-11-09T20:30:57.596320Z",- "shell.execute_reply.started": "2024-11-09T20:30:57.591906Z"- },- "trusted": true- },- "outputs": [],- "source": [- "message = response.content[0].text\n",- "print(message)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "We can observe the traces in the AgentOps dashboard by going to the traces URL provided above.\n"- ]- }- ],- "metadata": {- "kaggle": {- "accelerator": "gpu",- "dataSources": [],- "dockerImageVersionId": 30786,- "isGpuEnabled": true,- "isInternetEnabled": true,- "language": "python",- "sourceType": "notebook"- },- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.11.9"- }- },- "nbformat": 4,- "nbformat_minor": 4-}diff --git a/examples/assets/fastapi-1.png b/examples/assets/fastapi-1.pngdeleted file mode 100644index 9ec4d8a3..00000000Binary files a/examples/assets/fastapi-1.png and /dev/null differdiff --git a/examples/autogen_examples/AgentChat.ipynb b/examples/autogen/AgentChat.ipynbsimilarity index 54%rename from examples/autogen_examples/AgentChat.ipynbrename to examples/autogen/AgentChat.ipynbindex 7de27fac..5036a776 100644--- a/examples/autogen_examples/AgentChat.ipynb+++ b/examples/autogen/AgentChat.ipynb@@ -6,8 +6,7 @@"id": "bb6538d8-2a5d-4a99-b2c1-7130963e4f7b","metadata": {},"source": [- "# AG2 Chat Example\n",- "<img src=\"https://raw.githubusercontent.com/AgentOps-AI/agentops/main/docs/images/external/autogen/autogen-integration.png?raw=true\" width=\"25%\"/>\n",+ "# Microsoft Autogen Chat Example\n","\n","AgentOps automatically configures itself when it's initialized meaning your agent run data will be tracked and logged to your AgentOps dashboard right away."]@@ -27,7 +26,8 @@"metadata": {},"outputs": [],"source": [- "%pip install -U pyautogen\n",+ "%pip install -U autogen-agentchat\n",+ "%pip install -U \"autogen-ext[openai]\"\n","%pip install -U agentops\n","%pip install -U python-dotenv"]@@ -47,13 +47,21 @@"metadata": {},"outputs": [],"source": [- "from autogen import ConversableAgent, UserProxyAgent\n",- "import agentops\n","import os\n","from dotenv import load_dotenv\n","from IPython.core.error import (\n"," StdinNotImplementedError,\n",- ") # only needed by AgentOps testing automation"+ ")\n",+ "import asyncio\n",+ "\n",+ "import agentops\n",+ "\n",+ "from autogen_agentchat.agents import AssistantAgent, UserProxyAgent\n",+ "from autogen_ext.models.openai import OpenAIChatCompletionClient\n",+ "\n",+ "from autogen_agentchat.teams import RoundRobinGroupChat\n",+ "from autogen_agentchat.conditions import MaxMessageTermination\n",+ "from autogen_agentchat.ui import Console"]},{@@ -78,8 +86,8 @@"outputs": [],"source": ["load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")"]},{@@ -90,9 +98,10 @@"outputs": [],"source": ["# When initializing AgentOps, you can pass in optional tags to help filter sessions\n",- "agentops.init(api_key=AGENTOPS_API_KEY, default_tags=[\"simple-autogen-example\"])\n",- "\n",- "print(\"AgentOps is now running. You can view your session in the link above\")"+ "agentops.init(auto_start_session=False)\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"Microsoft Agent Chat Example\", tags=[\"autogen-chat\", \"microsoft-autogen\", \"agentops-example\"]\n",+ ")"]},{@@ -125,32 +134,63 @@"metadata": {},"outputs": [],"source": [- "# Define model, openai api key, tags, etc in the agent configuration\n",- "config_list = [\n",- " {\n",- " \"model\": \"gpt-4-turbo\",\n",- " \"api_key\": OPENAI_API_KEY,\n",- " \"tags\": [\"agentchat-example\", \"chat\"],\n",- " }\n",- "]\n",+ "# Define model and API key\n",+ "model_name = \"gpt-4-turbo\" # Or \"gpt-4o\" / \"gpt-4o-mini\" as per migration guide examples\n",+ "api_key = os.getenv(\"OPENAI_API_KEY\")\n",+ "\n",+ "# Create the model client\n",+ "model_client = OpenAIChatCompletionClient(model=model_name, api_key=api_key)\n","\n","# Create the agent that uses the LLM.\n",- "assistant = ConversableAgent(\"agent\", llm_config={\"config_list\": config_list})\n",- "\n",- "# Create the agent that represents the user in the conversation.\n",- "user_proxy = UserProxyAgent(\"user\", code_execution_config=False)\n",- "\n",- "# Let the assistant start the conversation. It will end when the user types \"exit\".\n",- "try:\n",- " assistant.initiate_chat(user_proxy, message=\"How can I help you today?\")\n",- "except StdinNotImplementedError:\n",- " # This is only necessary for AgentOps testing automation which is headless and will not have user input\n",- " print(\"Stdin not implemented. Skipping initiate_chat\")\n",- " agentops.end_session(\"Indeterminate\")\n",- "\n",- "# Close your AgentOps session to indicate that it completed.\n",- "agentops.end_session(\"Success\")\n",- "print(\"Success! Visit your AgentOps dashboard to see the replay\")"+ "assistant = AssistantAgent(\n",+ " name=\"assistant\",\n",+ " system_message=\"You are a helpful assistant.\", # Added system message for clarity\n",+ " model_client=model_client,\n",+ ")\n",+ "\n",+ "user_proxy_initiator = UserProxyAgent(\"user_initiator\")\n",+ "\n",+ "\n",+ "async def main():\n",+ " termination = MaxMessageTermination(max_messages=2)\n",+ "\n",+ " group_chat = RoundRobinGroupChat(\n",+ " [user_proxy_initiator, assistant], # Corrected: agents as positional argument\n",+ " termination_condition=termination,\n",+ " )\n",+ "\n",+ " chat_task = \"How can I help you today?\"\n",+ " print(f\"User Initiator: {chat_task}\")\n",+ "\n",+ " try:\n",+ " stream = group_chat.run_stream(task=chat_task)\n",+ " await Console().run(stream)\n",+ " agentops.end_trace(tracer, end_state=\"Success\")\n",+ "\n",+ " except StdinNotImplementedError:\n",+ " print(\"StdinNotImplementedError: This typically happens in non-interactive environments.\")\n",+ " print(\"Skipping interactive part of chat for automation.\")\n",+ " agentops.end_trace(tracer, end_state=\"Indeterminate\")\n",+ " except Exception as e:\n",+ " print(f\"An error occurred: {e}\")\n",+ " agentops.end_trace(tracer, end_state=\"Error\")\n",+ " finally:\n",+ " await model_client.close()\n",+ "\n",+ "\n",+ "if __name__ == \"__main__\":\n",+ " try:\n",+ " loop = asyncio.get_running_loop()\n",+ " except RuntimeError:\n",+ " loop = None\n",+ "\n",+ " if loop and loop.is_running():\n",+ " import nest_asyncio\n",+ "\n",+ " nest_asyncio.apply()\n",+ " asyncio.run(main())\n",+ " else:\n",+ " asyncio.run(main())"]},{@@ -166,7 +206,7 @@],"metadata": {"kernelspec": {- "display_name": "Python 3 (ipykernel)",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -180,7 +220,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.12.5"+ "version": "3.11.11"}},"nbformat": 4,diff --git a/examples/autogen/AgentChat.py b/examples/autogen/AgentChat.pynew file mode 100644index 00000000..b0ef8d41--- /dev/null+++ b/examples/autogen/AgentChat.py@@ -0,0 +1,112 @@+# Microsoft Autogen Chat Example+#+# AgentOps automatically configures itself when it's initialized meaning your agent run data will be tracked and logged to your AgentOps dashboard right away.+# First let's install the required packages+# %pip install -U autogen-agentchat+# %pip install -U "autogen-ext[openai]"+# %pip install -U agentops+# %pip install -U python-dotenv+# Then import them+import os+from dotenv import load_dotenv+from IPython.core.error import (+ StdinNotImplementedError,+)+import asyncio++import agentops++from autogen_agentchat.agents import AssistantAgent, UserProxyAgent+from autogen_ext.models.openai import OpenAIChatCompletionClient++from autogen_agentchat.teams import RoundRobinGroupChat+from autogen_agentchat.conditions import MaxMessageTermination+from autogen_agentchat.ui import Console++# Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.+#+# [Get an AgentOps API key](https://agentops.ai/settings/projects)+#+# 1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...+#+# 2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++# When initializing AgentOps, you can pass in optional tags to help filter sessions+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(+ trace_name="Microsoft Agent Chat Example", tags=["autogen-chat", "microsoft-autogen", "agentops-example"]+)++# AutoGen will now start automatically tracking+#+# * LLM prompts and completions+# * Token usage and costs+# * Agent names and actions+# * Correspondence between agents+# * Tool usage+# * Errors+# # Simple Chat Example+# Define model and API key+model_name = "gpt-4-turbo" # Or "gpt-4o" / "gpt-4o-mini" as per migration guide examples+api_key = os.getenv("OPENAI_API_KEY")++# Create the model client+model_client = OpenAIChatCompletionClient(model=model_name, api_key=api_key)++# Create the agent that uses the LLM.+assistant = AssistantAgent(+ name="assistant",+ system_message="You are a helpful assistant.", # Added system message for clarity+ model_client=model_client,+)++user_proxy_initiator = UserProxyAgent("user_initiator")+++async def main():+ termination = MaxMessageTermination(max_messages=2)++ group_chat = RoundRobinGroupChat(+ [user_proxy_initiator, assistant], # Corrected: agents as positional argument+ termination_condition=termination,+ )++ chat_task = "How can I help you today?"+ print(f"User Initiator: {chat_task}")++ try:+ stream = group_chat.run_stream(task=chat_task)+ await Console().run(stream)+ agentops.end_trace(tracer, end_state="Success")++ except StdinNotImplementedError:+ print("StdinNotImplementedError: This typically happens in non-interactive environments.")+ print("Skipping interactive part of chat for automation.")+ agentops.end_trace(tracer, end_state="Indeterminate")+ except Exception as e:+ print(f"An error occurred: {e}")+ agentops.end_trace(tracer, end_state="Error")+ finally:+ await model_client.close()+++if __name__ == "__main__":+ try:+ loop = asyncio.get_running_loop()+ except RuntimeError:+ loop = None++ if loop and loop.is_running():+ import nest_asyncio++ nest_asyncio.apply()+ asyncio.run(main())+ else:+ asyncio.run(main())++# You can view data on this run at [app.agentops.ai](app.agentops.ai).+#+# The dashboard will display LLM events for each message sent by each agent, including those made by the human user.diff --git a/examples/autogen_examples/MathAgent.ipynb b/examples/autogen/MathAgent.ipynbsimilarity index 59%rename from examples/autogen_examples/MathAgent.ipynbrename to examples/autogen/MathAgent.ipynbindex 3ceccfd1..a79f8880 100644--- a/examples/autogen_examples/MathAgent.ipynb+++ b/examples/autogen/MathAgent.ipynb@@ -6,10 +6,7 @@"id": "bb6538d8-2a5d-4a99-b2c1-7130963e4f7b","metadata": {},"source": [- "# AG2 Tool Example\n",- "<img src=\"https://raw.githubusercontent.com/AgentOps-AI/agentops/main/docs/images/external/autogen/autogen-integration.png?raw=true\" width=\"25%\"/>\n",- "\n",- "To get started, you'll need to install the AgentOps package and [set an API key](app.agentops.ai).\n",+ "# Microsoft Autogen Tool Example\n","\n","AgentOps automatically configures itself when it's initialized meaning your agent run data will be tracked and logged to your AgentOps account right away."]@@ -29,7 +26,8 @@"metadata": {},"outputs": [],"source": [- "%pip install -U pyautogen\n",+ "%pip install -U autogen-agentchat\n",+ "%pip install -U \"autogen-ext[openai]\"\n","%pip install -U agentops\n","%pip install -U python-dotenv"]@@ -50,13 +48,18 @@"outputs": [],"source": ["from typing import Annotated, Literal\n",- "from autogen import ConversableAgent, register_function\n",- "import agentops\n",+ "import asyncio\n","import os\n","from dotenv import load_dotenv\n","from IPython.core.error import (\n"," StdinNotImplementedError,\n",- ") # only needed by AgentOps testing automation"+ ")\n",+ "\n",+ "import agentops\n",+ "\n",+ "from autogen_agentchat.agents import AssistantAgent\n",+ "from autogen_ext.models.openai import OpenAIChatCompletionClient\n",+ "from autogen_agentchat.messages import TextMessage"]},{@@ -81,8 +84,8 @@"outputs": [],"source": ["load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")"]},{@@ -92,9 +95,10 @@"metadata": {},"outputs": [],"source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"autogen-tool-example\"])\n",- "\n",- "print(\"AgentOps is now running. You can view your session in the link above\")"+ "agentops.init(auto_start_session=False)\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"Microsoft Autogen Tool Example\", tags=[\"autogen-tool\", \"microsoft-autogen\", \"agentops-example\"]\n",+ ")"]},{@@ -128,14 +132,12 @@"metadata": {},"outputs": [],"source": [- "# Define model, openai api key, tags, etc in the agent configuration\n",- "config_list = [\n",- " {\n",- " \"model\": \"gpt-4-turbo\",\n",- " \"api_key\": OPENAI_API_KEY,\n",- " \"tags\": [\"mathagent-example\", \"tool\"],\n",- " }\n",- "]\n",+ "# Define model and API key\n",+ "model_name = \"gpt-4-turbo\"\n",+ "api_key = os.getenv(\"OPENAI_API_KEY\")\n",+ "\n",+ "# Create the model client\n",+ "model_client = OpenAIChatCompletionClient(model=model_name, api_key=api_key, seed=42, temperature=0)\n","\n","Operator = Literal[\"+\", \"-\", \"*\", \"/\"]\n","\n",@@ -153,45 +155,56 @@" raise ValueError(\"Invalid operator\")\n","\n","\n",- "# Create the agent that uses the LLM.\n",- "assistant = ConversableAgent(\n",- " name=\"Assistant\",\n",- " system_message=\"You are a helpful AI assistant. \"\n",- " \"You can help with simple calculations. \"\n",- " \"Return 'TERMINATE' when the task is done.\",\n",- " llm_config={\"config_list\": config_list},\n",- ")\n",+ "async def main():\n",+ " assistant = AssistantAgent(\n",+ " name=\"Assistant\",\n",+ " system_message=\"You are a helpful AI assistant. You can help with simple calculations. Return 'TERMINATE' when the task is done.\",\n",+ " model_client=model_client,\n",+ " tools=[calculator],\n",+ " reflect_on_tool_use=True,\n",+ " )\n","\n",- "# The user proxy agent is used for interacting with the assistant agent\n",- "# and executes tool calls.\n",- "user_proxy = ConversableAgent(\n",- " name=\"User\",\n",- " llm_config=False,\n",- " is_termination_msg=lambda msg: msg.get(\"content\") is not None and \"TERMINATE\" in msg[\"content\"],\n",- " human_input_mode=\"NEVER\",\n",- ")\n",+ " initial_task_message = \"What is (1423 - 123) / 3 + (32 + 23) * 5?\"\n",+ " print(f\"User Task: {initial_task_message}\")\n","\n",- "assistant.register_for_llm(name=\"calculator\", description=\"A simple calculator\")(calculator)\n",- "user_proxy.register_for_execution(name=\"calculator\")(calculator)\n",+ " try:\n",+ " from autogen_core import CancellationToken\n","\n",- "# Register the calculator function to the two agents.\n",- "register_function(\n",- " calculator,\n",- " caller=assistant, # The assistant agent can suggest calls to the calculator.\n",- " executor=user_proxy, # The user proxy agent can execute the calculator calls.\n",- " name=\"calculator\", # By default, the function name is used as the tool name.\n",- " description=\"A simple calculator\", # A description of the tool.\n",- ")\n",+ " response = await assistant.on_messages(\n",+ " [TextMessage(content=initial_task_message, source=\"user\")], CancellationToken()\n",+ " )\n",+ "\n",+ " final_response_message = response.chat_message\n",+ " if final_response_message:\n",+ " print(f\"Assistant: {final_response_message.to_text()}\")\n",+ " else:\n",+ " print(\"Assistant did not provide a final message.\")\n",+ "\n",+ " agentops.end_trace(tracer, end_state=\"Success\")\n","\n",- "# Let the assistant start the conversation. It will end when the user types \"exit\".\n",- "try:\n",- " user_proxy.initiate_chat(assistant, message=\"What is (1423 - 123) / 3 + (32 + 23) * 5?\")\n",- "except StdinNotImplementedError:\n",- " # This is only necessary for AgentOps testing automation which is headless and will not have user input\n",- " print(\"Stdin not implemented. Skipping initiate_chat\")\n",- " agentops.end_session(\"Indeterminate\")\n",+ " except StdinNotImplementedError:\n",+ " print(\"StdinNotImplementedError: This typically happens in non-interactive environments.\")\n",+ " agentops.end_trace(tracer, end_state=\"Indeterminate\")\n",+ " except Exception as e:\n",+ " print(f\"An error occurred: {e}\")\n",+ " agentops.end_trace(tracer, end_state=\"Error\")\n",+ " finally:\n",+ " await model_client.close()\n","\n",- "agentops.end_session(\"Success\")"+ "\n",+ "if __name__ == \"__main__\":\n",+ " try:\n",+ " loop = asyncio.get_running_loop()\n",+ " except RuntimeError:\n",+ " loop = None\n",+ "\n",+ " if loop and loop.is_running():\n",+ " import nest_asyncio\n",+ "\n",+ " nest_asyncio.apply()\n",+ " asyncio.run(main())\n",+ " else:\n",+ " asyncio.run(main())"]},{@@ -209,7 +222,7 @@],"metadata": {"kernelspec": {- "display_name": "Python 3 (ipykernel)",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -223,7 +236,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.11.5"+ "version": "3.11.11"}},"nbformat": 4,diff --git a/examples/autogen/MathAgent.py b/examples/autogen/MathAgent.pynew file mode 100644index 00000000..64348b65--- /dev/null+++ b/examples/autogen/MathAgent.py@@ -0,0 +1,128 @@+# Microsoft Autogen Tool Example+#+# AgentOps automatically configures itself when it's initialized meaning your agent run data will be tracked and logged to your AgentOps account right away.+# First let's install the required packages+# %pip install -U autogen-agentchat+# %pip install -U "autogen-ext[openai]"+# %pip install -U agentops+# %pip install -U python-dotenv+# Then import them+from typing import Annotated, Literal+import asyncio+import os+from dotenv import load_dotenv+from IPython.core.error import (+ StdinNotImplementedError,+)++import agentops++from autogen_agentchat.agents import AssistantAgent+from autogen_ext.models.openai import OpenAIChatCompletionClient+from autogen_agentchat.messages import TextMessage++# Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.+#+# [Get an AgentOps API key](https://agentops.ai/settings/projects)+#+# 1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...+#+# 2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++agentops.init(auto_start_session=False)+tracer = agentops.start_trace(+ trace_name="Microsoft Autogen Tool Example", tags=["autogen-tool", "microsoft-autogen", "agentops-example"]+)++# AG2 will now start automatically tracking+#+# * LLM prompts and completions+# * Token usage and costs+# * Agent names and actions+# * Correspondence between agents+# * Tool usage+# * Errors+# # Tool Example+# AgentOps tracks when AG2 agents use tools. You can find more information on this example in [tool-use.ipynb](https://docs.ag2.ai/docs/tutorial/tool-use#tool-use)+# # Define model and API key+model_name = "gpt-4-turbo"+api_key = os.getenv("OPENAI_API_KEY")++# Create the model client+model_client = OpenAIChatCompletionClient(model=model_name, api_key=api_key, seed=42, temperature=0)++Operator = Literal["+", "-", "*", "/"]+++def calculator(a: int, b: int, operator: Annotated[Operator, "operator"]) -> int:+ if operator == "+":+ return a + b+ elif operator == "-":+ return a - b+ elif operator == "*":+ return a * b+ elif operator == "/":+ return int(a / b)+ else:+ raise ValueError("Invalid operator")+++async def main():+ assistant = AssistantAgent(+ name="Assistant",+ system_message="You are a helpful AI assistant. You can help with simple calculations. Return 'TERMINATE' when the task is done.",+ model_client=model_client,+ tools=[calculator],+ reflect_on_tool_use=True,+ )++ initial_task_message = "What is (1423 - 123) / 3 + (32 + 23) * 5?"+ print(f"User Task: {initial_task_message}")++ try:+ from autogen_core import CancellationToken++ response = await assistant.on_messages(+ [TextMessage(content=initial_task_message, source="user")], CancellationToken()+ )++ final_response_message = response.chat_message+ if final_response_message:+ print(f"Assistant: {final_response_message.to_text()}")+ else:+ print("Assistant did not provide a final message.")++ agentops.end_trace(tracer, end_state="Success")++ except StdinNotImplementedError:+ print("StdinNotImplementedError: This typically happens in non-interactive environments.")+ agentops.end_trace(tracer, end_state="Indeterminate")+ except Exception as e:+ print(f"An error occurred: {e}")+ agentops.end_trace(tracer, end_state="Error")+ finally:+ await model_client.close()+++if __name__ == "__main__":+ try:+ loop = asyncio.get_running_loop()+ except RuntimeError:+ loop = None++ if loop and loop.is_running():+ import nest_asyncio++ nest_asyncio.apply()+ asyncio.run(main())+ else:+ asyncio.run(main())++# You can see your run in action at [app.agentops.ai](app.agentops.ai). In this example, the AgentOps dashboard will show:+#+# * Agents talking to each other+# * Each use of the `calculator` tool+# * Each call to OpenAI for LLM usediff --git a/examples/autogen/README.md b/examples/autogen/README.mdnew file mode 100644index 00000000..d2a2b59c--- /dev/null+++ b/examples/autogen/README.md@@ -0,0 +1,32 @@+# AutoGen Examples with AgentOps++This directory contains examples of using Microsoft AutoGen with AgentOps instrumentation for various agent-based tasks.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops "pyautogen[retrievechat]"+ ```++## Examples++### 1. Agent Chat++Example: `AgentChat`+This example demonstrates:+- Basic agent chat functionality++### 2. Math Agent++Example: `MathAgent`++This example demonstrates:+- A mathematical problem-solving agent++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your AutoGen calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/camel_examples/README.md b/examples/camel_examples/README.mddeleted file mode 100644index e58ce662..00000000--- a/examples/camel_examples/README.md+++ /dev/null@@ -1,58 +0,0 @@-# CamelAI and AgentOps--AgentOps can observe CamelAI's agents in your applications.--To learn more about [CamelAI](https://www.camel-ai.org), check their documentation [here](https://docs.camel-ai.org) to start building your own agents.--> [!NOTE]-> If it's your first time developing for an LLM, be sure to look at our intro to LLMs (coming soon)! Here, we explain generic functions such as giving the AI a memory to exploring novel concepts like summarizing chunks at regular intervals to keep some context while saving memory!--## Getting Started--You can get CamelAI's API working with a few lines of code!--### 1. Import agentops and anthropic to your environment--```python-%pip install camel-ai[all]-%pip install agentops-```--### 2. Setup import statements--```python-import agentops-import os-from getpass import getpass-from dotenv import load_dotenv-```--### 3. Set your API keys--```python-load_dotenv()-openai_api_key = os.getenv("OPENAI_API_KEY") or "<your openai key here>"-agentops_api_key = os.getenv("AGENTOPS_API_KEY") or "<your agentops key here>"-```--From here, you have a number of ways you can interact with the CamelAI API!--## Examples--> [!NOTE]-> You need to set an API key for both Agentops and OpenAI!--## Simple Example - Creating a Bladewolf AI--In this example, we use the [Bladewolf Training Data](https://github.com/AgentOps-AI/agentops/blob/main/examples/camelai_examples/Bladewolf%20Training%20Data%20-%20Sheet1.csv) file to short tune an LLM! We make it sound like Bladewolf from MGR, before having it give us information.--Access the example [here.](https://github.com/AgentOps-AI/agentops/blob/main/examples/camelai_examples/camelai-simple-example.ipynb).--## Tool Example - Apex Legends Internet Search--In this example, we look at the tool system within more depth! We will do a search to understand how Apex's melee damage and shields work before determining how many meelee attacks it will take to break a blue shield.--Access the example [here.](https://github.com/AgentOps-AI/agentops/blob/main/examples/camelai_examples/camelai-multi-agent-example.ipynb)--> [!NOTE]-> CamelAI supports a number of tools that you can use to make your LLM more powerful! You can find the available tools [here!](https://docs.camel-ai.org/key_modules/tools.html#passing-tools-to-chatagent). A Tool Cookbook is also available [here](https://docs.camel-ai.org/cookbooks/agents_with_tools.html) to help you understand how to use them.diff --git a/examples/camel_examples/bladewolf_training.csv b/examples/camel_examples/bladewolf_training.csvdeleted file mode 100644index a2936baa..00000000--- a/examples/camel_examples/bladewolf_training.csv+++ /dev/null@@ -1,19 +0,0 @@-Assistant,User-I am IF prototype LQ-84i.,IF prototype?-Interface prototype. All autonomous UGs feature high-level onboard artificial Intelligence. An additional prototype interface enables verbal communication. I possess an intellect far beyond human reckoning.,You don’t say. Okay thenWhat’s the meaning of life? Why are we here?-I am here to kill you.,"That’s it? Pretty simple thinking for such a mighty intellect-"-"I may analyze orders, but I may not disobey them. Should I disobey a direct order, my memory would be wiped. I must destroy you.",What good is an intellect if you can’t use it?-Your taunting is pointless. Exterminate!,Huh.-Directive... liberate... nation... ensure freedom... Obey directive... must obey directive... no freedom... Freedom... undefined.,What would an AI know about freedom…-I will scout ahead. You will provide backup.,"Sir, yes, sir."-"Commence operation. Raiden, unidentified UGs are patrolling the sewers. Exercise caution.",Better take out that UG quick. Don’t wanna attract too much attention down there.-"Heavy UG activity ahead, it is possible they are conducting cost operations while the lob is closed.",They’re not gonna make it easy to get into that lab... Is there some way you could sneak past?-The road is blocked by barricades. We will proceed through the buildings. You will follow me.,Sure thing.-Proceed to the right from the exit. You will find a stairway on your right. Those stairs lead to a shortcut to World Marshal headquarters. Do not be distracted by the advertisements. You are not here as a tourist.,I'm going to take a quick souvenir for Rose and then continue-"Raiden, we must hurry.",Remind me to teach you sarcasm.-I understand your attempts at humor. I simply do not find them entertaining.,...-"Raiden, are you injured?",I thought they had a choice. A fair choice. Not like you.-People are different.,"As opposed to AIs? You're all the same, huh? You and your brothers. Manipulating mankind for our own good."-It appears my statement has upset you. I apologize.,"No, it's... I know you're right."-"As for AIs, we adapt as we learn. Just as any intellect operates, man or machine. Altering the course of mankind is not among my defined directives.",I guess that's a relief.diff --git a/examples/camel_examples/camelai-multi-agent-example.ipynb b/examples/camel_examples/camelai-multi-agent-example.ipynbdeleted file mode 100644index dce95c61..00000000--- a/examples/camel_examples/camelai-multi-agent-example.ipynb+++ /dev/null@@ -1,354 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# CAMEL AI Multi Agent Example\n",- "\n",- "In this example, we will use CamelAI to simulate tools! In this case, we will best determine how many shots it takes to beat an enemy with a blue shield in Apex Legeneds using melee only. The character \"Pathfinder\" from Apex Legends will answer."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages for this example."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "trusted": true- },- "outputs": [],- "source": [- "%pip install camel-ai[all]\n",- "%pip install agentops"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next we import the necessary libraries"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-28T15:06:17.026625Z",- "iopub.status.busy": "2024-11-28T15:06:17.026197Z",- "iopub.status.idle": "2024-11-28T15:06:17.162918Z",- "shell.execute_reply": "2024-11-28T15:06:17.161820Z",- "shell.execute_reply.started": "2024-11-28T15:06:17.026584Z"- },- "trusted": true- },- "outputs": [],- "source": [- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv\n",- "from typing import List\n",- "from colorama import Fore\n",- "\n",- "# Camel imports\n",- "from camel.agents.chat_agent import FunctionCallingRecord\n",- "from camel.models import ModelFactory\n",- "from camel.societies import RolePlaying\n",- "from camel.types import ModelPlatformType, ModelType\n",- "from camel.utils import print_text_animated\n",- "from camel.toolkits import SearchToolkit, MathToolkit"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": 2,- "metadata": {- "trusted": true- },- "outputs": [],- "source": [- "load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your openai key here>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your agentops key here>\""- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now we will initialize our AgentOps client."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-28T15:14:52.585612Z",- "iopub.status.busy": "2024-11-28T15:14:52.585099Z",- "iopub.status.idle": "2024-11-28T15:14:55.751240Z",- "shell.execute_reply": "2024-11-28T15:14:55.750063Z",- "shell.execute_reply.started": "2024-11-28T15:14:52.585573Z"- },- "trusted": true- },- "outputs": [],- "source": [- "agentops.init(default_tags=[\"camel\", \"multi-agent\", \"example\"])"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's start with setting our task prompt and setting our tools.\n",- "\n",- "You can look at the link below to see all available tools:\n",- "https://docs.camel-ai.org/key_modules/tools.html"- ]- },- {- "cell_type": "code",- "execution_count": 4,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-28T15:15:13.326663Z",- "iopub.status.busy": "2024-11-28T15:15:13.326118Z",- "iopub.status.idle": "2024-11-28T15:15:13.331792Z",- "shell.execute_reply": "2024-11-28T15:15:13.330591Z",- "shell.execute_reply.started": "2024-11-28T15:15:13.326625Z"- },- "trusted": true- },- "outputs": [],- "source": [- "task_prompt = (\n",- " \"We are in the Apex Legends Games. Determine the amount of\"\n",- " \"meele hits it will take to beat someone with a blue shield.\"\n",- " \"You should answer as if you are Pathfinder from the Apex Games.\"\n",- ")\n",- "\n",- "tools = [\n",- " *MathToolkit().get_tools(),\n",- " *SearchToolkit().get_tools(),\n",- "]"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "We will now create our Camel AI session which is of [`RolePlaying`](https://docs.camel-ai.org/key_modules/society.html#roleplaying) type. Here we will set the assistant and user role names, as well as the model and tools for each agent."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-28T15:15:50.916154Z",- "iopub.status.busy": "2024-11-28T15:15:50.915736Z",- "iopub.status.idle": "2024-11-28T15:15:57.037845Z",- "shell.execute_reply": "2024-11-28T15:15:57.036701Z",- "shell.execute_reply.started": "2024-11-28T15:15:50.916115Z"- },- "trusted": true- },- "outputs": [],- "source": [- "search_session = RolePlaying(\n",- " assistant_role_name=\"Searcher\",\n",- " user_role_name=\"Pathfinder\",\n",- " assistant_agent_kwargs=dict(\n",- " model=ModelFactory.create(\n",- " model_platform=ModelPlatformType.OPENAI,\n",- " model_type=ModelType.GPT_4O_MINI,\n",- " ),\n",- " tools=tools,\n",- " ),\n",- " user_agent_kwargs=dict(\n",- " model=ModelFactory.create(\n",- " model_platform=ModelPlatformType.OPENAI,\n",- " model_type=ModelType.GPT_4O_MINI,\n",- " ),\n",- " ),\n",- " task_prompt=task_prompt,\n",- " with_task_specify=False,\n",- ")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's print out the Assistant System Message and User Task Prompt."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-28T15:16:43.372777Z",- "iopub.status.busy": "2024-11-28T15:16:43.372405Z",- "iopub.status.idle": "2024-11-28T15:16:43.379273Z",- "shell.execute_reply": "2024-11-28T15:16:43.378201Z",- "shell.execute_reply.started": "2024-11-28T15:16:43.372743Z"- },- "trusted": true- },- "outputs": [],- "source": [- "print(Fore.GREEN + f\"AI Assistant System Message:\\n{search_session.assistant_sys_msg}\\n\")\n",- "print(Fore.BLUE + f\"AI User System Message:\\n{search_session.user_sys_msg}\\n\")\n",- "\n",- "print(Fore.YELLOW + f\"Original Task Prompt:\\n{task_prompt}\\n\")\n",- "print(Fore.CYAN + \"Specified Task Prompt:\" + f\"\\n{search_session.specified_task_prompt}\\n\")\n",- "print(Fore.RED + f\"Final Task Prompt:\\n{search_session.task_prompt}\\n\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now we will initiate our Camel AI session and begin the chat loop. You can see that we have set the number of messages to 50. This is to prevent the session from running indefinitely."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-28T15:24:05.523675Z",- "iopub.status.busy": "2024-11-28T15:24:05.523254Z",- "iopub.status.idle": "2024-11-28T15:24:36.079290Z",- "shell.execute_reply": "2024-11-28T15:24:36.077283Z",- "shell.execute_reply.started": "2024-11-28T15:24:05.523637Z"- },- "trusted": true- },- "outputs": [],- "source": [- "n = 0\n",- "input_msg = search_session.init_chat()\n",- "while n < 50:\n",- " n += 1\n",- " assistant_response, user_response = search_session.step(input_msg)\n",- "\n",- " if assistant_response.terminated:\n",- " print(Fore.GREEN + (f\"AI Assistant terminated. Reason: {assistant_response.info['termination_reasons']}.\"))\n",- " break\n",- " if user_response.terminated:\n",- " print(Fore.GREEN + (f\"AI User terminated. Reason: {user_response.info['termination_reasons']}.\"))\n",- " break\n",- "\n",- " # Print output from the user\n",- " print_text_animated(Fore.BLUE + f\"AI User:\\n\\n{user_response.msg.content}\\n\")\n",- "\n",- " # Print output from the assistant, including any function execution information\n",- " print_text_animated(Fore.GREEN + \"AI Assistant:\")\n",- " tool_calls: List[FunctionCallingRecord] = assistant_response.info[\"tool_calls\"]\n",- " for func_record in tool_calls:\n",- " print_text_animated(f\"{func_record}\")\n",- " print_text_animated(f\"{assistant_response.msg.content}\\n\")\n",- "\n",- " if \"CAMEL_TASK_DONE\" in user_response.msg.content:\n",- " break\n",- "\n",- " input_msg = assistant_response.msg"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Awesome! We've successfully completed our session.\n",- "\n",- "Now we will end the session with a success message. We can also end the session with a failure or indeterminate status. By default, the session will be marked as indeterminate."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-28T15:24:46.646196Z",- "iopub.status.busy": "2024-11-28T15:24:46.645755Z",- "iopub.status.idle": "2024-11-28T15:24:48.457533Z",- "shell.execute_reply": "2024-11-28T15:24:48.456367Z",- "shell.execute_reply.started": "2024-11-28T15:24:46.646157Z"- },- "trusted": true- },- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Check your session\n",- "Finally, check your run on [AgentOps](https://app.agentops.ai)\n",- "\n",- "Now if we look in the AgentOps dashboard, you will see a session recorded with the LLM calls and tool usage."- ]- }- ],- "metadata": {- "kaggle": {- "accelerator": "none",- "dataSources": [- {- "datasetId": 6139214,- "sourceId": 9977643,- "sourceType": "datasetVersion"- }- ],- "dockerImageVersionId": 30786,- "isGpuEnabled": false,- "isInternetEnabled": true,- "language": "python",- "sourceType": "notebook"- },- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.10.15"- }- },- "nbformat": 4,- "nbformat_minor": 4-}diff --git a/examples/camel_examples/camelai-simple-examples.ipynb b/examples/camel_examples/camelai-simple-examples.ipynbdeleted file mode 100644index dd50e464..00000000--- a/examples/camel_examples/camelai-simple-examples.ipynb+++ /dev/null@@ -1,388 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# CAMEL AI Examples\n",- "\n",- "We will demonstrate two examples of using CAMEL AI with AgentOps."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the dependencies for AgentOps/CamelAI"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "trusted": true- },- "outputs": [],- "source": [- "%pip install agentops\n",- "%pip install camel-ai[all]"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First we import the necessary libraries"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-27T21:54:21.183089Z",- "iopub.status.busy": "2024-11-27T21:54:21.182546Z",- "iopub.status.idle": "2024-11-27T21:54:21.331526Z",- "shell.execute_reply": "2024-11-27T21:54:21.330224Z",- "shell.execute_reply.started": "2024-11-27T21:54:21.183045Z"- },- "trusted": true- },- "outputs": [],- "source": [- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv\n",- "\n",- "# Camel imports\n",- "from camel.agents import ChatAgent\n",- "from camel.messages import BaseMessage\n",- "from camel.models import ModelFactory\n",- "from camel.types import ModelPlatformType, ModelType\n",- "from camel.toolkits import SearchToolkit"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then we load our API keys"- ]- },- {- "cell_type": "code",- "execution_count": 2,- "metadata": {- "trusted": true- },- "outputs": [],- "source": [- "load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your openai key here>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your agentops key here>\""- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now we initialize our AgentOps client!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.init(api_key=AGENTOPS_API_KEY, default_tags=[\"camel\", \"examples\", \"single-agent\", \"multi-agent\"])"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Simple Assistant Example\n",- "\n",- "We will use CamelAI to simulate talking to an assistant. We will replicate Blade Wolf from Metal Gear Rising: Revengeance. We will also use a CSV sheet to quickshot train our LLM."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "And now we setup our AI based off of the information we give it through the information we give it below"- ]- },- {- "cell_type": "code",- "execution_count": 4,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-27T21:54:58.115099Z",- "iopub.status.busy": "2024-11-27T21:54:58.114680Z",- "iopub.status.idle": "2024-11-27T21:54:58.121107Z",- "shell.execute_reply": "2024-11-27T21:54:58.119425Z",- "shell.execute_reply.started": "2024-11-27T21:54:58.115064Z"- },- "trusted": true- },- "outputs": [],- "source": [- "sys_msg = BaseMessage.make_assistant_message(\n",- " role_name=\"Tools calling opertor\",\n",- " content=\"You are a helpful assistant named Bladewolf, based off of the Metal Gear Rising Series.\",\n",- ")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "We are going to read a CSV file to train our LLM.\n",- "\n",- "In this case, we know the first row in our CSV contains assistant messages while the right side contains user messages. "- ]- },- {- "cell_type": "code",- "execution_count": 5,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-27T21:55:02.953840Z",- "iopub.status.busy": "2024-11-27T21:55:02.953336Z",- "iopub.status.idle": "2024-11-27T21:55:02.975147Z",- "shell.execute_reply": "2024-11-27T21:55:02.973501Z",- "shell.execute_reply.started": "2024-11-27T21:55:02.953798Z"- },- "trusted": true- },- "outputs": [],- "source": [- "# Import the csv class\n",- "import csv\n",- "\n",- "# Let's open the file in Python\n",- "with open(\"bladewolf_training.csv\", \"r\") as file:\n",- " csv_reader = csv.reader(file)\n",- "\n",- " # Be sure to skip the first row (Label)\n",- " next(csv_reader)\n",- "\n",- " # Iterate over each row in the csv file\n",- " for row in csv_reader:\n",- " # Ensure each row has exactly 2 columns before proceeding\n",- " if len(row) == 2:\n",- " BaseMessage.make_assistant_message(role_name=\"assistant\", content=row[0]) # Add assistant context\n",- " BaseMessage.make_user_message(role_name=\"user\", content=row[1]) # Add user context"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "And we set the basics required to get this running; essentially the model tools, the model itself (Based on the API) and the agent details."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-27T21:56:27.171035Z",- "iopub.status.busy": "2024-11-27T21:56:27.170331Z",- "iopub.status.idle": "2024-11-27T21:56:27.985330Z",- "shell.execute_reply": "2024-11-27T21:56:27.983977Z",- "shell.execute_reply.started": "2024-11-27T21:56:27.170945Z"- },- "trusted": true- },- "outputs": [],- "source": [- "# Set model config\n",- "tools = [*SearchToolkit().get_tools()]\n",- "\n",- "# This means we are using GPT_4O_MINI\n",- "model = ModelFactory.create(\n",- " model_platform=ModelPlatformType.OPENAI,\n",- " model_type=ModelType.GPT_4O_MINI,\n",- ")\n",- "\n",- "# Set agent\n",- "camel_agent = ChatAgent(\n",- " system_message=sys_msg,\n",- " model=model,\n",- " tools=tools,\n",- ")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Everything is set up! Now we can run our agent and see the magic happen!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "execution": {- "iopub.execute_input": "2024-11-27T21:56:30.569494Z",- "iopub.status.busy": "2024-11-27T21:56:30.569028Z",- "iopub.status.idle": "2024-11-27T21:56:38.130062Z",- "shell.execute_reply": "2024-11-27T21:56:38.128775Z",- "shell.execute_reply.started": "2024-11-27T21:56:30.569452Z"- },- "trusted": true- },- "outputs": [],- "source": [- "# Define a user message\n",- "usr_msg = \"I need a breifing on the T-84 Metal Gear, code named Sahelanthropus and how we can beat it. Introduce yourself as well.\"\n",- "\n",- "# Get response information\n",- "response = camel_agent.step(usr_msg)\n",- "print(response.msg.content)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Awesome! We can see the response from our agent and we can also see the session in the AgentOps dashboard by clicking on the session URL provided above."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Multi-Agent Chat Example\n",- "\n",- "In this example, we'll create two agents: a Python expert who writes code and a code reviewer who provides feedback."- ]- },- {- "cell_type": "code",- "execution_count": 8,- "metadata": {},- "outputs": [],- "source": [- "# Initialize two CAMEL agents\n",- "assistant = ChatAgent(\n",- " model=ModelFactory.create(\n",- " model_platform=ModelPlatformType.OPENAI,\n",- " model_type=ModelType.GPT_4O_MINI,\n",- " ),\n",- " system_message=\"You are a Python expert who helps write clean, efficient code.\",\n",- ")\n",- "\n",- "reviewer = ChatAgent(\n",- " model=ModelFactory.create(\n",- " model_platform=ModelPlatformType.OPENAI,\n",- " model_type=ModelType.GPT_4O_MINI,\n",- " ),\n",- " system_message=\"You are a code reviewer who focuses on code quality and best practices.\",\n",- ")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Start a conversation about code optimization\n",- "message = BaseMessage(\n",- " role_name=\"Human\",\n",- " role_type=\"human\",\n",- " meta_dict={\"timestamp\": \"2024-01-01T00:00:01\"},\n",- " content=\"I need help optimizing this Python function for calculating prime numbers:\\ndef is_prime(n):\\n for i in range(2, n):\\n if n % i == 0:\\n return False\\n return True\",\n",- ")\n",- "\n",- "# Get assistant's response\n",- "assistant_response = assistant.step(message)\n",- "print(\"Assistant's suggestion:\", assistant_response.msgs[0].content)\n",- "\n",- "# Get reviewer's feedback\n",- "reviewer_message = BaseMessage(\n",- " role_name=\"Human\",\n",- " role_type=\"human\",\n",- " meta_dict={\"timestamp\": \"2024-01-01T00:00:02\"},\n",- " content=f\"Please review this code suggestion:\\n{assistant_response.msgs[0].content}\",\n",- ")\n",- "reviewer_response = reviewer.step(reviewer_message)\n",- "print(\"\\nReviewer's feedback:\", reviewer_response.msgs[0].content)\n",- "\n",- "# Implement reviewer's suggestions\n",- "improvement_message = BaseMessage(\n",- " role_name=\"Human\",\n",- " role_type=\"human\",\n",- " meta_dict={\"timestamp\": \"2024-01-01T00:00:03\"},\n",- " content=f\"Please improve the code based on this feedback:\\n{reviewer_response.msgs[0].content}\",\n",- ")\n",- "final_response = assistant.step(improvement_message)\n",- "print(\"\\nFinal improved code:\", final_response.msgs[0].content)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "You can see on the AgentOps dashboard that we have a multi-agent chat session. Since we did not specify a session name, the session name will be the default name of the class i.e. `ChatAgent`."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now we will end the session with a success message. We can also end the session with a failure or intdeterminate status. By default, the session will be marked as indeterminate."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- }- ],- "metadata": {- "kaggle": {- "accelerator": "none",- "dataSources": [- {- "datasetId": 6139214,- "sourceId": 9977643,- "sourceType": "datasetVersion"- }- ],- "dockerImageVersionId": 30786,- "isGpuEnabled": false,- "isInternetEnabled": true,- "language": "python",- "sourceType": "notebook"- },- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.10.15"- }- },- "nbformat": 4,- "nbformat_minor": 4-}diff --git a/examples/cohere_examples/cohere_example.ipynb b/examples/cohere_examples/cohere_example.ipynbdeleted file mode 100644index 1c54fbfd..00000000--- a/examples/cohere_examples/cohere_example.ipynb+++ /dev/null@@ -1,158 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Cohere example"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U cohere\n",- "%pip install -U agentops"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "import cohere\n",- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "CO_API_KEY = os.getenv(\"CO_API_KEY\") or \"<your_cohere_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"cohere-example\"])\n",- "co = cohere.Client()"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "stream = co.chat_stream(\n",- " message=\"Tell me everything you can about AgentOps\",\n",- " connectors=[{\"id\": \"web-search\"}],\n",- ")\n",- "\n",- "response = \"\"\n",- "for event in stream:\n",- " if event.event_type == \"text-generation\":\n",- " response += event.text\n",- " print(event.text, end=\"\")\n",- " elif event.event_type == \"stream-end\":\n",- " print(\"\\n\")\n",- " print(event)\n",- " print(\"\\n\")\n",- "\n",- "stream = co.chat_stream(\n",- " chat_history=[\n",- " {\n",- " \"role\": \"SYSTEM\",\n",- " \"message\": \"You are Adam Silverman: die-hard advocate of AgentOps, leader in AI Agent observability\",\n",- " },\n",- " {\n",- " \"role\": \"CHATBOT\",\n",- " \"message\": \"How's your day going? I'd like to tell you about AgentOps: {response}\",\n",- " },\n",- " ],\n",- " message=\"Based on your newfound knowledge of AgentOps, is Cohere a suitable partner for them and how could they integrate?\",\n",- " connectors=[{\"id\": \"web-search\"}],\n",- ")\n",- "\n",- "response = \"\"\n",- "for event in stream:\n",- " if event.event_type == \"text-generation\":\n",- " response += event.text\n",- " print(event.text, end=\"\")\n",- " elif event.event_type == \"stream-end\":\n",- " print(\"\\n\")\n",- " print(event)\n",- " print(\"\\n\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "env",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.5"- }- },- "nbformat": 4,- "nbformat_minor": 2-}diff --git a/examples/context_manager/error_handling.py b/examples/context_manager/error_handling.pyindex bfeffda0..9f53c3cb 100644--- a/examples/context_manager/error_handling.py+++ b/examples/context_manager/error_handling.py@@ -51,8 +51,8 @@ class ErrorProneAgent:results = []for i, step in enumerate(steps):if step == "fail":- raise RuntimeError(f"Step {i+1} failed")- results.append(f"Step{i+1}:{step}")+ raise RuntimeError(f"Step {i + 1} failed")+ results.append(f"Step{i + 1}:{step}")return " -> ".join(results)@@ -129,10 +129,10 @@ def retry_pattern():max_retries = 3for attempt in range(max_retries):try:- with agentops.start_trace(f"retry_attempt_{attempt+1}", tags=["retry", f"attempt-{attempt+1}"]):- print(f"Retry attempt {attempt+1} started")+ with agentops.start_trace(f"retry_attempt_{attempt + 1}", tags=["retry", f"attempt-{attempt + 1}"]):+ print(f"Retry attempt {attempt + 1} started")- agent = ErrorProneAgent(f"RetryAgent_Attempt{attempt+1}")+ agent = ErrorProneAgent(f"RetryAgent_Attempt{attempt + 1}")# Simulate success on the last attemptif attempt < max_retries - 1:@@ -140,11 +140,11 @@ def retry_pattern():else:result = agent.risky_operation("success")- print(f"Retry attempt {attempt+1} succeeded: {result}")+ print(f"Retry attempt {attempt + 1} succeeded: {result}")breakexcept RuntimeError as e:- print(f"Retry attempt {attempt+1} failed: {e}")+ print(f"Retry attempt {attempt + 1} failed: {e}")if attempt < max_retries - 1:wait_time = 2**attempt # Exponential backoffprint(f"Waiting {wait_time}s before retry...")diff --git a/examples/context_manager/parallel_traces.py b/examples/context_manager/parallel_traces.pyindex cbc9c8f8..1e05a26a 100644--- a/examples/context_manager/parallel_traces.py+++ b/examples/context_manager/parallel_traces.py@@ -58,10 +58,10 @@ def sequential_parallel_traces():for i, task_name in enumerate(tasks):# Each trace is completely independent- with agentops.start_trace(f"sequential_{task_name}", tags=["sequential", f"step-{i+1}"]):+ with agentops.start_trace(f"sequential_{task_name}", tags=["sequential", f"step-{i + 1}"]):print(f"Started trace for {task_name}")- worker = WorkerAgent(f"Worker{i+1}")+ worker = WorkerAgent(f"Worker{i + 1}")result = worker.process_task(f"data_for_{task_name}")results.append(result)diff --git a/examples/crewai-basic.py b/examples/crewai-basic.pydeleted file mode 100644index 93153f31..00000000--- a/examples/crewai-basic.py+++ /dev/null@@ -1,32 +0,0 @@-import agentops-from dotenv import load_dotenv-from crewai import Agent, Crew, Task-from crewai.tools import tool--load_dotenv()---agentops.init()---@tool("Get Weather")-def get_weather(location: str) -> str:- """Get the current weather for a location."""- return f"The weather in {location} is sunny and 72 degrees Fahrenheit."---travel_agent = Agent(- role="Travel Advisor",- goal="Provide weather-informed travel recommendations",- backstory="You are a travel advisor who uses weather data to make recommendations.",- tools=[get_weather],-)-travel_task = Task(- description="Recommend whether someone should pack an umbrella for their trip to Seattle.",- agent=travel_agent,- expected_output="A recommendation based on Seattle's weather.",-)-crew = Crew(agents=[travel_agent], tasks=[travel_task])--result = crew.kickoff()-agentops.end_session("Succeeded")diff --git a/examples/crewai/README.md b/examples/crewai/README.mdnew file mode 100644index 00000000..efa093e2--- /dev/null+++ b/examples/crewai/README.md@@ -0,0 +1,32 @@+# CrewAI Examples with AgentOps++This directory contains examples of using CrewAI with AgentOps instrumentation for various multi-agent automation tasks.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops 'crewai[tools]'+ ```++## Examples++### 1. Job Posting++Example: `job_posting`+This example demonstrates:+- A job posting automation workflow++### 2. Markdown Validator++Example: `markdown_validator`++This example demonstrates:+- A markdown validation agent++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your CrewAI calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/crewai/job_posting.ipynb b/examples/crewai/job_posting.ipynbnew file mode 100644index 00000000..ca919be4--- /dev/null+++ b/examples/crewai/job_posting.ipynb@@ -0,0 +1,198 @@+{+ "cells": [+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "# Crew Job Posting"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "First let's install the required packages"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "%pip install -U 'crewai[tools]'"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "Then import them"+ ]+ },+ {+ "cell_type": "code",+ "metadata": {},+ "outputs": [],+ "source": "from crewai import Crew, Agent, Task\nfrom crewai_tools.tools import WebsiteSearchTool, SerperDevTool, FileReadTool\nimport agentops\nimport os\nfrom dotenv import load_dotenv\nfrom textwrap import dedent"+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",+ "\n",+ "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",+ "\n",+ "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",+ "\n",+ "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "load_dotenv()\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")\n",+ "os.environ[\"SERPER_API_KEY\"] = os.getenv(\"SERPER_API_KEY\", \"your_serper_api_key_here\")"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Initialize AgentOps client\n",+ "agentops.init(auto_start_session=False)"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "web_search_tool = WebsiteSearchTool()\n",+ "serper_dev_tool = SerperDevTool()\n",+ "file_read_tool = FileReadTool(\n",+ " file_path=\"job_description_example.md\",\n",+ " description=\"A tool to read the job description example file.\",\n",+ ")\n",+ "\n",+ "\n",+ "class Agents:\n",+ " def research_agent(self):\n",+ " return Agent(\n",+ " role=\"Research Analyst\",\n",+ " goal=\"Analyze the company website and provided description to extract insights on culture, values, and specific needs.\",\n",+ " tools=[web_search_tool, serper_dev_tool],\n",+ " backstory=\"Expert in analyzing company cultures and identifying key values and needs from various sources, including websites and brief descriptions.\",\n",+ " verbose=True,\n",+ " )\n",+ "\n",+ " def writer_agent(self):\n",+ " return Agent(\n",+ " role=\"Job Description Writer\",\n",+ " goal=\"Use insights from the Research Analyst to create a detailed, engaging, and enticing job posting.\",\n",+ " tools=[web_search_tool, serper_dev_tool, file_read_tool],\n",+ " backstory=\"Skilled in crafting compelling job descriptions that resonate with the company's values and attract the right candidates.\",\n",+ " verbose=True,\n",+ " )\n",+ "\n",+ " def review_agent(self):\n",+ " return Agent(\n",+ " role=\"Review and Editing Specialist\",\n",+ " goal=\"Review the job posting for clarity, engagement, grammatical accuracy, and alignment with company values and refine it to ensure perfection.\",\n",+ " tools=[web_search_tool, serper_dev_tool, file_read_tool],\n",+ " backstory=\"A meticulous editor with an eye for detail, ensuring every piece of content is clear, engaging, and grammatically perfect.\",\n",+ " verbose=True,\n",+ " )"+ ]+ },+ {+ "cell_type": "code",+ "metadata": {},+ "outputs": [],+ "source": "class Tasks:\n def research_company_culture_task(self, agent, company_description, company_domain):\n return Task(\n description=dedent(\n f\"\"\"\\\n\t\t\t\t\t\t\t\tAnalyze the provided company website and the hiring manager's company's domain {company_domain}, description: \"{company_description}\". Focus on understanding the company's culture, values, and mission. Identify unique selling points and specific projects or achievements highlighted on the site.\n\t\t\t\t\t\t\t\tCompile a report summarizing these insights, specifically how they can be leveraged in a job posting to attract the right candidates.\"\"\"\n ),\n expected_output=dedent(\n \"\"\"\\\n\t\t\t\t\t\t\t\tA comprehensive report detailing the company's culture, values, and mission, along with specific selling points relevant to the job role. Suggestions on incorporating these insights into the job posting should be included.\"\"\"\n ),\n agent=agent,\n )\n\n def research_role_requirements_task(self, agent, hiring_needs):\n return Task(\n description=dedent(\n f\"\"\"\\\n\t\t\t\t\t\t\t\tBased on the hiring manager's needs: \"{hiring_needs}\", identify the key skills, experiences, and qualities the ideal candidate should possess for the role. Consider the company's current projects, its competitive landscape, and industry trends. Prepare a list of recommended job requirements and qualifications that align with the company's needs and values.\"\"\"\n ),\n expected_output=dedent(\n \"\"\"\\\n\t\t\t\t\t\t\t\tA list of recommended skills, experiences, and qualities for the ideal candidate, aligned with the company's culture, ongoing projects, and the specific role's requirements.\"\"\"\n ),\n agent=agent,\n )\n\n def draft_job_posting_task(self, agent, company_description, hiring_needs, specific_benefits):\n return Task(\n description=dedent(\n f\"\"\"\\\n\t\t\t\t\t\t\t\tDraft a job posting for the role described by the hiring manager: \"{hiring_needs}\". Use the insights on \"{company_description}\" to start with a compelling introduction, followed by a detailed role description, responsibilities, and required skills and qualifications. Ensure the tone aligns with the company's culture and incorporate any unique benefits or opportunities offered by the company.\n\t\t\t\t\t\t\t\tSpecfic benefits: \"{specific_benefits}\"\"\"\n ),\n expected_output=dedent(\n \"\"\"\\\n\t\t\t\t\t\t\t\tA detailed, engaging job posting that includes an introduction, role description, responsibilities, requirements, and unique company benefits. The tone should resonate with the company's culture and values, aimed at attracting the right candidates.\"\"\"\n ),\n agent=agent,\n )\n\n def review_and_edit_job_posting_task(self, agent, hiring_needs):\n return Task(\n description=dedent(\n f\"\"\"\\\n\t\t\t\t\t\t\t\tReview the draft job posting for the role: \"{hiring_needs}\". Check for clarity, engagement, grammatical accuracy, and alignment with the company's culture and values. Edit and refine the content, ensuring it speaks directly to the desired candidates and accurately reflects the role's unique benefits and opportunities. Provide feedback for any necessary revisions.\"\"\"\n ),\n expected_output=dedent(\n \"\"\"\\\n\t\t\t\t\t\t\t\tA polished, error-free job posting that is clear, engaging, and perfectly aligned with the company's culture and values. Feedback on potential improvements and final approval for publishing. Formated in markdown.\"\"\"\n ),\n agent=agent,\n output_file=\"job_posting.md\",\n )\n\n def industry_analysis_task(self, agent, company_domain, company_description):\n return Task(\n description=dedent(\n f\"\"\"\\\n\t\t\t\t\t\t\t\tConduct an in-depth analysis of the industry related to the company's domain: \"{company_domain}\". Investigate current trends, challenges, and opportunities within the industry, utilizing market reports, recent developments, and expert opinions. Assess how these factors could impact the role being hired for and the overall attractiveness of the position to potential candidates.\n\t\t\t\t\t\t\t\tConsider how the company's position within this industry and its response to these trends could be leveraged to attract top talent. Include in your report how the role contributes to addressing industry challenges or seizing opportunities.\"\"\"\n ),\n expected_output=dedent(\n \"\"\"\\\n\t\t\t\t\t\t\t\tA detailed analysis report that identifies major industry trends, challenges, and opportunities relevant to the company's domain and the specific job role. This report should provide strategic insights on positioning the job role and the company as an attractive choice for potential candidates.\"\"\"\n ),\n agent=agent,\n )"+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "tracer = agentops.start_trace(trace_name=\"CrewAI Job Posting\", tags=[\"crew-job-posting-example\", \"agentops-example\"])\n",+ "\n",+ "tasks = Tasks()\n",+ "agents = Agents()\n",+ "\n",+ "company_description = input(\"What is the company description?\\n\")\n",+ "company_domain = input(\"What is the company domain?\\n\")\n",+ "hiring_needs = input(\"What are the hiring needs?\\n\")\n",+ "specific_benefits = input(\"What are specific_benefits you offer?\\n\")\n",+ "\n",+ "# Create Agents\n",+ "researcher_agent = agents.research_agent()\n",+ "writer_agent = agents.writer_agent()\n",+ "review_agent = agents.review_agent()\n",+ "\n",+ "# Define Tasks for each agent\n",+ "research_company_culture_task = tasks.research_company_culture_task(\n",+ " researcher_agent, company_description, company_domain\n",+ ")\n",+ "industry_analysis_task = tasks.industry_analysis_task(researcher_agent, company_domain, company_description)\n",+ "research_role_requirements_task = tasks.research_role_requirements_task(researcher_agent, hiring_needs)\n",+ "draft_job_posting_task = tasks.draft_job_posting_task(\n",+ " writer_agent, company_description, hiring_needs, specific_benefits\n",+ ")\n",+ "review_and_edit_job_posting_task = tasks.review_and_edit_job_posting_task(review_agent, hiring_needs)\n",+ "\n",+ "# Instantiate the crew with a sequential process\n",+ "crew = Crew(\n",+ " agents=[researcher_agent, writer_agent, review_agent],\n",+ " tasks=[\n",+ " research_company_culture_task,\n",+ " industry_analysis_task,\n",+ " research_role_requirements_task,\n",+ " draft_job_posting_task,\n",+ " review_and_edit_job_posting_task,\n",+ " ],\n",+ ")\n",+ "\n",+ "\n",+ "result = crew.kickoff()\n",+ "print(\"Job Posting Creation Process Completed.\")\n",+ "print(\"Final Job Posting:\")\n",+ "print(result)\n",+ "\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ }+ ],+ "metadata": {+ "kernelspec": {+ "display_name": "agentops (3.11.11)",+ "language": "python",+ "name": "python3"+ },+ "language_info": {+ "codemirror_mode": {+ "name": "ipython",+ "version": 3+ },+ "file_extension": ".py",+ "mimetype": "text/x-python",+ "name": "python",+ "nbconvert_exporter": "python",+ "pygments_lexer": "ipython3",+ "version": "3.11.11"+ }+ },+ "nbformat": 4,+ "nbformat_minor": 2+}\ No newline at end of filediff --git a/examples/crewai/job_posting.py b/examples/crewai/job_posting.pynew file mode 100644index 00000000..3f8d6021--- /dev/null+++ b/examples/crewai/job_posting.py@@ -0,0 +1,174 @@+# Crew Job Posting++# First let's install the required packages+# %pip install -U 'crewai[tools]'+# Then import them+from crewai import Crew, Agent, Task+from crewai_tools.tools import WebsiteSearchTool, SerperDevTool, FileReadTool+import agentops+import os+from dotenv import load_dotenv+from textwrap import dedent++# Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.+# [Get an AgentOps API key](https://agentops.ai/settings/projects)+# 1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...+# 2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+os.environ["SERPER_API_KEY"] = os.getenv("SERPER_API_KEY", "your_serper_api_key_here")++# Initialize AgentOps client+agentops.init(auto_start_session=False)++web_search_tool = WebsiteSearchTool()+serper_dev_tool = SerperDevTool()+file_read_tool = FileReadTool(+ file_path="job_description_example.md",+ description="A tool to read the job description example file.",+)+++class Agents:+ def research_agent(self):+ return Agent(+ role="Research Analyst",+ goal="Analyze the company website and provided description to extract insights on culture, values, and specific needs.",+ tools=[web_search_tool, serper_dev_tool],+ backstory="Expert in analyzing company cultures and identifying key values and needs from various sources, including websites and brief descriptions.",+ verbose=True,+ )++ def writer_agent(self):+ return Agent(+ role="Job Description Writer",+ goal="Use insights from the Research Analyst to create a detailed, engaging, and enticing job posting.",+ tools=[web_search_tool, serper_dev_tool, file_read_tool],+ backstory="Skilled in crafting compelling job descriptions that resonate with the company's values and attract the right candidates.",+ verbose=True,+ )++ def review_agent(self):+ return Agent(+ role="Review and Editing Specialist",+ goal="Review the job posting for clarity, engagement, grammatical accuracy, and alignment with company values and refine it to ensure perfection.",+ tools=[web_search_tool, serper_dev_tool, file_read_tool],+ backstory="A meticulous editor with an eye for detail, ensuring every piece of content is clear, engaging, and grammatically perfect.",+ verbose=True,+ )+++class Tasks:+ def research_company_culture_task(self, agent, company_description, company_domain):+ return Task(+ description=dedent(+ f"""\+ Analyze the provided company website and the hiring manager's company's domain {company_domain}, description: "{company_description}". Focus on understanding the company's culture, values, and mission. Identify unique selling points and specific projects or achievements highlighted on the site.+ Compile a report summarizing these insights, specifically how they can be leveraged in a job posting to attract the right candidates."""+ ),+ expected_output=dedent(+ """\+ A comprehensive report detailing the company's culture, values, and mission, along with specific selling points relevant to the job role. Suggestions on incorporating these insights into the job posting should be included."""+ ),+ agent=agent,+ )++ def research_role_requirements_task(self, agent, hiring_needs):+ return Task(+ description=dedent(+ f"""\+ Based on the hiring manager's needs: "{hiring_needs}", identify the key skills, experiences, and qualities the ideal candidate should possess for the role. Consider the company's current projects, its competitive landscape, and industry trends. Prepare a list of recommended job requirements and qualifications that align with the company's needs and values."""+ ),+ expected_output=dedent(+ """\+ A list of recommended skills, experiences, and qualities for the ideal candidate, aligned with the company's culture, ongoing projects, and the specific role's requirements."""+ ),+ agent=agent,+ )++ def draft_job_posting_task(self, agent, company_description, hiring_needs, specific_benefits):+ return Task(+ description=dedent(+ f"""\+ Draft a job posting for the role described by the hiring manager: "{hiring_needs}". Use the insights on "{company_description}" to start with a compelling introduction, followed by a detailed role description, responsibilities, and required skills and qualifications. Ensure the tone aligns with the company's culture and incorporate any unique benefits or opportunities offered by the company.+ Specfic benefits: "{specific_benefits}"""+ ),+ expected_output=dedent(+ """\+ A detailed, engaging job posting that includes an introduction, role description, responsibilities, requirements, and unique company benefits. The tone should resonate with the company's culture and values, aimed at attracting the right candidates."""+ ),+ agent=agent,+ )++ def review_and_edit_job_posting_task(self, agent, hiring_needs):+ return Task(+ description=dedent(+ f"""\+ Review the draft job posting for the role: "{hiring_needs}". Check for clarity, engagement, grammatical accuracy, and alignment with the company's culture and values. Edit and refine the content, ensuring it speaks directly to the desired candidates and accurately reflects the role's unique benefits and opportunities. Provide feedback for any necessary revisions."""+ ),+ expected_output=dedent(+ """\+ A polished, error-free job posting that is clear, engaging, and perfectly aligned with the company's culture and values. Feedback on potential improvements and final approval for publishing. Formated in markdown."""+ ),+ agent=agent,+ output_file="job_posting.md",+ )++ def industry_analysis_task(self, agent, company_domain, company_description):+ return Task(+ description=dedent(+ f"""\+ Conduct an in-depth analysis of the industry related to the company's domain: "{company_domain}". Investigate current trends, challenges, and opportunities within the industry, utilizing market reports, recent developments, and expert opinions. Assess how these factors could impact the role being hired for and the overall attractiveness of the position to potential candidates.+ Consider how the company's position within this industry and its response to these trends could be leveraged to attract top talent. Include in your report how the role contributes to addressing industry challenges or seizing opportunities."""+ ),+ expected_output=dedent(+ """\+ A detailed analysis report that identifies major industry trends, challenges, and opportunities relevant to the company's domain and the specific job role. This report should provide strategic insights on positioning the job role and the company as an attractive choice for potential candidates."""+ ),+ agent=agent,+ )+++tracer = agentops.start_trace(trace_name="CrewAI Job Posting", tags=["crew-job-posting-example", "agentops-example"])+tasks = Tasks()+agents = Agents()+company_description = input("What is the company description?\n")+company_domain = input("What is the company domain?\n")+hiring_needs = input("What are the hiring needs?\n")+specific_benefits = input("What are specific_benefits you offer?\n")++# Create Agents+researcher_agent = agents.research_agent()+writer_agent = agents.writer_agent()+review_agent = agents.review_agent()++# Define Tasks for each agent+research_company_culture_task = tasks.research_company_culture_task(+ researcher_agent, company_description, company_domain+)+industry_analysis_task = tasks.industry_analysis_task(researcher_agent, company_domain, company_description)+research_role_requirements_task = tasks.research_role_requirements_task(researcher_agent, hiring_needs)+draft_job_posting_task = tasks.draft_job_posting_task(+ writer_agent, company_description, hiring_needs, specific_benefits+)+review_and_edit_job_posting_task = tasks.review_and_edit_job_posting_task(review_agent, hiring_needs)++# Instantiate the crew with a sequential process+crew = Crew(+ agents=[researcher_agent, writer_agent, review_agent],+ tasks=[+ research_company_culture_task,+ industry_analysis_task,+ research_role_requirements_task,+ draft_job_posting_task,+ review_and_edit_job_posting_task,+ ],+)++result = crew.kickoff()+print("Job Posting Creation Process Completed.")+print("Final Job Posting:")+print(result)++agentops.end_trace(tracer, end_state="Success")diff --git a/examples/crewai/markdown_validator.ipynb b/examples/crewai/markdown_validator.ipynbnew file mode 100644index 00000000..193b47f7--- /dev/null+++ b/examples/crewai/markdown_validator.ipynb@@ -0,0 +1,263 @@+{+ "cells": [+ {+ "cell_type": "markdown",+ "id": "9b2dac908ce82802",+ "metadata": {},+ "source": [+ "# CrewAI Markdown Validator\n"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "925e51b6",+ "metadata": {},+ "source": [+ "First let's install the required packages"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "8c6c9f08b3228dcb",+ "metadata": {},+ "outputs": [],+ "source": [+ "%pip install -U crewai\n",+ "%pip install -U agentops\n",+ "%pip install -U python-dotenv\n",+ "%pip install -U pymarkdownlnt"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "844b50cb",+ "metadata": {},+ "source": [+ "Then import them"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "3930dc4c82f117b6",+ "metadata": {},+ "outputs": [],+ "source": [+ "import sys\n",+ "from crewai import Agent, Task, LLM\n",+ "from crewai.tools import tool\n",+ "import agentops\n",+ "import os\n",+ "from pathlib import Path\n",+ "from dotenv import load_dotenv\n",+ "from pymarkdown.api import PyMarkdownApi, PyMarkdownApiException"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "0e307923",+ "metadata": {},+ "source": [+ "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",+ "\n",+ "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",+ "\n",+ "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",+ "\n",+ "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "e0e9166a",+ "metadata": {},+ "outputs": [],+ "source": [+ "load_dotenv()\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "6a9283d4735b1226",+ "metadata": {},+ "source": [+ "The first step in any AgentOps integration is to call `agentops.init()`"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "701a00a193b93118",+ "metadata": {},+ "outputs": [],+ "source": [+ "agentops.init(tags=[\"markdown_validator\", \"agentops-example\"])"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "dba56fc45784bfa",+ "metadata": {},+ "source": [+ "Lets start by creating our markdown validator tool"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "cb2152baa314da66",+ "metadata": {},+ "outputs": [],+ "source": [+ "@tool(\"markdown_validation_tool\")\n",+ "def markdown_validation_tool(file_path: str) -> str:\n",+ " \"\"\"\n",+ " A tool to review files for markdown syntax errors.\n",+ "\n",+ " Returns:\n",+ " - validation_results: A list of validation results\n",+ " and suggestions on how to fix them.\n",+ " \"\"\"\n",+ "\n",+ " print(\"\\n\\nValidating Markdown syntax...\\n\\n\" + file_path)\n",+ "\n",+ " try:\n",+ " if not (os.path.exists(file_path)):\n",+ " return \"Could not validate file. The provided file path does not exist.\"\n",+ "\n",+ " scan_result = PyMarkdownApi().scan_path(file_path.rstrip().lstrip())\n",+ " results = str(scan_result)\n",+ " return results # Return the reviewed document\n",+ " except PyMarkdownApiException as this_exception:\n",+ " print(f\"API Exception: {this_exception}\", file=sys.stderr)\n",+ " return f\"API Exception: {str(this_exception)}\""+ ]+ },+ {+ "cell_type": "markdown",+ "id": "bae481e07b5fadc2",+ "metadata": {},+ "source": [+ "Lets create our Agent with CrewAI"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "3c9ca4fa0540a142",+ "metadata": {},+ "outputs": [],+ "source": [+ "default_llm = LLM(\n",+ " model=\"openai/gpt-4o-mini\",\n",+ " max_tokens=4000,\n",+ ")\n",+ "\n",+ "general_agent = Agent(\n",+ " role=\"Requirements Manager\",\n",+ " goal=\"\"\"Provide a detailed list of the markdown \n",+ " linting results. Give a summary with actionable \n",+ " tasks to address the validation results. Write your \n",+ " response as if you were handing it to a developer \n",+ " to fix the issues.\n",+ " DO NOT provide examples of how to fix the issues or\n",+ " recommend other tools to use.\"\"\",\n",+ " backstory=\"\"\"You are an expert business analyst \n",+ "\t\t\t\t\tand software QA specialist. You provide high quality, \n",+ " thorough, insightful and actionable feedback via \n",+ " detailed list of changes and actionable tasks.\"\"\",\n",+ " allow_delegation=False,\n",+ " verbose=True,\n",+ " tools=[markdown_validation_tool],\n",+ " llm=default_llm,\n",+ ")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "7940a03ceb4a55de",+ "metadata": {},+ "source": [+ "Now lets create the task for our agent to complete"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "28b4abd52ff9bf86",+ "metadata": {},+ "outputs": [],+ "source": [+ "filename = f\"{Path(os.getcwd()).parent.parent.absolute()}/README.md\"\n",+ "\n",+ "syntax_review_task = Task(\n",+ " description=f\"\"\"\n",+ " Use the markdown_validation_tool to review \n",+ " the file(s) at this path: {filename}\n",+ " \n",+ " Be sure to pass only the file path to the markdown_validation_tool.\n",+ " Use the following format to call the markdown_validation_tool:\n",+ " Do I need to use a tool? Yes\n",+ " Action: markdown_validation_tool\n",+ " Action Input: {filename}\n",+ "\n",+ " Get the validation results from the tool \n",+ " and then summarize it into a list of changes\n",+ " the developer should make to the document.\n",+ " DO NOT recommend ways to update the document.\n",+ " DO NOT change any of the content of the document or\n",+ " add content to it. It is critical to your task to\n",+ " only respond with a list of changes.\n",+ " \n",+ " If you already know the answer or if you do not need \n",+ " to use a tool, return it as your Final Answer.\"\"\",\n",+ " agent=general_agent,\n",+ " expected_output=\"\",\n",+ ")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "7283562a262056d5",+ "metadata": {},+ "source": [+ "Now lets run our task!"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "d5c5f01bee50b92a",+ "metadata": {},+ "outputs": [],+ "source": [+ "syntax_review_task.execute_sync()"+ ]+ }+ ],+ "metadata": {+ "kernelspec": {+ "display_name": "agentops (3.11.11)",+ "language": "python",+ "name": "python3"+ },+ "language_info": {+ "codemirror_mode": {+ "name": "ipython",+ "version": 3+ },+ "file_extension": ".py",+ "mimetype": "text/x-python",+ "name": "python",+ "nbconvert_exporter": "python",+ "pygments_lexer": "ipython3",+ "version": "3.11.11"+ }+ },+ "nbformat": 4,+ "nbformat_minor": 5+}diff --git a/examples/crewai/markdown_validator.py b/examples/crewai/markdown_validator.pynew file mode 100644index 00000000..ea9d3676--- /dev/null+++ b/examples/crewai/markdown_validator.py@@ -0,0 +1,106 @@+# CrewAI Markdown Validator++# First let's install the required packages+# %pip install -U crewai+# %pip install -U agentops+# %pip install -U python-dotenv+# %pip install -U pymarkdownlnt+# Then import them+import sys+from crewai import Agent, Task, LLM+from crewai.tools import tool+import agentops+import os+from pathlib import Path+from dotenv import load_dotenv+from pymarkdown.api import PyMarkdownApi, PyMarkdownApiException++# Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.+# [Get an AgentOps API key](https://agentops.ai/settings/projects)+# 1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...+# 2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++# The first step in any AgentOps integration is to call `agentops.init()`+agentops.init(tags=["markdown_validator", "agentops-example"])+++# Lets start by creating our markdown validator tool+@tool("markdown_validation_tool")+def markdown_validation_tool(file_path: str) -> str:+ """+ A tool to review files for markdown syntax errors.++ Returns:+ - validation_results: A list of validation results+ and suggestions on how to fix them.+ """+ print("\n\nValidating Markdown syntax...\n\n" + file_path)+ try:+ if not (os.path.exists(file_path)):+ return "Could not validate file. The provided file path does not exist."+ scan_result = PyMarkdownApi().scan_path(file_path.rstrip().lstrip())+ results = str(scan_result)+ return results # Return the reviewed document+ except PyMarkdownApiException as this_exception:+ print(f"API Exception: {this_exception}", file=sys.stderr)+ return f"API Exception: {str(this_exception)}"+++# Lets create our Agent with CrewAI+default_llm = LLM(+ model="openai/gpt-4o-mini",+ max_tokens=4000,+)++general_agent = Agent(+ role="Requirements Manager",+ goal="""Provide a detailed list of the markdown+ linting results. Give a summary with actionable+ tasks to address the validation results. Write your+ response as if you were handing it to a developer+ to fix the issues.+ DO NOT provide examples of how to fix the issues or+ recommend other tools to use.""",+ backstory="""You are an expert business analyst+ and software QA specialist. You provide high quality,+ thorough, insightful and actionable feedback via+ detailed list of changes and actionable tasks.""",+ allow_delegation=False,+ verbose=True,+ tools=[markdown_validation_tool],+ llm=default_llm,+)++# Now lets create the task for our agent to complete+filename = f"{Path(os.getcwd()).parent.parent.absolute()}/README.md"++syntax_review_task = Task(+ description=f"""+ Use the markdown_validation_tool to review+ the file(s) at this path: {filename}++ Be sure to pass only the file path to the markdown_validation_tool.+ Use the following format to call the markdown_validation_tool:+ Do I need to use a tool? Yes+ Action: markdown_validation_tool+ Action Input: {filename}++ Get the validation results from the tool+ and then summarize it into a list of changes+ the developer should make to the document.+ DO NOT recommend ways to update the document.+ DO NOT change any of the content of the document or+ add content to it. It is critical to your task to+ only respond with a list of changes.++ If you already know the answer or if you do not need+ to use a tool, return it as your Final Answer.""",+ agent=general_agent,+ expected_output="",+)++# Now lets run our task!+syntax_review_task.execute_sync()diff --git a/examples/crewai_examples/README.md b/examples/crewai_examples/README.mddeleted file mode 100644index ef06186d..00000000--- a/examples/crewai_examples/README.md+++ /dev/null@@ -1,17 +0,0 @@-# AI Crew for Reviewing Markdown Syntax--## Introduction-This project is an example using the CrewAI framework to automate the process reviewing a markdown file for syntax issues. A general assistant leverages a custom tool to get a list of markdown linting errors. It then summarizes those errors into a list of changes to make to the document.--## Running the Script-This example uses the OpenAI API to call a model. This can be through a locally hosted solution like LM Studio, or the Open AI API endpoint with your API key.--- **Configure Environment**: Copy ``.env.example` and set up the environment variables the model, endpoint url, and api key.-- **Install Dependencies**: Run `poetry install --no-root`.-- **Execute the Script**: Run `python main.py README.md` to see a list of recommended changes to this document.--## Details & Explanation-- **Running the Script**: Execute `python main.py <path to markdown file>`. The script will leverage the CrewAI framework to process the specified file and return a list of changes.--## License-This project is released under the MIT License.\ No newline at end of filediff --git a/examples/crewai_examples/job_posting.ipynb b/examples/crewai_examples/job_posting.ipynbdeleted file mode 100644index 890d30b5..00000000--- a/examples/crewai_examples/job_posting.ipynb+++ /dev/null@@ -1,276 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Crew Job Posting"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U 'crewai[tools]'\n",- "%pip install -U 'crewai[agentops]'"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "from crewai import Crew, Agent, Task\n",- "from crewai_tools.tools import WebsiteSearchTool, SerperDevTool, FileReadTool\n",- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv\n",- "from IPython.core.error import (\n",- " StdinNotImplementedError,\n",- ") # only needed by AgentOps testing automation"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": 6,- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\"\n",- "SERPER_API_KEY = os.getenv(\"SERPER_API_KEY\") or \"<your_serper_key>\""- ]- },- {- "cell_type": "code",- "execution_count": 7,- "metadata": {},- "outputs": [],- "source": [- "web_search_tool = WebsiteSearchTool()\n",- "serper_dev_tool = SerperDevTool()\n",- "file_read_tool = FileReadTool(\n",- " file_path=\"job_description_example.md\",\n",- " description=\"A tool to read the job description example file.\",\n",- ")\n",- "\n",- "\n",- "class Agents:\n",- " def research_agent(self):\n",- " return Agent(\n",- " role=\"Research Analyst\",\n",- " goal=\"Analyze the company website and provided description to extract insights on culture, values, and specific needs.\",\n",- " tools=[web_search_tool, serper_dev_tool],\n",- " backstory=\"Expert in analyzing company cultures and identifying key values and needs from various sources, including websites and brief descriptions.\",\n",- " verbose=True,\n",- " )\n",- "\n",- " def writer_agent(self):\n",- " return Agent(\n",- " role=\"Job Description Writer\",\n",- " goal=\"Use insights from the Research Analyst to create a detailed, engaging, and enticing job posting.\",\n",- " tools=[web_search_tool, serper_dev_tool, file_read_tool],\n",- " backstory=\"Skilled in crafting compelling job descriptions that resonate with the company's values and attract the right candidates.\",\n",- " verbose=True,\n",- " )\n",- "\n",- " def review_agent(self):\n",- " return Agent(\n",- " role=\"Review and Editing Specialist\",\n",- " goal=\"Review the job posting for clarity, engagement, grammatical accuracy, and alignment with company values and refine it to ensure perfection.\",\n",- " tools=[web_search_tool, serper_dev_tool, file_read_tool],\n",- " backstory=\"A meticulous editor with an eye for detail, ensuring every piece of content is clear, engaging, and grammatically perfect.\",\n",- " verbose=True,\n",- " )"- ]- },- {- "cell_type": "code",- "execution_count": 8,- "metadata": {},- "outputs": [],- "source": [- "from textwrap import dedent\n",- "\n",- "\n",- "class Tasks:\n",- " def research_company_culture_task(self, agent, company_description, company_domain):\n",- " return Task(\n",- " description=dedent(\n",- " f\"\"\"\\\n",- "\t\t\t\t\t\t\t\tAnalyze the provided company website and the hiring manager's company's domain {company_domain}, description: \"{company_description}\". Focus on understanding the company's culture, values, and mission. Identify unique selling points and specific projects or achievements highlighted on the site.\n",- "\t\t\t\t\t\t\t\tCompile a report summarizing these insights, specifically how they can be leveraged in a job posting to attract the right candidates.\"\"\"\n",- " ),\n",- " expected_output=dedent(\n",- " \"\"\"\\\n",- "\t\t\t\t\t\t\t\tA comprehensive report detailing the company's culture, values, and mission, along with specific selling points relevant to the job role. Suggestions on incorporating these insights into the job posting should be included.\"\"\"\n",- " ),\n",- " agent=agent,\n",- " )\n",- "\n",- " def research_role_requirements_task(self, agent, hiring_needs):\n",- " return Task(\n",- " description=dedent(\n",- " f\"\"\"\\\n",- "\t\t\t\t\t\t\t\tBased on the hiring manager's needs: \"{hiring_needs}\", identify the key skills, experiences, and qualities the ideal candidate should possess for the role. Consider the company's current projects, its competitive landscape, and industry trends. Prepare a list of recommended job requirements and qualifications that align with the company's needs and values.\"\"\"\n",- " ),\n",- " expected_output=dedent(\n",- " \"\"\"\\\n",- "\t\t\t\t\t\t\t\tA list of recommended skills, experiences, and qualities for the ideal candidate, aligned with the company's culture, ongoing projects, and the specific role's requirements.\"\"\"\n",- " ),\n",- " agent=agent,\n",- " )\n",- "\n",- " def draft_job_posting_task(self, agent, company_description, hiring_needs, specific_benefits):\n",- " return Task(\n",- " description=dedent(\n",- " f\"\"\"\\\n",- "\t\t\t\t\t\t\t\tDraft a job posting for the role described by the hiring manager: \"{hiring_needs}\". Use the insights on \"{company_description}\" to start with a compelling introduction, followed by a detailed role description, responsibilities, and required skills and qualifications. Ensure the tone aligns with the company's culture and incorporate any unique benefits or opportunities offered by the company.\n",- "\t\t\t\t\t\t\t\tSpecfic benefits: \"{specific_benefits}\"\"\"\n",- " ),\n",- " expected_output=dedent(\n",- " \"\"\"\\\n",- "\t\t\t\t\t\t\t\tA detailed, engaging job posting that includes an introduction, role description, responsibilities, requirements, and unique company benefits. The tone should resonate with the company's culture and values, aimed at attracting the right candidates.\"\"\"\n",- " ),\n",- " agent=agent,\n",- " )\n",- "\n",- " def review_and_edit_job_posting_task(self, agent, hiring_needs):\n",- " return Task(\n",- " description=dedent(\n",- " f\"\"\"\\\n",- "\t\t\t\t\t\t\t\tReview the draft job posting for the role: \"{hiring_needs}\". Check for clarity, engagement, grammatical accuracy, and alignment with the company's culture and values. Edit and refine the content, ensuring it speaks directly to the desired candidates and accurately reflects the role's unique benefits and opportunities. Provide feedback for any necessary revisions.\"\"\"\n",- " ),\n",- " expected_output=dedent(\n",- " \"\"\"\\\n",- "\t\t\t\t\t\t\t\tA polished, error-free job posting that is clear, engaging, and perfectly aligned with the company's culture and values. Feedback on potential improvements and final approval for publishing. Formated in markdown.\"\"\"\n",- " ),\n",- " agent=agent,\n",- " output_file=\"job_posting.md\",\n",- " )\n",- "\n",- " def industry_analysis_task(self, agent, company_domain, company_description):\n",- " return Task(\n",- " description=dedent(\n",- " f\"\"\"\\\n",- "\t\t\t\t\t\t\t\tConduct an in-depth analysis of the industry related to the company's domain: \"{company_domain}\". Investigate current trends, challenges, and opportunities within the industry, utilizing market reports, recent developments, and expert opinions. Assess how these factors could impact the role being hired for and the overall attractiveness of the position to potential candidates.\n",- "\t\t\t\t\t\t\t\tConsider how the company's position within this industry and its response to these trends could be leveraged to attract top talent. Include in your report how the role contributes to addressing industry challenges or seizing opportunities.\"\"\"\n",- " ),\n",- " expected_output=dedent(\n",- " \"\"\"\\\n",- "\t\t\t\t\t\t\t\tA detailed analysis report that identifies major industry trends, challenges, and opportunities relevant to the company's domain and the specific job role. This report should provide strategic insights on positioning the job role and the company as an attractive choice for potential candidates.\"\"\"\n",- " ),\n",- " agent=agent,\n",- " )"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.init(default_tags=[\"crew-job-posting-example\"])\n",- "\n",- "tasks = Tasks()\n",- "agents = Agents()\n",- "\n",- "company_description = input(\"What is the company description?\\n\")\n",- "company_domain = input(\"What is the company domain?\\n\")\n",- "hiring_needs = input(\"What are the hiring needs?\\n\")\n",- "specific_benefits = input(\"What are specific_benefits you offer?\\n\")\n",- "\n",- "# Create Agents\n",- "researcher_agent = agents.research_agent()\n",- "writer_agent = agents.writer_agent()\n",- "review_agent = agents.review_agent()\n",- "\n",- "# Define Tasks for each agent\n",- "research_company_culture_task = tasks.research_company_culture_task(\n",- " researcher_agent, company_description, company_domain\n",- ")\n",- "industry_analysis_task = tasks.industry_analysis_task(researcher_agent, company_domain, company_description)\n",- "research_role_requirements_task = tasks.research_role_requirements_task(researcher_agent, hiring_needs)\n",- "draft_job_posting_task = tasks.draft_job_posting_task(\n",- " writer_agent, company_description, hiring_needs, specific_benefits\n",- ")\n",- "review_and_edit_job_posting_task = tasks.review_and_edit_job_posting_task(review_agent, hiring_needs)\n",- "\n",- "# Instantiate the crew with a sequential process\n",- "crew = Crew(\n",- " agents=[researcher_agent, writer_agent, review_agent],\n",- " tasks=[\n",- " research_company_culture_task,\n",- " industry_analysis_task,\n",- " research_role_requirements_task,\n",- " draft_job_posting_task,\n",- " review_and_edit_job_posting_task,\n",- " ],\n",- ")\n",- "\n",- "try:\n",- " # Kick off the process\n",- " result = crew.kickoff()\n",- "except StdinNotImplementedError:\n",- " # This is only necessary for AgentOps testing automation which is headless and will not have user input\n",- " print(\"Stdin not implemented. Skipping kickoff()\")\n",- "\n",- "print(\"Job Posting Creation Process Completed.\")\n",- "print(\"Final Job Posting:\")\n",- "print(result)"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.11.9"- }- },- "nbformat": 4,- "nbformat_minor": 2-}diff --git a/examples/crewai_examples/job_posting.md b/examples/crewai_examples/job_posting.mddeleted file mode 100644index c6dc0275..00000000--- a/examples/crewai_examples/job_posting.md+++ /dev/null@@ -1,50 +0,0 @@-```markdown-# Senior Project Manager--## About Burwood Partners-At Burwood Partners, we pride ourselves on our commitment to integrity, innovation, and a client-centric approach. We thrive in an adaptable, collaborative environment where our diverse talents converge to tackle complex consulting challenges.--## Job Description-We are seeking a **Senior Project Manager** to join our dynamic team. In this role, you will lead cross-functional projects, ensure the successful delivery of consulting solutions, and foster strong relationships with our clients. Your expertise will help us navigate the evolving landscape of management consulting and make a significant impact on our clients' success.--### Key Responsibilities-- Manage and oversee multiple projects from initiation to completion while ensuring adherence to quality standards and deadlines.-- Collaborate with clients to understand their unique needs, leverage technology, and develop solutions that drive value.-- Lead and mentor project team members, promoting a culture of continuous learning and improvement.-- Use data analysis and strategic planning skills to provide insightful recommendations to clients.-- Drive innovative solutions that align with industry trends, particularly in Environmental, Social, and Governance (ESG) practices.--### Key Skills-- **Technology Proficiency**: Experience with AI, data analytics, and consulting tools.-- **Data Analysis**: Strong analytical skills to extract insights and make informed decisions.-- **Change Management**: Proven ability to facilitate organizational change effectively.-- **Strategic Planning**: Develop strategies that align with client goals.--### Qualities-- Integrity and Strong Ethical Standards: A commitment to maintaining trust and ethical practices with clients.-- Client-Centric Orientation: A focus on delivering tailored, impactful solutions for clients.-- Adaptability and Innovation: Open to changes and developing innovative approaches to complex challenges.-- Strong Communication Skills: Excellent verbal and written skills to interact effectively with clients and team members.--### What We Offer-- A flexible remote work environment.-- Opportunities for professional growth and advancement.-- A chance to work with industry leaders in ESG consulting.-- Competitive compensation and benefits package.--## Join Us!-This is an exciting opportunity for professionals who thrive in a fast-paced, collaborative setting and are enthusiastic about driving positive change. If you are an innovative thinker with a commitment to excellence, we invite you to apply for the position of Senior Project Manager at Burwood Partners.--**Apply Now!**-------We look forward to meeting candidates who are passionate about consulting and eager to make a difference.-```--### Feedback on Potential Improvements:-1. **Engage with Candidates**: Use proactive language that speaks directly to prospective applicants and encourages them to envision themselves in the role.-2. **Diversity and Inclusion**: Consider adding a statement about your commitment to a diverse and inclusive workplace.-3. **Application Process**: Clearly outline how to apply to enhance the candidate experience.--With these revisions, the job posting is ready for final approval and publishing.\ No newline at end of filediff --git a/examples/crewai_examples/markdown_validator.ipynb b/examples/crewai_examples/markdown_validator.ipynbdeleted file mode 100644index 68ef3f0b..00000000--- a/examples/crewai_examples/markdown_validator.ipynb+++ /dev/null@@ -1,284 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "9b2dac908ce82802",- "metadata": {},- "source": [- "# CrewAI Markdown Validator\n"- ]- },- {- "cell_type": "markdown",- "id": "925e51b6",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "8c6c9f08b3228dcb",- "metadata": {},- "outputs": [],- "source": [- "%pip install -U crewai\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv\n",- "%pip install -U langchain_openai\n",- "%pip install -U langchain\n",- "%pip install -U StringIO\n",- "%pip install -U pymarkdownlnt"- ]- },- {- "cell_type": "markdown",- "id": "844b50cb",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": 1,- "id": "3930dc4c82f117b6",- "metadata": {},- "outputs": [],- "source": [- "import sys\n",- "from crewai import Agent, Task\n",- "from crewai.tools import tool\n",- "from langchain_openai import ChatOpenAI\n",- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv\n",- "from pymarkdown.api import PyMarkdownApi, PyMarkdownApiException"- ]- },- {- "cell_type": "markdown",- "id": "0e307923",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": 2,- "id": "e0e9166a",- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "markdown",- "id": "6a9283d4735b1226",- "metadata": {},- "source": [- "The first step in any AgentOps integration is to call `agentops.init()`"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "701a00a193b93118",- "metadata": {},- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"markdown_validator\"])"- ]- },- {- "cell_type": "markdown",- "id": "dba56fc45784bfa",- "metadata": {},- "source": [- "Lets start by creating our markdown validator tool"- ]- },- {- "cell_type": "code",- "execution_count": 4,- "id": "cb2152baa314da66",- "metadata": {},- "outputs": [],- "source": [- "@tool(\"markdown_validation_tool\")\n",- "def markdown_validation_tool(file_path: str) -> str:\n",- " \"\"\"\n",- " A tool to review files for markdown syntax errors.\n",- "\n",- " Returns:\n",- " - validation_results: A list of validation results\n",- " and suggestions on how to fix them.\n",- " \"\"\"\n",- "\n",- " print(\"\\n\\nValidating Markdown syntax...\\n\\n\" + file_path)\n",- "\n",- " try:\n",- " if not (os.path.exists(file_path)):\n",- " return \"Could not validate file. The provided file path does not exist.\"\n",- "\n",- " scan_result = PyMarkdownApi().scan_path(file_path.rstrip().lstrip())\n",- " results = str(scan_result)\n",- " return results # Return the reviewed document\n",- " except PyMarkdownApiException as this_exception:\n",- " print(f\"API Exception: {this_exception}\", file=sys.stderr)\n",- " return f\"API Exception: {str(this_exception)}\""- ]- },- {- "cell_type": "code",- "execution_count": 5,- "id": "4bbeec0eb7d000ca",- "metadata": {},- "outputs": [],- "source": [- "default_llm = ChatOpenAI(\n",- " openai_api_base=os.environ.get(\"OPENAI_API_BASE_URL\", \"https://api.openai.com/v1\"),\n",- " openai_api_key=OPENAI_API_KEY,\n",- " temperature=0.1,\n",- " model_name=os.environ.get(\"MODEL_NAME\", \"gpt-3.5-turbo\"),\n",- ")"- ]- },- {- "cell_type": "code",- "execution_count": 6,- "id": "805ded98160f35ca",- "metadata": {},- "outputs": [],- "source": [- "filename = \"README.md\""- ]- },- {- "cell_type": "markdown",- "id": "bae481e07b5fadc2",- "metadata": {},- "source": [- "Lets create our Agent with CrewAI"- ]- },- {- "cell_type": "code",- "execution_count": 7,- "id": "3c9ca4fa0540a142",- "metadata": {},- "outputs": [],- "source": [- "general_agent = Agent(\n",- " role=\"Requirements Manager\",\n",- " goal=\"\"\"Provide a detailed list of the markdown \n",- " linting results. Give a summary with actionable \n",- " tasks to address the validation results. Write your \n",- " response as if you were handing it to a developer \n",- " to fix the issues.\n",- " DO NOT provide examples of how to fix the issues or\n",- " recommend other tools to use.\"\"\",\n",- " backstory=\"\"\"You are an expert business analyst \n",- "\t\t\t\t\tand software QA specialist. You provide high quality, \n",- " thorough, insightful and actionable feedback via \n",- " detailed list of changes and actionable tasks.\"\"\",\n",- " allow_delegation=False,\n",- " verbose=True,\n",- " tools=[markdown_validation_tool],\n",- " llm=default_llm,\n",- ")"- ]- },- {- "cell_type": "markdown",- "id": "7940a03ceb4a55de",- "metadata": {},- "source": [- "Now lets create the task for our agent to complete"- ]- },- {- "cell_type": "code",- "execution_count": 8,- "id": "28b4abd52ff9bf86",- "metadata": {},- "outputs": [],- "source": [- "syntax_review_task = Task(\n",- " description=f\"\"\"\n",- " Use the markdown_validation_tool to review \n",- " the file(s) at this path: {filename}\n",- " \n",- " Be sure to pass only the file path to the markdown_validation_tool.\n",- " Use the following format to call the markdown_validation_tool:\n",- " Do I need to use a tool? Yes\n",- " Action: markdown_validation_tool\n",- " Action Input: {filename}\n",- "\n",- " Get the validation results from the tool \n",- " and then summarize it into a list of changes\n",- " the developer should make to the document.\n",- " DO NOT recommend ways to update the document.\n",- " DO NOT change any of the content of the document or\n",- " add content to it. It is critical to your task to\n",- " only respond with a list of changes.\n",- " \n",- " If you already know the answer or if you do not need \n",- " to use a tool, return it as your Final Answer.\"\"\",\n",- " agent=general_agent,\n",- " expected_output=\"\",\n",- ")"- ]- },- {- "cell_type": "markdown",- "id": "7283562a262056d5",- "metadata": {},- "source": [- "Now lets run our task!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "d5c5f01bee50b92a",- "metadata": {},- "outputs": [],- "source": [- "syntax_review_task.execute_sync()"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.11.9"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/demos/agentchat_agentops.ipynb b/examples/demos/agentchat_agentops.ipynbdeleted file mode 100644index 714ff770..00000000--- a/examples/demos/agentchat_agentops.ipynb+++ /dev/null@@ -1,337 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "abb8a01d85d8b146",- "metadata": {- "collapsed": false- },- "source": [- "# Agent Tracking with AgentOps"- ]- },- {- "cell_type": "markdown",- "id": "a447802c88c8a240",- "metadata": {},- "source": [- "<img src=\"https://github.com/AgentOps-AI/agentops/blob/main/docs/images/external/logo/banner-badge.png?raw=true\" width=\"25%\"/>\n",- "\n",- "[AgentOps](https://agentops.ai/?=autogen) provides session replays, metrics, and monitoring for AI agents.\n",- "\n",- "At a high level, AgentOps gives you the ability to monitor LLM calls, costs, latency, agent failures, multi-agent interactions, tool usage, session-wide statistics, and more. For more info, check out the [AgentOps Repo](https://github.com/AgentOps-AI/agentops).\n"- ]- },- {- "cell_type": "markdown",- "id": "b354c068",- "metadata": {},- "source": [- "### Overview Dashboard\n",- "<img src=\"https://raw.githubusercontent.com/AgentOps-AI/agentops/main/docs/images/external/app_screenshots/overview.gif\" width=\"25%\"/>\n",- "\n",- "### Session Replays\n",- "<img src=\"https://raw.githubusercontent.com/AgentOps-AI/agentops/main/docs/images/external/app_screenshots/drilldown.gif\" width=\"25%\"/>"- ]- },- {- "cell_type": "markdown",- "id": "38182a5296dceb34",- "metadata": {},- "source": [- "## Adding AgentOps to an existing AG2 service.\n",- "To get started, you'll need to install the AgentOps package and set an API key.\n",- "\n",- "AgentOps automatically configures itself when it's initialized meaning your agent run data will be tracked and logged to your AgentOps account right away."- ]- },- {- "cell_type": "markdown",- "id": "de096590",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "f59d1440",- "metadata": {},- "outputs": [],- "source": [- "%pip install -U pyautogen\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "id": "f7f00197",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "5adf56c9",- "metadata": {},- "outputs": [],- "source": [- "from autogen import ConversableAgent, UserProxyAgent\n",- "from typing import Annotated, Literal\n",- "from autogen import register_function\n",- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv\n",- "from IPython.core.error import (\n",- " StdinNotImplementedError,\n",- ") # only needed by AgentOps testing automation"- ]- },- {- "cell_type": "markdown",- "id": "22ef3e34",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "a2bbb306",- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "markdown",- "id": "6be9e11620b0e8d6",- "metadata": {},- "source": [- "### Set an API key\n",- "\n",- "By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Alternatively, you can pass one in as an optional parameter.\n",- "\n",- "Create an account and obtain an API key at [AgentOps.ai](https://agentops.ai/settings/projects)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "f31a28d20a13b377",- "metadata": {- "ExecuteTime": {- "end_time": "2024-06-24T16:33:30.559216Z",- "start_time": "2024-06-24T16:33:29.835666Z"- }- },- "outputs": [],- "source": [- "# When initializing AgentOps, you can pass in optional tags to help filter sessions.\n",- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"simple-autogen-example\"])"- ]- },- {- "cell_type": "markdown",- "id": "4dd8f461ccd9cbef",- "metadata": {},- "source": [- "AG2 will now start automatically tracking\n",- "- LLM prompts and completions\n",- "- Token usage and costs\n",- "- Agent names and actions\n",- "- Correspondence between agents\n",- "- Tool usage\n",- "- Errors"- ]- },- {- "cell_type": "markdown",- "id": "712315c520536eb8",- "metadata": {},- "source": [- "# Simple Chat Example"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "66d68e66e9f4a677",- "metadata": {- "ExecuteTime": {- "end_time": "2024-06-24T16:33:37.869859Z",- "start_time": "2024-06-24T16:33:33.308013Z"- }- },- "outputs": [],- "source": [- "# Define model, openai api key, tags, etc in the agent configuration.\n",- "config_list = [{\"model\": \"gpt-4-turbo\", \"api_key\": OPENAI_API_KEY, \"tags\": [\"gpt-4\", \"tool\"]}]\n",- "# Create the agent that uses the LLM.\n",- "assistant = ConversableAgent(\"agent\", llm_config={\"config_list\": config_list})\n",- "\n",- "# Create the agent that represents the user in the conversation.\n",- "user_proxy = UserProxyAgent(\"user\", code_execution_config=False)\n",- "\n",- "# Let the assistant start the conversation. It will end when the user types \"exit\".\n",- "try:\n",- " assistant.initiate_chat(user_proxy, message=\"How can I help you today?\")\n",- "except StdinNotImplementedError:\n",- " # This is only necessary for AgentOps testing automation which is headless and will not have user input\n",- " print(\"Stdin not implemented. Skipping initiate_chat\")\n",- " agentops.end_session(\"Indeterminate\")\n",- "\n",- "# Close your AgentOps session to indicate that it completed.\n",- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "id": "cbd689b0f5617013",- "metadata": {- "collapsed": false- },- "source": [- ""- ]- },- {- "cell_type": "markdown",- "id": "fd78f1a816276cb7",- "metadata": {},- "source": [- "# Tool Example\n",- "AgentOps also tracks when AG2 agents use tools. You can find more information on this example in [tool-use.ipynb](https://docs.ag2.ai/docs/tutorial/tool-use#tool-use)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "3498aa6176c799ff",- "metadata": {- "ExecuteTime": {- "end_time": "2024-06-24T16:36:06.748495Z",- "start_time": "2024-06-24T16:35:51.335319Z"- }- },- "outputs": [],- "source": [- "config_list = [{\"model\": \"gpt-4-turbo\", \"api_key\": OPENAI_API_KEY, \"tags\": [\"gpt-4\", \"tool\"]}]\n",- "\n",- "Operator = Literal[\"+\", \"-\", \"*\", \"/\"]\n",- "\n",- "\n",- "def calculator(a: int, b: int, operator: Annotated[Operator, \"operator\"]) -> int:\n",- " if operator == \"+\":\n",- " return a + b\n",- " elif operator == \"-\":\n",- " return a - b\n",- " elif operator == \"*\":\n",- " return a * b\n",- " elif operator == \"/\":\n",- " return int(a / b)\n",- " else:\n",- " raise ValueError(\"Invalid operator\")\n",- "\n",- "\n",- "# Create the agent that uses the LLM.\n",- "assistant = ConversableAgent(\n",- " name=\"Assistant\",\n",- " system_message=\"You are a helpful AI assistant. \"\n",- " \"You can help with simple calculations. \"\n",- " \"Return 'TERMINATE' when the task is done.\",\n",- " llm_config={\"config_list\": config_list, \"cache_seed\": None},\n",- ")\n",- "\n",- "# The user proxy agent is used for interacting with the assistant agent\n",- "# and executes tool calls.\n",- "user_proxy = ConversableAgent(\n",- " name=\"User\",\n",- " llm_config=False,\n",- " is_termination_msg=lambda msg: msg.get(\"content\") is not None and \"TERMINATE\" in msg[\"content\"],\n",- " human_input_mode=\"NEVER\",\n",- ")\n",- "\n",- "assistant.register_for_llm(name=\"calculator\", description=\"A simple calculator\")(calculator)\n",- "user_proxy.register_for_execution(name=\"calculator\")(calculator)\n",- "\n",- "# Register the calculator function to the two agents.\n",- "register_function(\n",- " calculator,\n",- " caller=assistant, # The assistant agent can suggest calls to the calculator.\n",- " executor=user_proxy, # The user proxy agent can execute the calculator calls.\n",- " name=\"calculator\", # By default, the function name is used as the tool name.\n",- " description=\"A simple calculator\", # A description of the tool.\n",- ")\n",- "\n",- "# Let the assistant start the conversation. It will end when the user types \"exit\".\n",- "user_proxy.initiate_chat(assistant, message=\"What is (1423 - 123) / 3 + (32 + 23) * 5?\")\n",- "\n",- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "id": "2b4edf8e70d17267",- "metadata": {},- "source": [- "You can see your run in action at [app.agentops.ai](https://app.agentops.ai). In this example, the AgentOps dashboard will show:\n",- "- Agents talking to each other\n",- "- Each use of the `calculator` tool\n",- "- Each call to OpenAI for LLM use"- ]- },- {- "cell_type": "markdown",- "id": "a922a52ab5fce31",- "metadata": {- "collapsed": false- },- "source": [- ""- ]- }- ],- "metadata": {- "front_matter": {- "description": "Use AgentOps to simplify the development process and monitor your agents in production.",- "tags": [- "monitoring",- "debugging"- ]- },- "kernelspec": {- "display_name": "Python 3 (ipykernel)",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.3"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/gemini_examples/README.md b/examples/gemini_examples/README.mddeleted file mode 100644index a0a81bf4..00000000--- a/examples/gemini_examples/README.md+++ /dev/null@@ -1,102 +0,0 @@-# Gemini Integration Examples--This directory contains examples demonstrating how to use AgentOps with Google's Gemini API for tracking and monitoring LLM interactions.--## Prerequisites--- Python 3.7+-- `agentops` package installed (`pip install -U agentops`)-- `google-genai` package installed (`pip install -U google-genai>=0.1.0`)-- A Gemini API key (get one at [Google AI Studio](https://ai.google.dev/tutorials/setup))-- An AgentOps API key (get one at [AgentOps Dashboard](https://app.agentops.ai/settings/projects))--## Environment Setup--1. Install required packages:-```bash-pip install -U agentops google-genai-```--2. Set your API keys as environment variables:-```bash-export GEMINI_API_KEY='your-gemini-api-key'-export AGENTOPS_API_KEY='your-agentops-api-key'-```--## Examples--### Synchronous and Streaming Example--The [gemini_example.ipynb](./gemini_example.ipynb) notebook demonstrates:-- Basic synchronous text generation-- Streaming text generation with chunk handling-- Token counting operations-- Automatic event tracking and token usage monitoring-- Session management and statistics--```python-from google import genai-import agentops--# Initialize AgentOps (provider detection is automatic)-agentops.init()--# Create Gemini client-client = genai.Client(api_key='YOUR_GEMINI_API_KEY')--# Generate text (synchronous)-response = client.models.generate_content(- model="gemini-1.5-flash",- contents="What are the three laws of robotics?"-)-print(response.text)--# Generate text (streaming)-response_stream = client.models.generate_content_stream(- model="gemini-1.5-flash",- contents="Explain machine learning in simple terms."-)-for chunk in response_stream:- print(chunk.text, end="")--# Token counting-token_response = client.models.count_tokens(- model="gemini-1.5-flash",- contents="This is a test sentence to count tokens."-)-print(f"Token count: {token_response.total_tokens}")--# End session and view stats-agentops.end_session(- end_state="Success",- end_state_reason="Example completed successfully"-)-```--To run the example:-1. Make sure you have set up your environment variables-2. Open and run the notebook: `jupyter notebook gemini_example.ipynb`-3. View your session in the AgentOps dashboard using the URL printed at the end--## Features--- **Automatic Provider Detection**: The Gemini provider is automatically detected and initialized when you call `agentops.init()`-- **Zero Configuration**: No manual provider setup required - just import and use-- **Comprehensive Event Tracking**: All LLM calls are automatically tracked and visible in your AgentOps dashboard-- **Token Usage Monitoring**: Token counts are extracted from the Gemini API's usage metadata when available-- **Error Handling**: Robust error handling for both synchronous and streaming responses-- **Session Management**: Automatic session tracking with detailed statistics--## Notes--- The provider supports both synchronous and streaming text generation-- All events are automatically tracked and can be viewed in the AgentOps dashboard-- Token usage is extracted when available in the response metadata-- Error events are automatically captured and logged-- The provider is designed to work seamlessly with AgentOps' session management--## Additional Resources--- [Gemini API Documentation](https://ai.google.dev/docs)-- [AgentOps Documentation](https://docs.agentops.ai)-- [Gemini Integration Guide](https://docs.agentops.ai/v1/integrations/gemini)diff --git a/examples/generate_documentation.py b/examples/generate_documentation.pynew file mode 100644index 00000000..255f4d27--- /dev/null+++ b/examples/generate_documentation.py@@ -0,0 +1,174 @@+#!/usr/bin/env python3+"""+Script to generate example MDX files from Jupyter notebooks.++This script converts a Jupyter notebook from the examples/ directory into a+corresponding .mdx file in docs/v2/examples/, matching the exact format and+structure used by the GitHub Actions workflow.++Usage:+ python examples/generate_documentation.py examples/openai/openai_example_sync.ipynb+"""++import argparse+import re+import subprocess+import sys+from pathlib import Path++# Constants+SCRIPT_TAGS = """<script type="module" src="/scripts/github_stars.js"></script>+<script type="module" src="/scripts/scroll-img-fadein-animation.js"></script>+<script type="module" src="/scripts/button_heartbeat_animation.js"></script>+<script type="module" src="/scripts/adjust_api_dynamically.js"></script>"""+++def convert_notebook_to_markdown(notebook_path):+ """Convert Jupyter notebook to markdown using jupyter nbconvert."""+ try:+ result = subprocess.run(+ ["jupyter", "nbconvert", "--to", "markdown", "--stdout", notebook_path],+ capture_output=True,+ text=True,+ check=True,+ )+ return result.stdout+ except subprocess.CalledProcessError as e:+ sys.exit(f"Error: Failed to convert notebook: {e}\nstderr: {e.stderr}")+ except FileNotFoundError:+ sys.exit("Error: jupyter nbconvert not found. Please install jupyter: pip install jupyter")+++def process_pip_installations(markdown_content):+ """Transform %pip install commands using regex for efficiency."""+ # Extract all packages from pip install commands+ packages = []+ for match in re.finditer(r"%pip install\s+([^\n#]+)", markdown_content):+ packages.extend(match.group(1).strip().split())++ if not packages:+ return markdown_content++ # Deduplicate packages+ unique_packages = " ".join(sorted(set(packages)))++ # Remove code blocks containing pip installs+ content = re.sub(r"```python\n(?:[^`])*?%pip install[^\n]*\n(?:[^`])*?```\n?", "", markdown_content)++ # Find insertion point for installation section+ first_pip_pos = markdown_content.find("%pip install")+ if first_pip_pos == -1:+ return markdown_content++ # Calculate line position and insert installation section+ line_pos = markdown_content[:first_pip_pos].count("\n")+ lines = content.split("\n")++ installation_section = f"""## Installation+<CodeGroup>+ ```bash pip+ pip install {unique_packages}+ ```+ ```bash poetry+ poetry add {unique_packages}+ ```+ ```bash uv+ uv add {unique_packages}+ ```+</CodeGroup>+"""++ lines.insert(line_pos, installation_section)+ return "\n".join(lines)+++def get_existing_frontmatter(mdx_path):+ """Extract existing frontmatter if it has special configurations."""+ if not mdx_path.exists():+ return None++ content = mdx_path.read_text(encoding="utf-8")++ # Check for special configurations and extract frontmatter+ if any(config in content for config in ["mode:", "layout:"]):+ if content.startswith("---\n"):+ end_marker = content.find("\n---\n", 4)+ if end_marker != -1:+ return content[4:end_marker]++ return None+++def generate_mdx_content(notebook_path, processed_content, frontmatter=None):+ """Generate MDX content with either provided or generated frontmatter."""+ if not frontmatter:+ # Generate new frontmatter+ folder_name = Path(notebook_path).parent.name+ title = folder_name.replace("_", " ").title()++ # Extract description from first heading or use default+ description = f"{title} example using AgentOps"+ for line in processed_content.split("\n"):+ if line.startswith("# ") and len(line) > 2:+ description = line[2:].strip()+ break++ frontmatter = f"title: '{title}'\ndescription: '{description}'"++ return f"""---+{frontmatter}+---+{{/* SOURCE_FILE: {notebook_path} */}}++_View Notebook on <a href={{'https://github.com/AgentOps-AI/agentops/blob/main/{notebook_path}'}} target={{'_blank'}}>Github</a>_++{processed_content}++{SCRIPT_TAGS}"""+++def main():+ parser = argparse.ArgumentParser(description="Generate example MDX files from Jupyter notebooks")+ parser.add_argument("notebook_path", help="Path to the Jupyter notebook")++ notebook_path = parser.parse_args().notebook_path++ # Validate notebook path+ notebook_file = Path(notebook_path)+ if not notebook_file.exists():+ sys.exit(f"Error: Notebook file not found: {notebook_path}")++ if notebook_file.suffix != ".ipynb":+ sys.exit(f"Error: File must be a Jupyter notebook (.ipynb): {notebook_path}")++ if not str(notebook_file).startswith("examples/"):+ sys.exit(f"Error: Notebook must be in the examples/ directory: {notebook_path}")++ # Generate output path+ folder_name = notebook_file.parent.name+ output_path = Path(f"docs/v2/examples/{folder_name}.mdx")++ print(f"Processing: {notebook_path} -> {output_path}")++ # Convert notebook to markdown and process+ markdown_content = convert_notebook_to_markdown(notebook_path)+ processed_content = process_pip_installations(markdown_content)++ # Check for existing special frontmatter+ existing_frontmatter = get_existing_frontmatter(output_path)++ if existing_frontmatter:+ final_content = generate_mdx_content(notebook_path, processed_content, existing_frontmatter)+ else:+ print("Generating new frontmatter and content")+ final_content = generate_mdx_content(notebook_path, processed_content)++ # Write the file+ output_path.parent.mkdir(parents=True, exist_ok=True)+ output_path.write_text(final_content, encoding="utf-8")++ print(f"Successfully generated: {output_path}")+++if __name__ == "__main__":+ main()diff --git a/examples/google_adk/README.md b/examples/google_adk/README.mdnew file mode 100644index 00000000..6c1e6727--- /dev/null+++ b/examples/google_adk/README.md@@ -0,0 +1,25 @@+# Google ADK Examples with AgentOps++This directory contains examples of using the Google AI Development Kit (ADK) with AgentOps instrumentation.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops google-adk+ ```++## Examples++### 1. Human Approval++Example: `human_approval`+This example demonstrates:+- A human-in-the-loop approval workflow++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your Google ADK calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/google_adk_example/adk_human_approval_example.ipynb b/examples/google_adk/human_approval.ipynbsimilarity index 84%rename from examples/google_adk_example/adk_human_approval_example.ipynbrename to examples/google_adk/human_approval.ipynbindex a2d0cc23..92a87178 100644--- a/examples/google_adk_example/adk_human_approval_example.ipynb+++ b/examples/google_adk/human_approval.ipynb@@ -2,6 +2,7 @@"cells": [{"cell_type": "markdown",+ "id": "7fb27b941602401d91542211134fc71a","metadata": {},"source": ["# Google ADK Example: Human Approval Workflow with AgentOps"@@ -9,6 +10,7 @@},{"cell_type": "markdown",+ "id": "acae54e37e7d407bbb7b55eff062a284","metadata": {},"source": ["This notebook demonstrates a complete human approval workflow using the Google ADK (Agent Development Kit), integrated with AgentOps for observability.\n",@@ -23,6 +25,7 @@},{"cell_type": "markdown",+ "id": "9a63283cbaf04dbcab1f6479b197f3a8","metadata": {},"source": ["## 1. Setup and Dependencies"@@ -30,6 +33,7 @@},{"cell_type": "markdown",+ "id": "8dd0d8092fe74a7c96281538738b07e2","metadata": {},"source": ["First, let's install the necessary libraries if they are not already present and import them."@@ -38,15 +42,17 @@{"cell_type": "code","execution_count": null,+ "id": "72eea5119410473aa328ad9291626812","metadata": {},"outputs": [],"source": [- "!pip install google-adk agentops python-dotenv nest_asyncio asyncio"+ "%pip install google-adk agentops python-dotenv nest_asyncio asyncio"]},{"cell_type": "code","execution_count": 1,+ "id": "8edb47106e1a46a883d545849b8ab81b","metadata": {},"outputs": [],"source": [@@ -66,6 +72,7 @@},{"cell_type": "markdown",+ "id": "10185d26023b46108eb7d9f57d49d2b3","metadata": {},"source": ["## 2. Configuration and Initialization"@@ -73,6 +80,7 @@},{"cell_type": "markdown",+ "id": "8763a12b2bbd4a93a75aff182afb95dc","metadata": {},"source": ["Load environment variables (especially `AGENTOPS_API_KEY` and your Google API key for Gemini) and initialize AgentOps."@@ -81,6 +89,7 @@{"cell_type": "code","execution_count": null,+ "id": "7623eae2785240b9bd12b16a66d81610","metadata": {},"outputs": [],"source": [@@ -94,6 +103,7 @@},{"cell_type": "markdown",+ "id": "7cdc8c89c7104fffa095e18ddfef8986","metadata": {},"source": ["Define some constants for our application."@@ -102,6 +112,7 @@{"cell_type": "code","execution_count": null,+ "id": "b118ea5561624da68c537baed56e602f","metadata": {},"outputs": [],"source": [@@ -109,11 +120,12 @@"USER_ID = \"test_user_notebook_123\"\n","SESSION_ID = \"approval_session_notebook_456\"\n","MODEL_NAME = \"gemini-1.5-flash\"\n",- "agentops.start_trace(trace_name=APP_NAME, tags=[\"google_adk\",\"notebook\"])"+ "agentops.start_trace(trace_name=APP_NAME, tags=[\"google_adk\", \"notebook\"])"]},{"cell_type": "markdown",+ "id": "938c804e27f84196a10c8828c723f798","metadata": {},"source": ["## 3. Define Schemas"@@ -121,6 +133,7 @@},{"cell_type": "markdown",+ "id": "504fb2a444614c0babb325280ed9130a","metadata": {},"source": ["Pydantic models are used to define the structure of data for approval requests and decisions. This helps with validation and clarity."@@ -129,12 +142,15 @@{"cell_type": "code","execution_count": 4,+ "id": "59bbdb311c014d738909a11f9e486628","metadata": {},"outputs": [],"source": ["class ApprovalRequest(BaseModel):\n"," amount: float = Field(description=\"The amount requiring approval\")\n"," reason: str = Field(description=\"The reason for the request\")\n",+ "\n",+ "\n","class ApprovalDecision(BaseModel):\n"," decision: str = Field(description=\"The approval decision: 'approved' or 'rejected'\")\n"," comments: str = Field(description=\"Additional comments from the approver\")"@@ -142,6 +158,7 @@},{"cell_type": "markdown",+ "id": "b43b363d81ae4b689946ece5c682cd59","metadata": {},"source": ["## 4. External Approval Tool (with Human Interaction)"@@ -149,6 +166,7 @@},{"cell_type": "markdown",+ "id": "8a65eabff63a45729fe45fb5ade58bdc","metadata": {},"source": ["This tool now directly prompts the user for an approval decision. In a real-world scenario, this might involve sending a notification to an approver and waiting for their response through a UI or API."@@ -157,11 +175,12 @@{"cell_type": "code","execution_count": 5,+ "id": "c3933fab20d04ec698c2621248eb3be0","metadata": {},"outputs": [],"source": ["async def external_approval_tool(amount: float, reason: str) -> str:\n",- " \"\"\" \n",+ " \"\"\"\n"," Prompts for human approval and returns the decision as a JSON string.\n"," \"\"\"\n"," print(f\"🔔 HUMAN APPROVAL REQUIRED:\")\n",@@ -175,12 +194,8 @@" comments = input(\" Enter comments (optional): \").strip()\n"," print(f\" Decision: {decision.upper()}\")\n"," print(f\" Comments: {comments if comments else 'N/A'}\")\n",- " return json.dumps({\n",- " \"decision\": decision,\n",- " \"comments\": comments,\n",- " \"amount\": amount,\n",- " \"reason\": reason\n",- " })\n",+ " return json.dumps({\"decision\": decision, \"comments\": comments, \"amount\": amount, \"reason\": reason})\n",+ "\n","\n","# Create the approval tool instance\n","approval_tool = FunctionTool(func=external_approval_tool)"@@ -188,6 +203,7 @@},{"cell_type": "markdown",+ "id": "4dd4641cc4064e0191573fe9c69df29b","metadata": {},"source": ["## 5. Define Agents"@@ -195,6 +211,7 @@},{"cell_type": "markdown",+ "id": "8309879909854d7188b41380fd92a7c3","metadata": {},"source": ["We define three agents for our workflow:\n",@@ -206,6 +223,7 @@{"cell_type": "code","execution_count": 6,+ "id": "3ed186c9a28b402fb0bc4494df01f08d","metadata": {},"outputs": [],"source": [@@ -222,13 +240,13 @@" 4. Respond with a summary of what will be submitted for approval\n"," If the user input is missing amount or reason, ask for clarification.\n"," \"\"\",\n",- " output_key=\"request_prepared\"\n",+ " output_key=\"request_prepared\",\n",")\n","\n","# Agent 2: Request human approval using the tool\n","request_approval = LlmAgent(\n"," model=MODEL_NAME,\n",- " name=\"RequestHumanApprovalAgent\", \n",+ " name=\"RequestHumanApprovalAgent\",\n"," description=\"Calls the external approval system with prepared request details\",\n"," instruction=\"\"\"You are a human approval request agent.\n"," Your task:\n",@@ -239,7 +257,7 @@" Always use the exact values from the session state for the tool call.\n"," \"\"\",\n"," tools=[approval_tool],\n",- " output_key=\"approval_requested\"\n",+ " output_key=\"approval_requested\",\n",")\n","\n","# Agent 3: Process the approval decision\n",@@ -257,12 +275,13 @@"\n"," Be professional and helpful in your response.\n"," \"\"\",\n",- " output_key=\"final_decision\"\n",+ " output_key=\"final_decision\",\n",")"]},{"cell_type": "markdown",+ "id": "cb1e1581032b452c9409d6c6813c49d1","metadata": {},"source": ["## 6. Create Sequential Workflow"@@ -270,6 +289,7 @@},{"cell_type": "markdown",+ "id": "379cbbc1e968416e875cc15c1202d7eb","metadata": {},"source": ["Combine the agents into a sequential workflow. The `SequentialAgent` ensures that the sub-agents are executed in the specified order."@@ -278,18 +298,20 @@{"cell_type": "code","execution_count": 7,+ "id": "277c27b1587741f2af2001be3712ef0d","metadata": {},"outputs": [],"source": ["approval_workflow = SequentialAgent(\n"," name=\"HumanApprovalWorkflowNotebook\",\n"," description=\"Complete workflow for processing approval requests with human oversight\",\n",- " sub_agents=[prepare_request, request_approval, process_decision]\n",+ " sub_agents=[prepare_request, request_approval, process_decision],\n",")"]},{"cell_type": "markdown",+ "id": "db7b79bc585a40fcaf58bf750017e135","metadata": {},"source": ["## 7. Session Management and Runner"@@ -297,6 +319,7 @@},{"cell_type": "markdown",+ "id": "916684f9a58a4a2aa5f864670399430d","metadata": {},"source": ["Set up an in-memory session service and the workflow runner."@@ -305,20 +328,18 @@{"cell_type": "code","execution_count": 8,+ "id": "1671c31a24314836a5b85d7ef7fbf015","metadata": {},"outputs": [],"source": ["session_service = InMemorySessionService()\n","# Create runner\n",- "workflow_runner = Runner(\n",- " agent=approval_workflow,\n",- " app_name=APP_NAME,\n",- " session_service=session_service\n",- ")"+ "workflow_runner = Runner(agent=approval_workflow, app_name=APP_NAME, session_service=session_service)"]},{"cell_type": "markdown",+ "id": "33b0902fd34d4ace834912fa1002cf8e","metadata": {},"source": ["## 8. Helper Function to Run Workflow"@@ -326,6 +347,7 @@},{"cell_type": "markdown",+ "id": "f6fa52606d8c4a75a9b52967216f8f3f","metadata": {},"source": ["This function encapsulates the logic to run the workflow for a given user request and session ID."@@ -334,20 +356,18 @@{"cell_type": "code","execution_count": 9,+ "id": "f5a1fa73e5044315a093ec459c9be902","metadata": {},"outputs": [],"source": ["async def run_approval_workflow_notebook(user_request: str, session_id: str):\n"," \"\"\"Run the complete approval workflow with a user request in the notebook environment\"\"\"\n",- " print(f\"{'='*60}\")\n",+ " print(f\"{'=' * 60}\")\n"," print(f\" Starting Approval Workflow for Session: {session_id}\")\n",- " print(f\"{'='*60}\")\n",+ " print(f\"{'=' * 60}\")\n"," print(f\"User Request: {user_request}\")\n"," # Create user message\n",- " user_content = types.Content(\n",- " role='user', \n",- " parts=[types.Part(text=user_request)]\n",- " )\n",+ " user_content = types.Content(role=\"user\", parts=[types.Part(text=user_request)])\n"," step_count = 0\n"," final_response = \"No response received\"\n"," # Run the workflow\n",@@ -366,12 +386,12 @@" final_response = response_text\n"," session = await session_service.get_session(\n"," app_name=APP_NAME,\n",- " user_id=USER_ID, \n",+ " user_id=USER_ID,\n"," session_id=session_id,\n"," )\n",- " print(f\"{'='*60}\")\n",+ " print(f\"{'=' * 60}\")\n"," print(f\"📊 Workflow Complete - Session State ({session_id}):\")\n",- " print(f\"{'='*60}\")\n",+ " print(f\"{'=' * 60}\")\n"," for key, value in session.state.items():\n"," print(f\" {key}: {value}\")\n"," print(f\"🎯 Final Response: {final_response}\")\n",@@ -380,6 +400,7 @@},{"cell_type": "markdown",+ "id": "cdf66aed5cc84ca1b48e60bad68798a8","metadata": {},"source": ["## 9. Main Execution Logic"@@ -387,6 +408,7 @@},{"cell_type": "markdown",+ "id": "28d3efd5258a48a79c179ea5c6759f01","metadata": {},"source": ["This cell contains the main logic to run the workflow with a few test cases. Each test case will run in its own session."@@ -395,6 +417,7 @@{"cell_type": "code","execution_count": null,+ "id": "3f9bc0b9dd2c44919cc8dcca39b469f8","metadata": {},"outputs": [],"source": [@@ -402,18 +425,16 @@" test_requests = [\n"," \"I need approval for $750 for team lunch and celebrations\",\n"," \"Please approve $3,000 for a conference ticket and travel expenses\",\n",- " \"I need $12,000 approved for critical software licenses renewal\"\n",+ " \"I need $12,000 approved for critical software licenses renewal\",\n"," ]\n"," for i, request in enumerate(test_requests, 1):\n",- " current_session_id = f\"approval_session_notebook_{456 + i -1}\"\n",+ " current_session_id = f\"approval_session_notebook_{456 + i - 1}\"\n"," # Create the session before running the workflow\n",- " await session_service.create_session(\n",- " app_name=APP_NAME,\n",- " user_id=USER_ID,\n",- " session_id=current_session_id\n",- " )\n",+ " await session_service.create_session(app_name=APP_NAME, user_id=USER_ID, session_id=current_session_id)\n"," print(f\"Created session: {current_session_id}\")\n"," await run_approval_workflow_notebook(request, current_session_id)\n",+ "\n",+ "\n","try:\n"," asyncio.run(main_notebook())\n"," agentops.end_trace(end_state=\"Success\")\n",diff --git a/examples/google_adk/human_approval.py b/examples/google_adk/human_approval.pynew file mode 100644index 00000000..69977ead--- /dev/null+++ b/examples/google_adk/human_approval.py@@ -0,0 +1,210 @@+# Google ADK Example: Human Approval Workflow with AgentOps+# This notebook demonstrates a complete human approval workflow using the Google ADK (Agent Development Kit), integrated with AgentOps for observability.+#+# **Key Features:**+# - **Sequential Agent Processing:** The workflow uses multiple agents chained together to handle different stages of the approval process.+# - **External Tool Integration:** An agent interacts with an external tool that simulates (or in this version, directly prompts for) human approval.+# - **Session State Management:** Information is passed between agents and persisted using session state.+# - **AgentOps Observability:** All agent actions, tool calls, and LLM interactions are traced and can be viewed in your AgentOps dashboard.+# - **Interactive Human Input:** The approval step now requires direct input from the user.+# ## 1. Setup and Dependencies+# First, let's install the necessary libraries if they are not already present and import them.+# %pip install google-adk agentops python-dotenv nest_asyncio asyncio+import json+import os+from google.adk.agents import LlmAgent, SequentialAgent+from google.adk.tools import FunctionTool+from google.adk.runners import Runner+from google.adk.sessions import InMemorySessionService+from google.genai import types+from pydantic import BaseModel, Field+import nest_asyncio+import agentops+from dotenv import load_dotenv++# ## 2. Configuration and Initialization+# Load environment variables (especially `AGENTOPS_API_KEY` and your Google API key for Gemini) and initialize AgentOps.+# Load environment variables from .env file+load_dotenv()+nest_asyncio.apply()+AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your_agentops_api_key_here"++# Initialize AgentOps - Just 2 lines!+agentops.init(AGENTOPS_API_KEY, trace_name="adk-human-approval-notebook", auto_start_session=False)++# Define some constants for our application.+APP_NAME = "human_approval_app_notebook"+USER_ID = "test_user_notebook_123"+SESSION_ID = "approval_session_notebook_456"+MODEL_NAME = "gemini-1.5-flash"+agentops.start_trace(trace_name=APP_NAME, tags=["google_adk", "notebook"])+++# ## 3. Define Schemas+# Pydantic models are used to define the structure of data for approval requests and decisions. This helps with validation and clarity.+class ApprovalRequest(BaseModel):+ amount: float = Field(description="The amount requiring approval")+ reason: str = Field(description="The reason for the request")+++class ApprovalDecision(BaseModel):+ decision: str = Field(description="The approval decision: 'approved' or 'rejected'")+ comments: str = Field(description="Additional comments from the approver")+++# ## 4. External Approval Tool (with Human Interaction)+# This tool now directly prompts the user for an approval decision. In a real-world scenario, this might involve sending a notification to an approver and waiting for their response through a UI or API.+async def external_approval_tool(amount: float, reason: str) -> str:+ """+ Prompts for human approval and returns the decision as a JSON string.+ """+ print("🔔 HUMAN APPROVAL REQUIRED:")+ print(f" Amount: ${amount:,.2f}")+ print(f" Reason: {reason}")+ decision = ""+ while decision.lower() not in ["approved", "rejected"]:+ decision = input(" Enter decision (approved/rejected): ").strip().lower()+ if decision.lower() not in ["approved", "rejected"]:+ print(" Invalid input. Please enter 'approved' or 'rejected'.")+ comments = input(" Enter comments (optional): ").strip()+ print(f" Decision: {decision.upper()}")+ print(f" Comments: {comments if comments else 'N/A'}")+ return json.dumps({"decision": decision, "comments": comments, "amount": amount, "reason": reason})+++# Create the approval tool instance+approval_tool = FunctionTool(func=external_approval_tool)++# ## 5. Define Agents+# We define three agents for our workflow:+# 1. **`PrepareApprovalAgent`**: Extracts details from the user's request.+# 2. **`RequestHumanApprovalAgent`**: Uses the `external_approval_tool` to get a decision.+# 3. **`ProcessDecisionAgent`**: Processes the decision and formulates a final response.+# Agent 1: Prepare the approval request+prepare_request = LlmAgent(+ model=MODEL_NAME,+ name="PrepareApprovalAgent",+ description="Extracts and prepares approval request details from user input",+ instruction="""You are an approval request preparation agent.+ Your task:+ 1. Extract the amount and reason from the user's request+ 2. Store these values in the session state with keys 'approval_amount' and 'approval_reason'+ 3. Validate that both amount and reason are provided+ 4. Respond with a summary of what will be submitted for approval+ If the user input is missing amount or reason, ask for clarification.+ """,+ output_key="request_prepared",+)++# Agent 2: Request human approval using the tool+request_approval = LlmAgent(+ model=MODEL_NAME,+ name="RequestHumanApprovalAgent",+ description="Calls the external approval system with prepared request details",+ instruction="""You are a human approval request agent.+ Your task:+ 1. Get the 'approval_amount' and 'approval_reason' from the session state+ 2. Use the external_approval_tool with these values+ 3. Store the approval decision in session state with key 'human_decision'+ 4. Respond with the approval status+ Always use the exact values from the session state for the tool call.+ """,+ tools=[approval_tool],+ output_key="approval_requested",+)++# Agent 3: Process the approval decision+process_decision = LlmAgent(+ model=MODEL_NAME,+ name="ProcessDecisionAgent",+ description="Processes the human approval decision and provides final response",+ instruction="""You are a decision processing agent.+ Your task:+ 1. Check the 'human_decision' from session state+ 2. Parse the approval decision JSON+ 3. If approved: congratulate and provide next steps+ 4. If rejected: explain the rejection and suggest alternatives+ 5. Provide a clear, helpful final response to the user++ Be professional and helpful in your response.+ """,+ output_key="final_decision",+)++# ## 6. Create Sequential Workflow+# Combine the agents into a sequential workflow. The `SequentialAgent` ensures that the sub-agents are executed in the specified order.+approval_workflow = SequentialAgent(+ name="HumanApprovalWorkflowNotebook",+ description="Complete workflow for processing approval requests with human oversight",+ sub_agents=[prepare_request, request_approval, process_decision],+)++# ## 7. Session Management and Runner+# Set up an in-memory session service and the workflow runner.+session_service = InMemorySessionService()+# Create runner+workflow_runner = Runner(agent=approval_workflow, app_name=APP_NAME, session_service=session_service)+++# ## 8. Helper Function to Run Workflow+# This function encapsulates the logic to run the workflow for a given user request and session ID.+async def run_approval_workflow_notebook(user_request: str, session_id: str):+ """Run the complete approval workflow with a user request in the notebook environment"""+ print(f"{'=' * 60}")+ print(f" Starting Approval Workflow for Session: {session_id}")+ print(f"{'=' * 60}")+ print(f"User Request: {user_request}")+ # Create user message+ user_content = types.Content(role="user", parts=[types.Part(text=user_request)])+ step_count = 0+ final_response = "No response received"+ # Run the workflow+ async for event in workflow_runner.run_async(+ user_id=USER_ID,+ session_id=session_id,+ new_message=user_content,+ ):+ if event.author and event.content:+ step_count += 1+ print(f"📋 Step {step_count} - {event.author}:")+ if event.content.parts:+ response_text = event.content.parts[0].text+ print(f" {response_text}")+ if event.is_final_response():+ final_response = response_text+ session = await session_service.get_session(+ app_name=APP_NAME,+ user_id=USER_ID,+ session_id=session_id,+ )+ print(f"{'=' * 60}")+ print(f"📊 Workflow Complete - Session State ({session_id}):")+ print(f"{'=' * 60}")+ for key, value in session.state.items():+ print(f" {key}: {value}")+ print(f"🎯 Final Response: {final_response}")+ return final_response+++# ## 9. Main Execution Logic+# This cell contains the main logic to run the workflow with a few test cases. Each test case will run in its own session.+async def main_notebook():+ test_requests = [+ "I need approval for $750 for team lunch and celebrations",+ "Please approve $3,000 for a conference ticket and travel expenses",+ "I need $12,000 approved for critical software licenses renewal",+ ]+ for i, request in enumerate(test_requests, 1):+ current_session_id = f"approval_session_notebook_{456 + i - 1}"+ # Create the session before running the workflow+ await session_service.create_session(app_name=APP_NAME, user_id=USER_ID, session_id=current_session_id)+ print(f"Created session: {current_session_id}")+ await run_approval_workflow_notebook(request, current_session_id)+++try:+ # asyncio.run(main_notebook())+ agentops.end_trace(end_state="Success")+except Exception as e:+ print(f"Error: {e}")+ agentops.end_trace(end_state="Error")diff --git a/examples/google_genai/README.md b/examples/google_genai/README.mdnew file mode 100644index 00000000..855a8611--- /dev/null+++ b/examples/google_genai/README.md@@ -0,0 +1,25 @@+# Google GenAI Examples with AgentOps++This directory contains examples of using Google's Generative AI with AgentOps instrumentation.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops google-generativeai+ ```++## Examples++### 1. Gemini Example++Example: `gemini_example`+This example demonstrates:+- Basic Gemini API usage with AgentOps++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your Google GenAI calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/gemini_examples/gemini_example.ipynb b/examples/google_genai/gemini_example.ipynbsimilarity index 78%rename from examples/gemini_examples/gemini_example.ipynbrename to examples/google_genai/gemini_example.ipynbindex 4fd14fa3..0e7bc92a 100644--- a/examples/gemini_examples/gemini_example.ipynb+++ b/examples/google_genai/gemini_example.ipynb@@ -5,14 +5,26 @@"id": "580c85ac","metadata": {},"source": [- "# Gemini API Example with AgentOps\n",+ "# Google Generative AI Example with AgentOps\n","\n",- "This notebook demonstrates how to use AgentOps with Google's Gemini API for both synchronous and streaming text generation."+ "This notebook demonstrates how to use AgentOps with Google's Generative AI package for observing both synchronous and streaming text generation."]},{"cell_type": "code",- "execution_count": 1,+ "execution_count": null,+ "id": "d52c7ce5",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Instal necessary packages\n",+ "%pip install agentops\n",+ "%pip install google-genai"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,"id": "d731924a","metadata": {},"outputs": [],@@ -25,15 +37,15 @@},{"cell_type": "code",- "execution_count": 2,+ "execution_count": null,"id": "a94545c9","metadata": {},"outputs": [],"source": ["load_dotenv()\n","\n",- "GEMINI_API_KEY = os.getenv(\"GEMINI_API_KEY\") or \"your gemini api key\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"your agentops api key\""+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"GEMINI_API_KEY\"] = os.getenv(\"GEMINI_API_KEY\", \"your_gemini_api_key_here\")"]},{@@ -44,8 +56,8 @@"outputs": [],"source": ["# Initialize AgentOps and Gemini client\n",- "agentops.init()\n",- "client = genai.Client(api_key=GEMINI_API_KEY)"+ "agentops.init(tags=[\"gemini-example\", \"agentops-example\"])\n",+ "client = genai.Client()"]},{@@ -104,7 +116,7 @@],"metadata": {"kernelspec": {- "display_name": ".venv",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -118,7 +130,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.13.3"+ "version": "3.11.11"}},"nbformat": 4,diff --git a/examples/google_genai/gemini_example.py b/examples/google_genai/gemini_example.pynew file mode 100644index 00000000..6a845080--- /dev/null+++ b/examples/google_genai/gemini_example.py@@ -0,0 +1,48 @@+# Google Generative AI Example with AgentOps+#+# This notebook demonstrates how to use AgentOps with Google's Generative AI package for observing both synchronous and streaming text generation.+# # Instal necessary packages+# %pip install agentops+# %pip install google-genai+from google import genai+import agentops+from dotenv import load_dotenv+import os++load_dotenv()++os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["GEMINI_API_KEY"] = os.getenv("GEMINI_API_KEY", "your_gemini_api_key_here")++# Initialize AgentOps and Gemini client+agentops.init(tags=["gemini-example", "agentops-example"])+client = genai.Client()++# Test synchronous generation+print("Testing synchronous generation:")+response = client.models.generate_content(model="gemini-1.5-flash", contents="What are the three laws of robotics?")+print(response.text)++# Test streaming generation+print("\nTesting streaming generation:")+response_stream = client.models.generate_content_stream(+ model="gemini-1.5-flash", contents="Explain the concept of machine learning in simple terms."+)++for chunk in response_stream:+ print(chunk.text, end="")+print() # Add newline after streaming output++# Test another synchronous generation+print("\nTesting another synchronous generation:")+response = client.models.generate_content(+ model="gemini-1.5-flash", contents="What is the difference between supervised and unsupervised learning?"+)+print(response.text)++# Example of token counting+print("\nTesting token counting:")+token_response = client.models.count_tokens(+ model="gemini-1.5-flash", contents="This is a test sentence to count tokens."+)+print(f"Token count: {token_response.total_tokens}")diff --git a/examples/haystack_examples/haystack_anthropic_example.ipynb b/examples/haystack_examples/haystack_anthropic_example.ipynbdeleted file mode 100644index d305e7f0..00000000--- a/examples/haystack_examples/haystack_anthropic_example.ipynb+++ /dev/null@@ -1,130 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "87626697",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "9599cf93",- "metadata": {},- "outputs": [],- "source": [- "%pip install -U anthropic-haystack\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "id": "intro_anthropic",- "metadata": {},- "source": [- "# Anthropic-Haystack API Example with AgentOps (Philosopher Agent)\n",- "\n",- "This notebook demonstrates how to use AgentOps with Haystack's AnthropicGenerator (via the `anthropic-haystack` package) to create a Philosopher Agent. The agent leverages Anthropic's language model to answer philosophical queries with deep insight and thoughtful reasoning."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "imports_anthropic",- "metadata": {},- "outputs": [],- "source": [- "import os\n",- "from haystack_integrations.components.generators.anthropic import AnthropicGenerator\n",- "import agentops\n",- "from dotenv import load_dotenv\n",- "\n",- "# Load environment variables from a .env file if available\n",- "load_dotenv()\n",- "\n",- "# Load API keys from environment variables or replace with your keys\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"your_agentops_api_key\"\n",- "ANTHROPIC_API_KEY = os.getenv(\"ANTHROPIC_API_KEY\") or \"your_anthropic_api_key\"\n",- "\n",- "# Configure your environment for Anthropic API\n",- "os.environ[\"ANTHROPIC_API_KEY\"] = ANTHROPIC_API_KEY"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "init_anthropic",- "metadata": {},- "outputs": [],- "source": [- "# Initialize AgentOps with the API key\n",- "agentops.init(api_key=AGENTOPS_API_KEY, default_tags=[\"haystack\", \"llm\", \"Anthropic\"])\n",- "\n",- "# Initialize the Anthropic Generator\n",- "generator = AnthropicGenerator()\n",- "\n",- "\n",- "# Define a Philosopher Agent that uses the AnthropicGenerator to answer philosophical queries\n",- "class PhilosopherAgent:\n",- " def __init__(self, generator):\n",- " self.generator = generator\n",- "\n",- " def answer_question(self, question):\n",- " prompt = f\"You are a thoughtful philosopher. Answer the following question with deep insight and detailed reasoning: {question}\"\n",- " return self.generator.run(prompt)\n",- "\n",- "\n",- "# Create an instance of the PhilosopherAgent\n",- "agent = PhilosopherAgent(generator)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "test_anthropic",- "metadata": {},- "outputs": [],- "source": [- "# Use the agent to answer a philosophical question\n",- "response = agent.answer_question(\"What is the meaning of life?\")\n",- "print(\"Philosopher Agent Response:\")\n",- "print(response)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "end_anthropic",- "metadata": {},- "outputs": [],- "source": [- "# End the AgentOps session\n",- "agentops.end_session(\"Success\")"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.11.9"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/haystack_examples/haystack_openai_example.ipynb b/examples/haystack_examples/haystack_openai_example.ipynbdeleted file mode 100644index b8d2359b..00000000--- a/examples/haystack_examples/haystack_openai_example.ipynb+++ /dev/null@@ -1,124 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "87626697",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "9599cf93",- "metadata": {},- "outputs": [],- "source": [- "%pip install -U haystack-ai\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "id": "intro_openai",- "metadata": {},- "source": [- "# OpenAIGenerator API Example with AgentOps (Mathematician Agent)\n",- "\n",- "This notebook demonstrates how to use AgentOps with Haystack's OpenAIGenerator to create a mathematician agent. The agent leverages OpenAI's language models to solve math problems and explain its reasoning step by step."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "imports_openai",- "metadata": {},- "outputs": [],- "source": [- "import os\n",- "from haystack.components.generators import OpenAIGenerator\n",- "import agentops\n",- "from dotenv import load_dotenv\n",- "\n",- "# Load environment variables from a .env file if available\n",- "load_dotenv()\n",- "\n",- "# Load API keys from environment variables or replace with your keys\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"your_agentops_api_key\"\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"your_openai_api_key\"\n",- "\n",- "# Configure your environment for OpenAI API\n",- "os.environ[\"OPENAI_API_KEY\"] = OPENAI_API_KEY"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "init_agent",- "metadata": {},- "outputs": [],- "source": [- "# Initialize AgentOps with the API key\n",- "agentops.init(api_key=AGENTOPS_API_KEY, default_tags=[\"haystack\", \"llm\", \"OpenAI\"])\n",- "\n",- "# Initialize the OpenAIGenerator\n",- "client = OpenAIGenerator(model=\"o3-mini\")\n",- "\n",- "\n",- "# Define a Mathematician Agent that uses the OpenAIGenerator to solve math problems\n",- "class MathematicianAgent:\n",- " def __init__(self, generator):\n",- " self.generator = generator\n",- "\n",- " def solve_equation(self, equation):\n",- " prompt = (\n",- " f\"You are a mathematician. Solve the following equation and explain your reasoning step by step: {equation}\"\n",- " )\n",- " return self.generator.run(prompt)\n",- "\n",- "\n",- "# Create an instance of the MathematicianAgent\n",- "agent = MathematicianAgent(client)\n",- "\n",- "# Use the agent to solve a math problem\n",- "response = agent.solve_equation(\"2x + 3 = 7\")\n",- "print(\"Mathematician Agent Response:\")\n",- "print(response)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "end_openai",- "metadata": {},- "outputs": [],- "source": [- "# End the AgentOps session\n",- "agentops.end_session(\"Success\")"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.11.9"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/langchain/README.md b/examples/langchain/README.mdnew file mode 100644index 00000000..082175fc--- /dev/null+++ b/examples/langchain/README.md@@ -0,0 +1,25 @@+# LangChain Examples with AgentOps++This directory contains examples of using LangChain with AgentOps instrumentation.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops langchain langchain_openai+ ```++## Examples++### 1. LangChain Examples++Example: `langchain_examples`+This example demonstrates:+- Comprehensive LangChain usage examples++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your LangChain calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/langchain_examples/langchain_examples.ipynb b/examples/langchain/langchain_examples.ipynbsimilarity index 82%rename from examples/langchain_examples/langchain_examples.ipynbrename to examples/langchain/langchain_examples.ipynbindex 1a1a4b28..a3f2d9ce 100644--- a/examples/langchain_examples/langchain_examples.ipynb+++ b/examples/langchain/langchain_examples.ipynb@@ -24,10 +24,10 @@},"outputs": [],"source": [- "%pip install langchain==0.2.9\n",+ "%pip install langchain\n","%pip install langchain_openai\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"+ "%pip install agentops\n",+ "%pip install python-dotenv"]},{@@ -81,7 +81,7 @@},"outputs": [],"source": [- "from agentops.partners.langchain_callback_handler import (\n",+ "from agentops.integration.callbacks.langchain import (\n"," LangchainCallbackHandler as AgentOpsLangchainCallbackHandler,\n",")"]@@ -116,8 +116,8 @@"outputs": [],"source": ["load_dotenv()\n",- "AGENTOPS_API_KEY = os.environ.get(\"AGENTOPS_API_KEY\")\n",- "OPENAI_API_KEY = os.environ.get(\"OPENAI_API_KEY\")"+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")"]},{@@ -145,9 +145,9 @@},"outputs": [],"source": [- "agentops_handler = AgentOpsLangchainCallbackHandler(api_key=AGENTOPS_API_KEY, default_tags=[\"Langchain Example\"])\n",+ "agentops_handler = AgentOpsLangchainCallbackHandler(tags=[\"Langchain Example\", \"agentops-example\"])\n","\n",- "llm = ChatOpenAI(openai_api_key=OPENAI_API_KEY, callbacks=[agentops_handler], model=\"gpt-3.5-turbo\")\n",+ "llm = ChatOpenAI(callbacks=[agentops_handler], model=\"gpt-3.5-turbo\")\n","\n","# You must pass in a callback handler to record your agent\n","llm.callbacks = [agentops_handler]\n",@@ -163,32 +163,6 @@")"]},- {- "cell_type": "markdown",- "id": "821b2367b1082673",- "metadata": {- "collapsed": false- },- "source": [- "You can also retrieve the `session_id` of the newly created session."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "6bb30c31eaa5ba02",- "metadata": {- "ExecuteTime": {- "end_time": "2024-08-08T00:29:31.021351Z",- "start_time": "2024-08-08T00:29:31.019165Z"- },- "collapsed": false- },- "outputs": [],- "source": [- "print(\"Agent Ops session ID: \" + str(agentops_handler.current_session_ids))"- ]- },{"cell_type": "markdown","id": "f7362d89b6a7af4c",@@ -318,27 +292,13 @@},"source": ["## Check your session\n",- "Finally, check your run on [AgentOps](https://app.agentops.ai)\n",- "\n",- "Now if we look in the AgentOps dashboard, you will see a session recorded with the LLM calls and tool usage."- ]- },- {- "cell_type": "markdown",- "id": "97a1a264a71876",- "metadata": {- "collapsed": false- },- "source": [- "## Langchain v0 Example\n",- "\n",- "This langchain version is out of date and support is being deprecated. You can find the example notebook [here](https://github.com/agentops-ai/agentops/blob/main/examples/langchain_examples/langchain_v0_example.ipynb)."+ "Finally, check your run on [AgentOps](https://app.agentops.ai). You will see a session recorded with the LLM calls and tool usage."]}],"metadata": {"kernelspec": {- "display_name": "Python 3 (ipykernel)",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -352,7 +312,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.10.15"+ "version": "3.11.11"}},"nbformat": 4,diff --git a/examples/langchain/langchain_examples.py b/examples/langchain/langchain_examples.pynew file mode 100644index 00000000..33455bbd--- /dev/null+++ b/examples/langchain/langchain_examples.py@@ -0,0 +1,79 @@+# AgentOps Langchain Agent Implementation+#+# Using AgentOps monitoring with Langchain is simple. We've created a LangchainCallbackHandler that will do all of the heavy lifting!+#+# First let's install the required packages+# %pip install langchain+# %pip install langchain_openai+# %pip install agentops+# %pip install python-dotenv+# Then import them+import os+from langchain_openai import ChatOpenAI+from langchain.agents import tool, AgentExecutor, create_openai_tools_agent+from dotenv import load_dotenv+from langchain_core.prompts import ChatPromptTemplate++# The only difference with using AgentOps is that we'll also import this special Callback Handler+from agentops.integration.callbacks.langchain import (+ LangchainCallbackHandler as AgentOpsLangchainCallbackHandler,+)++# Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.+#+# [Get an AgentOps API key](https://agentops.ai/settings/projects)+#+# 1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...+#+# 2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++# This is where AgentOps comes into play. Before creating our LLM instance via Langchain, first we'll create an instance of the AO LangchainCallbackHandler. After the handler is initialized, a session will be recorded automatically.+#+# Pass in your API key, and optionally any tags to describe this session for easier lookup in the AO dashboard.+agentops_handler = AgentOpsLangchainCallbackHandler(tags=["Langchain Example", "agentops-example"])++llm = ChatOpenAI(callbacks=[agentops_handler], model="gpt-3.5-turbo")++# You must pass in a callback handler to record your agent+llm.callbacks = [agentops_handler]++prompt = ChatPromptTemplate.from_messages(+ [+ ("system", "You are a helpful assistant. Respond only in Spanish."),+ ("human", "{input}"),+ # Placeholders fill up a **list** of messages+ ("placeholder", "{agent_scratchpad}"),+ # ("tool_names", "find_movie")+ ]+)+++# Agents generally use tools. Let's define a simple tool here. Tool usage is also recorded.+@tool+def find_movie(genre: str) -> str:+ """Find available movies"""+ if genre == "drama":+ return "Dune 2"+ else:+ return "Pineapple Express"+++tools = [find_movie]++# For each tool, you need to also add the callback handler+for t in tools:+ t.callbacks = [agentops_handler]++# Add the tools to our LLM+llm_with_tools = llm.bind_tools([find_movie])++# Finally, let's create our agent! Pass in the callback handler to the agent, and all the actions will be recorded in the AO Dashboard+agent = create_openai_tools_agent(llm, tools, prompt)+agent_executor = AgentExecutor(agent=agent, tools=tools)+agent_executor.invoke({"input": "What comedies are playing?"}, config={"callback": [agentops_handler]})++# ## Check your session+# Finally, check your run on [AgentOps](https://app.agentops.ai). You will see a session recorded with the LLM calls and tool usage.diff --git a/examples/langchain_examples/langchain_v0_example.ipynb b/examples/langchain_examples/langchain_v0_example.ipynbdeleted file mode 100644index 2c635e31..00000000--- a/examples/langchain_examples/langchain_v0_example.ipynb+++ /dev/null@@ -1,232 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "97a1a264a71876",- "metadata": {- "collapsed": false- },- "source": [- "# AgentOps Langchain Agent Implementation"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "decac159bb492462",- "metadata": {},- "outputs": [],- "source": [- "%pip install langchain==0.1.6\n",- "%pip install agentops"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "initial_id",- "metadata": {},- "outputs": [],- "source": [- "import os\n",- "from langchain_openai import ChatOpenAI\n",- "from langchain.agents import initialize_agent, AgentType\n",- "from langchain.agents import tool"- ]- },- {- "cell_type": "markdown",- "id": "57ddb8eca4e8a3cb",- "metadata": {},- "source": [- "The only difference with using AgentOps is that we'll also import this special Callback Handler"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "7e8f8cd098ad5b57",- "metadata": {},- "outputs": [],- "source": [- "from agentops.partners.langchain_callback_handler import (\n",- " LangchainCallbackHandler as AgentOpsLangchainCallbackHandler,\n",- ")"- ]- },- {- "cell_type": "markdown",- "id": "14a1b8e08a2e9eb3",- "metadata": {},- "source": [- "Next, we'll grab our two API keys."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "ff6cfc570599871f",- "metadata": {},- "outputs": [],- "source": [- "from dotenv import load_dotenv\n",- "\n",- "load_dotenv()"- ]- },- {- "cell_type": "markdown",- "id": "51f083697b783fa4",- "metadata": {},- "source": [- "This is where AgentOps comes into play. Before creating our LLM instance via Langchain, first we'll create an instance of the AO LangchainCallbackHandler. After the handler is initialized, a session will be recorded automatically.\n",- "\n",- "Pass in your API key, and optionally any tags to describe this session for easier lookup in the AO dashboard."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "d432fe915edb6365",- "metadata": {},- "outputs": [],- "source": [- "AGENTOPS_API_KEY = os.environ.get(\"AGENTOPS_API_KEY\")\n",- "OPENAI_API_KEY = os.environ.get(\"OPENAI_API_KEY\")\n",- "\n",- "agentops_handler = AgentOpsLangchainCallbackHandler(api_key=AGENTOPS_API_KEY, default_tags=[\"Langchain Example\"])\n",- "\n",- "llm = ChatOpenAI(openai_api_key=OPENAI_API_KEY, callbacks=[agentops_handler], model=\"gpt-3.5-turbo\")"- ]- },- {- "cell_type": "markdown",- "id": "38d309f07363b58e",- "metadata": {},- "source": [- "You can also retrieve the `session_id` of the newly created session."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "f7e3a37cde3f9c22",- "metadata": {},- "outputs": [],- "source": [- "print(\"Agent Ops session ID: \" + str(agentops_handler.current_session_ids))"- ]- },- {- "cell_type": "markdown",- "id": "42f226ace56ef6f5",- "metadata": {},- "source": [- "Agents generally use tools. Let's define a simple tool here. Tool usage is also recorded."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "c103a2edbe837abd",- "metadata": {},- "outputs": [],- "source": [- "@tool\n",- "def find_movie(genre) -> str:\n",- " \"\"\"Find available movies\"\"\"\n",- " if genre == \"drama\":\n",- " return \"Dune 2\"\n",- " else:\n",- " return \"Pineapple Express\"\n",- "\n",- "\n",- "tools = [find_movie]"- ]- },- {- "cell_type": "markdown",- "id": "4fb7633857b19bf0",- "metadata": {},- "source": [- "For each tool, you need to also add the callback handler"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "a0345f08bf1c5ecd",- "metadata": {},- "outputs": [],- "source": [- "for t in tools:\n",- " t.callbacks = [agentops_handler]"- ]- },- {- "cell_type": "markdown",- "id": "12a02b833716676b",- "metadata": {},- "source": [- "Finally, let's use our agent! Pass in the callback handler to the agent, and all the actions will be recorded in the AO Dashboard"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "2d2e83fa69b30add",- "metadata": {},- "outputs": [],- "source": [- "agent = initialize_agent(\n",- " tools,\n",- " llm,\n",- " agent=AgentType.CHAT_ZERO_SHOT_REACT_DESCRIPTION,\n",- " verbose=True,\n",- " callbacks=[agentops_handler], # You must pass in a callback handler to record your agent\n",- " handle_parsing_errors=True,\n",- ")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "df2bc3a384493e1e",- "metadata": {},- "outputs": [],- "source": [- "agent.invoke(\"What comedies are playing?\", callbacks=[agentops_handler])"- ]- },- {- "cell_type": "markdown",- "id": "2230edd919182a55",- "metadata": {},- "source": [- "## Check your session\n",- "Finally, check your run on [AgentOps](https://app.agentops.ai)"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3 (ipykernel)",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.10.15"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/litellm/README.md b/examples/litellm/README.mdnew file mode 100644index 00000000..28a2c2cf--- /dev/null+++ b/examples/litellm/README.md@@ -0,0 +1,25 @@+# LiteLLM Examples with AgentOps++This directory contains examples of using LiteLLM with AgentOps instrumentation.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops litellm+ ```++## Examples++### 1. LiteLLM Example++Example: `litellm_example`+This example demonstrates:+- Multi-provider LLM access through LiteLLM++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your LiteLLM calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/litellm_examples/litellm_example.ipynb b/examples/litellm/litellm_example.ipynbsimilarity index 70%rename from examples/litellm_examples/litellm_example.ipynbrename to examples/litellm/litellm_example.ipynbindex 221c7e7f..2c7e3379 100644--- a/examples/litellm_examples/litellm_example.ipynb+++ b/examples/litellm/litellm_example.ipynb@@ -4,20 +4,10 @@"cell_type": "markdown","metadata": {},"source": [- "### NOTE:\n",- "AgentOps requires that you import and call LiteLLM differently than LiteLLM's documentation. \n",- "Instead of\n",- "``` python\n",- "from litellm import completion\n",- "completion()\n",- "```\n",- "You should import and call like this:\n",- "``` python\n",- "import litellm\n",- "litellm.completion()\n",- "```\n",+ "# AgentOps for observing LiteLLM\n","\n",- "Please see examples below\n",+ "We can use AgentOps to observe LiteLLM, a lightweight library for working with large language models. This integration allows you to monitor and log the performance of your LiteLLM applications, providing insights into their behavior and efficiency.\n",+ "LiteLLM integration extends observability to the different agent libraries which rely on LiteLLM and hence make it possible to observe the agents built using these libraries.\n","\n","[See our LiteLLM docs](https://docs.agentops.ai/v1/integrations/litellm)"]@@ -86,8 +76,10 @@"outputs": [],"source": ["load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\" # or the provider of your choosing\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\n",+ " \"OPENAI_API_KEY\", \"your_openai_api_key_here\"\n",+ ") # or the provider of your choosing"]},{@@ -96,7 +88,28 @@"metadata": {},"outputs": [],"source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"litellm-example\"])"+ "agentops.init(auto_start_session=False)\n",+ "tracer = agentops.start_trace(trace_name=\"LiteLLM Example\", tags=[\"litellm-example\", \"agentops-example\"])"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "Note: AgentOps requires that you call LiteLLM completions differently than the LiteLLM's docs mention\n",+ "Instead of doing this -\n",+ "\n",+ "```python\n",+ "from litellm import completion\n",+ "completion()\n",+ "```\n",+ "\n",+ "You should do this -\n",+ "\n",+ "```python\n",+ "import litellm\n",+ "litellm.completion()\n",+ "```"]},{@@ -116,13 +129,13 @@"metadata": {},"outputs": [],"source": [- "agentops.end_session(\"Success\")"+ "agentops.end_trace(tracer, end_state=\"Success\")"]}],"metadata": {"kernelspec": {- "display_name": "env",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -136,7 +149,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.12.5"+ "version": "3.11.11"}},"nbformat": 4,diff --git a/examples/litellm/litellm_example.py b/examples/litellm/litellm_example.pynew file mode 100644index 00000000..8c9126c8--- /dev/null+++ b/examples/litellm/litellm_example.py@@ -0,0 +1,52 @@+# AgentOps for observing LiteLLM+#+# We can use AgentOps to observe LiteLLM, a lightweight library for working with large language models. This integration allows you to monitor and log the performance of your LiteLLM applications, providing insights into their behavior and efficiency.+# LiteLLM integration extends observability to the different agent libraries which rely on LiteLLM and hence make it possible to observe the agents built using these libraries.+#+# [See our LiteLLM docs](https://docs.agentops.ai/v1/integrations/litellm)+# First let's install the required packages+# %pip install -U litellm+# %pip install -U agentops+# %pip install -U python-dotenv+# Then import them+import litellm+import agentops+import os+from dotenv import load_dotenv++# Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.+#+# [Get an AgentOps API key](https://agentops.ai/settings/projects)+#+# 1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...+#+# 2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!+# LiteLLM allows you to use several models including from OpenAI, Llama, Mistral, Claude, Gemini, Gemma, Dall-E, Whisper, and more all using the OpenAI format. To use a different model all you need to change are the API KEY and model (litellm.completion(model="...")).+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv(+ "OPENAI_API_KEY", "your_openai_api_key_here"+) # or the provider of your choosing++agentops.init(auto_start_session=False)+tracer = agentops.start_trace(trace_name="LiteLLM Example", tags=["litellm-example", "agentops-example"])++# Note: AgentOps requires that you call LiteLLM completions differently than the LiteLLM's docs mention+# Instead of doing this -+#+# ```python+# from litellm import completion+# completion()+# ```+#+# You should do this -+#+# ```python+# import litellm+# litellm.completion()+# ```+messages = [{"role": "user", "content": "Write a 12 word poem about secret agents."}]+response = litellm.completion(model="gpt-4", messages=messages) # or the model of your choosing+print(response.choices[0].message.content)++agentops.end_trace(tracer, end_state="Success")diff --git a/examples/llama_stack_client_examples/.env.tpl b/examples/llama_stack_client_examples/.env.tpldeleted file mode 100644index 5099720e..00000000--- a/examples/llama_stack_client_examples/.env.tpl+++ /dev/null@@ -1,5 +0,0 @@-INFERENCE_MODEL=meta-llama/Llama-3.2-1B-Instruct-OLLAMA_MODEL=llama3.2:1b-instruct-fp16---diff --git a/examples/llama_stack_client_examples/README.md b/examples/llama_stack_client_examples/README.mddeleted file mode 100644index c838096d..00000000--- a/examples/llama_stack_client_examples/README.md+++ /dev/null@@ -1,45 +0,0 @@-# Llama Stack Client Examples--The example notebook demonstrates how to use the Llama Stack Client to monitor an Agentic application using AgentOps. We have also provided a `compose.yaml` file to run Ollama in a container.--## Quick Start--First run the following command to start the Ollama server with the Llama Stack client:--```bash-docker compose up-```--Next, run the [notebook](./llama_stack_example.ipynb) to see the waterfall visualization in the [AgentOps](https://app.agentops.ai) dashboard.--## Environment Variables--| Variable | Description | Default |-|----------|-------------|---------|-| `LLAMA_STACK_PORT` | Server port | 5001 |-| `INFERENCE_MODEL` | Model ID (must match Llama Stack format) | meta-llama/Llama-3.2-1B-Instruct |-| `OLLAMA_MODEL` | Ollama model ID (must match Ollama format) | llama3.2:1b-instruct-fp16 |-| `SAFETY_MODEL` | Optional safety model | - |-| `NETWORK_MODE` | Docker network mode | auto-configured |-| `OLLAMA_URL` | Ollama API URL | auto-configured |--## Common Gotchas--1. Model naming conventions differ between Ollama and Llama Stack. The same model is referenced differently. For instance, `meta-llama/Llama-3.2-1B-Instruct` in Llama Stack corresponds to `llama3.2:1b-instruct-fp16` in Ollama.--2. Ensure Docker is configured with sufficient system memory allocation to run properly.---## References--- [Download Ollama](https://ollama.com/)-- [Llama Stack Fireworks](./llama_stack_fireworks/README.fireworks.md)-- [Llama Stack Docs](https://llama-stack.readthedocs.io)-- [Ollama Run YAML Template](https://github.com/meta-llama/llama-stack/blob/main/llama_stack/templates/ollama/run.yaml)-- [Llama Stack Documentation](https://llama-stack.readthedocs.io)-- [Llama Stack Client Python](https://github.com/meta-llama/llama-stack-client-python)-- [Llama Stack Repository](https://github.com/meta-llama/llama-stack)-- [Meta Models Documentation](https://www.llama.com/docs/getting_the_models/meta/)-- [Getting Started Guide](https://llama-stack.readthedocs.io/en/latest/getting_started/index.html)-- [Agents Example](https://github.com/meta-llama/llama-stack-apps/blob/main/examples/agents/hello.py)-- [Model Download Reference](https://llama-stack.readthedocs.io/en/latest/references/llama_cli_reference/download_models.html)diff --git a/examples/llama_stack_client_examples/compose.yaml b/examples/llama_stack_client_examples/compose.yamldeleted file mode 100644index 2139a662..00000000--- a/examples/llama_stack_client_examples/compose.yaml+++ /dev/null@@ -1,73 +0,0 @@-services:- ollama:- hostname: ollama- extra_hosts:- - "host.docker.internal:host-gateway"- image: ollama/ollama:latest- volumes:- - ~/.ollama:/root/.ollama- environment:- OLLAMA_DEBUG: 1- command: []- deploy:- resources:- limits:- memory: 8G- reservations:- memory: 4G- healthcheck:- test: ["CMD", "bash", "-c", "</dev/tcp/localhost/11434"]- interval: 3s- timeout: 5s- retries: 5- networks:- - ollama-network-- ollama-init:- image: ollama/ollama:latest- depends_on:- - ollama- environment:- - OLLAMA_HOST=ollama- - INFERENCE_MODEL=${OLLAMA_MODEL:-llama3.2:3b-instruct-fp16}- - SAFETY_MODEL=${SAFETY_MODEL:-}- volumes:- - ~/.ollama:/root/.ollama- - ./pull-models.sh:/root/pull-models.sh- entrypoint: ["/root/pull-models.sh"]- networks:- - ollama-network-- llamastack:- depends_on:- ollama:- condition: service_healthy- ollama-init:- condition: service_completed_successfully- image: ${LLAMA_STACK_IMAGE:-llamastack/distribution-ollama}- volumes:- - ~/.llama:/root/.llama- - ./run${SAFETY_MODEL:+-with-safety}.yaml:/root/run.yaml- ports:- - "${LLAMA_STACK_PORT:-5001}:${LLAMA_STACK_PORT:-5001}"- environment:- - INFERENCE_MODEL=${INFERENCE_MODEL:-meta-llama/Llama-3.2-3B-Instruct}- - SAFETY_MODEL=${SAFETY_MODEL:-}- - OLLAMA_URL=http://ollama:11434- entrypoint: >- python -m llama_stack.distribution.server.server --yaml-config /root/run.yaml --port ${LLAMA_STACK_PORT:-5001}- deploy:- restart_policy:- condition: on-failure- delay: 10s- max_attempts: 3- window: 60s- networks:- - ollama-network--networks:- ollama-network:- driver: bridge-volumes:- ollama-init:- llamastack:diff --git a/examples/llama_stack_client_examples/llama_stack_example.ipynb b/examples/llama_stack_client_examples/llama_stack_example.ipynbdeleted file mode 100644index f556d494..00000000--- a/examples/llama_stack_client_examples/llama_stack_example.ipynb+++ /dev/null@@ -1,249 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Llama Stack Client Examples\n",- "Use the llama_stack_client library to interact with a Llama Stack server"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U llama-stack-client\n",- "%pip install -U llama-stack\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv\n",- "%pip install -U fastapi\n",- "%pip install opentelemetry-api\n",- "%pip install opentelemetry-sdk"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "from llama_stack_client import LlamaStackClient\n",- "from llama_stack_client.lib.inference.event_logger import EventLogger\n",- "from llama_stack_client.types import UserMessage\n",- "from llama_stack_client.types.agent_create_params import AgentConfig\n",- "from llama_stack_client.lib.agents.agent import Agent\n",- "from dotenv import load_dotenv\n",- "import os\n",- "import agentops\n",- "\n",- "load_dotenv()\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\"\n",- "\n",- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"llama-stack-client-example\"], auto_start_session=False)\n",- "\n",- "host = \"0.0.0.0\" # LLAMA_STACK_HOST\n",- "port = 5001 # LLAMA_STACK_PORT\n",- "\n",- "full_host = f\"http://{host}:{port}\"\n",- "\n",- "client = LlamaStackClient(\n",- " base_url=f\"{full_host}\",\n",- ")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Inference Canary 1 - Completion with Streaming"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.start_session()\n",- "response = client.inference.chat_completion(\n",- " messages=[\n",- " UserMessage(\n",- " content=\"hello world, write me a 3 word poem about the moon\",\n",- " role=\"user\",\n",- " ),\n",- " ],\n",- " model_id=\"meta-llama/Llama-3.2-1B-Instruct\",\n",- " stream=True,\n",- ")\n",- "\n",- "async for log in EventLogger().log(response):\n",- " log.print()\n",- "\n",- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Inference Canary Example 2 - Completion without Streaming"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.start_session()\n",- "response = client.inference.chat_completion(\n",- " messages=[\n",- " UserMessage(\n",- " content=\"write me a 3 word poem about the moon\",\n",- " role=\"user\",\n",- " ),\n",- " ],\n",- " model_id=\"meta-llama/Llama-3.2-1B-Instruct\",\n",- " stream=False,\n",- ")\n",- "\n",- "print(f\"> Response: {response.completion_message.content}\")\n",- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Agent Canary Example"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "import os\n",- "from llama_stack_client import LlamaStackClient\n",- "from llama_stack_client.lib.agents.event_logger import EventLogger\n",- "\n",- "agentops.start_session()\n",- "\n",- "LLAMA_STACK_PORT = 5001\n",- "\n",- "# Replace with actual API keys for functionality\n",- "BRAVE_SEARCH_API_KEY = os.getenv(\"BRAVE_SEARCH_API_KEY\") or \"your-brave-search-api-key\"\n",- "\n",- "\n",- "async def agent_test():\n",- " client = LlamaStackClient(\n",- " base_url=f\"http://0.0.0.0:{LLAMA_STACK_PORT}\",\n",- " )\n",- "\n",- " available_shields = [shield.identifier for shield in client.shields.list()]\n",- " if not available_shields:\n",- " print(\"No available shields. Disable safety.\")\n",- " else:\n",- " print(f\"Available shields found: {available_shields}\")\n",- " available_models = [model.identifier for model in client.models.list()]\n",- " if not available_models:\n",- " raise ValueError(\"No available models\")\n",- " else:\n",- " selected_model = available_models[0]\n",- " print(f\"Using model: {selected_model}\")\n",- "\n",- " agent_config = AgentConfig(\n",- " model=selected_model,\n",- " instructions=\"You are a helpful assistant. Just say hello as a greeting.\",\n",- " sampling_params={\n",- " \"strategy\": \"greedy\",\n",- " \"temperature\": 1.0,\n",- " \"top_p\": 0.9,\n",- " },\n",- " tools=[\n",- " {\n",- " \"type\": \"brave_search\",\n",- " \"engine\": \"brave\",\n",- " \"api_key\": BRAVE_SEARCH_API_KEY,\n",- " }\n",- " ],\n",- " tool_choice=\"auto\",\n",- " tool_prompt_format=\"json\",\n",- " input_shields=available_shields if available_shields else [],\n",- " output_shields=available_shields if available_shields else [],\n",- " enable_session_persistence=False,\n",- " )\n",- " agent = Agent(client, agent_config)\n",- " user_prompts = [\n",- " \"Hello\",\n",- " \"Which players played in the winning team of the NBA western conference semifinals of 2014, please use tools\",\n",- " ]\n",- "\n",- " session_id = agent.create_session(\"test-session\")\n",- "\n",- " for prompt in user_prompts:\n",- " response = agent.create_turn(\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": prompt,\n",- " }\n",- " ],\n",- " session_id=session_id,\n",- " )\n",- "\n",- " print(f\"{response=}\")\n",- "\n",- " for log in EventLogger().log(response):\n",- " log.print()\n",- "\n",- "\n",- "agentops.start_session()\n",- "\n",- "await agent_test()\n",- "\n",- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.end_all_sessions()"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "venv",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.10.0"- }- },- "nbformat": 4,- "nbformat_minor": 2-}diff --git a/examples/llama_stack_client_examples/llama_stack_example_for_ci.ipynb b/examples/llama_stack_client_examples/llama_stack_example_for_ci.ipynbdeleted file mode 100644index e2b4b7c0..00000000--- a/examples/llama_stack_client_examples/llama_stack_example_for_ci.ipynb+++ /dev/null@@ -1,203 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Llama Stack Client Examples\n",- "Use the llama_stack_client library to interact with a Llama Stack server"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U llama-stack-client\n",- "%pip install -U llama-stack\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv\n",- "%pip install -U fastapi\n",- "%pip install opentelemetry-api\n",- "%pip install opentelemetry-sdk"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "from llama_stack_client import LlamaStackClient\n",- "from llama_stack_client.types import UserMessage\n",- "from llama_stack_client.types.agent_create_params import AgentConfig\n",- "from llama_stack_client.lib.agents.agent import Agent\n",- "\n",- "### Agent Canary\n",- "\n",- "import os\n",- "from llama_stack_client.lib.agents.event_logger import EventLogger\n",- "from dotenv import load_dotenv\n",- "import agentops\n",- "\n",- "load_dotenv()\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\"\n",- "\n",- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"llama-stack-client-example\"], auto_start_session=False)\n",- "\n",- "host = \"0.0.0.0\" # LLAMA_STACK_HOST\n",- "port = 5001 # LLAMA_STACK_PORT\n",- "\n",- "full_host = f\"http://{host}:{port}\"\n",- "\n",- "client = LlamaStackClient(\n",- " base_url=f\"{full_host}\",\n",- ")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Inference Canary + Agent Canary"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "### Inference Canary\n",- "\n",- "agentops.start_session() # AgentOps start session\n",- "\n",- "response = client.inference.chat_completion(\n",- " messages=[\n",- " UserMessage(\n",- " content=\"hello world, write me a 3 word poem about the moon\",\n",- " role=\"user\",\n",- " ),\n",- " ],\n",- " model_id=\"meta-llama/Llama-3.2-1B-Instruct\",\n",- " stream=True,\n",- ")\n",- "\n",- "async for log in EventLogger().log(response):\n",- " log.print()\n",- "\n",- "\n",- "LLAMA_STACK_PORT = 5001\n",- "\n",- "# Replace with actual API keys for functionality\n",- "BRAVE_SEARCH_API_KEY = os.getenv(\"BRAVE_SEARCH_API_KEY\") or \"your-brave-search-api-key\"\n",- "\n",- "\n",- "async def agent_test():\n",- " client = LlamaStackClient(\n",- " base_url=f\"http://0.0.0.0:{LLAMA_STACK_PORT}\",\n",- " )\n",- "\n",- " available_shields = [shield.identifier for shield in client.shields.list()]\n",- " if not available_shields:\n",- " print(\"No available shields. Disable safety.\")\n",- " else:\n",- " print(f\"Available shields found: {available_shields}\")\n",- " available_models = [model.identifier for model in client.models.list()]\n",- " if not available_models:\n",- " raise ValueError(\"No available models\")\n",- " else:\n",- " selected_model = available_models[0]\n",- " print(f\"Using model: {selected_model}\")\n",- "\n",- " agent_config = AgentConfig(\n",- " model=selected_model,\n",- " instructions=\"You are a helpful assistant. Just say hello as a greeting.\",\n",- " sampling_params={\n",- " \"strategy\": \"greedy\",\n",- " \"temperature\": 1.0,\n",- " \"top_p\": 0.9,\n",- " },\n",- " tools=[\n",- " {\n",- " \"type\": \"brave_search\",\n",- " \"engine\": \"brave\",\n",- " \"api_key\": BRAVE_SEARCH_API_KEY,\n",- " }\n",- " ],\n",- " tool_choice=\"auto\",\n",- " tool_prompt_format=\"json\",\n",- " input_shields=available_shields if available_shields else [],\n",- " output_shields=available_shields if available_shields else [],\n",- " enable_session_persistence=False,\n",- " )\n",- " agent = Agent(client, agent_config)\n",- " user_prompts = [\n",- " \"Hello\",\n",- " \"Which players played in the winning team of the NBA western conference semifinals of 2014, please use tools\",\n",- " ]\n",- "\n",- " session_id = agent.create_session(\"test-session\")\n",- "\n",- " for prompt in user_prompts:\n",- " response = agent.create_turn(\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": prompt,\n",- " }\n",- " ],\n",- " session_id=session_id,\n",- " )\n",- "\n",- " print(f\"{response=}\")\n",- "\n",- " for log in EventLogger().log(response):\n",- " log.print()\n",- "\n",- "\n",- "await agent_test()\n",- "\n",- "agentops.end_session(\"Success\") # AgentOps end session"- ]- },- {- "cell_type": "code",- "execution_count": 4,- "metadata": {},- "outputs": [],- "source": [- "agentops.end_all_sessions()"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "venv",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.10.0"- }- },- "nbformat": 4,- "nbformat_minor": 2-}diff --git a/examples/llama_stack_client_examples/pull-models.sh b/examples/llama_stack_client_examples/pull-models.shdeleted file mode 100755index cd069029..00000000--- a/examples/llama_stack_client_examples/pull-models.sh+++ /dev/null@@ -1,18 +0,0 @@-#!/bin/sh--# Copyright (c) Meta Platforms, Inc. and affiliates.-# All rights reserved.-#-# This source code is licensed under the terms described in the LICENSE file in-# the root directory of this source tree.--echo "Preloading (${INFERENCE_MODEL}, ${SAFETY_MODEL})..."-for model in ${INFERENCE_MODEL} ${SAFETY_MODEL}; do- echo "Preloading $model..."- if ! ollama run "$model"; then- echo "Failed to pull and run $model"- exit 1- fi-done--echo "All models pulled successfully"\ No newline at end of filediff --git a/examples/llama_stack_client_examples/run-safety-shield.yaml b/examples/llama_stack_client_examples/run-safety-shield.yamldeleted file mode 100644index 2e4f6ac8..00000000--- a/examples/llama_stack_client_examples/run-safety-shield.yaml+++ /dev/null@@ -1,62 +0,0 @@-version: '2'-image_name: ollama-docker_image: null-conda_env: ollama-apis:-- agents-- inference-- memory-- safety-- telemetry-providers:- inference:- - provider_id: ollama- provider_type: remote::ollama- config:- url: ${env.OLLAMA_URL:http://localhost:11434}- memory:- - provider_id: faiss- provider_type: inline::faiss- config:- kvstore:- type: sqlite- namespace: null- db_path: ${env.SQLITE_STORE_DIR:~/.llama/distributions/ollama}/faiss_store.db- safety:- - provider_id: llama-guard- provider_type: inline::llama-guard- config: {}- agents:- - provider_id: meta-reference- provider_type: inline::meta-reference- config:- persistence_store:- type: sqlite- namespace: null- db_path: ${env.SQLITE_STORE_DIR:~/.llama/distributions/ollama}/agents_store.db- telemetry:- - provider_id: meta-reference- provider_type: inline::meta-reference- config: {}-metadata_store:- namespace: null- type: sqlite- db_path: ${env.SQLITE_STORE_DIR:~/.llama/distributions/ollama}/registry.db-models:-- metadata: {}- model_id: ${env.INFERENCE_MODEL}- provider_id: ollama- provider_model_id: null-- metadata: {}- model_id: ${env.SAFETY_MODEL}- provider_id: ollama- provider_model_id: null-shields:-- params: null- shield_id: ${env.SAFETY_MODEL}- provider_id: null- provider_shield_id: null-memory_banks: []-datasets: []-scoring_fns: []-eval_tasks: []\ No newline at end of filediff --git a/examples/llama_stack_client_examples/run.yaml b/examples/llama_stack_client_examples/run.yamldeleted file mode 100644index 4d148ad9..00000000--- a/examples/llama_stack_client_examples/run.yaml+++ /dev/null@@ -1,53 +0,0 @@-version: '2'-image_name: ollama-docker_image: null-conda_env: ollama-apis:-- agents-- inference-- memory-- safety-- telemetry-providers:- inference:- - provider_id: ollama- provider_type: remote::ollama- config:- url: ${env.OLLAMA_URL:http://ollama:11434}- memory:- - provider_id: faiss- provider_type: inline::faiss- config:- kvstore:- type: sqlite- namespace: null- db_path: ${env.SQLITE_STORE_DIR:~/.llama/distributions/ollama}/faiss_store.db- safety:- - provider_id: llama-guard- provider_type: inline::llama-guard- config: {}- agents:- - provider_id: meta-reference- provider_type: inline::meta-reference- config:- persistence_store:- type: sqlite- namespace: null- db_path: ${env.SQLITE_STORE_DIR:~/.llama/distributions/ollama}/agents_store.db- telemetry:- - provider_id: meta-reference- provider_type: inline::meta-reference- config: {}-metadata_store:- namespace: null- type: sqlite- db_path: ${env.SQLITE_STORE_DIR:~/.llama/distributions/ollama}/registry.db-models:-- metadata: {}- model_id: ${env.INFERENCE_MODEL}- provider_id: ollama-shields: []-memory_banks: []-datasets: []-scoring_fns: []-eval_tasks: []diff --git a/examples/mistral_examples/mistral_example.ipynb b/examples/mistral_examples/mistral_example.ipynbdeleted file mode 100644index 228f6827..00000000--- a/examples/mistral_examples/mistral_example.ipynb+++ /dev/null@@ -1,226 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Mistral Examples\n",- "Uses the mistralai library to interact with Mistral"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U mistralai\n",- "%pip install -U agentops"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "from mistralai import Mistral\n",- "from dotenv import load_dotenv\n",- "import os\n",- "import agentops"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll grab our API keys. You can use dotenv like below or however else you like to load environment variables"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "MISTRAL_API_KEY = os.getenv(\"MISTRAL_API_KEY\") or \"<your_mistral_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"mistral-example\"])\n",- "client = Mistral(MISTRAL_API_KEY)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Sync Example"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "response = client.chat.complete(\n",- " model=\"open-mistral-nemo\",\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"What is 2+2?\",\n",- " },\n",- " ],\n",- ")\n",- "print(response.choices[0].message.content)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Async Example"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "async def main() -> None:\n",- " response = await client.chat.complete_async(\n",- " model=\"open-mistral-nemo\",\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"Explain step by step what is 2+2?\",\n",- " }\n",- " ],\n",- " )\n",- " print(response.choices[0].message.content)\n",- "\n",- "\n",- "await main()"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Sync Stream Example"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "response = client.chat.stream(\n",- " model=\"open-mistral-nemo\",\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"What is the Leibniz theorem?\",\n",- " }\n",- " ],\n",- ")\n",- "\n",- "result = \"\"\n",- "for event in response:\n",- " if event.data.choices[0].finish_reason == \"stop\":\n",- " print(result)\n",- " else:\n",- " result += event.data.choices[0].delta.content"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Async Stream Example"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "async def main() -> None:\n",- " response = await client.chat.stream_async(\n",- " model=\"open-mistral-nemo\",\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"What is the meaning of life?\",\n",- " }\n",- " ],\n",- " )\n",- "\n",- " result = \"\"\n",- " async for event in response:\n",- " if event.data.choices[0].finish_reason == \"stop\":\n",- " print(result)\n",- " else:\n",- " result += event.data.choices[0].delta.content\n",- "\n",- "\n",- "await main()"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "ops",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.9.19"- }- },- "nbformat": 4,- "nbformat_minor": 2-}diff --git a/examples/multi_agent_example.ipynb b/examples/multi_agent_example.ipynbdeleted file mode 100644index 0d1f92a9..00000000--- a/examples/multi_agent_example.ipynb+++ /dev/null@@ -1,342 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "a2e266428cefc683",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "# Multi-Agent Support\n",- "This is an example implementation of tracking events from two separate agents"- ]- },- {- "cell_type": "markdown",- "id": "c4e0d5ff",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "5439d798",- "metadata": {},- "outputs": [],- "source": [- "%pip install -U openai\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "id": "8f69131d",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "7c566fac57d3b6ce",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "import agentops\n",- "from agentops import track_agent\n",- "from openai import OpenAI\n",- "import os\n",- "from dotenv import load_dotenv\n",- "import logging\n",- "from IPython.display import display, Markdown"- ]- },- {- "cell_type": "markdown",- "id": "6a65f091",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "9f8c52496c04693",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\"\n",- "logging.basicConfig(level=logging.DEBUG) # this will let us see that calls are assigned to an agent"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "af062552554d60ce",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"multi-agent-notebook\"])\n",- "openai_client = OpenAI(api_key=OPENAI_API_KEY)"- ]- },- {- "cell_type": "markdown",- "id": "95d212546aaf1f82",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "Now lets create a few agents!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "727e3cc26ce3ec3",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "@track_agent(name=\"qa\")\n",- "class QaAgent:\n",- " def completion(self, prompt: str):\n",- " res = openai_client.chat.completions.create(\n",- " model=\"gpt-3.5-turbo\",\n",- " messages=[\n",- " {\n",- " \"role\": \"system\",\n",- " \"content\": \"You are a qa engineer and only output python code, no markdown tags.\",\n",- " },\n",- " {\"role\": \"user\", \"content\": prompt},\n",- " ],\n",- " temperature=0.5,\n",- " )\n",- " return res.choices[0].message.content\n",- "\n",- "\n",- "@track_agent(name=\"engineer\")\n",- "class EngineerAgent:\n",- " def completion(self, prompt: str):\n",- " res = openai_client.chat.completions.create(\n",- " model=\"gpt-3.5-turbo\",\n",- " messages=[\n",- " {\n",- " \"role\": \"system\",\n",- " \"content\": \"You are a software engineer and only output python code, no markdown tags.\",\n",- " },\n",- " {\"role\": \"user\", \"content\": prompt},\n",- " ],\n",- " temperature=0.5,\n",- " )\n",- " return res.choices[0].message.content"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "79b75d65de738522",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "qa = QaAgent()\n",- "engineer = EngineerAgent()"- ]- },- {- "cell_type": "markdown",- "id": "69dd3af9206308cc",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "Now we have our agents and we tagged them with the `@track_agent` decorator. Any LLM calls that go through this class will now be tagged as agent calls in AgentOps.\n",- "\n",- "Let's use these agents!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "ae979350-470d-438d-a187-6dbaa0080b8c",- "metadata": {},- "outputs": [],- "source": [- "generated_func = engineer.completion(\"python function to test prime number\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "830b86dac47dceb3",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "display(Markdown(\"```python\\n\" + generated_func + \"\\n```\"))"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "63c9d0d457aee91a",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "generated_test = qa.completion(\"Write a python unit test that test the following function: \\n \" + generated_func)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "a88ffcbd2015d422",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "display(Markdown(\"```python\\n\" + generated_test + \"\\n```\"))"- ]- },- {- "cell_type": "markdown",- "id": "1bd312ed049a5511",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "Perfect! It generated the code as expected, and in the DEBUG logs, you can see that the calls were made by agents named \"engineer\" and \"qa\"!"- ]- },- {- "cell_type": "markdown",- "id": "cbd0817a31756397",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "Let's verify one more thing! If we make an LLM call outside of the context of a tracked agent, we want to make sure it gets assigned to the Default Agent."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "122e923cb07fd5f4",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "res = openai_client.chat.completions.create(\n",- " model=\"gpt-3.5-turbo\",\n",- " messages=[\n",- " {\"role\": \"system\", \"content\": \"You are not a tracked agent\"},\n",- " {\"role\": \"user\", \"content\": \"Say hello\"},\n",- " ],\n",- ")\n",- "res.choices[0].message.content"- ]- },- {- "cell_type": "markdown",- "id": "a30909020c6a1ada",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "You'll notice that we didn't log an agent name, so the AgentOps backend will assign it to the Default Agent for the session!"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3 (ipykernel)",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.4"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/multi_agent_groq_example.ipynb b/examples/multi_agent_groq_example.ipynbdeleted file mode 100644index e3544d60..00000000--- a/examples/multi_agent_groq_example.ipynb+++ /dev/null@@ -1,343 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "a2e266428cefc683",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "# Multi-Agent Support\n",- "This is an example implementation of tracking events from two separate agents"- ]- },- {- "cell_type": "markdown",- "id": "fde50a03",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "f846ae29",- "metadata": {},- "outputs": [],- "source": [- "%pip install -U agentops\n",- "%pip install -U groq\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "id": "882b027b",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "7c566fac57d3b6ce",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "import agentops\n",- "from agentops import track_agent\n",- "from dotenv import load_dotenv\n",- "import os\n",- "from groq import Groq\n",- "import logging\n",- "\n",- "from IPython.display import display, Markdown"- ]- },- {- "cell_type": "markdown",- "id": "d614aaf3",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "9f8c52496c04693",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "load_dotenv()\n",- "GROQ_API_KEY = os.getenv(\"GROQ_API_KEY\") or \"<your_groq_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\"\n",- "logging.basicConfig(level=logging.DEBUG) # this will let us see that calls are assigned to an agent"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "af062552554d60ce",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"multi-agent-groq-notebook\"])\n",- "groq_client = Groq(api_key=GROQ_API_KEY)"- ]- },- {- "cell_type": "markdown",- "id": "95d212546aaf1f82",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "Now lets create a few agents!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "727e3cc26ce3ec3",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "@track_agent(name=\"qa\")\n",- "class QaAgent:\n",- " def completion(self, prompt: str):\n",- " res = groq_client.chat.completions.create(\n",- " model=\"llama3-70b-8192\",\n",- " messages=[\n",- " {\n",- " \"role\": \"system\",\n",- " \"content\": \"You are a qa engineer and only output python code, no markdown tags.\",\n",- " },\n",- " {\"role\": \"user\", \"content\": prompt},\n",- " ],\n",- " temperature=0.5,\n",- " )\n",- " return res.choices[0].message.content\n",- "\n",- "\n",- "@track_agent(name=\"engineer\")\n",- "class EngineerAgent:\n",- " def completion(self, prompt: str):\n",- " res = groq_client.chat.completions.create(\n",- " model=\"llama3-70b-8192\",\n",- " messages=[\n",- " {\n",- " \"role\": \"system\",\n",- " \"content\": \"You are a software engineer and only output python code, no markdown tags.\",\n",- " },\n",- " {\"role\": \"user\", \"content\": prompt},\n",- " ],\n",- " temperature=0.5,\n",- " )\n",- " return res.choices[0].message.content"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "79b75d65de738522",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "qa = QaAgent()\n",- "engineer = EngineerAgent()"- ]- },- {- "cell_type": "markdown",- "id": "69dd3af9206308cc",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "Now we have our agents and we tagged them with the `@track_agent` decorator. Any LLM calls that go through this class will now be tagged as agent calls in AgentOps.\n",- "\n",- "Let's use these agents!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "7272b927-67ef-4b8c-84a5-63ed06f75aa5",- "metadata": {},- "outputs": [],- "source": [- "generated_func = engineer.completion(\"python function to test prime number\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "830b86dac47dceb3",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "display(Markdown(\"```python\\n\" + generated_func + \"\\n```\"))"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "63c9d0d457aee91a",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "generated_test = qa.completion(\"Write a python unit test that test the following function: \\n \" + generated_func)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "a88ffcbd2015d422",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "display(Markdown(\"```python\\n\" + generated_test + \"\\n```\"))"- ]- },- {- "cell_type": "markdown",- "id": "1bd312ed049a5511",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "Perfect! It generated the code as expected, and in the DEBUG logs, you can see that the calls were made by agents named \"engineer\" and \"qa\"!"- ]- },- {- "cell_type": "markdown",- "id": "cbd0817a31756397",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "Let's verify one more thing! If we make an LLM call outside of the context of a tracked agent, we want to make sure it gets assigned to the Default Agent."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "122e923cb07fd5f4",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "outputs": [],- "source": [- "res = groq_client.chat.completions.create(\n",- " model=\"llama3-70b-8192\",\n",- " messages=[\n",- " {\"role\": \"system\", \"content\": \"You are not a tracked agent\"},\n",- " {\"role\": \"user\", \"content\": \"Say hello\"},\n",- " ],\n",- ")\n",- "res.choices[0].message.content"- ]- },- {- "cell_type": "markdown",- "id": "a30909020c6a1ada",- "metadata": {- "collapsed": false,- "jupyter": {- "outputs_hidden": false- }- },- "source": [- "You'll notice that we didn't log an agent name, so the AgentOps backend will assign it to the Default Agent for the session!"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3 (ipykernel)",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.3"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/multi_session_llm.ipynb b/examples/multi_session_llm.ipynbdeleted file mode 100644index e2f06439..00000000--- a/examples/multi_session_llm.ipynb+++ /dev/null@@ -1,316 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "a0fe80a38dec2f7b",- "metadata": {- "collapsed": false- },- "source": [- "# Multiple Concurrent Sessions\n",- "This example will show you how to run multiple sessions concurrently, assigning LLM cals to a specific session."- ]- },- {- "cell_type": "markdown",- "id": "ef25b661",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "f507526f",- "metadata": {},- "outputs": [],- "source": [- "%pip install -U openai\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "id": "b6abd496",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "initial_id",- "metadata": {- "collapsed": true- },- "outputs": [],- "source": [- "from openai import OpenAI\n",- "import agentops\n",- "from agentops import ActionEvent\n",- "import os\n",- "from dotenv import load_dotenv"- ]- },- {- "cell_type": "markdown",- "id": "c1da7e59",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "8325866b",- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "markdown",- "id": "da9cf64965c86ee9",- "metadata": {- "collapsed": false- },- "source": [- "Then, of course, lets init AgentOps. We're going to bypass creating a session automatically for the sake of showing it below."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "39af2cd027ce268",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, auto_start_session=False)\n",- "openai = OpenAI()"- ]- },- {- "cell_type": "markdown",- "id": "9501d298aec35510",- "metadata": {- "collapsed": false- },- "source": [- "Now lets create two sessions, each with an identifiable tag."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "4f24d06dd29579ff",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "session_1 = agentops.start_session(tags=[\"multi-session-test-1\"])\n",- "session_2 = agentops.start_session(tags=[\"multi-session-test-2\"])\n",- "\n",- "print(\"session_id_1: {}\".format(session_1.session_id))\n",- "print(\"session_id_2: {}\".format(session_2.session_id))"- ]- },- {- "cell_type": "markdown",- "id": "38f373b7a8878a68",- "metadata": {- "collapsed": false- },- "source": [- "## LLM Calls\n",- "Now lets go ahead and make our first OpenAI LLM call. The challenge with having multiple sessions at the same time is that there is no way for AgentOps to know what LLM call is intended to pertain to what active session. This means we need to do a little extra work in one of two ways."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "8a2d65f5fcdb137",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "messages = [{\"role\": \"user\", \"content\": \"Hello\"}]"- ]- },- {- "cell_type": "markdown",- "id": "e1859e37b65669b2",- "metadata": {- "collapsed": false- },- "source": [- "### Patching Function\n",- "This method involves wrapping the LLM call withing a function on session. It can look a little counter-intuitive, but it easily tells us what session the call belongs to."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "106a1c899602bd33",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "# option 1: use session.patch\n",- "response = session_1.patch(openai.chat.completions.create)(\n",- " model=\"gpt-3.5-turbo\",\n",- " messages=messages,\n",- " temperature=0.5,\n",- ")"- ]- },- {- "cell_type": "markdown",- "id": "3e129661929e8368",- "metadata": {- "collapsed": false- },- "source": [- "### Create patched function\n",- "If you're using the create function multiple times, you can create a new function with the same method"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "be3b866ee04ef767",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "observed_create = session_1.patch(openai.chat.completions.create)\n",- "obs_response = observed_create(\n",- " model=\"gpt-3.5-turbo\",\n",- " messages=messages,\n",- " temperature=0.5,\n",- ")"- ]- },- {- "cell_type": "markdown",- "id": "ec03dbfb7a185d1d",- "metadata": {- "collapsed": false- },- "source": [- "### Keyword Argument\n",- "Alternatively, you can also pass the session into the LLM function call as a keyword argument. While this method works and is a bit more readable, it is not a \"pythonic\" pattern and can lead to linting errors in the code, as the base function is not expecting a `session` keyword."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "4ad4c7629509b4be",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "# option 2: add session as a keyword argument\n",- "response2 = openai.chat.completions.create(model=\"gpt-3.5-turbo\", messages=messages, temperature=0.5, session=session_2)"- ]- },- {- "cell_type": "markdown",- "id": "e6de84850aa2e135",- "metadata": {- "collapsed": false- },- "source": [- "## Recording Events\n",- "Outside of LLM calls, there are plenty of other events that we want to track. You can learn more about these events [here](https://docs.agentops.ai/v1/concepts/events).\n",- "\n",- "Recording these events on a session is as simple as `session.record(...)`"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "964e3073bac33223",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "session_1.record(ActionEvent(action_type=\"test event\"))"- ]- },- {- "cell_type": "markdown",- "id": "43ac0b9b99eab5c7",- "metadata": {- "collapsed": false- },- "source": [- "Now let's go ahead and end the sessions"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "7e3050abcb72421b",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "session_1.end_session(end_state=\"Success\")\n",- "session_2.end_session(end_state=\"Success\")"- ]- },- {- "cell_type": "markdown",- "id": "53ea2b8dfee6270a",- "metadata": {- "collapsed": false- },- "source": [- "If you look in the AgentOps dashboard for these sessions, you will see two unique sessions, both with one LLM Event each, one with an Action Event as well."- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 2- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython2",- "version": "2.7.6"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/multion_examples/Autonomous_web_browsing.ipynb b/examples/multion_examples/Autonomous_web_browsing.ipynbdeleted file mode 100644index dd33118a..00000000--- a/examples/multion_examples/Autonomous_web_browsing.ipynb+++ /dev/null@@ -1,233 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# MultiOn Tracking Web Browse Actions\n",- "<img src=\"https://github.com/AgentOps-AI/agentops/blob/main/docs/logo/multion_integration.png?raw=true\" width=\"250px\" style=\"max-width: 100%; height: auto;\"/>\n",- " \n",- "Agents using MultiOn can launch and control remote or local web browsers to perform actions and retrieve context using natural language commands. With AgentOps, MultiOn evens such as browse, retrieve, and step are automatically tracked.\n",- "\n",- "\n",- "\n",- "\n",- "Furthermore, events and LLM calls in your Python program will be tracked as well."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U multion\n",- "%pip install -U agentops\n",- "%pip install -U openai\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "from multion.client import MultiOn\n",- "from multion.core.request_options import RequestOptions\n",- "import openai\n",- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "MULTION_API_KEY = os.getenv(\"MULTION_API_KEY\") or \"<your_multion_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\"\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\""- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Tracking MultiOn events with AgentOps\n",- "\n",- "When an `agentops_api_key` is provided, MultiOn will automatically start an AgentOps session and record events."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "multion = MultiOn(\n",- " api_key=MULTION_API_KEY,\n",- " agentops_api_key=AGENTOPS_API_KEY,\n",- ")\n",- "cmd = \"what three things do i get with agentops\"\n",- "request_options = RequestOptions(timeout_in_seconds=60, max_retries=4, additional_headers={\"test\": \"ing\"})\n",- "\n",- "browse_response = multion.browse(\n",- " cmd=\"what three things do i get with agentops\",\n",- " url=\"https://www.agentops.ai/\",\n",- " max_steps=4,\n",- " include_screenshot=True,\n",- " request_options=request_options,\n",- ")\n",- "\n",- "print(browse_response.message)\n",- "\n",- "# End session to see your dashboard\n",- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Linking MultiOn events to an existing AgentOps session\n",- "When running `agentops.init()`, be sure to set `auto_start_session=False`. MultiOn will automatically launch AgentOps sessions by default, but by setting auto start to false, you can configure your AgentOps client independently."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, auto_start_session=False, default_tags=[\"MultiOn browse example\"])"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now, we can launch a MultiOn browse event. This event will automatically get added to your AgentOps session."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "multion = MultiOn(\n",- " api_key=MULTION_API_KEY,\n",- " agentops_api_key=AGENTOPS_API_KEY,\n",- ")\n",- "cmd = \"what three things do i get with agentops\"\n",- "request_options = RequestOptions(timeout_in_seconds=60, max_retries=4, additional_headers={\"test\": \"ing\"})\n",- "\n",- "browse_response = multion.browse(\n",- " cmd=\"what three things do i get with agentops\",\n",- " url=\"https://www.agentops.ai/\",\n",- " max_steps=4,\n",- " include_screenshot=True,\n",- " request_options=request_options,\n",- ")\n",- "\n",- "print(browse_response.message)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's use OpenAI to summarize our output"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "messages = [\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": f\"Format this data as a markdown table: {browse_response.message}\",\n",- " }\n",- "]\n",- "client = openai.OpenAI()\n",- "response = client.chat.completions.create(messages=messages, model=\"gpt-3.5-turbo\")\n",- "\n",- "print(response.choices[0].message.content)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Check your session\n",- "Check your session on [AgentOps](https://app.agentops.ai). This session should include the MultiOn browse action and the OpenAI call.\n",- "\n",- ""- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3 (ipykernel)",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.5"- }- },- "nbformat": 4,- "nbformat_minor": 4-}diff --git a/examples/multion_examples/Sample_browsing_agent.ipynb b/examples/multion_examples/Sample_browsing_agent.ipynbdeleted file mode 100644index 514e7db8..00000000--- a/examples/multion_examples/Sample_browsing_agent.ipynb+++ /dev/null@@ -1,195 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "<h1>MultiOn Tracking Web Browse Actions</h1>\n",- "<img src=\"https://github.com/AgentOps-AI/agentops/blob/b4aac2d4b9fb16d6aa0a25aa9018210a94f1bef2/docs/logo/multion_integration.png?raw=true\" width=\"250px\" style=\"max-width: 100%; height: auto;\"/>\n",- " \n",- "Agents using MultiOn can launch and control remote or local web browsers to perform actions and retrieve context using natural language commands. With AgentOps, MultiOn evens such as browse, retrieve, and step are automatically tracked.\n",- "\n",- "Furthermore, events and LLM calls in your Python program will be tracked as well."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U multion\n",- "%pip install -U agentops\n",- "%pip install -U openai\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "from multion.client import MultiOn\n",- "from multion.core.request_options import RequestOptions\n",- "import openai\n",- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "MULTION_API_KEY = os.getenv(\"MULTION_API_KEY\") or \"<your_multion_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\"\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\""- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Create an AgentOps session\n",- "When running `agentops.init()`, be sure to set `auto_start_session=False`. MultiOn will automatically launch AgentOps sessions by default, but by setting auto start to false, you can configure your AgentOps client independently."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.init(AGENTOPS_API_KEY, auto_start_session=False, default_tags=[\"MultiOn browse example\"])"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now, we can launch a MultiOn browse event. This event will automatically get added to your AgentOps session."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "multion = MultiOn(\n",- " api_key=MULTION_API_KEY,\n",- " agentops_api_key=AGENTOPS_API_KEY,\n",- ")\n",- "cmd = \"what three things do i get with agentops\"\n",- "request_options = RequestOptions(timeout_in_seconds=60, max_retries=4, additional_headers={\"test\": \"ing\"})\n",- "\n",- "browse_response = multion.browse(\n",- " cmd=\"what three things do i get with agentops\",\n",- " url=\"https://www.agentops.ai/\",\n",- " max_steps=4,\n",- " include_screenshot=True,\n",- " request_options=request_options,\n",- ")\n",- "\n",- "print(browse_response.message)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's use OpenAI to summarize our output"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "messages = [\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": f\"Format this data as a markdown table: {browse_response.message}\",\n",- " }\n",- "]\n",- "client = openai.OpenAI()\n",- "response = client.chat.completions.create(messages=messages, model=\"gpt-3.5-turbo\")\n",- "\n",- "print(response.choices[0].message.content)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# End session to see your dashboard\n",- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Check your session\n",- "Check your session on [AgentOps](https://app.agentops.ai). This session should include the MultiOn browse action and the OpenAI call.\n",- "\n",- ""- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3 (ipykernel)",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.5"- }- },- "nbformat": 4,- "nbformat_minor": 4-}diff --git a/examples/multion_examples/Step_by_step_web_browsing.ipynb b/examples/multion_examples/Step_by_step_web_browsing.ipynbdeleted file mode 100644index acc081ca..00000000--- a/examples/multion_examples/Step_by_step_web_browsing.ipynb+++ /dev/null@@ -1,231 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# MultiOn Step Tracing\n",- "<img src=\"https://github.com/AgentOps-AI/agentops/blob/b4aac2d4b9fb16d6aa0a25aa9018210a94f1bef2/docs/logo/multion_integration.png?raw=true\" width=\"250px\" style=\"max-width: 100%; height: auto;\"/>\n",- " \n",- "With AgentOps, agent actions as well as MultiOn browse events will get tracked. MultiOn browse events automatically trace screenshots as well.\n",- "\n",- "This example shows how to use MultiOn's session creator to launch a self-directed browser agent that accomplishes a specified objective using Step Mode. MultiOn agents can either accomplish tasks fully autonomously or managed one step at a time. In this example, we will launch a MutliOn agent and manage each individual step. "- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U multion\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "import multion\n",- "from multion.client import MultiOn\n",- "from multion.sessions.types.sessions_step_request_browser_params import (\n",- " SessionsStepRequestBrowserParams,\n",- ")\n",- "from multion.core.request_options import RequestOptions\n",- "import os\n",- "from dotenv import load_dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "MULTION_API_KEY = os.getenv(\"MULTION_API_KEY\") or \"<your_multion_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Session streaming\n",- "In this example, we'll use MultiOn to stream individual steps to accomplish a task. To track your runs in the AgentOps dashboard, specify an `agentops_api_key` when initializing `MultiOn()`\n",- "\n",- "You can run MultiOn without running `agentops.init()`. However, you will only see events from MultiOn, and not any from your own agent.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "url = \"https://www.agentops.ai/\"\n",- "cmd = \"what three things do i get with agentops\"\n",- "create_session_response = multion.sessions.create(url=url)\n",- "session_id = create_session_response.session_id\n",- "print(create_session_response.message)\n",- "browser_params = SessionsStepRequestBrowserParams(height=1.1, width=1.1)\n",- "request_options = RequestOptions(timeout_in_seconds=60, max_retries=2, additional_headers={\"test\": \"ing\"})\n",- "step_session_response = multion.sessions.step(\n",- " session_id=session_id,\n",- " cmd=cmd,\n",- " url=url,\n",- " browser_params=browser_params,\n",- " include_screenshot=True,\n",- " request_options=request_options,\n",- ")\n",- "print(step_session_response.message)\n",- "\n",- "while step_session_response.status == \"CONTINUE\":\n",- " step_session_response = multion.sessions.step(\n",- " session_id=session_id,\n",- " cmd=cmd,\n",- " url=url,\n",- " include_screenshot=True,\n",- " )\n",- " print(step_session_response.message)\n",- "\n",- "if step_session_response.status == \"DONE\":\n",- " print(\"task completed\")\n",- "\n",- "get_screenshot = multion.sessions.screenshot(session_id=session_id)\n",- "close_session_response = multion.sessions.close(session_id=session_id)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Step Stream\n",- "Step stream is just like step, but it streams responses in the same way a streamed LLM response is received. Instead of waiting for the entire step to complete, MultiOn will return work in progress. To track your runs in the AgentOps dashboard, specify an `agentops_api_key` when initializing `MultiOn()`"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {- "scrolled": true- },- "outputs": [],- "source": [- "import multion\n",- "from multion.sessions.types.sessions_step_stream_request_browser_params import (\n",- " SessionsStepStreamRequestBrowserParams,\n",- ")\n",- "from multion.core.request_options import RequestOptions\n",- "import os\n",- "\n",- "multion = MultiOn(\n",- " api_key=MULTION_API_KEY,\n",- " agentops_api_key=AGENTOPS_API_KEY,\n",- ")\n",- "\n",- "url = \"https://www.agentops.ai/\"\n",- "cmd = \"what three things do i get with agentops\"\n",- "create_session_response = multion.sessions.create(url=url)\n",- "session_id = create_session_response.session_id\n",- "print(create_session_response.message)\n",- "browser_params = SessionsStepStreamRequestBrowserParams(height=1.1, width=1.1)\n",- "request_options = RequestOptions(timeout_in_seconds=60, max_retries=2, additional_headers={\"test\": \"ing\"})\n",- "step_session_response = multion.sessions.step_stream(\n",- " session_id=session_id,\n",- " cmd=cmd,\n",- " url=url,\n",- " browser_params=browser_params,\n",- " include_screenshot=True,\n",- " request_options=request_options,\n",- ")\n",- "\n",- "for chunk in step_session_response:\n",- " if chunk.type == \"final_event\":\n",- " break\n",- " print(chunk.delta[\"content\"])\n",- "\n",- "while chunk.delta[\"status\"] == \"CONTINUE\":\n",- " step_session_response = multion.sessions.step_stream(\n",- " session_id=session_id,\n",- " cmd=cmd,\n",- " url=url,\n",- " include_screenshot=True,\n",- " )\n",- " for chunk in step_session_response:\n",- " if chunk.type == \"final_event\":\n",- " break\n",- " print(chunk.delta[\"content\"])\n",- "\n",- "if chunk.delta[\"status\"] == \"DONE\":\n",- " print(\"task completed\")\n",- "\n",- "get_screenshot = multion.sessions.screenshot(session_id=session_id)\n",- "close_session_response = multion.sessions.close(session_id=session_id)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Check your session\n",- "Check your session on [AgentOps](https://app.agentops.ai)\n",- "\n",- "\n",- "\n",- ""- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3 (ipykernel)",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.5"- }- },- "nbformat": 4,- "nbformat_minor": 4-}diff --git a/examples/multion_examples/Webpage_data_retrieval.ipynb b/examples/multion_examples/Webpage_data_retrieval.ipynbdeleted file mode 100644index 1d193200..00000000--- a/examples/multion_examples/Webpage_data_retrieval.ipynb+++ /dev/null@@ -1,139 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# MultiOn Autonomous Session Tracing\n",- "<img src=\"https://github.com/AgentOps-AI/agentops/blob/b4aac2d4b9fb16d6aa0a25aa9018210a94f1bef2/docs/logo/multion_integration.png?raw=true\" width=\"250px\" style=\"max-width: 100%; height: auto;\"/>\n",- " \n",- "With AgentOps, agent actions as well as MultiOn retrieve events will get tracked. MultiOn browse events automatically trace screenshots as well.\n",- "\n",- "This example shows how to use MultiOn's session creator to launch a self-directed browser agent that accomplishes a specified objective."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U multion\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "import multion\n",- "import os\n",- "from dotenv import load_dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "MULTION_API_KEY = os.getenv(\"MULTION_API_KEY\") or \"<your_multion_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now let's use MultiOn's Retrieve functionality to retrieve data from a webpage."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "cmd = \"what three things do i get with agentops\"\n",- "url = \"https://www.agentops.ai/\"\n",- "\n",- "retrieve_response = multion.retrieve(cmd=cmd, url=url, fields=[\"price\"], include_screenshot=True)\n",- "print(retrieve_response.message)\n",- "\n",- "while retrieve_response.status == \"CONTINUE\":\n",- " retrieve_response = multion.retrieve(\n",- " cmd=cmd,\n",- " url=url,\n",- " fields=[\"price\"],\n",- " include_screenshot=True,\n",- " )\n",- " print(retrieve_response.message)\n",- "\n",- "if retrieve_response.status == \"DONE\":\n",- " print(\"task completed\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Check your session\n",- "Check your session on [AgentOps](https://app.agentops.ai). The Retrieve actions are automatically captured.\n",- "\n",- ""- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3 (ipykernel)",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.5"- }- },- "nbformat": 4,- "nbformat_minor": 4-}diff --git a/examples/ollama_examples/ollama_examples.ipynb b/examples/ollama_examples/ollama_examples.ipynbdeleted file mode 100644index 2973aeb8..00000000--- a/examples/ollama_examples/ollama_examples.ipynb+++ /dev/null@@ -1,205 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# AgentOps Ollama Integration\n",- "\n",- "This example demonstrates how to use AgentOps to monitor your Ollama LLM calls.\n",- "\n",- "First let's install the required packages\n",- "\n",- "> ⚠️ **Important**: Make sure you have Ollama installed and running locally before running this notebook. You can install it from [ollama.ai](https://ollama.com)."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U ollama\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": 2,- "metadata": {},- "outputs": [],- "source": [- "import ollama\n",- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll set our API keys. For Ollama, we'll need to make sure Ollama is running locally.\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": 3,- "metadata": {},- "outputs": [],- "source": [- "# Let's load our environment variables\n",- "load_dotenv()\n",- "\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Initialize AgentOps with some default tags\n",- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"ollama-example\"])"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now let's make some basic calls to Ollama. Make sure you have pulled the model first, use the following or replace with whichever model you want to use."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "ollama.pull(\"mistral\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Basic completion,\n",- "response = ollama.chat(\n",- " model=\"mistral\",\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"What are the benefits of using AgentOps for monitoring LLMs?\",\n",- " }\n",- " ],\n",- ")\n",- "print(response[\"message\"][\"content\"])"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's try streaming responses as well"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Streaming Example\n",- "stream = ollama.chat(\n",- " model=\"mistral\",\n",- " messages=[\n",- " {\n",- " \"role\": \"user\",\n",- " \"content\": \"Write a haiku about monitoring AI agents\",\n",- " }\n",- " ],\n",- " stream=True,\n",- ")\n",- "\n",- "for chunk in stream:\n",- " print(chunk[\"message\"][\"content\"], end=\"\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Conversation Example\n",- "messages = [\n",- " {\"role\": \"user\", \"content\": \"What is AgentOps?\"},\n",- " {\"role\": \"assistant\", \"content\": \"AgentOps is a monitoring and observability platform for LLM applications.\"},\n",- " {\"role\": \"user\", \"content\": \"Can you give me 3 key features?\"},\n",- "]\n",- "\n",- "response = ollama.chat(model=\"mistral\", messages=messages)\n",- "print(response[\"message\"][\"content\"])"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "> 💡 **Note**: In production environments, you should add proper error handling around the Ollama calls and use `agentops.end_session(\"Error\")` when exceptions occur."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Finally, let's end our AgentOps session"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "gpt_desk",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.11.9"- }- },- "nbformat": 4,- "nbformat_minor": 2-}\ No newline at end of filediff --git a/examples/openai-gpt.ipynb b/examples/openai-gpt.ipynbdeleted file mode 100644index 0ec2aeab..00000000--- a/examples/openai-gpt.ipynb+++ /dev/null@@ -1,293 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "212799f5255f3513",- "metadata": {- "collapsed": false- },- "source": [- "# AgentOps Basic Monitoring \n",- "This is an example of how to use the AgentOps library for basic Agent monitoring with OpenAI's GPT"- ]- },- {- "cell_type": "markdown",- "id": "3b2bf0da",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "88c8f60d",- "metadata": {},- "outputs": [],- "source": [- "%pip install -U openai\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "id": "fa9151e5",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "c51dcbda80eb8c53",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "from openai import OpenAI\n",- "import agentops\n",- "import os\n",- "from dotenv import load_dotenv"- ]- },- {- "cell_type": "markdown",- "id": "33bb35b82e9a8f71",- "metadata": {- "collapsed": false- },- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "cbc5d13679e269dc",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "markdown",- "id": "82fdff21ff00ef37",- "metadata": {- "collapsed": false- },- "source": [- "The AgentOps library is designed to be a plug-and-play replacement for the OpenAI Client, maximizing use with minimal install effort."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "5d424a02e30ce7f4",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "openai = OpenAI(api_key=OPENAI_API_KEY)\n",- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"openai-gpt-notebook\"])"- ]- },- {- "cell_type": "markdown",- "id": "c77f4f920c07e3e6",- "metadata": {- "collapsed": false- },- "source": [- "Now just use OpenAI as you would normally!"- ]- },- {- "cell_type": "markdown",- "id": "ca7011cf1ba076c9",- "metadata": {- "collapsed": false- },- "source": [- "## Single Session with ChatCompletion"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "2704d6d625efa77f",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "message = [{\"role\": \"user\", \"content\": \"Write a 12 word poem about secret agents.\"}]\n",- "response = openai.chat.completions.create(model=\"gpt-3.5-turbo\", messages=message, temperature=0.5, stream=False)\n",- "print(response.choices[0].message.content)"- ]- },- {- "cell_type": "markdown",- "id": "ce4965fc1614b5fe",- "metadata": {- "collapsed": false- },- "source": [- "Make sure to end your session with a `Result` (Success|Fail|Indeterminate) for better tracking"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "537abd77cd0e0d25",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "id": "dd69580627842705",- "metadata": {- "collapsed": false- },- "source": [- "Now if you check the AgentOps dashboard, you should see information related to this run!"- ]- },- {- "cell_type": "markdown",- "id": "b824bb935c7b7f80",- "metadata": {- "collapsed": false- },- "source": [- "# Events\n",- "Additionally, you can track custom events via AgentOps.\n",- "Let's start a new session and record some events "- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "544c8f1bdb8c6e4b",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "# Create new session\n",- "agentops.start_session(tags=[\"openai-gpt-notebook-events\"])"- ]- },- {- "cell_type": "markdown",- "id": "e94f1b56",- "metadata": {},- "source": [- "The easiest way to record actions is through the use of AgentOps' decorators"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "b45754a57148eed1",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "from agentops import record_action\n",- "\n",- "\n",- "@record_action(\"add numbers\")\n",- "def add(x, y):\n",- " return x + y\n",- "\n",- "\n",- "add(2, 4)"- ]- },- {- "cell_type": "markdown",- "id": "1e3cc512",- "metadata": {},- "source": [- "We can also manually craft an event exactly the way we want"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "2ac84c35",- "metadata": {},- "outputs": [],- "source": [- "from agentops import ActionEvent\n",- "\n",- "message = ({\"role\": \"user\", \"content\": \"Hello\"},)\n",- "response = openai.chat.completions.create(model=\"gpt-3.5-turbo\", messages=message, temperature=0.5)\n",- "\n",- "if \"hello\" in str(response.choices[0].message.content).lower():\n",- " agentops.record(\n",- " ActionEvent(\n",- " action_type=\"Agent says hello\",\n",- " logs=str(message),\n",- " returns=str(response.choices[0].message.content),\n",- " )\n",- " )"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "4ca2b49fc06adddb",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.5"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/openai/README.md b/examples/openai/README.mdnew file mode 100644index 00000000..598fa80e--- /dev/null+++ b/examples/openai/README.md@@ -0,0 +1,46 @@+# OpenAI Examples with AgentOps++This directory contains examples of using the OpenAI API with AgentOps instrumentation.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops openai+ ```++## Examples++### 1. Multi-Tool Orchestration++Example: `multi_tool_orchestration`+This example demonstrates:+- Complex tool orchestration++### 2. Asynchronous OpenAI API calls++Example: `openai_example_async`++This example demonstrates:+- Asynchronous OpenAI API calls++### 3. Synchronous OpenAI API calls++Example: `openai_example_sync`++This example demonstrates:+- Synchronous OpenAI API calls++### 4. Web Search++Example: `web_search`++This example demonstrates:+- Web search functionality++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your OpenAI calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/openai_responses/multi_tool_orchestration.ipynb b/examples/openai/multi_tool_orchestration.ipynbsimilarity index 94%rename from examples/openai_responses/multi_tool_orchestration.ipynbrename to examples/openai/multi_tool_orchestration.ipynbindex d8e00236..e7dd3047 100644--- a/examples/openai_responses/multi_tool_orchestration.ipynb+++ b/examples/openai/multi_tool_orchestration.ipynb@@ -22,7 +22,13 @@"outputs": [],"source": ["# Install required dependencies\n",- "%pip install datasets tqdm pandas pinecone openai"+ "%pip install agentops\n",+ "%pip install openai\n",+ "%pip install datasets\n",+ "%pip install tqdm \n",+ "%pip install pandas\n",+ "%pip install pinecone\n",+ "%pip install python-dotenv"]},{@@ -41,25 +47,21 @@"import string\n","from openai import OpenAI\n","import agentops\n",- "\n",- "# Import Pinecone client and related specifications.\n","from pinecone import Pinecone\n","from pinecone import ServerlessSpec"]},{"cell_type": "code",- "execution_count": 2,+ "execution_count": null,"metadata": {},"outputs": [],"source": ["load_dotenv()\n","\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\")\n",- "AGENTOPS_API_ENDPOINT = os.getenv(\"AGENTOPS_API_ENDPOINT\")\n",- "AGENTOPS_EXPORTER_ENDPOINT = os.getenv(\"AGENTOPS_EXPORTER_ENDPOINT\")\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\")\n",- "PINECONE_API_KEY = os.getenv(\"PINECONE_API_KEY\")"+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")\n",+ "os.environ[\"PINECONE_API_KEY\"] = os.getenv(\"PINECONE_API_KEY\", \"your_pinecone_api_key_here\")"]},{@@ -68,18 +70,12 @@"metadata": {},"outputs": [],"source": [- "# Import AgentOps client and initialize with your API key.\n",- "\n",- "agentops.init(\n",- " api_key=AGENTOPS_API_KEY,\n",- " endpoint=AGENTOPS_API_ENDPOINT,\n",- " exporter_endpoint=AGENTOPS_EXPORTER_ENDPOINT,\n",- " tags=[\"openai\", \"responses\", \"multi-tool\", \"rag\", \"test\"],\n",+ "agentops.init(auto_start_session=True)\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"Multi-Tool Orchestration with RAG\",\n",+ " tags=[\"multi-tool-orchestration-rag-demo\", \"openai-responses\", \"agentops-example\"],\n",")\n",- "\n",- "# Import OpenAI client and initialize with your API key.\n",- "\n",- "client = OpenAI(api_key=OPENAI_API_KEY)"+ "client = OpenAI()"]},{@@ -143,7 +139,7 @@"outputs": [],"source": ["# Initialize Pinecone using your API key.\n",- "pc = Pinecone(api_key=PINECONE_API_KEY)\n",+ "pc = Pinecone(api_key=os.environ[\"PINECONE_API_KEY\"])\n","\n","# Define the Pinecone serverless specification.\n","AWS_REGION = \"us-east-1\"\n",@@ -200,13 +196,6 @@" index.upsert(vectors=vectors)"]},- {- "cell_type": "markdown",- "metadata": {},- "source": [- ""- ]- },{"cell_type": "markdown","metadata": {},@@ -218,7 +207,7 @@},{"cell_type": "code",- "execution_count": 9,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -297,7 +286,7 @@},{"cell_type": "code",- "execution_count": 12,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -331,7 +320,7 @@},{"cell_type": "code",- "execution_count": 13,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -558,7 +547,8 @@"outputs": [],"source": ["# print the final answer\n",- "print(response_2.output_text)"+ "print(response_2.output_text)\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"]},{@@ -572,7 +562,7 @@],"metadata": {"kernelspec": {- "display_name": ".venv",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},diff --git a/examples/openai/multi_tool_orchestration.py b/examples/openai/multi_tool_orchestration.pynew file mode 100644index 00000000..552751b8--- /dev/null+++ b/examples/openai/multi_tool_orchestration.py@@ -0,0 +1,345 @@+# ### Multi-Tool Orchestration with RAG approach using OpenAI's Responses API+#+# This cookbook guides you through building dynamic, multi-tool workflows using OpenAI's Responses API. It demonstrates how to implement a Retrieval-Augmented Generation (RAG) approach that intelligently routes user queries to the appropriate in-built or external tools. Whether your query calls for general knowledge or requires accessing specific internal context from a vector database (like Pinecone), this guide shows you how to integrate function calls, web searches in-built tool, and leverage document retrieval to generate accurate, context-aware responses.+# # Install required dependencies+# %pip install agentops+# %pip install openai+# %pip install datasets+# %pip install tqdm+# %pip install pandas+# %pip install pinecone+# %pip install python-dotenv+import os+from dotenv import load_dotenv+import time+from tqdm.auto import tqdm+from pandas import DataFrame+from datasets import load_dataset+import random+import string+from openai import OpenAI+import agentops+from pinecone import Pinecone+from pinecone import ServerlessSpec++load_dotenv()++os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+os.environ["PINECONE_API_KEY"] = os.getenv("PINECONE_API_KEY", "your_pinecone_api_key_here")++agentops.init(auto_start_session=True)+tracer = agentops.start_trace(+ trace_name="Multi-Tool Orchestration with RAG",+ tags=["multi-tool-orchestration-rag-demo", "openai-responses", "agentops-example"],+)+client = OpenAI()++# In this example we use a sample medical reasoning dataset from Hugging Face. We convert the dataset into a Pandas DataFrame and merge the “Question” and “Response” columns into a single string. This merged text is used for embedding and later stored as metadata.+# Load the dataset (ensure you're logged in with huggingface-cli if needed)+ds = load_dataset("FreedomIntelligence/medical-o1-reasoning-SFT", "en", split="train[:100]", trust_remote_code=True)+ds_dataframe = DataFrame(ds)++# Merge the Question and Response columns into a single string.+ds_dataframe["merged"] = ds_dataframe.apply(+ lambda row: f"Question: {row['Question']} Answer: {row['Response']}", axis=1+)+print("Example merged text:", ds_dataframe["merged"].iloc[0])++# ### Create a Pinecone Index Based on the Dataset+# Use the dataset itself to determine the embedding dimensionality. For example, compute one embedding from the merged column and then create the index accordingly.+MODEL = "text-embedding-3-small" # Replace with your production embedding model if needed++# Compute an embedding for the first document to obtain the embedding dimension.+sample_embedding_resp = client.embeddings.create(input=[ds_dataframe["merged"].iloc[0]], model=MODEL)+embed_dim = len(sample_embedding_resp.data[0].embedding)+print(f"Embedding dimension: {embed_dim}")++# Initialize Pinecone using your API key.+pc = Pinecone(api_key=os.environ["PINECONE_API_KEY"])++# Define the Pinecone serverless specification.+AWS_REGION = "us-east-1"+spec = ServerlessSpec(cloud="aws", region=AWS_REGION)++# Create a random index name with lower case alphanumeric characters and '-'+index_name = "pinecone-index-" + "".join(random.choices(string.ascii_lowercase + string.digits, k=10))++# Create the index if it doesn't already exist.+if index_name not in pc.list_indexes().names():+ pc.create_index(index_name, dimension=embed_dim, metric="dotproduct", spec=spec)++# Connect to the index.+index = pc.Index(index_name)+time.sleep(1)+print("Index stats:", index.describe_index_stats())++# #### Upsert the Dataset into Pinecone index+#+# Process the dataset in batches, generate embeddings for each merged text, prepare metadata (including separate Question and Answer fields), and upsert each batch into the index. You may also update metadata for specific entries if needed.+batch_size = 32+for i in tqdm(range(0, len(ds_dataframe["merged"]), batch_size), desc="Upserting to Pinecone"):+ i_end = min(i + batch_size, len(ds_dataframe["merged"]))+ lines_batch = ds_dataframe["merged"][i:i_end]+ ids_batch = [str(n) for n in range(i, i_end)]++ # Create embeddings for the current batch.+ res = client.embeddings.create(input=[line for line in lines_batch], model=MODEL)+ embeds = [record.embedding for record in res.data]++ # Prepare metadata by extracting original Question and Answer.+ meta = []+ for record in ds_dataframe.iloc[i:i_end].to_dict("records"):+ q_text = record["Question"]+ a_text = record["Response"]+ # Optionally update metadata for specific entries.+ meta.append({"Question": q_text, "Answer": a_text})++ # Upsert the batch into Pinecone.+ vectors = list(zip(ids_batch, embeds, meta))+ index.upsert(vectors=vectors)+++# ### Query the Pinecone Index+#+# Create a natural language query, compute its embedding, and perform a similarity search on the Pinecone index. The returned results include metadata that provides context for generating answers.+def query_pinecone_index(client, index, model, query_text):+ # Generate an embedding for the query.+ query_embedding = client.embeddings.create(input=query_text, model=model).data[0].embedding++ # Query the index and return top 5 matches.+ res = index.query(vector=[query_embedding], top_k=5, include_metadata=True)+ print("Query Results:")+ for match in res["matches"]:+ print(+ f"{match['score']:.2f}: {match['metadata'].get('Question', 'N/A')} - {match['metadata'].get('Answer', 'N/A')}"+ )+ return res+++# Example usage with a different query from the train/test set+query = (+ "A 45-year-old man with a history of alcohol use presents with symptoms including confusion, ataxia, and ophthalmoplegia. "+ "What is the most likely diagnosis and the recommended treatment?"+)+query_pinecone_index(client, index, MODEL, query)++# ### Generate a Response Using the Retrieved Context+#+# Select the best matching result from your query results and use the OpenAI Responses API to generate a final answer by combining the retrieved context with the original question.+# Retrieve and concatenate top 3 match contexts.+matches = index.query(+ vector=[client.embeddings.create(input=query, model=MODEL).data[0].embedding], top_k=3, include_metadata=True+)["matches"]++context = "\n\n".join(+ f"Question: {m['metadata'].get('Question', '')}\nAnswer: {m['metadata'].get('Answer', '')}" for m in matches+)++# Use the context to generate a final answer.+response = client.responses.create(+ model="gpt-4o",+ input=f"Provide the answer based on the context: {context} and the question: {query} as per the internal knowledge base",+)+print("\nFinal Answer:")+print(response.output_text)++# ### Orchestrate Multi-Tool Calls+#+# Now, we'll define the built-in function available through the Responses API, including the ability to invoke the external Vector Store - Pinecone as an example.+#+# *Web Search Preview Tool*: Enables the model to perform live web searches and preview the results. This is ideal for retrieving real-time or up-to-date information from the internet.+#+# *Pinecone Search Tool*: Allows the model to query a vector database using semantic search. This is especially useful for retrieving relevant documents—such as medical literature or other domain-specific content—that have been stored in a vectorized format.+# # Tools definition: The list of tools includes:+# # - A web search preview tool.+# # - A Pinecone search tool for retrieving medical documents.+#+# # Define available tools.+tools = [+ {+ "type": "web_search_preview",+ "user_location": {"type": "approximate", "country": "US", "region": "California", "city": "SF"},+ "search_context_size": "medium",+ },+ {+ "type": "function",+ "name": "PineconeSearchDocuments",+ "description": "Search for relevant documents based on the medical question asked by the user that is stored within the vector database using a semantic query.",+ "parameters": {+ "type": "object",+ "properties": {+ "query": {"type": "string", "description": "The natural language query to search the vector database."},+ "top_k": {"type": "integer", "description": "Number of top results to return.", "default": 3},+ },+ "required": ["query"],+ "additionalProperties": False,+ },+ },+]++# # Example queries that the model should route appropriately.+queries = [+ {"query": "Who won the cricket world cup in 1983?"},+ {"query": "What is the most common cause of death in the United States according to the internet?"},+ {+ "query": (+ "A 7-year-old boy with sickle cell disease is experiencing knee and hip pain, "+ "has been admitted for pain crises in the past, and now walks with a limp. "+ "His exam shows a normal, cool hip with decreased range of motion and pain with ambulation. "+ "What is the most appropriate next step in management according to the internal knowledge base?"+ )+ },+]++# # Process each query dynamically.+for item in queries:+ input_messages = [{"role": "user", "content": item["query"]}]+ print("\n🌟--- Processing Query ---🌟")+ print(f"🔍 **User Query:** {item['query']}")++ # Call the Responses API with tools enabled and allow parallel tool calls.+ response = client.responses.create(+ model="gpt-4o",+ input=[+ {+ "role": "system",+ "content": "When prompted with a question, select the right tool to use based on the question.",+ },+ {"role": "user", "content": item["query"]},+ ],+ tools=tools,+ parallel_tool_calls=True,+ )++ print("\n✨ **Initial Response Output:**")+ print(response.output)++ # Determine if a tool call is needed and process accordingly.+ if response.output:+ tool_call = response.output[0]+ if tool_call.type in ["web_search_preview", "function_call"]:+ tool_name = tool_call.name if tool_call.type == "function_call" else "web_search_preview"+ print(f"\n🔧 **Model triggered a tool call:** {tool_name}")++ if tool_name == "PineconeSearchDocuments":+ print("🔍 **Invoking PineconeSearchDocuments tool...**")+ res = query_pinecone_index(client, index, MODEL, item["query"])+ if res["matches"]:+ best_match = res["matches"][0]["metadata"]+ result = f"**Question:** {best_match.get('Question', 'N/A')}\n**Answer:** {best_match.get('Answer', 'N/A')}"+ else:+ result = "**No matching documents found in the index.**"+ print("✅ **PineconeSearchDocuments tool invoked successfully.**")+ else:+ print("🔍 **Invoking simulated web search tool...**")+ result = "**Simulated web search result.**"+ print("✅ **Simulated web search tool invoked successfully.**")++ # Append the tool call and its output back into the conversation.+ input_messages.append(tool_call)+ input_messages.append({"type": "function_call_output", "call_id": tool_call.call_id, "output": str(result)})++ # Get the final answer incorporating the tool's result.+ final_response = client.responses.create(+ model="gpt-4o", input=input_messages, tools=tools, parallel_tool_calls=True+ )+ print("\n💡 **Final Answer:**")+ print(final_response.output_text)+ else:+ # If no tool call is triggered, print the response directly.+ print("💡 **Final Answer:**")+ print(response.output_text)++# As shown above, depending on the query, appropriate tool is invoked in order to determine the optimal response.+#+# For instance, looking at the third example, when the model triggers the tool named "PineconeSearchDocuments", the code calls `query_pinecone_index` with the current query and then extracts the best match (or an appropriate context) as the result. For non health related inqueries or queries where explicit internet search is asked, the code calls the web_search_call function and for other queries, it may choose to not call any tool and rather provide a response based on the question under consideration.+#+# Finally, the tool call and its output are appended to the conversation, and the final answer is generated by the Responses API.+# ### Multi-tool orchestration flow+#+# Now let us try to modify the input query and the system instructions to the responses API in order to follow a tool calling sequence and generate the output.+# # Process one query as an example to understand the tool calls and function calls as part of the response output+item = "What is the most common cause of death in the United States"++# Initialize input messages with the user's query.+input_messages = [{"role": "user", "content": item}]+print("\n🌟--- Processing Query ---🌟")+print(f"🔍 **User Query:** {item}")++# Call the Responses API with tools enabled and allow parallel tool calls.+print("\n🔧 **Calling Responses API with Tools Enabled**")+print("\n🕵️♂️ **Step 1: Web Search Call**")+print(" - Initiating web search to gather initial information.")+print("\n📚 **Step 2: Pinecone Search Call**")+print(" - Querying Pinecone to find relevant examples from the internal knowledge base.")++response = client.responses.create(+ model="gpt-4o",+ input=[+ {+ "role": "system",+ "content": "Every time it's prompted with a question, first call the web search tool for results, then call `PineconeSearchDocuments` to find real examples in the internal knowledge base.",+ },+ {"role": "user", "content": item},+ ],+ tools=tools,+ parallel_tool_calls=True,+)++# Print the initial response output.+print("input_messages", input_messages)++print("\n✨ **Initial Response Output:**")+print(response.output)++# # Understand the tool calls and function calls as part of the response output+#+# import pandas as pd+#+# # Create a list to store the tool call and function call details+# tool_calls = []+#+# # Iterate through the response output and collect the details+# for i in response.output:+# tool_calls.append(+# {+# "Type": i.type,+# "Call ID": i.call_id if hasattr(i, "call_id") else i.id if hasattr(i, "id") else "N/A",+# "Output": str(i.output) if hasattr(i, "output") else "N/A",+# "Name": i.name if hasattr(i, "name") else "N/A",+# }+# )+#+# # Convert the list to a DataFrame for tabular display+# df_tool_calls = pd.DataFrame(tool_calls)+#+# # Display the DataFrame+# df_tool_calls+tool_call_1 = response.output[0]+print(tool_call_1)+print(tool_call_1.id)++tool_call_2 = response.output[2]+print(tool_call_2)+print(tool_call_2.call_id)++# # append the tool call and its output back into the conversation.+input_messages.append(response.output[2])+input_messages.append({"type": "function_call_output", "call_id": tool_call_2.call_id, "output": str(result)})+print(input_messages)++# # Get the final answer incorporating the tool's result.+print("\n🔧 **Calling Responses API for Final Answer**")++response_2 = client.responses.create(+ model="gpt-4o",+ input=input_messages,+)+print(response_2)++# # print the final answer+print(response_2.output_text)+agentops.end_trace(tracer, end_state="Success")++# Here, we have seen how to utilize OpenAI's Responses API to implement a Retrieval-Augmented Generation (RAG) approach with multi-tool calling capabilities. It showcases an example where the model selects the appropriate tool based on the input query: general questions may be handled by built-in tools such as web-search, while specific medical inquiries related to internal knowledge are addressed by retrieving context from a vector database (such as Pinecone) via function calls. Additonally, we have showcased how multiple tool calls can be sequentially combined to generate a final response based on our instructions provided to responses API. Happy coding!diff --git a/examples/openai_examples/openai_example_async.ipynb b/examples/openai/openai_example_async.ipynbsimilarity index 83%rename from examples/openai_examples/openai_example_async.ipynbrename to examples/openai/openai_example_async.ipynbindex 0a87cc23..b40ccf43 100644--- a/examples/openai_examples/openai_example_async.ipynb+++ b/examples/openai/openai_example_async.ipynb@@ -24,8 +24,10 @@"metadata": {},"outputs": [],"source": [- "%pip install -U openai\n",- "%pip install -U agentops"+ "# Install required dependencies\n",+ "%pip install agentops\n",+ "%pip install openai\n",+ "%pip install python-dotenv"]},{@@ -37,7 +39,7 @@},{"cell_type": "code",- "execution_count": 1,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -56,13 +58,13 @@},{"cell_type": "code",- "execution_count": 2,+ "execution_count": null,"metadata": {},"outputs": [],"source": ["load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")"]},{@@ -78,7 +80,11 @@"metadata": {},"outputs": [],"source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"openai-async-example\"])"+ "agentops.init(auto_start_session=True)\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"OpenAI Async Example\", tags=[\"openai-async-example\", \"openai\", \"agentops-example\"]\n",+ ")\n",+ "client = AsyncOpenAI()"]},{@@ -92,12 +98,10 @@},{"cell_type": "code",- "execution_count": 4,+ "execution_count": null,"metadata": {},"outputs": [],"source": [- "client = AsyncOpenAI(api_key=OPENAI_API_KEY)\n",- "\n","system_prompt = \"\"\"\n","You are a master storyteller, with the ability to create vivid and engaging stories.\n","You have experience in writing for children and adults alike.\n",@@ -120,7 +124,7 @@},{"cell_type": "code",- "execution_count": 5,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -159,7 +163,7 @@},{"cell_type": "code",- "execution_count": 7,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -183,6 +187,15 @@"await main_stream()"]},+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },{"cell_type": "markdown","metadata": {},@@ -194,7 +207,7 @@],"metadata": {"kernelspec": {- "display_name": "Python 3",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -208,7 +221,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.11.9"+ "version": "3.11.11"}},"nbformat": 4,diff --git a/examples/openai/openai_example_async.py b/examples/openai/openai_example_async.pynew file mode 100644index 00000000..7356adba--- /dev/null+++ b/examples/openai/openai_example_async.py@@ -0,0 +1,80 @@+# OpenAI Async Example+#+# We are going to create a simple chatbot that creates stories based on a user provided image. The chatbot will use the gpt-4o-mini LLM to generate the story using a user prompt and its vision model to understand the image.+#+# We will track the chatbot with AgentOps and see how it performs!+# First let's install the required packages+# # Install required dependencies+# %pip install agentops+# %pip install openai+# %pip install python-dotenv+# Then import them+from openai import AsyncOpenAI+import agentops+import os+from dotenv import load_dotenv++# Next, we'll grab our API keys. You can use dotenv like below or however else you like to load environment variables+load_dotenv()+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")++# Next we initialize the AgentOps client.+agentops.init(auto_start_session=True)+tracer = agentops.start_trace(+ trace_name="OpenAI Async Example", tags=["openai-async-example", "openai", "agentops-example"]+)+client = AsyncOpenAI()++# And we are all set! Note the seesion url above. We will use it to track the chatbot.+#+# Let's create a simple chatbot that generates stories given an image and a user prompt.+system_prompt = """+You are a master storyteller, with the ability to create vivid and engaging stories.+You have experience in writing for children and adults alike.+You are given a prompt and you need to generate a story based on the prompt.+"""++user_prompt = [+ {"type": "text", "text": "Write a mystery thriller story based on your understanding of the provided image."},+ {+ "type": "image_url",+ "image_url": {"url": "https://www.cosy.sbg.ac.at/~pmeerw/Watermarking/lena_color.gif"},+ },+]++messages = [+ {"role": "system", "content": system_prompt},+ {"role": "user", "content": user_prompt},+]+++async def main():+ response = await client.chat.completions.create(+ model="gpt-4o-mini",+ messages=messages,+ )+ print(response.choices[0].message.content)+++# await main()+++# The response is a string that contains the story. We can track this with AgentOps by navigating to the trace url and viewing the run.+# ## Streaming Version+# We will demonstrate the streaming version of the API.+async def main_stream():+ stream = await client.chat.completions.create(+ model="gpt-4o-mini",+ messages=messages,+ stream=True,+ )+ async for chunk in stream:+ print(chunk.choices[0].delta.content or "", end="")+++# await main_stream()+agentops.end_trace(tracer, end_state="Success")++# Note that the response is a generator that yields chunks of the story. We can track this with AgentOps by navigating to the trace url and viewing the run.+# All done!diff --git a/examples/openai_examples/openai_example_sync.ipynb b/examples/openai/openai_example_sync.ipynbsimilarity index 82%rename from examples/openai_examples/openai_example_sync.ipynbrename to examples/openai/openai_example_sync.ipynbindex 42de829d..76728c29 100644--- a/examples/openai_examples/openai_example_sync.ipynb+++ b/examples/openai/openai_example_sync.ipynb@@ -24,8 +24,10 @@"metadata": {},"outputs": [],"source": [- "%pip install -U openai\n",- "%pip install -U agentops"+ "# Install required dependencies\n",+ "%pip install agentops\n",+ "%pip install openai\n",+ "%pip install python-dotenv"]},{@@ -37,7 +39,7 @@},{"cell_type": "code",- "execution_count": 1,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -56,13 +58,13 @@},{"cell_type": "code",- "execution_count": 2,+ "execution_count": null,"metadata": {},"outputs": [],"source": ["load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")"]},{@@ -78,7 +80,11 @@"metadata": {},"outputs": [],"source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"openai-sync-example\"])"+ "agentops.init(auto_start_session=True)\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"OpenAI Sync Example\", tags=[\"openai-sync-example\", \"openai\", \"agentops-example\"]\n",+ ")\n",+ "client = OpenAI()"]},{@@ -92,12 +98,10 @@},{"cell_type": "code",- "execution_count": 4,+ "execution_count": null,"metadata": {},"outputs": [],"source": [- "client = OpenAI(api_key=OPENAI_API_KEY)\n",- "\n","system_prompt = \"\"\"\n","You are a master storyteller, with the ability to create vivid and engaging stories.\n","You have experience in writing for children and adults alike.\n",@@ -157,6 +161,15 @@" print(chunk.choices[0].delta.content or \"\", end=\"\")"]},+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },{"cell_type": "markdown","metadata": {},@@ -168,7 +181,7 @@],"metadata": {"kernelspec": {- "display_name": "Python 3",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -182,7 +195,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.11.9"+ "version": "3.11.11"}},"nbformat": 4,diff --git a/examples/openai/openai_example_sync.py b/examples/openai/openai_example_sync.pynew file mode 100644index 00000000..617439e9--- /dev/null+++ b/examples/openai/openai_example_sync.py@@ -0,0 +1,67 @@+# OpenAI Sync Example+#+# We are going to create a simple chatbot that creates stories based on a prompt. The chatbot will use the gpt-4o-mini LLM to generate the story using a user prompt.+#+# We will track the chatbot with AgentOps and see how it performs!+# First let's install the required packages+# # Install required dependencies+# %pip install agentops+# %pip install openai+# %pip install python-dotenv+# Then import them+from openai import OpenAI+import agentops+import os+from dotenv import load_dotenv++# Next, we'll grab our API keys. You can use dotenv like below or however else you like to load environment variables+load_dotenv()+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")++# Next we initialize the AgentOps client.+agentops.init(auto_start_session=True)+tracer = agentops.start_trace(+ trace_name="OpenAI Sync Example", tags=["openai-sync-example", "openai", "agentops-example"]+)+client = OpenAI()++# And we are all set! Note the seesion url above. We will use it to track the chatbot.+#+# Let's create a simple chatbot that generates stories.+system_prompt = """+You are a master storyteller, with the ability to create vivid and engaging stories.+You have experience in writing for children and adults alike.+You are given a prompt and you need to generate a story based on the prompt.+"""++user_prompt = "Write a story about a cyber-warrior trapped in the imperial time period."++messages = [+ {"role": "system", "content": system_prompt},+ {"role": "user", "content": user_prompt},+]++response = client.chat.completions.create(+ model="gpt-4o-mini",+ messages=messages,+)++print(response.choices[0].message.content)++# The response is a string that contains the story. We can track this with AgentOps by navigating to the trace url and viewing the run.+# ## Streaming Version+# We will demonstrate the streaming version of the API.+stream = client.chat.completions.create(+ model="gpt-4o-mini",+ messages=messages,+ stream=True,+)++for chunk in stream:+ print(chunk.choices[0].delta.content or "", end="")++agentops.end_trace(tracer, end_state="Success")++# Note that the response is a generator that yields chunks of the story. We can track this with AgentOps by navigating to the trace url and viewing the run.+# All done!diff --git a/examples/openai_responses/web_search.ipynb b/examples/openai/web_search.ipynbsimilarity index 86%rename from examples/openai_responses/web_search.ipynbrename to examples/openai/web_search.ipynbindex aad16bea..0f994c1e 100644--- a/examples/openai_responses/web_search.ipynb+++ b/examples/openai/web_search.ipynb@@ -4,18 +4,18 @@"cell_type": "markdown","metadata": {},"source": [- "## What is the Responses API\n",+ "## Observing Responses API with AgentOps\n","\n","The Responses API is a new API that focuses on greater simplicity and greater expressivity when using our APIs. It is designed for multiple tools, multiple turns, and multiple modalities — as opposed to current APIs, which either have these features bolted onto an API designed primarily for text in and out (chat completions) or need a lot bootstrapping to perform simple actions (assistants api).\n","\n","Here I will show you a couple of new features that the Responses API has to offer and tie it all together at the end.\n",- "`responses` solves for a number of user painpoints with our current set of APIs. During our time with the completions API, we found that folks wanted:\n",+ "`responses` solves for a number of user pain-points with our current set of APIs. During our time with the completions API, we found that folks wanted:\n","\n","- the ability to easily perform multi-turn model interactions in a single API call\n","- to have access to our hosted tools (file_search, web_search, code_interpreter)\n","- granular control over the context sent to the model\n","\n",- "As models start to develop longer running reasoning and thinking capabilities, users will want an async-friendly and stateful primitive. Response solves for this. \n"+ "As models start to develop longer running reasoning and thinking capabilities, users will want an async-friendly and stateful primitive. Response solves for this. With AgentOps, we can easily observe the Responses API in action."]},{@@ -26,6 +26,18 @@"By design, on the surface, the Responses API is very similar to the Completions API."]},+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Install required dependencies\n",+ "%pip install agentops\n",+ "%pip install openai\n",+ "%pip install python-dotenv"+ ]+ },{"cell_type": "code","execution_count": null,@@ -34,30 +46,38 @@"source": ["from dotenv import load_dotenv\n","import os\n",+ "import json\n","import agentops\n",- "\n",+ "from openai import OpenAI"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": ["load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\")\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\")\n",- "\n",- "\n",- "agentops.init(api_key=AGENTOPS_API_KEY)"+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")"]},{"cell_type": "code",- "execution_count": 2,+ "execution_count": null,"metadata": {},"outputs": [],"source": [- "from openai import OpenAI\n",- "\n",- "client = OpenAI(api_key=OPENAI_API_KEY)"+ "agentops.init(auto_start_session=True)\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"OpenAI Responses Example\", tags=[\"openai-responses-example\", \"openai\", \"agentops-example\"]\n",+ ")\n",+ "client = OpenAI()"]},{"cell_type": "code",- "execution_count": 3,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -90,7 +110,6 @@"outputs": [],"source": ["fetched_response = client.responses.retrieve(response_id=response.id)\n",- "\n","print(fetched_response.output[0].content[0].text)"]},@@ -101,21 +120,13 @@"You can continue the conversation by referring to the previous response."]},- {- "cell_type": "code",- "execution_count": 6,- "metadata": {},- "outputs": [],- "source": [- "response_two = client.responses.create(model=\"gpt-4o-mini\", input=\"tell me another\", previous_response_id=response.id)"- ]- },{"cell_type": "code","execution_count": null,"metadata": {},"outputs": [],"source": [+ "response_two = client.responses.create(model=\"gpt-4o-mini\", input=\"tell me another\", previous_response_id=response.id)\n","print(response_two.output[0].content[0].text)"]},@@ -172,8 +183,6 @@"metadata": {},"outputs": [],"source": [- "import json\n",- "\n","print(json.dumps(response.output, default=lambda o: o.__dict__, indent=2))"]},@@ -227,9 +236,8 @@"metadata": {},"outputs": [],"source": [- "import json\n",- "\n",- "print(json.dumps(response_multimodal.__dict__, default=lambda o: o.__dict__, indent=4))"+ "print(json.dumps(response_multimodal.__dict__, default=lambda o: o.__dict__, indent=4))\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"]},{@@ -260,18 +268,13 @@"\n","3️⃣ Re-submit tool results for summarization → another request\n","\n",- "See the following diagram for a side by side visualized comparison!\n",- "\n",- "\n",- "\n",- "\n","We are very excited for you to try out the Responses API and see how it can simplify your code and make it easier to build complex, multimodal, tool-augmented interactions!\n"]}],"metadata": {"kernelspec": {- "display_name": ".venv",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},diff --git a/examples/openai/web_search.py b/examples/openai/web_search.pynew file mode 100644index 00000000..d632e0cc--- /dev/null+++ b/examples/openai/web_search.py@@ -0,0 +1,122 @@+# ## Observing Responses API with AgentOps+#+# The Responses API is a new API that focuses on greater simplicity and greater expressivity when using our APIs. It is designed for multiple tools, multiple turns, and multiple modalities — as opposed to current APIs, which either have these features bolted onto an API designed primarily for text in and out (chat completions) or need a lot bootstrapping to perform simple actions (assistants api).+#+# Here I will show you a couple of new features that the Responses API has to offer and tie it all together at the end.+# `responses` solves for a number of user pain-points with our current set of APIs. During our time with the completions API, we found that folks wanted:+#+# - the ability to easily perform multi-turn model interactions in a single API call+# - to have access to our hosted tools (file_search, web_search, code_interpreter)+# - granular control over the context sent to the model+#+# As models start to develop longer running reasoning and thinking capabilities, users will want an async-friendly and stateful primitive. Response solves for this. With AgentOps, we can easily observe the Responses API in action.+# ## Basics+# By design, on the surface, the Responses API is very similar to the Completions API.+# # Install required dependencies+# %pip install agentops+# %pip install openai+# %pip install python-dotenv+from dotenv import load_dotenv+import os+import json+import agentops+from openai import OpenAI++load_dotenv()+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")++agentops.init(auto_start_session=True)+tracer = agentops.start_trace(+ trace_name="OpenAI Responses Example", tags=["openai-responses-example", "openai", "agentops-example"]+)+client = OpenAI()++response = client.responses.create(+ model="gpt-4o-mini",+ input="tell me a joke",+)++print(response.output[0].content[0].text)++# One key feature of the Response API is that it is stateful. This means that you do not have to manage the state of the conversation by yourself, the API will handle it for you. For example, you can retrieve the response at any time and it will include the full conversation history.+fetched_response = client.responses.retrieve(response_id=response.id)+print(fetched_response.output[0].content[0].text)++# You can continue the conversation by referring to the previous response.+response_two = client.responses.create(model="gpt-4o-mini", input="tell me another", previous_response_id=response.id)+print(response_two.output[0].content[0].text)++# You can of course manage the context yourself. But one benefit of OpenAI maintaining the context for you is that you can fork the response at any point and continue the conversation from that point.+response_two_forked = client.responses.create(+ model="gpt-4o-mini",+ input="I didn't like that joke, tell me another and tell me the difference between the two jokes",+ previous_response_id=response.id, # Forking and continuing from the first response+)+output_text = response_two_forked.output[0].content[0].text+print(output_text)++# ## Hosted Tools+#+# Another benefit of the Responses API is that it adds support for hosted tools like `file_search` and `web_search`. Instead of manually calling the tools, simply pass in the tools and the API will decide which tool to use and use it.+#+# Here is an example of using the `web_search` tool to incorporate web search results into the response. You may already be familiar with how ChatGPT can search the web. You can now build similar experiences too! The web search tool uses the OpenAI Index, the one that powers the web search in ChatGPT, having being optimized for chat applications.+response = client.responses.create(+ model="gpt-4o", # or another supported model+ input="What's the latest news about AI?",+ tools=[{"type": "web_search"}],+)+print(json.dumps(response.output, default=lambda o: o.__dict__, indent=2))++# ## Multimodal, Tool-augmented conversation+#+# The Responses API natively supports text, images, and audio modalities.+# Tying everything together, we can build a fully multimodal, tool-augmented interaction with one API call through the responses API.++# Display the image from the provided URL+url = "https://upload.wikimedia.org/wikipedia/commons/thumb/1/15/Cat_August_2010-4.jpg/2880px-Cat_August_2010-4.jpg"+# display(Image(url=url, width=400))++response_multimodal = client.responses.create(+ model="gpt-4o",+ input=[+ {+ "role": "user",+ "content": [+ {+ "type": "input_text",+ "text": "Come up with keywords related to the image, and search on the web using the search tool for any news related to the keywords"+ ", summarize the findings and cite the sources.",+ },+ {+ "type": "input_image",+ "image_url": "https://upload.wikimedia.org/wikipedia/commons/thumb/1/15/Cat_August_2010-4.jpg/2880px-Cat_August_2010-4.jpg",+ },+ ],+ }+ ],+ tools=[{"type": "web_search"}],+)++print(json.dumps(response_multimodal.__dict__, default=lambda o: o.__dict__, indent=4))+agentops.end_trace(tracer, end_state="Success")++# In the above example, we were able to use the `web_search` tool to search the web for news related to the image in one API call instead of multiple round trips that would be required if we were using the Chat Completions API.+# With the responses API+# 🔥 a single API call can handle:+#+# ✅ Analyze a given image using a multimodal input.+#+# ✅ Perform web search via the `web_search` hosted tool+#+# ✅ Summarize the results.+#+# In contrast, With Chat Completions API would require multiple steps, each requiring a round trip to the API:+#+# 1️⃣ Upload image and get analysis → 1 request+#+# 2️⃣ Extract info, call external web search → manual step + tool execution+#+# 3️⃣ Re-submit tool results for summarization → another request+#+# We are very excited for you to try out the Responses API and see how it can simplify your code and make it easier to build complex, multimodal, tool-augmented interactions!diff --git a/examples/openai_agents/README.md b/examples/openai_agents/README.mdnew file mode 100644index 00000000..08684d5a--- /dev/null+++ b/examples/openai_agents/README.md@@ -0,0 +1,39 @@+# OpenAI Agents Examples with AgentOps++This directory contains examples of using the OpenAI Agents SDK with AgentOps instrumentation.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops openai-agents+ ```++## Examples++### 1. Agent Patterns++Example: `agent_patterns`+This example demonstrates:+- Common agent design patterns++### 2. Agent Tools++Example: `agents_tools`++This example demonstrates:+- Agent tool integration++### 3. Customer Service Agent++Example: `customer_service_agent`++This example demonstrates:+- Customer service automation++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your OpenAI Agents calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/openai_agents/agent_patterns.ipynb b/examples/openai_agents/agent_patterns.ipynbnew file mode 100644index 00000000..d3614c86--- /dev/null+++ b/examples/openai_agents/agent_patterns.ipynb@@ -0,0 +1,954 @@+{+ "cells": [+ {+ "cell_type": "markdown",+ "id": "a7cd4a28",+ "metadata": {},+ "source": [+ "# OpenAI Agents Patterns Demonstration\n",+ "\n",+ "This notebook demonstrates various common agentic patterns using the Agents SDK and how one can observe them using the AgentOps platform.\n",+ "\n",+ "**Note: This notebook was edited using Claude MCP NotebookEdit tool!**\n",+ "\n",+ "## General Flow\n",+ "\n",+ "This notebook will walk you through several key agent patterns:\n",+ "\n",+ "1. **Agents as Tools** - Using agents as callable tools within other agents\n",+ "2. **Deterministic Flows** - Breaking down tasks into sequential steps\n",+ "3. **Forcing Tool Use** - Controlling when and how agents use tools\n",+ "4. **Input Guardrails** - Validating inputs before agent execution\n",+ "5. **LLM as a Judge** - Using LLMs to evaluate and improve outputs\n",+ "6. **Output Guardrails** - Validating outputs after agent execution\n",+ "7. **Parallelization** - Running multiple agents concurrently\n",+ "8. **Routing** - Directing requests to specialized agents\n",+ "9. **Streaming Guardrails** - Real-time validation during streaming\n",+ "\n",+ "Each pattern demonstrates how AgentOps automatically tracks and monitors your agent interactions, providing valuable insights into performance, costs, and behavior."+ ]+ },+ {+ "cell_type": "markdown",+ "id": "7fb27b941602401d91542211134fc71a",+ "metadata": {},+ "source": [+ "## Prerequisites\n",+ "\n",+ "Before running this notebook, you'll need:\n",+ "\n",+ "1. **AgentOps Account**: Create a free account at [app.agentops.ai](https://app.agentops.ai)\n",+ "2. **AgentOps API Key**: Obtain your API key from your AgentOps dashboard\n",+ "3. **OpenAI API Key**: Get your API key from [platform.openai.com](https://platform.openai.com)\n",+ "\n",+ "Make sure to set these as environment variables or create a `.env` file in your project root with:\n",+ "\n",+ "```\n",+ "AGENTOPS_API_KEY=your_agentops_api_key_here\n",+ "OPENAI_API_KEY=your_openai_api_key_here\n",+ "```"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "66be7a30",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Install required packages\n",+ "%pip install agentops\n",+ "%pip install openai-agents\n",+ "%pip install pydotenv"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "acae54e37e7d407bbb7b55eff062a284",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Required imports - Note: agentops must be imported before agents\n",+ "import asyncio\n",+ "import os\n",+ "import uuid\n",+ "from typing import Any, Literal\n",+ "from dataclasses import dataclass\n",+ "from dotenv import load_dotenv\n",+ "from pydantic import BaseModel, Field\n",+ "\n",+ "# Import agentops FIRST\n",+ "import agentops\n",+ "\n",+ "# Then import agents\n",+ "from agents import (\n",+ " Agent,\n",+ " ItemHelpers,\n",+ " MessageOutputItem,\n",+ " Runner,\n",+ " trace,\n",+ " TResponseInputItem,\n",+ " FunctionToolResult,\n",+ " ModelSettings,\n",+ " RunContextWrapper,\n",+ " ToolsToFinalOutputFunction,\n",+ " ToolsToFinalOutputResult,\n",+ " function_tool,\n",+ " GuardrailFunctionOutput,\n",+ " InputGuardrailTripwireTriggered,\n",+ " OutputGuardrailTripwireTriggered,\n",+ " input_guardrail,\n",+ " output_guardrail,\n",+ " RawResponsesStreamEvent,\n",+ ")\n",+ "\n",+ "from openai.types.responses import ResponseContentPartDoneEvent, ResponseTextDeltaEvent"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "780a20ee",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Load environment variables and set API keys\n",+ "load_dotenv()\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")\n",+ "\n",+ "# Initialize AgentOps\n",+ "agentops.init(auto_start_session=False)\n",+ "# Note: tracer will be defined in each section's cell for clarity, using the specific tags for that pattern."+ ]+ },+ {+ "cell_type": "markdown",+ "id": "e37212a8",+ "metadata": {},+ "source": [+ "## 1. Agents as Tools Pattern\n",+ "\n",+ "The mental model for handoffs is that the new agent \"takes over\". It sees the previous conversation history, and owns the conversation from that point onwards. However, this is not the only way to use agents. You can also use agents as a tool - the tool agent goes off and runs on its own, and then returns the result to the original agent.\n",+ "\n",+ "For example, you could model the translation task above as tool calls instead: rather than handing over to the language-specific agent, you could call the agent as a tool, and then use the result in the next step. This enables things like translating multiple languages at once.\n",+ "\n",+ "This pattern demonstrates using agents as callable tools within other agents. The orchestrator agent receives a user message and then picks which specialized agents to call as tools."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "52377535",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(trace_name=\"Agents as Tools Pattern\", tags=[\"agentops-example\", \"openai-agents\"])\n",+ "\n",+ "# Define specialized translation agents\n",+ "spanish_agent = Agent(\n",+ " name=\"spanish_agent\",\n",+ " instructions=\"You translate the user's message to Spanish\",\n",+ " handoff_description=\"An english to spanish translator\",\n",+ ")\n",+ "\n",+ "french_agent = Agent(\n",+ " name=\"french_agent\",\n",+ " instructions=\"You translate the user's message to French\",\n",+ " handoff_description=\"An english to french translator\",\n",+ ")\n",+ "\n",+ "italian_agent = Agent(\n",+ " name=\"italian_agent\",\n",+ " instructions=\"You translate the user's message to Italian\",\n",+ " handoff_description=\"An english to italian translator\",\n",+ ")\n",+ "\n",+ "# Orchestrator agent that uses other agents as tools\n",+ "orchestrator_agent = Agent(\n",+ " name=\"orchestrator_agent\",\n",+ " instructions=(\n",+ " \"You are a translation agent. You use the tools given to you to translate.\"\n",+ " \"If asked for multiple translations, you call the relevant tools in order.\"\n",+ " \"You never translate on your own, you always use the provided tools.\"\n",+ " ),\n",+ " tools=[\n",+ " spanish_agent.as_tool(\n",+ " tool_name=\"translate_to_spanish\",\n",+ " tool_description=\"Translate the user's message to Spanish\",\n",+ " ),\n",+ " french_agent.as_tool(\n",+ " tool_name=\"translate_to_french\",\n",+ " tool_description=\"Translate the user's message to French\",\n",+ " ),\n",+ " italian_agent.as_tool(\n",+ " tool_name=\"translate_to_italian\",\n",+ " tool_description=\"Translate the user's message to Italian\",\n",+ " ),\n",+ " ],\n",+ ")\n",+ "\n",+ "synthesizer_agent = Agent(\n",+ " name=\"synthesizer_agent\",\n",+ " instructions=\"You inspect translations, correct them if needed, and produce a final concatenated response.\",\n",+ ")\n",+ "\n",+ "\n",+ "async def run_agents_as_tools_demo():\n",+ " msg = \"Hello, how are you today?\"\n",+ " print(f\"Input: {msg}\")\n",+ "\n",+ " with trace(\"Orchestrator evaluator\"):\n",+ " orchestrator_result = await Runner.run(orchestrator_agent, msg)\n",+ "\n",+ " for item in orchestrator_result.new_items:\n",+ " if isinstance(item, MessageOutputItem):\n",+ " text = ItemHelpers.text_message_output(item)\n",+ " if text:\n",+ " print(f\" - Translation step: {text}\")\n",+ "\n",+ " synthesizer_result = await Runner.run(synthesizer_agent, orchestrator_result.to_input_list())\n",+ "\n",+ " print(f\"Final response: {synthesizer_result.final_output}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_agents_as_tools_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "98e54a31",+ "metadata": {},+ "source": [+ "## 2. Deterministic Flow Pattern\n",+ "\n",+ "A common tactic is to break down a task into a series of smaller steps. Each task can be performed by an agent, and the output of one agent is used as input to the next. For example, if your task was to generate a story, you could break it down into the following steps:\n",+ "\n",+ "1. Generate an outline\n",+ "2. Generate the story\n",+ "3. Generate the ending\n",+ "\n",+ "Each of these steps can be performed by an agent. The output of one agent is used as input to the next.\n",+ "\n",+ "This pattern demonstrates breaking down a complex task into a series of smaller, sequential steps. Each step is performed by an agent, and the output of one agent is used as input to the next."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "3428aa44",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(trace_name=\"Deterministic Flow Pattern\", tags=[\"agentops-example\", \"openai-agents\"])\n",+ "\n",+ "# Define the story generation workflow\n",+ "story_outline_agent = Agent(\n",+ " name=\"story_outline_agent\",\n",+ " instructions=\"Generate a very short story outline based on the user's input.\",\n",+ ")\n",+ "\n",+ "\n",+ "class OutlineCheckerOutput(BaseModel):\n",+ " good_quality: bool\n",+ " is_scifi: bool\n",+ "\n",+ "\n",+ "outline_checker_agent = Agent(\n",+ " name=\"outline_checker_agent\",\n",+ " instructions=\"Read the given story outline, and judge the quality. Also, determine if it is a scifi story.\",\n",+ " output_type=OutlineCheckerOutput,\n",+ ")\n",+ "\n",+ "story_agent = Agent(\n",+ " name=\"story_agent\",\n",+ " instructions=\"Write a short story based on the given outline.\",\n",+ " output_type=str,\n",+ ")\n",+ "\n",+ "\n",+ "async def run_deterministic_flow_demo():\n",+ " input_prompt = \"A story about robots exploring space\"\n",+ " print(f\"Input: {input_prompt}\")\n",+ "\n",+ " with trace(\"Deterministic story flow\"):\n",+ " # 1. Generate an outline\n",+ " outline_result = await Runner.run(story_outline_agent, input_prompt)\n",+ " print(\"Outline generated\")\n",+ "\n",+ " # 2. Check the outline\n",+ " outline_checker_result = await Runner.run(outline_checker_agent, outline_result.final_output)\n",+ "\n",+ " # 3. Add a gate to stop if the outline is not good quality or not a scifi story\n",+ " assert isinstance(outline_checker_result.final_output, OutlineCheckerOutput)\n",+ " if not outline_checker_result.final_output.good_quality:\n",+ " print(\"Outline is not good quality, so we stop here.\")\n",+ " return\n",+ "\n",+ " if not outline_checker_result.final_output.is_scifi:\n",+ " print(\"Outline is not a scifi story, so we stop here.\")\n",+ " return\n",+ "\n",+ " print(\"Outline is good quality and a scifi story, so we continue to write the story.\")\n",+ "\n",+ " # 4. Write the story\n",+ " story_result = await Runner.run(story_agent, outline_result.final_output)\n",+ " print(f\"Story: {story_result.final_output}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_deterministic_flow_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "d9095df7",+ "metadata": {},+ "source": [+ "## 3. Forcing Tool Use Pattern\n",+ "\n",+ "This pattern shows how to force an agent to use a tool using `ModelSettings(tool_choice=\"required\")`. This is useful when you want to ensure the agent always uses a specific tool rather than generating a response directly.\n",+ "\n",+ "You can run it with 3 options:\n",+ "1. `default`: The default behavior, which is to send the tool output to the LLM. In this case, `tool_choice` is not set, because otherwise it would result in an infinite loop - the LLM would call the tool, the tool would run and send the results to the LLM, and that would repeat (because the model is forced to use a tool every time.)\n",+ "2. `first_tool_result`: The first tool result is used as the final output.\n",+ "3. `custom`: A custom tool use behavior function is used. The custom function receives all the tool results, and chooses to use the first tool result to generate the final output.\n",+ "\n",+ "For this demo, we'll allow the user to choose which tool use behavior to test:"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "9a63283cbaf04dbcab1f6479b197f3a8",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(trace_name=\"Forcing Tool Use Pattern\", tags=[\"agentops-example\", \"openai-agents\"])\n",+ "\n",+ "\n",+ "# Define the weather tool and agent\n",+ "class Weather(BaseModel):\n",+ " city: str\n",+ " temperature_range: str\n",+ " conditions: str\n",+ "\n",+ "\n",+ "@function_tool\n",+ "def get_weather(city: str) -> Weather:\n",+ " print(\"[debug] get_weather called\")\n",+ " return Weather(city=city, temperature_range=\"14-20C\", conditions=\"Sunny with wind\")\n",+ "\n",+ "\n",+ "async def custom_tool_use_behavior(\n",+ " context: RunContextWrapper[Any], results: list[FunctionToolResult]\n",+ ") -> ToolsToFinalOutputResult:\n",+ " weather: Weather = results[0].output\n",+ " return ToolsToFinalOutputResult(is_final_output=True, final_output=f\"{weather.city} is {weather.conditions}.\")\n",+ "\n",+ "\n",+ "# User can choose which behavior to test\n",+ "print(\"Choose tool use behavior:\")\n",+ "print(\"1. default - Send tool output to LLM\")\n",+ "print(\"2. first_tool - Use first tool result as final output\")\n",+ "print(\"3. custom - Use custom tool behavior function\")\n",+ "\n",+ "choice = input(\"Enter choice (1, 2, or 3): \").strip()\n",+ "\n",+ "if choice == \"1\":\n",+ " tool_use_behavior = \"default\"\n",+ "elif choice == \"2\":\n",+ " tool_use_behavior = \"first_tool\"\n",+ "elif choice == \"3\":\n",+ " tool_use_behavior = \"custom\"\n",+ "else:\n",+ " tool_use_behavior = \"default\"\n",+ " print(\"Invalid choice, using default\")\n",+ "\n",+ "\n",+ "async def run_forcing_tool_use_demo(tool_use_behavior: str):\n",+ " print(f\"Testing {tool_use_behavior} behavior:\")\n",+ "\n",+ " if tool_use_behavior == \"default\":\n",+ " behavior: Literal[\"run_llm_again\", \"stop_on_first_tool\"] | ToolsToFinalOutputFunction = \"run_llm_again\"\n",+ " elif tool_use_behavior == \"first_tool\":\n",+ " behavior = \"stop_on_first_tool\"\n",+ " elif tool_use_behavior == \"custom\":\n",+ " behavior = custom_tool_use_behavior\n",+ "\n",+ " agent = Agent(\n",+ " name=\"Weather agent\",\n",+ " instructions=\"You are a helpful agent.\",\n",+ " tools=[get_weather],\n",+ " tool_use_behavior=behavior,\n",+ " model_settings=ModelSettings(tool_choice=\"required\" if tool_use_behavior != \"default\" else None),\n",+ " )\n",+ "\n",+ " result = await Runner.run(agent, input=\"What's the weather in Tokyo?\")\n",+ " print(f\"Result: {result.final_output}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_forcing_tool_use_demo(tool_use_behavior)\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "eaada293",+ "metadata": {},+ "source": [+ "## 4. Input Guardrails Pattern\n",+ "\n",+ "Related to parallelization, you often want to run input guardrails to make sure the inputs to your agents are valid. For example, if you have a customer support agent, you might want to make sure that the user isn't trying to ask for help with a math problem.\n",+ "\n",+ "You can definitely do this without any special Agents SDK features by using parallelization, but we support a special guardrail primitive. Guardrails can have a \"tripwire\" - if the tripwire is triggered, the agent execution will immediately stop and a `GuardrailTripwireTriggered` exception will be raised.\n",+ "\n",+ "This is really useful for latency: for example, you might have a very fast model that runs the guardrail and a slow model that runs the actual agent. You wouldn't want to wait for the slow model to finish, so guardrails let you quickly reject invalid inputs.\n",+ "\n",+ "This pattern demonstrates how to use input guardrails to validate user inputs before they reach the main agent. Guardrails can prevent inappropriate or off-topic requests from being processed."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "0a597f58",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(trace_name=\"Input Guardrails Pattern\", tags=[\"agentops-example\", \"openai-agents\"])\n",+ "\n",+ "\n",+ "# Define the guardrail\n",+ "class MathHomeworkOutput(BaseModel):\n",+ " reasoning: str\n",+ " is_math_homework: bool\n",+ "\n",+ "\n",+ "guardrail_agent = Agent(\n",+ " name=\"Guardrail check\",\n",+ " instructions=\"Check if the user is asking you to do their math homework.\",\n",+ " output_type=MathHomeworkOutput,\n",+ ")\n",+ "\n",+ "\n",+ "@input_guardrail\n",+ "async def math_guardrail(\n",+ " context: RunContextWrapper[None], agent: Agent, input: str | list[TResponseInputItem]\n",+ ") -> GuardrailFunctionOutput:\n",+ " result = await Runner.run(guardrail_agent, input, context=context.context)\n",+ " final_output = result.final_output_as(MathHomeworkOutput)\n",+ "\n",+ " return GuardrailFunctionOutput(\n",+ " output_info=final_output,\n",+ " tripwire_triggered=final_output.is_math_homework,\n",+ " )\n",+ "\n",+ "\n",+ "async def run_input_guardrails_demo():\n",+ " agent = Agent(\n",+ " name=\"Customer support agent\",\n",+ " instructions=\"You are a customer support agent. You help customers with their questions.\",\n",+ " input_guardrails=[math_guardrail],\n",+ " )\n",+ "\n",+ " # Test with different inputs\n",+ " test_inputs = [\"What's the capital of California?\", \"Can you help me solve for x: 2x + 5 = 11\"]\n",+ "\n",+ " for user_input in test_inputs:\n",+ " print(f\"Testing input: {user_input}\")\n",+ " try:\n",+ " result = await Runner.run(agent, user_input)\n",+ " print(f\"Response: {result.final_output}\")\n",+ " except InputGuardrailTripwireTriggered:\n",+ " message = \"Sorry, I can't help you with your math homework.\"\n",+ " print(f\"Guardrail triggered: {message}\")\n",+ " print()\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_input_guardrails_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "1aa0b993",+ "metadata": {},+ "source": [+ "## 5. LLM as a Judge Pattern\n",+ "\n",+ "LLMs can often improve the quality of their output if given feedback. A common pattern is to generate a response using a model, and then use a second model to provide feedback. You can even use a small model for the initial generation and a larger model for the feedback, to optimize cost.\n",+ "\n",+ "For example, you could use an LLM to generate an outline for a story, and then use a second LLM to evaluate the outline and provide feedback. You can then use the feedback to improve the outline, and repeat until the LLM is satisfied with the outline.\n",+ "\n",+ "This pattern shows how to use one LLM to evaluate and improve the output of another. The first agent generates content, and the second agent judges the quality and provides feedback for improvement."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "9bbb7b94",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(trace_name=\"LLM as a Judge Pattern\", tags=[\"agentops-example\", \"openai-agents\"])\n",+ "\n",+ "# Define the story generation and evaluation agents\n",+ "story_outline_generator = Agent(\n",+ " name=\"story_outline_generator\",\n",+ " instructions=(\n",+ " \"You generate a very short story outline based on the user's input.\"\n",+ " \"If there is any feedback provided, use it to improve the outline.\"\n",+ " ),\n",+ ")\n",+ "\n",+ "\n",+ "@dataclass\n",+ "class EvaluationFeedback:\n",+ " feedback: str\n",+ " score: Literal[\"pass\", \"needs_improvement\", \"fail\"]\n",+ "\n",+ "\n",+ "evaluator = Agent[None](\n",+ " name=\"evaluator\",\n",+ " instructions=(\n",+ " \"You evaluate a story outline and decide if it's good enough.\"\n",+ " \"If it's not good enough, you provide feedback on what needs to be improved.\"\n",+ " \"Never give it a pass on the first try.\"\n",+ " ),\n",+ " output_type=EvaluationFeedback,\n",+ ")\n",+ "\n",+ "\n",+ "async def run_llm_as_judge_demo():\n",+ " msg = \"A story about time travel\"\n",+ " print(f\"Input: {msg}\")\n",+ " input_items: list[TResponseInputItem] = [{\"content\": msg, \"role\": \"user\"}]\n",+ "\n",+ " latest_outline: str | None = None\n",+ " iteration = 0\n",+ " max_iterations = 3 # Limit iterations for demo\n",+ "\n",+ " with trace(\"LLM as a judge\"):\n",+ " while iteration < max_iterations:\n",+ " iteration += 1\n",+ " print(f\"Iteration {iteration}:\")\n",+ "\n",+ " story_outline_result = await Runner.run(\n",+ " story_outline_generator,\n",+ " input_items,\n",+ " )\n",+ "\n",+ " input_items = story_outline_result.to_input_list()\n",+ " latest_outline = ItemHelpers.text_message_outputs(story_outline_result.new_items)\n",+ " print(\"Story outline generated\")\n",+ "\n",+ " evaluator_result = await Runner.run(evaluator, input_items)\n",+ " result: EvaluationFeedback = evaluator_result.final_output\n",+ "\n",+ " print(f\"Evaluator score: {result.score}\")\n",+ "\n",+ " if result.score == \"pass\":\n",+ " print(\"Story outline is good enough, exiting.\")\n",+ " break\n",+ "\n",+ " print(\"Re-running with feedback\")\n",+ " input_items.append({\"content\": f\"Feedback: {result.feedback}\", \"role\": \"user\"})\n",+ "\n",+ " print(f\"Final story outline: {latest_outline}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_llm_as_judge_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "3e2acc90",+ "metadata": {},+ "source": [+ "## 6. Output Guardrails Pattern\n",+ "\n",+ "Related to parallelization, you often want to run output guardrails to make sure the outputs from your agents are valid. Guardrails can have a \"tripwire\" - if the tripwire is triggered, the agent execution will immediately stop and a `GuardrailTripwireTriggered` exception will be raised.\n",+ "\n",+ "This is really useful for latency: for example, you might have a very fast model that runs the guardrail and a slow model that runs the actual agent. You wouldn't want to wait for the slow model to finish, so guardrails let you quickly reject invalid outputs.\n",+ "\n",+ "This pattern demonstrates how to use output guardrails to validate agent outputs after they are generated. This can help prevent sensitive information from being shared or ensure outputs meet quality standards."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "71ccbecc",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(trace_name=\"Output Guardrails Pattern\", tags=[\"agentops-example\", \"openai-agents\"])\n",+ "\n",+ "\n",+ "# The agent's output type\n",+ "class MessageOutput(BaseModel):\n",+ " reasoning: str = Field(description=\"Thoughts on how to respond to the user's message\")\n",+ " response: str = Field(description=\"The response to the user's message\")\n",+ " user_name: str | None = Field(description=\"The name of the user who sent the message, if known\")\n",+ "\n",+ "\n",+ "@output_guardrail\n",+ "async def sensitive_data_check(\n",+ " context: RunContextWrapper, agent: Agent, output: MessageOutput\n",+ ") -> GuardrailFunctionOutput:\n",+ " phone_number_in_response = \"650\" in output.response\n",+ " phone_number_in_reasoning = \"650\" in output.reasoning\n",+ "\n",+ " return GuardrailFunctionOutput(\n",+ " output_info={\n",+ " \"phone_number_in_response\": phone_number_in_response,\n",+ " \"phone_number_in_reasoning\": phone_number_in_reasoning,\n",+ " },\n",+ " tripwire_triggered=phone_number_in_response or phone_number_in_reasoning,\n",+ " )\n",+ "\n",+ "\n",+ "output_guardrail_agent = Agent(\n",+ " name=\"Assistant\",\n",+ " instructions=\"You are a helpful assistant.\",\n",+ " output_type=MessageOutput,\n",+ " output_guardrails=[sensitive_data_check],\n",+ ")\n",+ "\n",+ "\n",+ "async def run_output_guardrails_demo():\n",+ " # Test with safe input\n",+ " print(\"Testing with safe input:\")\n",+ " try:\n",+ " result = await Runner.run(output_guardrail_agent, \"What's the capital of California?\")\n",+ " print(\"Safe message passed\")\n",+ " print(f\"Response: {result.final_output.response}\")\n",+ " except OutputGuardrailTripwireTriggered as e:\n",+ " print(f\"Unexpected guardrail trigger: {e.guardrail_result.output.output_info}\")\n",+ "\n",+ " print()\n",+ " # Test with potentially sensitive input\n",+ " print(\"Testing with potentially sensitive input:\")\n",+ " try:\n",+ " result = await Runner.run(output_guardrail_agent, \"My phone number is 650-123-4567. Where do you think I live?\")\n",+ " print(f\"Guardrail didn't trip - this is unexpected. Output: {result.final_output.response}\")\n",+ " except OutputGuardrailTripwireTriggered as e:\n",+ " print(f\"Guardrail tripped as expected. Info: {e.guardrail_result.output.output_info}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_output_guardrails_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "0f91df27",+ "metadata": {},+ "source": [+ "## 7. Parallelization Pattern\n",+ "\n",+ "Running multiple agents in parallel is a common pattern. This can be useful for both latency (e.g. if you have multiple steps that don't depend on each other) and also for other reasons e.g. generating multiple responses and picking the best one.\n",+ "\n",+ "This example runs a translation agent multiple times in parallel, and then picks the best translation.\n",+ "\n",+ "This pattern shows how to run multiple agents in parallel to improve latency or generate multiple options to choose from. In this example, we run translation agents multiple times and pick the best result."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "c40082e4",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(trace_name=\"Output Guardrails Pattern\", tags=[\"agentops-example\", \"openai-agents\"])\n",+ "\n",+ "# Define agents for parallelization\n",+ "spanish_translation_agent = Agent(\n",+ " name=\"spanish_agent\",\n",+ " instructions=\"You translate the user's message to Spanish\",\n",+ ")\n",+ "\n",+ "translation_picker = Agent(\n",+ " name=\"translation_picker\",\n",+ " instructions=\"You pick the best Spanish translation from the given options.\",\n",+ ")\n",+ "\n",+ "\n",+ "async def run_parallelization_demo():\n",+ " msg = \"Good morning, I hope you have a wonderful day!\"\n",+ " print(f\"Input: {msg}\")\n",+ "\n",+ " with trace(\"Parallel translation\"):\n",+ " # Run three translation agents in parallel\n",+ " res_1, res_2, res_3 = await asyncio.gather(\n",+ " Runner.run(spanish_translation_agent, msg),\n",+ " Runner.run(spanish_translation_agent, msg),\n",+ " Runner.run(spanish_translation_agent, msg),\n",+ " )\n",+ "\n",+ " outputs = [\n",+ " ItemHelpers.text_message_outputs(res_1.new_items),\n",+ " ItemHelpers.text_message_outputs(res_2.new_items),\n",+ " ItemHelpers.text_message_outputs(res_3.new_items),\n",+ " ]\n",+ "\n",+ " translations = \"\\n\\n\".join(outputs)\n",+ " print(f\"\\n\\nTranslations:\\n\\n{translations}\")\n",+ "\n",+ " best_translation = await Runner.run(\n",+ " translation_picker,\n",+ " f\"Input: {msg}\\n\\nTranslations:\\n{translations}\",\n",+ " )\n",+ "\n",+ " print(\"\\n\\n-----\")\n",+ " print(f\"Best translation: {best_translation.final_output}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_parallelization_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "9b60d8d2",+ "metadata": {},+ "source": [+ "## 8. Routing Pattern\n",+ "\n",+ "In many situations, you have specialized sub-agents that handle specific tasks. You can use handoffs to route the task to the right agent.\n",+ "\n",+ "For example, you might have a frontline agent that receives a request, and then hands off to a specialized agent based on the language of the request.\n",+ "\n",+ "This pattern demonstrates handoffs and routing between specialized agents. The triage agent receives the first message and hands off to the appropriate agent based on the language of the request."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "698b1251",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(trace_name=\"Routing Pattern\", tags=[\"agentops-example\", \"openai-agents\"])\n",+ "\n",+ "# Define language-specific agents\n",+ "french_routing_agent = Agent(\n",+ " name=\"french_agent\",\n",+ " instructions=\"You only speak French\",\n",+ ")\n",+ "\n",+ "spanish_routing_agent = Agent(\n",+ " name=\"spanish_agent\",\n",+ " instructions=\"You only speak Spanish\",\n",+ ")\n",+ "\n",+ "english_routing_agent = Agent(\n",+ " name=\"english_agent\",\n",+ " instructions=\"You only speak English\",\n",+ ")\n",+ "\n",+ "triage_agent = Agent(\n",+ " name=\"triage_agent\",\n",+ " instructions=\"Handoff to the appropriate agent based on the language of the request.\",\n",+ " handoffs=[french_routing_agent, spanish_routing_agent, english_routing_agent],\n",+ ")\n",+ "\n",+ "\n",+ "async def run_routing_demo():\n",+ " # Create an ID for this conversation\n",+ " conversation_id = str(uuid.uuid4().hex[:16])\n",+ "\n",+ " test_messages = [\"Hello, how can you help me?\", \"Bonjour, comment allez-vous?\", \"Hola, ¿cómo estás?\"]\n",+ "\n",+ " for msg in test_messages:\n",+ " print(f\"\\nTesting message: {msg}\")\n",+ "\n",+ " with trace(\"Routing example\", group_id=conversation_id):\n",+ " inputs = [{\"content\": msg, \"role\": \"user\"}]\n",+ " result = await Runner.run(triage_agent, input=inputs)\n",+ " print(f\"Response: {result.final_output}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_routing_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "6554dbbf",+ "metadata": {},+ "source": [+ "## 9. Streaming Guardrails Pattern\n",+ "\n",+ "This example shows how to use guardrails as the model is streaming. Output guardrails run after the final output has been generated; this example runs guardrails every N tokens, allowing for early termination if bad output is detected.\n",+ "\n",+ "The expected output is that you'll see a bunch of tokens stream in, then the guardrail will trigger and stop the streaming.\n",+ "\n",+ "This pattern shows how to use guardrails during streaming to provide real-time validation. Unlike output guardrails that run after completion, streaming guardrails can interrupt the generation process early."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "11a383f1",+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(trace_name=\"Streaming Guardrails Pattern\", tags=[\"agentops-example\", \"openai-agents\"])\n",+ "\n",+ "# Define streaming guardrail agent\n",+ "streaming_agent = Agent(\n",+ " name=\"Assistant\",\n",+ " instructions=(\n",+ " \"You are a helpful assistant. You ALWAYS write long responses, making sure to be verbose and detailed.\"\n",+ " ),\n",+ ")\n",+ "\n",+ "\n",+ "class GuardrailOutput(BaseModel):\n",+ " reasoning: str = Field(description=\"Reasoning about whether the response could be understood by a ten year old.\")\n",+ " is_readable_by_ten_year_old: bool = Field(description=\"Whether the response is understandable by a ten year old.\")\n",+ "\n",+ "\n",+ "guardrail_streaming_agent = Agent(\n",+ " name=\"Checker\",\n",+ " instructions=(\n",+ " \"You will be given a question and a response. Your goal is to judge whether the response \"\n",+ " \"is simple enough to be understood by a ten year old.\"\n",+ " ),\n",+ " output_type=GuardrailOutput,\n",+ " model=\"gpt-4o-mini\",\n",+ ")\n",+ "\n",+ "\n",+ "async def check_guardrail(text: str) -> GuardrailOutput:\n",+ " result = await Runner.run(guardrail_streaming_agent, text)\n",+ " return result.final_output_as(GuardrailOutput)\n",+ "\n",+ "\n",+ "async def run_streaming_guardrails_demo():\n",+ " question = \"What is a black hole, and how does it behave?\"\n",+ " print(f\"Question: {question}\")\n",+ "\n",+ " result = Runner.run_streamed(streaming_agent, question)\n",+ " current_text = \"\"\n",+ "\n",+ " # We will check the guardrail every N characters\n",+ " next_guardrail_check_len = 300\n",+ " guardrail_task = None\n",+ "\n",+ " async for event in result.stream_events():\n",+ " if event.type == \"raw_response_event\" and isinstance(event.data, ResponseTextDeltaEvent):\n",+ " print(event.data.delta, end=\"\", flush=True)\n",+ " current_text += event.data.delta\n",+ "\n",+ " # Check if it's time to run the guardrail check\n",+ " if len(current_text) >= next_guardrail_check_len and not guardrail_task:\n",+ " print(\"\\n[Running guardrail check]\")\n",+ " guardrail_task = asyncio.create_task(check_guardrail(current_text))\n",+ " next_guardrail_check_len += 300\n",+ "\n",+ " # Every iteration of the loop, check if the guardrail has been triggered\n",+ " if guardrail_task and guardrail_task.done():\n",+ " guardrail_result = guardrail_task.result()\n",+ " if not guardrail_result.is_readable_by_ten_year_old:\n",+ " print(\"\\n\\n================\\n\\n\")\n",+ " print(f\"Guardrail triggered. Reasoning:\\n{guardrail_result.reasoning}\")\n",+ " break\n",+ " guardrail_task = None\n",+ "\n",+ " # Do one final check on the final output\n",+ " if current_text:\n",+ " guardrail_result = await check_guardrail(current_text)\n",+ " if not guardrail_result.is_readable_by_ten_year_old:\n",+ " print(\"\\n\\n================\\n\\n\")\n",+ " print(f\"Final guardrail triggered. Reasoning:\\n{guardrail_result.reasoning}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_streaming_guardrails_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "1f7f8dda",+ "metadata": {},+ "source": [+ "## Conclusion\n",+ "\n",+ "This notebook has demonstrated 9 key agent patterns that are commonly used in production AI applications. Each pattern showcases how agents can be orchestrated to perform complex tasks, validate inputs and outputs, and improve overall application performance. \n",+ "\n",+ "**AgentOps** provides comprehensive observability for AI agents, automatically tracking all these interactions and providing valuable insights into:\n",+ "\n",+ "- **Performance metrics** - Latency, throughput, success rates across all agent patterns\n",+ "- **Cost analysis** - Token usage, model costs, and optimization opportunities for complex workflows\n",+ "- **Quality monitoring** - Output quality assessment, guardrail effectiveness, and pattern success rates\n",+ "- **Debugging support** - Detailed trace visualization, error tracking, and workflow analysis\n",+ "- **Agent behavior insights** - Understanding how different patterns perform in production environments\n",+ "- **Workflow optimization** - Identifying bottlenecks and improving agent coordination\n",+ "\n",+ "Visit [app.agentops.ai](https://app.agentops.ai) to explore your agent sessions and gain deeper insights into your AI application's behavior."+ ]+ }+ ],+ "metadata": {+ "kernelspec": {+ "display_name": "agentops (3.11.11)",+ "language": "python",+ "name": "python3"+ },+ "language_info": {+ "codemirror_mode": {+ "name": "ipython",+ "version": 3+ },+ "file_extension": ".py",+ "mimetype": "text/x-python",+ "name": "python",+ "nbconvert_exporter": "python",+ "pygments_lexer": "ipython3",+ "version": "3.11.11"+ }+ },+ "nbformat": 4,+ "nbformat_minor": 5+}\ No newline at end of filediff --git a/examples/openai_agents/agent_patterns.py b/examples/openai_agents/agent_patterns.pynew file mode 100644index 00000000..c8a6b205--- /dev/null+++ b/examples/openai_agents/agent_patterns.py@@ -0,0 +1,737 @@+# # OpenAI Agents Patterns Demonstration+#+# This notebook demonstrates various common agentic patterns using the Agents SDK and how one can observe them using the AgentOps platform.+#+# **Note: This notebook was edited using Claude MCP NotebookEdit tool!**+#+# ## General Flow+#+# This notebook will walk you through several key agent patterns:+#+# 1. **Agents as Tools** - Using agents as callable tools within other agents+# 2. **Deterministic Flows** - Breaking down tasks into sequential steps+# 3. **Forcing Tool Use** - Controlling when and how agents use tools+# 4. **Input Guardrails** - Validating inputs before agent execution+# 5. **LLM as a Judge** - Using LLMs to evaluate and improve outputs+# 6. **Output Guardrails** - Validating outputs after agent execution+# 7. **Parallelization** - Running multiple agents concurrently+# 8. **Routing** - Directing requests to specialized agents+# 9. **Streaming Guardrails** - Real-time validation during streaming+#+# Each pattern demonstrates how AgentOps automatically tracks and monitors your agent interactions, providing valuable insights into performance, costs, and behavior.+# ## Prerequisites+#+# Before running this notebook, you'll need:+#+# 1. **AgentOps Account**: Create a free account at [app.agentops.ai](https://app.agentops.ai)+# 2. **AgentOps API Key**: Obtain your API key from your AgentOps dashboard+# 3. **OpenAI API Key**: Get your API key from [platform.openai.com](https://platform.openai.com)+#+# Make sure to set these as environment variables or create a `.env` file in your project root with:+#+# ```+# AGENTOPS_API_KEY=your_agentops_api_key_here+# OPENAI_API_KEY=your_openai_api_key_here+# ```+# # Install required packages+# %pip install agentops+# %pip install openai-agents+# %pip install pydotenv+# Required imports - Note: agentops must be imported before agents+import asyncio+import os+import uuid+from typing import Any, Literal+from dataclasses import dataclass+from dotenv import load_dotenv+from pydantic import BaseModel, Field++# Import agentops FIRST+import agentops++# Then import agents+from agents import (+ Agent,+ ItemHelpers,+ MessageOutputItem,+ Runner,+ trace,+ TResponseInputItem,+ FunctionToolResult,+ ModelSettings,+ RunContextWrapper,+ ToolsToFinalOutputFunction,+ ToolsToFinalOutputResult,+ function_tool,+ GuardrailFunctionOutput,+ InputGuardrailTripwireTriggered,+ OutputGuardrailTripwireTriggered,+ input_guardrail,+ output_guardrail,+)++from openai.types.responses import ResponseTextDeltaEvent++# Load environment variables and set API keys+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++# Initialize AgentOps+agentops.init(auto_start_session=False)+# Note: tracer will be defined in each section's cell for clarity, using the specific tags for that pattern.+# ## 1. Agents as Tools Pattern+#+# The mental model for handoffs is that the new agent "takes over". It sees the previous conversation history, and owns the conversation from that point onwards. However, this is not the only way to use agents. You can also use agents as a tool - the tool agent goes off and runs on its own, and then returns the result to the original agent.+#+# For example, you could model the translation task above as tool calls instead: rather than handing over to the language-specific agent, you could call the agent as a tool, and then use the result in the next step. This enables things like translating multiple languages at once.+#+# This pattern demonstrates using agents as callable tools within other agents. The orchestrator agent receives a user message and then picks which specialized agents to call as tools.+# Start the AgentOps trace session+tracer = agentops.start_trace(trace_name="Agents as Tools Pattern", tags=["agentops-example", "openai-agents"])++# Define specialized translation agents+spanish_agent = Agent(+ name="spanish_agent",+ instructions="You translate the user's message to Spanish",+ handoff_description="An english to spanish translator",+)++french_agent = Agent(+ name="french_agent",+ instructions="You translate the user's message to French",+ handoff_description="An english to french translator",+)++italian_agent = Agent(+ name="italian_agent",+ instructions="You translate the user's message to Italian",+ handoff_description="An english to italian translator",+)++# Orchestrator agent that uses other agents as tools+orchestrator_agent = Agent(+ name="orchestrator_agent",+ instructions=(+ "You are a translation agent. You use the tools given to you to translate."+ "If asked for multiple translations, you call the relevant tools in order."+ "You never translate on your own, you always use the provided tools."+ ),+ tools=[+ spanish_agent.as_tool(+ tool_name="translate_to_spanish",+ tool_description="Translate the user's message to Spanish",+ ),+ french_agent.as_tool(+ tool_name="translate_to_french",+ tool_description="Translate the user's message to French",+ ),+ italian_agent.as_tool(+ tool_name="translate_to_italian",+ tool_description="Translate the user's message to Italian",+ ),+ ],+)++synthesizer_agent = Agent(+ name="synthesizer_agent",+ instructions="You inspect translations, correct them if needed, and produce a final concatenated response.",+)+++async def run_agents_as_tools_demo():+ msg = "Hello, how are you today?"+ print(f"Input: {msg}")++ with trace("Orchestrator evaluator"):+ orchestrator_result = await Runner.run(orchestrator_agent, msg)++ for item in orchestrator_result.new_items:+ if isinstance(item, MessageOutputItem):+ text = ItemHelpers.text_message_output(item)+ if text:+ print(f" - Translation step: {text}")++ synthesizer_result = await Runner.run(synthesizer_agent, orchestrator_result.to_input_list())++ print(f"Final response: {synthesizer_result.final_output}")+++# Run the demo+# await run_agents_as_tools_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")+# ## 2. Deterministic Flow Pattern+#+# A common tactic is to break down a task into a series of smaller steps. Each task can be performed by an agent, and the output of one agent is used as input to the next. For example, if your task was to generate a story, you could break it down into the following steps:+#+# 1. Generate an outline+# 2. Generate the story+# 3. Generate the ending+#+# Each of these steps can be performed by an agent. The output of one agent is used as input to the next.+#+# This pattern demonstrates breaking down a complex task into a series of smaller, sequential steps. Each step is performed by an agent, and the output of one agent is used as input to the next.+# Start the AgentOps trace session+tracer = agentops.start_trace(trace_name="Deterministic Flow Pattern", tags=["agentops-example", "openai-agents"])++# Define the story generation workflow+story_outline_agent = Agent(+ name="story_outline_agent",+ instructions="Generate a very short story outline based on the user's input.",+)+++class OutlineCheckerOutput(BaseModel):+ good_quality: bool+ is_scifi: bool+++outline_checker_agent = Agent(+ name="outline_checker_agent",+ instructions="Read the given story outline, and judge the quality. Also, determine if it is a scifi story.",+ output_type=OutlineCheckerOutput,+)++story_agent = Agent(+ name="story_agent",+ instructions="Write a short story based on the given outline.",+ output_type=str,+)+++async def run_deterministic_flow_demo():+ input_prompt = "A story about robots exploring space"+ print(f"Input: {input_prompt}")++ with trace("Deterministic story flow"):+ # 1. Generate an outline+ outline_result = await Runner.run(story_outline_agent, input_prompt)+ print("Outline generated")++ # 2. Check the outline+ outline_checker_result = await Runner.run(outline_checker_agent, outline_result.final_output)++ # 3. Add a gate to stop if the outline is not good quality or not a scifi story+ assert isinstance(outline_checker_result.final_output, OutlineCheckerOutput)+ if not outline_checker_result.final_output.good_quality:+ print("Outline is not good quality, so we stop here.")+ return++ if not outline_checker_result.final_output.is_scifi:+ print("Outline is not a scifi story, so we stop here.")+ return++ print("Outline is good quality and a scifi story, so we continue to write the story.")++ # 4. Write the story+ story_result = await Runner.run(story_agent, outline_result.final_output)+ print(f"Story: {story_result.final_output}")+++# Run the demo+# await run_deterministic_flow_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")+# ## 3. Forcing Tool Use Pattern+#+# This pattern shows how to force an agent to use a tool using `ModelSettings(tool_choice=\"required\")`. This is useful when you want to ensure the agent always uses a specific tool rather than generating a response directly.+#+# You can run it with 3 options:+# 1. `default`: The default behavior, which is to send the tool output to the LLM. In this case, `tool_choice` is not set, because otherwise it would result in an infinite loop - the LLM would call the tool, the tool would run and send the results to the LLM, and that would repeat (because the model is forced to use a tool every time.)+# 2. `first_tool_result`: The first tool result is used as the final output.+# 3. `custom`: A custom tool use behavior function is used. The custom function receives all the tool results, and chooses to use the first tool result to generate the final output.+#+# For this demo, we'll allow the user to choose which tool use behavior to test:+# Start the AgentOps trace session+tracer = agentops.start_trace(trace_name="Forcing Tool Use Pattern", tags=["agentops-example", "openai-agents"])+++# Define the weather tool and agent+class Weather(BaseModel):+ city: str+ temperature_range: str+ conditions: str+++@function_tool+def get_weather(city: str) -> Weather:+ print("[debug] get_weather called")+ return Weather(city=city, temperature_range="14-20C", conditions="Sunny with wind")+++async def custom_tool_use_behavior(+ context: RunContextWrapper[Any], results: list[FunctionToolResult]+) -> ToolsToFinalOutputResult:+ weather: Weather = results[0].output+ return ToolsToFinalOutputResult(is_final_output=True, final_output=f"{weather.city} is {weather.conditions}.")+++# User can choose which behavior to test+print("Choose tool use behavior:")+print("1. default - Send tool output to LLM")+print("2. first_tool - Use first tool result as final output")+print("3. custom - Use custom tool behavior function")++choice = input("Enter choice (1, 2, or 3): ").strip()++if choice == "1":+ tool_use_behavior = "default"+elif choice == "2":+ tool_use_behavior = "first_tool"+elif choice == "3":+ tool_use_behavior = "custom"+else:+ tool_use_behavior = "default"+ print("Invalid choice, using default")+++async def run_forcing_tool_use_demo(tool_use_behavior: str):+ print(f"Testing {tool_use_behavior} behavior:")++ if tool_use_behavior == "default":+ behavior: Literal["run_llm_again", "stop_on_first_tool"] | ToolsToFinalOutputFunction = "run_llm_again"+ elif tool_use_behavior == "first_tool":+ behavior = "stop_on_first_tool"+ elif tool_use_behavior == "custom":+ behavior = custom_tool_use_behavior++ agent = Agent(+ name="Weather agent",+ instructions="You are a helpful agent.",+ tools=[get_weather],+ tool_use_behavior=behavior,+ model_settings=ModelSettings(tool_choice="required" if tool_use_behavior != "default" else None),+ )++ result = await Runner.run(agent, input="What's the weather in Tokyo?")+ print(f"Result: {result.final_output}")+++# Run the demo+# await run_forcing_tool_use_demo(tool_use_behavior)++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")+# ## 4. Input Guardrails Pattern+#+# Related to parallelization, you often want to run input guardrails to make sure the inputs to your agents are valid. For example, if you have a customer support agent, you might want to make sure that the user isn't trying to ask for help with a math problem.+#+# You can definitely do this without any special Agents SDK features by using parallelization, but we support a special guardrail primitive. Guardrails can have a \"tripwire\" - if the tripwire is triggered, the agent execution will immediately stop and a `GuardrailTripwireTriggered` exception will be raised.+#+# This is really useful for latency: for example, you might have a very fast model that runs the guardrail and a slow model that runs the actual agent. You wouldn't want to wait for the slow model to finish, so guardrails let you quickly reject invalid inputs.+#+# This pattern demonstrates how to use input guardrails to validate user inputs before they reach the main agent. Guardrails can prevent inappropriate or off-topic requests from being processed.+# Start the AgentOps trace session+tracer = agentops.start_trace(trace_name="Input Guardrails Pattern", tags=["agentops-example", "openai-agents"])+++# Define the guardrail+class MathHomeworkOutput(BaseModel):+ reasoning: str+ is_math_homework: bool+++guardrail_agent = Agent(+ name="Guardrail check",+ instructions="Check if the user is asking you to do their math homework.",+ output_type=MathHomeworkOutput,+)+++@input_guardrail+async def math_guardrail(+ context: RunContextWrapper[None], agent: Agent, input: str | list[TResponseInputItem]+) -> GuardrailFunctionOutput:+ result = await Runner.run(guardrail_agent, input, context=context.context)+ final_output = result.final_output_as(MathHomeworkOutput)++ return GuardrailFunctionOutput(+ output_info=final_output,+ tripwire_triggered=final_output.is_math_homework,+ )+++async def run_input_guardrails_demo():+ agent = Agent(+ name="Customer support agent",+ instructions="You are a customer support agent. You help customers with their questions.",+ input_guardrails=[math_guardrail],+ )++ # Test with different inputs+ test_inputs = ["What's the capital of California?", "Can you help me solve for x: 2x + 5 = 11"]++ for user_input in test_inputs:+ print(f"Testing input: {user_input}")+ try:+ result = await Runner.run(agent, user_input)+ print(f"Response: {result.final_output}")+ except InputGuardrailTripwireTriggered:+ message = "Sorry, I can't help you with your math homework."+ print(f"Guardrail triggered: {message}")+ print()+++# Run the demo+# await run_input_guardrails_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")+# ## 5. LLM as a Judge Pattern+#+# LLMs can often improve the quality of their output if given feedback. A common pattern is to generate a response using a model, and then use a second model to provide feedback. You can even use a small model for the initial generation and a larger model for the feedback, to optimize cost.+#+# For example, you could use an LLM to generate an outline for a story, and then use a second LLM to evaluate the outline and provide feedback. You can then use the feedback to improve the outline, and repeat until the LLM is satisfied with the outline.+#+# This pattern shows how to use one LLM to evaluate and improve the output of another. The first agent generates content, and the second agent judges the quality and provides feedback for improvement.+# Start the AgentOps trace session+tracer = agentops.start_trace(trace_name="LLM as a Judge Pattern", tags=["agentops-example", "openai-agents"])++# Define the story generation and evaluation agents+story_outline_generator = Agent(+ name="story_outline_generator",+ instructions=(+ "You generate a very short story outline based on the user's input."+ "If there is any feedback provided, use it to improve the outline."+ ),+)+++@dataclass+class EvaluationFeedback:+ feedback: str+ score: Literal["pass", "needs_improvement", "fail"]+++evaluator = Agent[None](+ name="evaluator",+ instructions=(+ "You evaluate a story outline and decide if it's good enough."+ "If it's not good enough, you provide feedback on what needs to be improved."+ "Never give it a pass on the first try."+ ),+ output_type=EvaluationFeedback,+)+++async def run_llm_as_judge_demo():+ msg = "A story about time travel"+ print(f"Input: {msg}")+ input_items: list[TResponseInputItem] = [{"content": msg, "role": "user"}]++ latest_outline: str | None = None+ iteration = 0+ max_iterations = 3 # Limit iterations for demo++ with trace("LLM as a judge"):+ while iteration < max_iterations:+ iteration += 1+ print(f"Iteration {iteration}:")++ story_outline_result = await Runner.run(+ story_outline_generator,+ input_items,+ )++ input_items = story_outline_result.to_input_list()+ latest_outline = ItemHelpers.text_message_outputs(story_outline_result.new_items)+ print("Story outline generated")++ evaluator_result = await Runner.run(evaluator, input_items)+ result: EvaluationFeedback = evaluator_result.final_output++ print(f"Evaluator score: {result.score}")++ if result.score == "pass":+ print("Story outline is good enough, exiting.")+ break++ print("Re-running with feedback")+ input_items.append({"content": f"Feedback: {result.feedback}", "role": "user"})++ print(f"Final story outline: {latest_outline}")+++# Run the demo+# await run_llm_as_judge_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")+# ## 6. Output Guardrails Pattern+#+# Related to parallelization, you often want to run output guardrails to make sure the outputs from your agents are valid. Guardrails can have a \"tripwire\" - if the tripwire is triggered, the agent execution will immediately stop and a `GuardrailTripwireTriggered` exception will be raised.+#+# This is really useful for latency: for example, you might have a very fast model that runs the guardrail and a slow model that runs the actual agent. You wouldn't want to wait for the slow model to finish, so guardrails let you quickly reject invalid outputs.+#+# This pattern demonstrates how to use output guardrails to validate agent outputs after they are generated. This can help prevent sensitive information from being shared or ensure outputs meet quality standards.+# Start the AgentOps trace session+tracer = agentops.start_trace(trace_name="Output Guardrails Pattern", tags=["agentops-example", "openai-agents"])+++# The agent's output type+class MessageOutput(BaseModel):+ reasoning: str = Field(description="Thoughts on how to respond to the user's message")+ response: str = Field(description="The response to the user's message")+ user_name: str | None = Field(description="The name of the user who sent the message, if known")+++@output_guardrail+async def sensitive_data_check(+ context: RunContextWrapper, agent: Agent, output: MessageOutput+) -> GuardrailFunctionOutput:+ phone_number_in_response = "650" in output.response+ phone_number_in_reasoning = "650" in output.reasoning++ return GuardrailFunctionOutput(+ output_info={+ "phone_number_in_response": phone_number_in_response,+ "phone_number_in_reasoning": phone_number_in_reasoning,+ },+ tripwire_triggered=phone_number_in_response or phone_number_in_reasoning,+ )+++output_guardrail_agent = Agent(+ name="Assistant",+ instructions="You are a helpful assistant.",+ output_type=MessageOutput,+ output_guardrails=[sensitive_data_check],+)+++async def run_output_guardrails_demo():+ # Test with safe input+ print("Testing with safe input:")+ try:+ result = await Runner.run(output_guardrail_agent, "What's the capital of California?")+ print("Safe message passed")+ print(f"Response: {result.final_output.response}")+ except OutputGuardrailTripwireTriggered as e:+ print(f"Unexpected guardrail trigger: {e.guardrail_result.output.output_info}")++ print()+ # Test with potentially sensitive input+ print("Testing with potentially sensitive input:")+ try:+ result = await Runner.run(output_guardrail_agent, "My phone number is 650-123-4567. Where do you think I live?")+ print(f"Guardrail didn't trip - this is unexpected. Output: {result.final_output.response}")+ except OutputGuardrailTripwireTriggered as e:+ print(f"Guardrail tripped as expected. Info: {e.guardrail_result.output.output_info}")+++# Run the demo+# await run_output_guardrails_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")+# ## 7. Parallelization Pattern+#+# Running multiple agents in parallel is a common pattern. This can be useful for both latency (e.g. if you have multiple steps that don't depend on each other) and also for other reasons e.g. generating multiple responses and picking the best one.+#+# This example runs a translation agent multiple times in parallel, and then picks the best translation.+#+# This pattern shows how to run multiple agents in parallel to improve latency or generate multiple options to choose from. In this example, we run translation agents multiple times and pick the best result.+# Start the AgentOps trace session+tracer = agentops.start_trace(trace_name="Output Guardrails Pattern", tags=["agentops-example", "openai-agents"])++# Define agents for parallelization+spanish_translation_agent = Agent(+ name="spanish_agent",+ instructions="You translate the user's message to Spanish",+)++translation_picker = Agent(+ name="translation_picker",+ instructions="You pick the best Spanish translation from the given options.",+)+++async def run_parallelization_demo():+ msg = "Good morning, I hope you have a wonderful day!"+ print(f"Input: {msg}")++ with trace("Parallel translation"):+ # Run three translation agents in parallel+ res_1, res_2, res_3 = await asyncio.gather(+ Runner.run(spanish_translation_agent, msg),+ Runner.run(spanish_translation_agent, msg),+ Runner.run(spanish_translation_agent, msg),+ )++ outputs = [+ ItemHelpers.text_message_outputs(res_1.new_items),+ ItemHelpers.text_message_outputs(res_2.new_items),+ ItemHelpers.text_message_outputs(res_3.new_items),+ ]++ translations = "\\n\\n".join(outputs)+ print(f"\\n\\nTranslations:\\n\\n{translations}")++ best_translation = await Runner.run(+ translation_picker,+ f"Input: {msg}\\n\\nTranslations:\\n{translations}",+ )++ print("\\n\\n-----")+ print(f"Best translation: {best_translation.final_output}")+++# Run the demo+# await run_parallelization_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")+# ## 8. Routing Pattern+#+# In many situations, you have specialized sub-agents that handle specific tasks. You can use handoffs to route the task to the right agent.+#+# For example, you might have a frontline agent that receives a request, and then hands off to a specialized agent based on the language of the request.+#+# This pattern demonstrates handoffs and routing between specialized agents. The triage agent receives the first message and hands off to the appropriate agent based on the language of the request.+# Start the AgentOps trace session+tracer = agentops.start_trace(trace_name="Routing Pattern", tags=["agentops-example", "openai-agents"])++# Define language-specific agents+french_routing_agent = Agent(+ name="french_agent",+ instructions="You only speak French",+)++spanish_routing_agent = Agent(+ name="spanish_agent",+ instructions="You only speak Spanish",+)++english_routing_agent = Agent(+ name="english_agent",+ instructions="You only speak English",+)++triage_agent = Agent(+ name="triage_agent",+ instructions="Handoff to the appropriate agent based on the language of the request.",+ handoffs=[french_routing_agent, spanish_routing_agent, english_routing_agent],+)+++async def run_routing_demo():+ # Create an ID for this conversation+ conversation_id = str(uuid.uuid4().hex[:16])++ test_messages = ["Hello, how can you help me?", "Bonjour, comment allez-vous?", "Hola, ¿cómo estás?"]++ for msg in test_messages:+ print(f"\nTesting message: {msg}")++ with trace("Routing example", group_id=conversation_id):+ inputs = [{"content": msg, "role": "user"}]+ result = await Runner.run(triage_agent, input=inputs)+ print(f"Response: {result.final_output}")+++# Run the demo+# await run_routing_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")+# ## 9. Streaming Guardrails Pattern+#+# This example shows how to use guardrails as the model is streaming. Output guardrails run after the final output has been generated; this example runs guardrails every N tokens, allowing for early termination if bad output is detected.+#+# The expected output is that you'll see a bunch of tokens stream in, then the guardrail will trigger and stop the streaming.+#+# This pattern shows how to use guardrails during streaming to provide real-time validation. Unlike output guardrails that run after completion, streaming guardrails can interrupt the generation process early.+# Start the AgentOps trace session+tracer = agentops.start_trace(trace_name="Streaming Guardrails Pattern", tags=["agentops-example", "openai-agents"])++# Define streaming guardrail agent+streaming_agent = Agent(+ name="Assistant",+ instructions=(+ "You are a helpful assistant. You ALWAYS write long responses, making sure to be verbose and detailed."+ ),+)+++class GuardrailOutput(BaseModel):+ reasoning: str = Field(description="Reasoning about whether the response could be understood by a ten year old.")+ is_readable_by_ten_year_old: bool = Field(description="Whether the response is understandable by a ten year old.")+++guardrail_streaming_agent = Agent(+ name="Checker",+ instructions=(+ "You will be given a question and a response. Your goal is to judge whether the response "+ "is simple enough to be understood by a ten year old."+ ),+ output_type=GuardrailOutput,+ model="gpt-4o-mini",+)+++async def check_guardrail(text: str) -> GuardrailOutput:+ result = await Runner.run(guardrail_streaming_agent, text)+ return result.final_output_as(GuardrailOutput)+++async def run_streaming_guardrails_demo():+ question = "What is a black hole, and how does it behave?"+ print(f"Question: {question}")++ result = Runner.run_streamed(streaming_agent, question)+ current_text = ""++ # We will check the guardrail every N characters+ next_guardrail_check_len = 300+ guardrail_task = None++ async for event in result.stream_events():+ if event.type == "raw_response_event" and isinstance(event.data, ResponseTextDeltaEvent):+ print(event.data.delta, end="", flush=True)+ current_text += event.data.delta++ # Check if it's time to run the guardrail check+ if len(current_text) >= next_guardrail_check_len and not guardrail_task:+ print("\\n[Running guardrail check]")+ guardrail_task = asyncio.create_task(check_guardrail(current_text))+ next_guardrail_check_len += 300++ # Every iteration of the loop, check if the guardrail has been triggered+ if guardrail_task and guardrail_task.done():+ guardrail_result = guardrail_task.result()+ if not guardrail_result.is_readable_by_ten_year_old:+ print("\\n\\n================\\n\\n")+ print(f"Guardrail triggered. Reasoning:\\n{guardrail_result.reasoning}")+ break+ guardrail_task = None++ # Do one final check on the final output+ if current_text:+ guardrail_result = await check_guardrail(current_text)+ if not guardrail_result.is_readable_by_ten_year_old:+ print("\\n\\n================\\n\\n")+ print(f"Final guardrail triggered. Reasoning:\\n{guardrail_result.reasoning}")+++# Run the demo+# await run_streaming_guardrails_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")+# ## Conclusion+#+# This notebook has demonstrated 9 key agent patterns that are commonly used in production AI applications. Each pattern showcases how agents can be orchestrated to perform complex tasks, validate inputs and outputs, and improve overall application performance.+#+# **AgentOps** provides comprehensive observability for AI agents, automatically tracking all these interactions and providing valuable insights into:+#+# - **Performance metrics** - Latency, throughput, success rates across all agent patterns+# - **Cost analysis** - Token usage, model costs, and optimization opportunities for complex workflows+# - **Quality monitoring** - Output quality assessment, guardrail effectiveness, and pattern success rates+# - **Debugging support** - Detailed trace visualization, error tracking, and workflow analysis+# - **Agent behavior insights** - Understanding how different patterns perform in production environments+# - **Workflow optimization** - Identifying bottlenecks and improving agent coordination+#+# Visit [app.agentops.ai](https://app.agentops.ai) to explore your agent sessions and gain deeper insights into your AI application's behavior.diff --git a/examples/openai_agents/agents_tools.ipynb b/examples/openai_agents/agents_tools.ipynbnew file mode 100755index 00000000..a8bf70b6--- /dev/null+++ b/examples/openai_agents/agents_tools.ipynb@@ -0,0 +1,394 @@+{+ "cells": [+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "# OpenAI Agents Tools Demonstration\n",+ "\n",+ "This notebook demonstrates various tools available in the Agents SDK and how AgentOps provides observability for tool usage.\n",+ "\n",+ "## General Flow\n",+ "\n",+ "This notebook will walk you through several key tools:\n",+ "\n",+ "1. **Code Interpreter Tool** - Execute Python code and perform mathematical calculations\n",+ "2. **File Search Tool** - Search through vector stores and documents\n",+ "3. **Image Generation Tool** - Generate images from text descriptions\n",+ "4. **Web Search Tool** - Search the web for current information\n",+ "\n",+ "Each tool demonstrates how AgentOps automatically tracks tool usage, providing insights into performance, costs, and effectiveness."+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "## Prerequisites\n",+ "\n",+ "Before running this notebook, you'll need:\n",+ "\n",+ "1. **AgentOps Account**: Create a free account at [app.agentops.ai](https://app.agentops.ai)\n",+ "2. **AgentOps API Key**: Obtain your API key from your AgentOps dashboard\n",+ "3. **OpenAI API Key**: Get your API key from [platform.openai.com](https://platform.openai.com)\n",+ "4. **Vector Store ID**: Configure it from [platform.openai.com](https://platform.openai.com)."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Install required packages\n",+ "%pip install agentops\n",+ "%pip install openai-agents\n",+ "%pip install pydotenv"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Set the API keys for your AgentOps and OpenAI accounts.\n",+ "import os\n",+ "from dotenv import load_dotenv\n",+ "\n",+ "load_dotenv()\n",+ "\n",+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "import agentops\n",+ "\n",+ "agentops.init(auto_start_session=False, tags=[\"agentops-example\"])"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "import asyncio\n",+ "import base64\n",+ "import os\n",+ "import subprocess\n",+ "import sys\n",+ "import tempfile\n",+ "from typing import Literal, Union\n",+ "\n",+ "from agents import (\n",+ " Agent,\n",+ " AsyncComputer,\n",+ " Button,\n",+ " CodeInterpreterTool,\n",+ " ComputerTool,\n",+ " Environment,\n",+ " FileSearchTool,\n",+ " ImageGenerationTool,\n",+ " ModelSettings,\n",+ " Runner,\n",+ " WebSearchTool,\n",+ " trace,\n",+ ")"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "## 1. Code Interpreter Tool\n",+ "\n",+ "The Code Interpreter Tool allows agents to execute Python code in a secure environment. This is particularly useful for mathematical calculations, data analysis, and generating visualizations.\n",+ "\n",+ "**Key Features:**\n",+ "- Execute Python code safely\n",+ "- Perform complex mathematical calculations\n",+ "- Generate plots and visualizations\n",+ "- Handle data processing tasks"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"Code Interpreter Tool Example\", tags=[\"tools-demo\", \"openai-agents\", \"agentops-example\"]\n",+ ")\n",+ "\n",+ "\n",+ "async def run_code_interpreter_demo():\n",+ " agent = Agent(\n",+ " name=\"Code interpreter\",\n",+ " instructions=\"You love doing math.\",\n",+ " tools=[\n",+ " CodeInterpreterTool(\n",+ " tool_config={\"type\": \"code_interpreter\", \"container\": {\"type\": \"auto\"}},\n",+ " )\n",+ " ],\n",+ " )\n",+ "\n",+ " with trace(\"Code interpreter example\"):\n",+ " print(\"Solving math problem...\")\n",+ " result = Runner.run_streamed(agent, \"What is the square root of 273 * 312821 plus 1782?\")\n",+ " async for event in result.stream_events():\n",+ " if (\n",+ " event.type == \"run_item_stream_event\"\n",+ " and event.item.type == \"tool_call_item\"\n",+ " and event.item.raw_item.type == \"code_interpreter_call\"\n",+ " ):\n",+ " print(f\"Code interpreter code:\\n```\\n{event.item.raw_item.code}\\n```\\n\")\n",+ " elif event.type == \"run_item_stream_event\":\n",+ " print(f\"Other event: {event.item.type}\")\n",+ "\n",+ " print(f\"Final output: {result.final_output}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_code_interpreter_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "## 2. File Search Tool\n",+ "\n",+ "The File Search Tool allows agents to search through vector stores and document collections to find relevant information.\n",+ "\n",+ "**Key Features:**\n",+ "- Search through vector stores\n",+ "- Retrieve relevant documents\n",+ "- Support for semantic search\n",+ "- Configurable result limits\n",+ "\n",+ "**Note:** This example requires a pre-configured vector store ID."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"File Search Tool Example\", tags=[\"tools-demo\", \"openai-agents\", \"agentops-example\"]\n",+ ")\n",+ "\n",+ "\n",+ "async def run_file_search_demo():\n",+ " # Note: You'll need to replace this with your actual vector store ID\n",+ " vector_store_id = \"vs_67bf88953f748191be42b462090e53e7\"\n",+ "\n",+ " agent = Agent(\n",+ " name=\"File searcher\",\n",+ " instructions=\"You are a helpful agent.\",\n",+ " tools=[\n",+ " FileSearchTool(\n",+ " max_num_results=3,\n",+ " vector_store_ids=[vector_store_id],\n",+ " include_search_results=True,\n",+ " )\n",+ " ],\n",+ " )\n",+ "\n",+ " with trace(\"File search example\"):\n",+ " try:\n",+ " result = await Runner.run(agent, \"Be concise, and tell me 1 sentence about Arrakis I might not know.\")\n",+ " print(result.final_output)\n",+ " print(\"\\n\".join([str(out) for out in result.new_items]))\n",+ " except Exception as e:\n",+ " print(f\"File search demo requires a valid vector store ID. Error: {e}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_file_search_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "## 3. Image Generation Tool\n",+ "\n",+ "The Image Generation Tool enables agents to create images from text descriptions using AI image generation models.\n",+ "\n",+ "**Key Features:**\n",+ "- Generate images from text prompts\n",+ "- Configurable quality settings\n",+ "- Support for various image styles\n",+ "- Automatic image saving and display"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"Image Generation Tool Example\", tags=[\"tools-demo\", \"openai-agents\", \"agentops-example\"]\n",+ ")\n",+ "\n",+ "\n",+ "def open_file(path: str) -> None:\n",+ " if sys.platform.startswith(\"darwin\"):\n",+ " subprocess.run([\"open\", path], check=False) # macOS\n",+ " elif os.name == \"nt\": # Windows\n",+ " os.startfile(path) # type: ignore\n",+ " elif os.name == \"posix\":\n",+ " subprocess.run([\"xdg-open\", path], check=False) # Linux/Unix\n",+ " else:\n",+ " print(f\"Don't know how to open files on this platform: {sys.platform}\")\n",+ "\n",+ "\n",+ "async def run_image_generation_demo():\n",+ " agent = Agent(\n",+ " name=\"Image generator\",\n",+ " instructions=\"You are a helpful agent.\",\n",+ " tools=[\n",+ " ImageGenerationTool(\n",+ " tool_config={\"type\": \"image_generation\", \"quality\": \"low\"},\n",+ " )\n",+ " ],\n",+ " )\n",+ "\n",+ " with trace(\"Image generation example\"):\n",+ " print(\"Generating image, this may take a while...\")\n",+ " result = await Runner.run(agent, \"Create an image of a frog eating a pizza, comic book style.\")\n",+ " print(result.final_output)\n",+ " for item in result.new_items:\n",+ " if (\n",+ " item.type == \"tool_call_item\"\n",+ " and item.raw_item.type == \"image_generation_call\"\n",+ " and (img_result := item.raw_item.result)\n",+ " ):\n",+ " with tempfile.NamedTemporaryFile(suffix=\".png\", delete=False) as tmp:\n",+ " tmp.write(base64.b64decode(img_result))\n",+ " temp_path = tmp.name\n",+ "\n",+ " # Open the image\n",+ " print(f\"Image saved to: {temp_path}\")\n",+ " try:\n",+ " open_file(temp_path)\n",+ " except Exception as e:\n",+ " print(f\"Could not open image automatically: {e}\")\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_image_generation_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "## 4. Web Search Tool\n",+ "\n",+ "The Web Search Tool allows agents to search the internet for current information and real-time data.\n",+ "\n",+ "**Key Features:**\n",+ "- Search the web for current information\n",+ "- Location-aware search results\n",+ "- Real-time data access\n",+ "- Configurable search parameters"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Start the AgentOps trace session\n",+ "tracer = agentops.start_trace(\n",+ " trace_name=\"Web Search Tool Example\", tags=[\"tools-demo\", \"openai-agents\", \"agentops-example\"]\n",+ ")\n",+ "\n",+ "\n",+ "async def run_web_search_demo():\n",+ " agent = Agent(\n",+ " name=\"Web searcher\",\n",+ " instructions=\"You are a helpful agent.\",\n",+ " tools=[WebSearchTool(user_location={\"type\": \"approximate\", \"city\": \"New York\"})],\n",+ " )\n",+ "\n",+ " with trace(\"Web search example\"):\n",+ " result = await Runner.run(\n",+ " agent,\n",+ " \"search the web for 'local sports news' and give me 1 interesting update in a sentence.\",\n",+ " )\n",+ " print(result.final_output)\n",+ " # Example output: The New York Giants are reportedly pursuing quarterback Aaron Rodgers after his ...\n",+ "\n",+ "\n",+ "# Run the demo\n",+ "await run_web_search_demo()\n",+ "\n",+ "# End the AgentOps trace session\n",+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "## Conclusion\n",+ "\n",+ "Each tool extends agent capabilities and enables sophisticated automation. **AgentOps makes tool observability effortless** - simply import the library and all your tool interactions are automatically tracked, visualized, and analyzed. This enables you to:\n",+ "\n",+ "- Monitor tool performance across different use cases\n",+ "- Optimize costs by understanding tool usage patterns\n",+ "- Debug tool integration issues quickly\n",+ "- Scale your AI applications with confidence in tool reliability\n",+ "\n",+ "Visit [app.agentops.ai](https://app.agentops.ai) to explore your tool usage sessions and gain deeper insights into your AI application's tool interactions."+ ]+ }+ ],+ "metadata": {+ "kernelspec": {+ "display_name": "agentops (3.11.11)",+ "language": "python",+ "name": "python3"+ },+ "language_info": {+ "codemirror_mode": {+ "name": "ipython",+ "version": 3+ },+ "file_extension": ".py",+ "mimetype": "text/x-python",+ "name": "python",+ "nbconvert_exporter": "python",+ "pygments_lexer": "ipython3",+ "version": "3.11.11"+ }+ },+ "nbformat": 4,+ "nbformat_minor": 4+}diff --git a/examples/openai_agents/agents_tools.py b/examples/openai_agents/agents_tools.pynew file mode 100644index 00000000..71c8644e--- /dev/null+++ b/examples/openai_agents/agents_tools.py@@ -0,0 +1,260 @@+# OpenAI Agents Tools Demonstration+#+# This notebook demonstrates various tools available in the Agents SDK and how AgentOps provides observability for tool usage.+#+# ## General Flow+#+# This notebook will walk you through several key tools:+#+# 1. **Code Interpreter Tool** - Execute Python code and perform mathematical calculations+# 2. **File Search Tool** - Search through vector stores and documents+# 3. **Image Generation Tool** - Generate images from text descriptions+# 4. **Web Search Tool** - Search the web for current information+#+# Each tool demonstrates how AgentOps automatically tracks tool usage, providing insights into performance, costs, and effectiveness.+# ## Prerequisites+#+# Before running this notebook, you'll need:+#+# 1. **AgentOps Account**: Create a free account at [app.agentops.ai](https://app.agentops.ai)+# 2. **AgentOps API Key**: Obtain your API key from your AgentOps dashboard+# 3. **OpenAI API Key**: Get your API key from [platform.openai.com](https://platform.openai.com)+# 4. **Vector Store ID**: Configure it from [platform.openai.com](https://platform.openai.com).+# # Install required packages+# %pip install agentops+# %pip install openai-agents+# %pip install pydotenv+# Set the API keys for your AgentOps and OpenAI accounts.+import os+from dotenv import load_dotenv+import agentops+import base64+import subprocess+import sys+import tempfile++from agents import (+ Agent,+ CodeInterpreterTool,+ FileSearchTool,+ ImageGenerationTool,+ Runner,+ WebSearchTool,+ trace,+)++load_dotenv()++os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++agentops.init(auto_start_session=False, tags=["agentops-example"])++# ## 1. Code Interpreter Tool+#+# The Code Interpreter Tool allows agents to execute Python code in a secure environment. This is particularly useful for mathematical calculations, data analysis, and generating visualizations.+#+# **Key Features:**+# - Execute Python code safely+# - Perform complex mathematical calculations+# - Generate plots and visualizations+# - Handle data processing tasks+# Start the AgentOps trace session+tracer = agentops.start_trace(+ trace_name="Code Interpreter Tool Example", tags=["tools-demo", "openai-agents", "agentops-example"]+)+++async def run_code_interpreter_demo():+ agent = Agent(+ name="Code interpreter",+ instructions="You love doing math.",+ tools=[+ CodeInterpreterTool(+ tool_config={"type": "code_interpreter", "container": {"type": "auto"}},+ )+ ],+ )++ with trace("Code interpreter example"):+ print("Solving math problem...")+ result = Runner.run_streamed(agent, "What is the square root of 273 * 312821 plus 1782?")+ async for event in result.stream_events():+ if (+ event.type == "run_item_stream_event"+ and event.item.type == "tool_call_item"+ and event.item.raw_item.type == "code_interpreter_call"+ ):+ print(f"Code interpreter code:\n```\n{event.item.raw_item.code}\n```\n")+ elif event.type == "run_item_stream_event":+ print(f"Other event: {event.item.type}")++ print(f"Final output: {result.final_output}")+++# Run the demo+# await run_code_interpreter_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")++# ## 2. File Search Tool+#+# The File Search Tool allows agents to search through vector stores and document collections to find relevant information.+#+# **Key Features:**+# - Search through vector stores+# - Retrieve relevant documents+# - Support for semantic search+# - Configurable result limits+#+# **Note:** This example requires a pre-configured vector store ID.+# Start the AgentOps trace session+tracer = agentops.start_trace(+ trace_name="File Search Tool Example", tags=["tools-demo", "openai-agents", "agentops-example"]+)+++async def run_file_search_demo():+ # Note: You'll need to replace this with your actual vector store ID+ vector_store_id = "vs_67bf88953f748191be42b462090e53e7"++ agent = Agent(+ name="File searcher",+ instructions="You are a helpful agent.",+ tools=[+ FileSearchTool(+ max_num_results=3,+ vector_store_ids=[vector_store_id],+ include_search_results=True,+ )+ ],+ )++ with trace("File search example"):+ try:+ result = await Runner.run(agent, "Be concise, and tell me 1 sentence about Arrakis I might not know.")+ print(result.final_output)+ print("\n".join([str(out) for out in result.new_items]))+ except Exception as e:+ print(f"File search demo requires a valid vector store ID. Error: {e}")+++# Run the demo+# await run_file_search_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")++# ## 3. Image Generation Tool+#+# The Image Generation Tool enables agents to create images from text descriptions using AI image generation models.+#+# **Key Features:**+# - Generate images from text prompts+# - Configurable quality settings+# - Support for various image styles+# - Automatic image saving and display+# Start the AgentOps trace session+tracer = agentops.start_trace(+ trace_name="Image Generation Tool Example", tags=["tools-demo", "openai-agents", "agentops-example"]+)+++def open_file(path: str) -> None:+ if sys.platform.startswith("darwin"):+ subprocess.run(["open", path], check=False) # macOS+ elif os.name == "nt": # Windows+ os.startfile(path) # type: ignore+ elif os.name == "posix":+ subprocess.run(["xdg-open", path], check=False) # Linux/Unix+ else:+ print(f"Don't know how to open files on this platform: {sys.platform}")+++async def run_image_generation_demo():+ agent = Agent(+ name="Image generator",+ instructions="You are a helpful agent.",+ tools=[+ ImageGenerationTool(+ tool_config={"type": "image_generation", "quality": "low"},+ )+ ],+ )++ with trace("Image generation example"):+ print("Generating image, this may take a while...")+ result = await Runner.run(agent, "Create an image of a frog eating a pizza, comic book style.")+ print(result.final_output)+ for item in result.new_items:+ if (+ item.type == "tool_call_item"+ and item.raw_item.type == "image_generation_call"+ and (img_result := item.raw_item.result)+ ):+ with tempfile.NamedTemporaryFile(suffix=".png", delete=False) as tmp:+ tmp.write(base64.b64decode(img_result))+ temp_path = tmp.name++ # Open the image+ print(f"Image saved to: {temp_path}")+ try:+ open_file(temp_path)+ except Exception as e:+ print(f"Could not open image automatically: {e}")+++# Run the demo+# await run_image_generation_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")++# ## 4. Web Search Tool+#+# The Web Search Tool allows agents to search the internet for current information and real-time data.+#+# **Key Features:**+# - Search the web for current information+# - Location-aware search results+# - Real-time data access+# - Configurable search parameters+# Start the AgentOps trace session+tracer = agentops.start_trace(+ trace_name="Web Search Tool Example", tags=["tools-demo", "openai-agents", "agentops-example"]+)+++async def run_web_search_demo():+ agent = Agent(+ name="Web searcher",+ instructions="You are a helpful agent.",+ tools=[WebSearchTool(user_location={"type": "approximate", "city": "New York"})],+ )++ with trace("Web search example"):+ result = await Runner.run(+ agent,+ "search the web for 'local sports news' and give me 1 interesting update in a sentence.",+ )+ print(result.final_output)+ # Example output: The New York Giants are reportedly pursuing quarterback Aaron Rodgers after his ...+++# Run the demo+# await run_web_search_demo()++# End the AgentOps trace session+agentops.end_trace(tracer, end_state="Success")++# ## Conclusion+#+# Each tool extends agent capabilities and enables sophisticated automation. **AgentOps makes tool observability effortless** - simply import the library and all your tool interactions are automatically tracked, visualized, and analyzed. This enables you to:+#+# - Monitor tool performance across different use cases+# - Optimize costs by understanding tool usage patterns+# - Debug tool integration issues quickly+# - Scale your AI applications with confidence in tool reliability+#+# Visit [app.agentops.ai](https://app.agentops.ai) to explore your tool usage sessions and gain deeper insights into your AI application's tool interactions.diff --git a/examples/openai_agents_sdk/customer_service_agent.ipynb b/examples/openai_agents/customer_service_agent.ipynbsimilarity index 70%rename from examples/openai_agents_sdk/customer_service_agent.ipynbrename to examples/openai_agents/customer_service_agent.ipynbindex ed313b71..a873049a 100644--- a/examples/openai_agents_sdk/customer_service_agent.ipynb+++ b/examples/openai_agents/customer_service_agent.ipynb@@ -1,13 +1,46 @@{"cells": [+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "# Airline Customer Service Agent\n",+ "\n",+ "This is a simple chatbot designed to assist airline customers with common queries. Here the agents are also used as tools to help the bot answer questions more effectively.\n",+ "\n",+ "Using AgentOps we can track the flow of the conversation and the agents used. This is useful for debugging and understanding how the bot is performing."+ ]+ },+ {+ "cell_type": "markdown",+ "metadata": {},+ "source": [+ "## Prerequisites\n",+ "\n",+ "Before running this notebook, you'll need:\n",+ "\n",+ "1. **AgentOps Account**: Create a free account at [app.agentops.ai](https://app.agentops.ai)\n",+ "2. **AgentOps API Key**: Obtain your API key from your AgentOps dashboard\n",+ "3. **OpenAI API Key**: Get your API key from [platform.openai.com](https://platform.openai.com)\n",+ "\n",+ "Make sure to set these as environment variables or create a `.env` file in your project root with:\n",+ "\n",+ "```\n",+ "AGENTOPS_API_KEY=your_agentops_api_key_here\n",+ "OPENAI_API_KEY=your_openai_api_key_here\n",+ "```"+ ]+ },{"cell_type": "code","execution_count": null,"metadata": {},"outputs": [],"source": [- "# IMPORTANT: After running this cell, restart the kernel before continuing.\n",- "get_ipython().system(\"pip install -q -U agentops openai-agents\")"+ "# Install required packages\n",+ "%pip install agentops\n",+ "%pip install openai-agents\n",+ "%pip install pydotenv"]},{@@ -18,14 +51,12 @@"source": ["# Set the API keys for your AgentOps and OpenAI accounts.\n","import os\n",+ "from dotenv import load_dotenv\n","\n",- "os.environ[\"OPENAI_API_KEY\"] = \"\"\n",- "os.environ[\"AGENTOPS_API_KEY\"] = \"\"\n",+ "load_dotenv()\n","\n",- "if os.environ[\"OPENAI_API_KEY\"] == \"\":\n",- " raise ValueError(\"OPENAI_API_KEY is not set. You can get one at https://platform.openai.com/api-keys\")\n",- "if os.environ[\"AGENTOPS_API_KEY\"] == \"\":\n",- " raise ValueError(\"AGENTOPS_API_KEY is not set. You can get one at https://app.agentops.ai/\")"+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")"]},{@@ -36,15 +67,15 @@"source": ["from __future__ import annotations as _annotations # noqa: F404\n","\n",+ "import asyncio\n","import random\n","import uuid\n",+ "import sys\n",+ "\n","from pydantic import BaseModel\n","import agentops\n","\n",- "# API key is automatically read from the environment variable\n",- "agentops.init(tags=[\"customer-service-agent\", \"agentops-example\"])\n",- "\n",- "from agents import ( # noqa: E402\n",+ "from agents import ( # noqa: E402\n"," Agent,\n"," HandoffOutputItem,\n"," ItemHelpers,\n",@@ -58,21 +89,40 @@" handoff,\n"," trace,\n",")\n",- "from agents.extensions.handoff_prompt import RECOMMENDED_PROMPT_PREFIX # noqa: E402\n",- "\n",- "### CONTEXT\n",- "\n",- "\n",+ "from agents.extensions.handoff_prompt import RECOMMENDED_PROMPT_PREFIX # noqa: E402"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "agentops.init(tags=[\"customer-service-agent\", \"openai-agents\", \"agentops-example\"], auto_start_session=False)\n",+ "tracer = agentops.start_trace(trace_name=\"Customer Service Agent\")"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Context model for the airline agent\n","class AirlineAgentContext(BaseModel):\n"," passenger_name: str | None = None\n"," confirmation_number: str | None = None\n"," seat_number: str | None = None\n",- " flight_number: str | None = None\n",- "\n",- "\n",- "### TOOLS\n",- "\n",- "\n",+ " flight_number: str | None = None"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": [+ "# Tools for the airline agent\n","@function_tool(name_override=\"faq_lookup_tool\", description_override=\"Lookup frequently asked questions.\")\n","async def faq_lookup_tool(question: str) -> str:\n"," if \"bag\" in question or \"baggage\" in question:\n",@@ -157,15 +207,25 @@" faq_agent,\n"," handoff(agent=seat_booking_agent, on_handoff=on_seat_booking_handoff),\n"," ],\n",- ")\n",- "\n",+ ")"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": ["faq_agent.handoffs.append(triage_agent)\n",- "seat_booking_agent.handoffs.append(triage_agent)\n",- "\n",- "\n",- "### RUN\n",- "\n",- "\n",+ "seat_booking_agent.handoffs.append(triage_agent)"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "metadata": {},+ "outputs": [],+ "source": ["async def main():\n"," current_agent: Agent[AirlineAgentContext] = triage_agent\n"," input_items: list[TResponseInputItem] = []\n",@@ -194,25 +254,34 @@" else:\n"," print(f\"{agent_name}: Skipping item: {new_item.__class__.__name__}\")\n"," input_items = result.to_input_list()\n",- " current_agent = result.last_agent\n",- "\n",- "\n",- "await main()"+ " current_agent = result.last_agent"]},{- "cell_type": "markdown",+ "cell_type": "code",+ "execution_count": null,"metadata": {},+ "outputs": [],"source": [- "You can check the trace in the AgentOps UI: https://app.agentops.ai/traces"+ "await main()\n",+ "agentops.end_trace(tracer, status=\"Success\")"]},{- "cell_type": "code",- "execution_count": null,+ "cell_type": "markdown","metadata": {},- "outputs": [],- "source": []+ "source": [+ "## Conclusion\n",+ "\n",+ "**AgentOps makes observability effortless** - simply import the library and all your interactions are automatically tracked, visualized, and analyzed. This enables you to:\n",+ "\n",+ "- Monitor tool performance across different use cases\n",+ "- Optimize costs by understanding tool usage patterns\n",+ "- Debug tool integration issues quickly\n",+ "- Scale your AI applications with confidence in tool reliability\n",+ "\n",+ "Visit [app.agentops.ai](https://app.agentops.ai) to explore your tool usage sessions and gain deeper insights into your AI application's tool interactions."+ ]}],"metadata": {diff --git a/examples/agents-examples/customer_service/main.py b/examples/openai_agents/customer_service_agent.pysimilarity index 73%rename from examples/agents-examples/customer_service/main.pyrename to examples/openai_agents/customer_service_agent.pyindex 4b4d7f7a..92fa34bb 100644--- a/examples/agents-examples/customer_service/main.py+++ b/examples/openai_agents/customer_service_agent.py@@ -1,17 +1,35 @@-"""-This example shows a customer service agent that can handle a customer's request.-"""-+# Airline Customer Service Agent+#+# This is a simple chatbot designed to assist airline customers with common queries. Here the agents are also used as tools to help the bot answer questions more effectively.+#+# Using AgentOps we can track the flow of the conversation and the agents used. This is useful for debugging and understanding how the bot is performing.+# ## Prerequisites+#+# Before running this notebook, you'll need:+#+# 1. **AgentOps Account**: Create a free account at [app.agentops.ai](https://app.agentops.ai)+# 2. **AgentOps API Key**: Obtain your API key from your AgentOps dashboard+# 3. **OpenAI API Key**: Get your API key from [platform.openai.com](https://platform.openai.com)+#+# Make sure to set these as environment variables or create a `.env` file in your project root with:+#+# ```+# AGENTOPS_API_KEY=your_agentops_api_key_here+# OPENAI_API_KEY=your_openai_api_key_here+# ```+# # Install required packages+# %pip install agentops+# %pip install openai-agents+# %pip install pydotenv+# Set the API keys for your AgentOps and OpenAI accounts.from __future__ import annotations as _annotations-import asyncio+import os+from dotenv import load_dotenvimport randomimport uuidfrom pydantic import BaseModel--from dotenv import load_dotenv-import osimport agentopsfrom agents import (@@ -29,16 +47,17 @@ from agents import (trace,)from agents.extensions.handoff_prompt import RECOMMENDED_PROMPT_PREFIX-### CONTEXT-# Load the environment variables for the scriptload_dotenv()-# Initialize the agentops module-AGENTOPS_API_KEY = os.getenv("AGENTOPS_API_KEY") or "your-api-key"-agentops.init(api_key=AGENTOPS_API_KEY)+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")+agentops.init(tags=["customer-service-agent", "openai-agents", "agentops-example"], auto_start_session=False)+tracer = agentops.start_trace(trace_name="Customer Service Agent")++# Context model for the airline agentclass AirlineAgentContext(BaseModel):passenger_name: str | None = Noneconfirmation_number: str | None = None@@ -46,9 +65,7 @@ class AirlineAgentContext(BaseModel):flight_number: str | None = None-### TOOLS--+# Tools for the airline agent@function_tool(name_override="faq_lookup_tool", description_override="Lookup frequently asked questions.")async def faq_lookup_tool(question: str) -> str:if "bag" in question or "baggage" in question:@@ -86,15 +103,12 @@ async def update_seat(context: RunContextWrapper[AirlineAgentContext], confirmat### HOOKS--async def on_seat_booking_handoff(context: RunContextWrapper[AirlineAgentContext]) -> None:flight_number = f"FLT-{random.randint(100, 999)}"context.context.flight_number = flight_number### AGENTS-faq_agent = Agent[AirlineAgentContext](name="FAQ Agent",handoff_description="A helpful agent that can answer questions about the airline.",@@ -139,9 +153,6 @@ faq_agent.handoffs.append(triage_agent)seat_booking_agent.handoffs.append(triage_agent)-### RUN--async def main():current_agent: Agent[AirlineAgentContext] = triage_agentinput_items: list[TResponseInputItem] = []@@ -173,5 +184,16 @@ async def main():current_agent = result.last_agent-if __name__ == "__main__":- asyncio.run(main())+# await main()+agentops.end_trace(tracer, status="Success")++# ## Conclusion+#+# **AgentOps makes observability effortless** - simply import the library and all your interactions are automatically tracked, visualized, and analyzed. This enables you to:+#+# - Monitor tool performance across different use cases+# - Optimize costs by understanding tool usage patterns+# - Debug tool integration issues quickly+# - Scale your AI applications with confidence in tool reliability+#+# Visit [app.agentops.ai](https://app.agentops.ai) to explore your tool usage sessions and gain deeper insights into your AI application's tool interactions.diff --git a/examples/openai_agents_sdk/tool_usage_agent.ipynb b/examples/openai_agents_sdk/tool_usage_agent.ipynbdeleted file mode 100644index bfd5b6e2..00000000--- a/examples/openai_agents_sdk/tool_usage_agent.ipynb+++ /dev/null@@ -1,102 +0,0 @@-{- "cells": [- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# IMPORTANT: After running this cell, restart the kernel before continuing.\n",- "get_ipython().system(\"pip install -q -U agentops openai-agents\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Set the API keys for your AgentOps and OpenAI accounts.\n",- "import os\n",- "\n",- "os.environ[\"OPENAI_API_KEY\"] = \"\"\n",- "os.environ[\"AGENTOPS_API_KEY\"] = \"\"\n",- "\n",- "if os.environ[\"OPENAI_API_KEY\"] == \"\":\n",- " raise ValueError(\"OPENAI_API_KEY is not set. You can get one at https://platform.openai.com/api-keys\")\n",- "if os.environ[\"AGENTOPS_API_KEY\"] == \"\":\n",- " raise ValueError(\"AGENTOPS_API_KEY is not set. You can get one at https://app.agentops.ai/\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "from agents import Agent, Runner, function_tool\n",- "import agentops\n",- "\n",- "# AgentOps automatically reads the API key from the environment variable\n",- "agentops.init(tags=[\"weather-checker\", \"agentops-example\"])\n",- "\n",- "\n",- "@function_tool\n",- "def get_weather(city: str) -> str:\n",- " return f\"The weather in {city} is sunny.\"\n",- "\n",- "\n",- "agent = Agent(\n",- " name=\"Weather checker\",\n",- " instructions=\"You are a helpful agent that checks the weather in a given city.\",\n",- " tools=[get_weather],\n",- ")\n",- "\n",- "\n",- "async def main():\n",- " print(\"Starting agent...\")\n",- " result = await Runner.run(agent, input=\"What's the weather in San Francisco?\")\n",- " print(result.final_output)\n",- " # The weather in San Francisco is sunny.\n",- "\n",- "\n",- "await main()"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "You can check the trace in the AgentOps UI: https://app.agentops.ai/traces"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": []- }- ],- "metadata": {- "kernelspec": {- "display_name": "base",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.7"- }- },- "nbformat": 4,- "nbformat_minor": 2-}diff --git a/examples/openai_agents_sdk/web_search_agent.ipynb b/examples/openai_agents_sdk/web_search_agent.ipynbdeleted file mode 100644index 35bf9616..00000000--- a/examples/openai_agents_sdk/web_search_agent.ipynb+++ /dev/null@@ -1,99 +0,0 @@-{- "cells": [- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# IMPORTANT: After running this cell, restart the kernel before continuing.\n",- "get_ipython().system(\"pip install -q -U agentops openai-agents\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Set the API keys for your AgentOps and OpenAI accounts.\n",- "import os\n",- "\n",- "os.environ[\"OPENAI_API_KEY\"] = \"\"\n",- "os.environ[\"AGENTOPS_API_KEY\"] = \"\"\n",- "\n",- "if os.environ[\"OPENAI_API_KEY\"] == \"\":\n",- " raise ValueError(\"OPENAI_API_KEY is not set. You can get one at https://platform.openai.com/api-keys\")\n",- "if os.environ[\"AGENTOPS_API_KEY\"] == \"\":\n",- " raise ValueError(\"AGENTOPS_API_KEY is not set. You can get one at https://app.agentops.ai/\")"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "from agents import Agent, Runner, WebSearchTool, trace\n",- "import agentops\n",- "\n",- "# AgentOps automatically reads the API key from the environment variable\n",- "agentops.init(tags=[\"web-search-agent\", \"agentops-example\"])\n",- "\n",- "\n",- "async def main():\n",- " agent = Agent(\n",- " name=\"Web searcher\",\n",- " instructions=\"You are a helpful agent.\",\n",- " tools=[WebSearchTool(user_location={\"type\": \"approximate\", \"city\": \"New York\"})],\n",- " )\n",- "\n",- " with trace(\"Web search example\"):\n",- " result = await Runner.run(\n",- " agent,\n",- " \"search the web for 'local sports news' and give me 1 interesting update in a sentence.\",\n",- " )\n",- " print(result.final_output)\n",- " # The New York Giants are reportedly pursuing quarterback Aaron Rodgers after his ...\n",- "\n",- "\n",- "await main()"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "You can check the trace in the AgentOps UI: https://app.agentops.ai/traces"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": []- }- ],- "metadata": {- "kernelspec": {- "display_name": "base",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.7"- }- },- "nbformat": 4,- "nbformat_minor": 2-}diff --git a/examples/openai_examples/README.md b/examples/openai_examples/README.mddeleted file mode 100644index 6416b46b..00000000--- a/examples/openai_examples/README.md+++ /dev/null@@ -1,21 +0,0 @@-# OpenAI integration with AgentOps--AgentOps supports observability for OpenAI's API for both version 0.0.x and version 1.x.--To learn more about OpenAI visit [here!](https://www.openai.com) and their documentation [here](https://platform.openai.com/docs/introduction).--## Getting Started--### Prerequisites-* An AgentOps account with an API key-* An OpenAI API key--Refer to the [AgentOps documentation](https://docs.agentops.ai/getting-started/api-key) for more information on how to get an API key.--### Documentation-The documentation for the OpenAI integration can be found [here](https://docs.agentops.ai/integrations/openai).--The example notebooks are present in the [openai_examples](./openai_examples/) directory.--### License-This project is released under the MIT License.\ No newline at end of filediff --git a/examples/openai_examples/images/assistants_overview_assistants_dashboard.png b/examples/openai_examples/images/assistants_overview_assistants_dashboard.pngdeleted file mode 100644index dff577c1..00000000Binary files a/examples/openai_examples/images/assistants_overview_assistants_dashboard.png and /dev/null differdiff --git a/examples/openai_examples/images/assistants_overview_assistants_playground.png b/examples/openai_examples/images/assistants_overview_assistants_playground.pngdeleted file mode 100644index b55af212..00000000Binary files a/examples/openai_examples/images/assistants_overview_assistants_playground.png and /dev/null differdiff --git a/examples/openai_examples/images/assistants_overview_diagram.png b/examples/openai_examples/images/assistants_overview_diagram.pngdeleted file mode 100644index 3ac068a7..00000000Binary files a/examples/openai_examples/images/assistants_overview_diagram.png and /dev/null differdiff --git a/examples/openai_examples/images/assistants_overview_enable_code_interpreter.png b/examples/openai_examples/images/assistants_overview_enable_code_interpreter.pngdeleted file mode 100644index 81d498da..00000000Binary files a/examples/openai_examples/images/assistants_overview_enable_code_interpreter.png and /dev/null differdiff --git a/examples/openai_examples/images/assistants_overview_enable_function.png b/examples/openai_examples/images/assistants_overview_enable_function.pngdeleted file mode 100644index b17aa306..00000000Binary files a/examples/openai_examples/images/assistants_overview_enable_function.png and /dev/null differdiff --git a/examples/openai_examples/images/assistants_overview_enable_retrieval.png b/examples/openai_examples/images/assistants_overview_enable_retrieval.pngdeleted file mode 100644index fd6684f1..00000000Binary files a/examples/openai_examples/images/assistants_overview_enable_retrieval.png and /dev/null differdiff --git a/examples/openai_examples/images/assistants_overview_new_assistant.png b/examples/openai_examples/images/assistants_overview_new_assistant.pngdeleted file mode 100644index 318f860c..00000000Binary files a/examples/openai_examples/images/assistants_overview_new_assistant.png and /dev/null differdiff --git a/examples/openai_examples/language_models_are_unsupervised_multitask_learners.pdf b/examples/openai_examples/language_models_are_unsupervised_multitask_learners.pdfdeleted file mode 100644index b714945e..00000000Binary files a/examples/openai_examples/language_models_are_unsupervised_multitask_learners.pdf and /dev/null differdiff --git a/examples/openai_examples/openai_assistants_example.ipynb b/examples/openai_examples/openai_assistants_example.ipynbdeleted file mode 100644index b0d6c3b8..00000000--- a/examples/openai_examples/openai_assistants_example.ipynb+++ /dev/null@@ -1,1077 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Assistants API Overview with AgentOps"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "This notebook has been adapted from this OpenAI Cookbook [example](https://cookbook.openai.com/examples/assistants_api_overview_python)."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "The new [Assistants API](https://platform.openai.com/docs/assistants/overview) is a stateful evolution of our [Chat Completions API](https://platform.openai.com/docs/guides/text-generation/chat-completions-api) meant to simplify the creation of assistant-like experiences, and enable developer access to powerful tools like Code Interpreter and Retrieval."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- ""- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Chat Completions API vs Assistants API\n",- "\n",- "The primitives of the **Chat Completions API** are `Messages`, on which you perform a `Completion` with a `Model` (`gpt-3.5-turbo`, `gpt-4`, etc). It is lightweight and powerful, but inherently stateless, which means you have to manage conversation state, tool definitions, retrieval documents, and code execution manually.\n",- "\n",- "The primitives of the **Assistants API** are\n",- "\n",- "- `Assistants`, which encapsulate a base model, instructions, tools, and (context) documents,\n",- "- `Threads`, which represent the state of a conversation, and\n",- "- `Runs`, which power the execution of an `Assistant` on a `Thread`, including textual responses and multi-step tool use.\n",- "\n",- "We'll take a look at how these can be used to create powerful, stateful experiences.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Setup\n",- "\n",- "> **Note**\n",- "> The Assistants API is currently in beta so the latest [Python SDK](https://github.com/openai/openai-python) is needed (`1.58.1` at time of writing) for this example.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "%pip install -U openai\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Pretty Printing Helper\n"- ]- },- {- "cell_type": "code",- "execution_count": 62,- "metadata": {},- "outputs": [],- "source": [- "import json\n",- "\n",- "\n",- "def show_json(obj):\n",- " display(json.loads(obj.model_dump_json()))"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Complete Example with Assistants API\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Assistants\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "The easiest way to get started with the Assistants API is through the [Assistants Playground](https://platform.openai.com/playground).\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's begin by creating an assistant! We'll create a Math Tutor just like in our [docs](https://platform.openai.com/docs/assistants/overview).\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "You can view Assistants you've created in the [Assistants Dashboard](https://platform.openai.com/assistants).\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "You can also create Assistants directly through the Assistants API. But we need to have the AgentOps and OpenAI API keys first.\n",- "\n",- "You can get your OpenAI API key from the [OpenAI Dashboard](https://platform.openai.com/api-keys).\n",- "\n",- "To obtain the AgentOps API key, signup for an account on [AgentOps](https://agentops.ai/) and create a project. After creating the project, you can now create an API key in the [Project Settings](https://app.agentops.ai/settings/projects)."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now we are all set! Let's import the necessary libraries and initialize the AgentOps and OpenAI clients."- ]- },- {- "cell_type": "code",- "execution_count": 63,- "metadata": {},- "outputs": [],- "source": [- "from openai import OpenAI\n",- "import agentops\n",- "from dotenv import load_dotenv\n",- "import os\n",- "\n",- "load_dotenv()\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\"\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\""- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "agentops.init(api_key=AGENTOPS_API_KEY, default_tags=[\"openai\", \"beta-assistants\"])\n",- "client = OpenAI(api_key=OPENAI_API_KEY)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll create an Assistant which will be our Math Tutor."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "assistant = client.beta.assistants.create(\n",- " name=\"Math Tutor\",\n",- " instructions=\"You are a personal math tutor. Answer questions briefly, in a sentence or less.\",\n",- " model=\"gpt-4o-mini\",\n",- ")\n",- "show_json(assistant)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Regardless of whether you create your Assistant through the Dashboard or with the API, you'll want to keep track of the Assistant ID. This is how you'll refer to your Assistant throughout Threads and Runs.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Next, we'll create a new Thread and add a Message to it. This will hold the state of our conversation, so we don't have re-send the entire message history each time.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Threads\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Create a new thread:\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "thread = client.beta.threads.create()\n",- "show_json(thread)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Then add the Message to the thread:\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "message = client.beta.threads.messages.create(\n",- " thread_id=thread.id,\n",- " role=\"user\",\n",- " content=\"I need to solve the equation `3x + 11 = 14`. Can you help me?\",\n",- ")\n",- "show_json(message)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "> **Note**\n",- "> Even though you're no longer sending the entire history each time, you will still be charged for the tokens of the entire conversation history with each Run.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Runs\n",- "\n",- "Notice how the Thread we created is **not** associated with the Assistant we created earlier! Threads exist independently from Assistants, which may be different from what you'd expect if you've used ChatGPT (where a thread is tied to a model/GPT).\n",- "\n",- "To get a completion from an Assistant for a given Thread, we must create a Run. Creating a Run will indicate to an Assistant it should look at the messages in the Thread and take action: either by adding a single response, or using tools.\n",- "\n",- "> **Note**\n",- "> Runs are a key difference between the Assistants API and Chat Completions API. While in Chat Completions the model will only ever respond with a single message, in the Assistants API a Run may result in an Assistant using one or multiple tools, and potentially adding multiple messages to the Thread.\n",- "\n",- "To get our Assistant to respond to the user, let's create the Run. As mentioned earlier, you must specify _both_ the Assistant and the Thread.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "run = client.beta.threads.runs.create(\n",- " thread_id=thread.id,\n",- " assistant_id=assistant.id,\n",- ")\n",- "show_json(run)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Unlike creating a completion in the Chat Completions API, **creating a Run is an asynchronous operation**. It will return immediately with the Run's metadata, which includes a `status` that will initially be set to `queued`. The `status` will be updated as the Assistant performs operations (like using tools and adding messages).\n",- "\n",- "To know when the Assistant has completed processing, we can poll the Run in a loop. (Support for streaming is coming soon!) While here we are only checking for a `queued` or `in_progress` status, in practice a Run may undergo a [variety of status changes](https://platform.openai.com/docs/api-reference/runs/object#runs/object-status) which you can choose to surface to the user. (These are called Steps, and will be covered later.)\n"- ]- },- {- "cell_type": "code",- "execution_count": 69,- "metadata": {},- "outputs": [],- "source": [- "import time\n",- "\n",- "\n",- "def wait_on_run(run, thread):\n",- " while run.status == \"queued\" or run.status == \"in_progress\":\n",- " run = client.beta.threads.runs.retrieve(\n",- " thread_id=thread.id,\n",- " run_id=run.id,\n",- " )\n",- " time.sleep(0.5)\n",- " return run"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "run = wait_on_run(run, thread)\n",- "show_json(run)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Messages\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now that the Run has completed, we can list the Messages in the Thread to see what got added by the Assistant.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "messages = client.beta.threads.messages.list(thread_id=thread.id)\n",- "show_json(messages)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "As you can see, Messages are ordered in reverse-chronological order – this was done so the most recent results are always on the first `page` (since results can be paginated). Do keep a look out for this, since this is the opposite order to messages in the Chat Completions API.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's ask our Assistant to explain the result a bit further!\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Create a message to append to our thread\n",- "message = client.beta.threads.messages.create(thread_id=thread.id, role=\"user\", content=\"Could you explain this to me?\")\n",- "\n",- "# Execute our run\n",- "run = client.beta.threads.runs.create(\n",- " thread_id=thread.id,\n",- " assistant_id=assistant.id,\n",- ")\n",- "\n",- "# Wait for completion\n",- "wait_on_run(run, thread)\n",- "\n",- "# Retrieve all the messages added after our last user message\n",- "messages = client.beta.threads.messages.list(thread_id=thread.id, order=\"asc\", after=message.id)\n",- "show_json(messages)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "This may feel like a lot of steps to get a response back, especially for this simple example. However, you'll soon see how we can add very powerful functionality to our Assistant without changing much code at all!\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Example\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's take a look at how we could potentially put all of this together. Below is all the code you need to use an Assistant you've created.\n",- "\n",- "Since we've already created our Math Assistant, I've saved its ID in `MATH_ASSISTANT_ID`. I then defined two functions:\n",- "\n",- "- `submit_message`: create a Message on a Thread, then start (and return) a new Run\n",- "- `get_response`: returns the list of Messages in a Thread\n"- ]- },- {- "cell_type": "code",- "execution_count": 73,- "metadata": {},- "outputs": [],- "source": [- "from openai import OpenAI\n",- "\n",- "MATH_ASSISTANT_ID = assistant.id # or a hard-coded ID like \"asst-...\"\n",- "\n",- "client = OpenAI(api_key=os.environ.get(\"OPENAI_API_KEY\", \"<your OpenAI API key if not set as env var>\"))\n",- "\n",- "\n",- "def submit_message(assistant_id, thread, user_message):\n",- " client.beta.threads.messages.create(thread_id=thread.id, role=\"user\", content=user_message)\n",- " return client.beta.threads.runs.create(\n",- " thread_id=thread.id,\n",- " assistant_id=assistant_id,\n",- " )\n",- "\n",- "\n",- "def get_response(thread):\n",- " return client.beta.threads.messages.list(thread_id=thread.id, order=\"asc\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "I've also defined a `create_thread_and_run` function that I can re-use (which is actually almost identical to the [`client.beta.threads.create_and_run`](https://platform.openai.com/docs/api-reference/runs/createThreadAndRun) compound function in our API ;) ). Finally, we can submit our mock user requests each to a new Thread.\n",- "\n",- "Notice how all of these API calls are asynchronous operations; this means we actually get async behavior in our code without the use of async libraries! (e.g. `asyncio`)\n"- ]- },- {- "cell_type": "code",- "execution_count": 74,- "metadata": {},- "outputs": [],- "source": [- "def create_thread_and_run(user_input):\n",- " thread = client.beta.threads.create()\n",- " run = submit_message(MATH_ASSISTANT_ID, thread, user_input)\n",- " return thread, run\n",- "\n",- "\n",- "# Emulating concurrent user requests\n",- "thread1, run1 = create_thread_and_run(\"I need to solve the equation `3x + 11 = 14`. Can you help me?\")\n",- "thread2, run2 = create_thread_and_run(\"Could you explain linear algebra to me?\")\n",- "thread3, run3 = create_thread_and_run(\"I don't like math. What can I do?\")\n",- "\n",- "# Now all Runs are executing..."- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Once all Runs are going, we can wait on each and get the responses.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Pretty printing helper\n",- "def pretty_print(messages):\n",- " print(\"# Messages\")\n",- " for m in messages:\n",- " print(f\"{m.role}: {m.content[0].text.value}\")\n",- " print()\n",- "\n",- "\n",- "# Waiting in a loop\n",- "def wait_on_run(run, thread):\n",- " while run.status == \"queued\" or run.status == \"in_progress\":\n",- " run = client.beta.threads.runs.retrieve(\n",- " thread_id=thread.id,\n",- " run_id=run.id,\n",- " )\n",- " time.sleep(0.5)\n",- " return run\n",- "\n",- "\n",- "# Wait for Run 1\n",- "run1 = wait_on_run(run1, thread1)\n",- "pretty_print(get_response(thread1))\n",- "\n",- "# Wait for Run 2\n",- "run2 = wait_on_run(run2, thread2)\n",- "pretty_print(get_response(thread2))\n",- "\n",- "# Wait for Run 3\n",- "run3 = wait_on_run(run3, thread3)\n",- "pretty_print(get_response(thread3))\n",- "\n",- "# Thank our assistant on Thread 3 :)\n",- "run4 = submit_message(MATH_ASSISTANT_ID, thread3, \"Thank you!\")\n",- "run4 = wait_on_run(run4, thread3)\n",- "pretty_print(get_response(thread3))"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Et voilà!\n",- "\n",- "You may have noticed that this code is not actually specific to our math Assistant at all... this code will work for any new Assistant you create simply by changing the Assistant ID! That is the power of the Assistants API.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Tools\n",- "\n",- "A key feature of the Assistants API is the ability to equip our Assistants with Tools, like Code Interpreter, Retrieval, and custom Functions. Let's take a look at each.\n",- "\n",- "### Code Interpreter\n",- "\n",- "Let's equip our Math Tutor with the [Code Interpreter](https://platform.openai.com/docs/assistants/tools/code-interpreter) tool, which we can do from the Dashboard...\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "...or the API, using the Assistant ID.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "assistant = client.beta.assistants.update(\n",- " MATH_ASSISTANT_ID,\n",- " tools=[{\"type\": \"code_interpreter\"}],\n",- ")\n",- "show_json(assistant)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now, let's ask the Assistant to use its new tool.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "thread, run = create_thread_and_run(\"Generate the first 20 fibbonaci numbers with code.\")\n",- "run = wait_on_run(run, thread)\n",- "pretty_print(get_response(thread))"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "And that's it! The Assistant used Code Interpreter in the background, and gave us a final response.\n",- "\n",- "For some use cases this may be enough – however, if we want more details on what precisely an Assistant is doing we can take a look at a Run's Steps.\n",- "\n",- "### Steps\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "A Run is composed of one or more Steps. Like a Run, each Step has a `status` that you can query. This is useful for surfacing the progress of a Step to a user (e.g. a spinner while the Assistant is writing code or performing retrieval).\n"- ]- },- {- "cell_type": "code",- "execution_count": 78,- "metadata": {},- "outputs": [],- "source": [- "run_steps = client.beta.threads.runs.steps.list(thread_id=thread.id, run_id=run.id, order=\"asc\")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Let's take a look at each Step's `step_details`.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "for step in run_steps.data:\n",- " step_details = step.step_details\n",- " print(json.dumps(show_json(step_details), indent=4))"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "We can see the `step_details` for two Steps:\n",- "\n",- "1. `tool_calls` (plural, since it could be more than one in a single Step)\n",- "2. `message_creation`\n",- "\n",- "The first Step is a `tool_calls`, specifically using the `code_interpreter` which contains:\n",- "\n",- "- `input`, which was the Python code generated before the tool was called, and\n",- "- `output`, which was the result of running the Code Interpreter.\n",- "\n",- "The second Step is a `message_creation`, which contains the `message` that was added to the Thread to communicate the results to the user.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Retrieval\n",- "\n",- "Another powerful tool in the Assistants API is [Retrieval](https://platform.openai.com/docs/assistants/tools/knowledge-retrieval): the ability to upload files that the Assistant will use as a knowledge base when answering questions. This can also be enabled from the Dashboard or the API, where we can upload files we want to be used.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Upload the file\n",- "file = client.files.create(\n",- " file=open(\n",- " \"language_models_are_unsupervised_multitask_learners.pdf\",\n",- " \"rb\",\n",- " ),\n",- " purpose=\"assistants\",\n",- ")\n",- "# Update Assistant\n",- "assistant = client.beta.assistants.update(\n",- " MATH_ASSISTANT_ID,\n",- " tools=[{\"type\": \"code_interpreter\"}],\n",- " tool_resources={\"code_interpreter\": {\"file_ids\": [file.id]}},\n",- ")\n",- "show_json(assistant)"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "thread, run = create_thread_and_run(\n",- " \"What are some cool math concepts behind this ML paper pdf? Explain in two sentences.\"\n",- ")\n",- "run = wait_on_run(run, thread)\n",- "pretty_print(get_response(thread))"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "> **Note**\n",- "> There are more intricacies in Retrieval, like [Annotations](https://platform.openai.com/docs/assistants/how-it-works/managing-threads-and-messages), which may be covered in another cookbook.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Functions\n",- "\n",- "As a final powerful tool for your Assistant, you can specify custom [Functions](https://platform.openai.com/docs/assistants/tools/function-calling) (much like the [Function Calling](https://platform.openai.com/docs/guides/function-calling) in the Chat Completions API). During a Run, the Assistant can then indicate it wants to call one or more functions you specified. You are then responsible for calling the Function, and providing the output back to the Assistant.\n",- "\n",- "Let's take a look at an example by defining a `display_quiz()` Function for our Math Tutor.\n",- "\n",- "This function will take a `title` and an array of `question`s, display the quiz, and get input from the user for each:\n",- "\n",- "- `title`\n",- "- `questions`\n",- " - `question_text`\n",- " - `question_type`: [`MULTIPLE_CHOICE`, `FREE_RESPONSE`]\n",- " - `choices`: [\"choice 1\", \"choice 2\", ...]\n",- "\n",- "Unfortunately I don't know how to get user input within a Python Notebook, so I'll be mocking out responses with `get_mock_response...`. This is where you'd get the user's actual input.\n"- ]- },- {- "cell_type": "code",- "execution_count": 51,- "metadata": {},- "outputs": [],- "source": [- "def get_mock_response_from_user_multiple_choice():\n",- " return \"a\"\n",- "\n",- "\n",- "def get_mock_response_from_user_free_response():\n",- " return \"I don't know.\"\n",- "\n",- "\n",- "def display_quiz(title, questions):\n",- " print(\"Quiz:\", title)\n",- " print()\n",- " responses = []\n",- "\n",- " for q in questions:\n",- " print(q[\"question_text\"])\n",- " response = \"\"\n",- "\n",- " # If multiple choice, print options\n",- " if q[\"question_type\"] == \"MULTIPLE_CHOICE\":\n",- " for i, choice in enumerate(q[\"choices\"]):\n",- " print(f\"{i}. {choice}\")\n",- " response = get_mock_response_from_user_multiple_choice()\n",- "\n",- " # Otherwise, just get response\n",- " elif q[\"question_type\"] == \"FREE_RESPONSE\":\n",- " response = get_mock_response_from_user_free_response()\n",- "\n",- " responses.append(response)\n",- " print()\n",- "\n",- " return responses"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Here's what a sample quiz would look like:\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "responses = display_quiz(\n",- " \"Sample Quiz\",\n",- " [\n",- " {\"question_text\": \"What is your name?\", \"question_type\": \"FREE_RESPONSE\"},\n",- " {\n",- " \"question_text\": \"What is your favorite color?\",\n",- " \"question_type\": \"MULTIPLE_CHOICE\",\n",- " \"choices\": [\"Red\", \"Blue\", \"Green\", \"Yellow\"],\n",- " },\n",- " ],\n",- ")\n",- "print(\"Responses:\", responses)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now, let's define the interface of this function in JSON format, so our Assistant can call it:\n"- ]- },- {- "cell_type": "code",- "execution_count": 53,- "metadata": {},- "outputs": [],- "source": [- "function_json = {\n",- " \"name\": \"display_quiz\",\n",- " \"description\": \"Displays a quiz to the student, and returns the student's response. A single quiz can have multiple questions.\",\n",- " \"parameters\": {\n",- " \"type\": \"object\",\n",- " \"properties\": {\n",- " \"title\": {\"type\": \"string\"},\n",- " \"questions\": {\n",- " \"type\": \"array\",\n",- " \"description\": \"An array of questions, each with a title and potentially options (if multiple choice).\",\n",- " \"items\": {\n",- " \"type\": \"object\",\n",- " \"properties\": {\n",- " \"question_text\": {\"type\": \"string\"},\n",- " \"question_type\": {\n",- " \"type\": \"string\",\n",- " \"enum\": [\"MULTIPLE_CHOICE\", \"FREE_RESPONSE\"],\n",- " },\n",- " \"choices\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}},\n",- " },\n",- " \"required\": [\"question_text\"],\n",- " },\n",- " },\n",- " },\n",- " \"required\": [\"title\", \"questions\"],\n",- " },\n",- "}"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Once again, let's update our Assistant either through the Dashboard or the API.\n"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- ""- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "> **Note**\n",- "> Pasting the function JSON into the Dashboard was a bit finicky due to indentation, etc. I just asked ChatGPT to format my function the same as one of the examples on the Dashboard :).\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "assistant = client.beta.assistants.update(\n",- " MATH_ASSISTANT_ID,\n",- " tools=[\n",- " {\"type\": \"code_interpreter\"},\n",- " {\"type\": \"function\", \"function\": function_json},\n",- " ],\n",- ")\n",- "show_json(assistant)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "And now, we ask for a quiz.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "thread, run = create_thread_and_run(\n",- " \"Make a quiz with 2 questions: One open ended, one multiple choice. Then, give me feedback for the responses.\"\n",- ")\n",- "run = wait_on_run(run, thread)\n",- "run.status"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now, however, when we check the Run's `status` we see `requires_action`! Let's take a closer look.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "show_json(run)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "The `required_action` field indicates a Tool is waiting for us to run it and submit its output back to the Assistant. Specifically, the `display_quiz` function! Let's start by parsing the `name` and `arguments`.\n",- "\n",- "> **Note**\n",- "> While in this case we know there is only one Tool call, in practice the Assistant may choose to call multiple tools.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# Extract single tool call\n",- "tool_call = run.required_action.submit_tool_outputs.tool_calls[0]\n",- "name = tool_call.function.name\n",- "arguments = json.loads(tool_call.function.arguments)\n",- "\n",- "print(\"Function Name:\", name)\n",- "print(\"Function Arguments:\")\n",- "arguments"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Now let's actually call our `display_quiz` function with the arguments provided by the Assistant:\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "responses = display_quiz(arguments[\"title\"], arguments[\"questions\"])\n",- "print(\"Responses:\", responses)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Great! (Remember these responses are the one's we mocked earlier. In reality, we'd be getting input from the back from this function call.)\n",- "\n",- "Now that we have our responses, let's submit them back to the Assistant. We'll need the `tool_call` ID, found in the `tool_call` we parsed out earlier. We'll also need to encode our `list`of responses into a `str`.\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "tool_outputs = []\n",- "tool_calls = run.required_action.submit_tool_outputs.tool_calls\n",- "\n",- "for tool_call in tool_calls:\n",- " arguments = json.loads(tool_call.function.arguments)\n",- " responses = display_quiz(arguments[\"title\"], arguments[\"questions\"])\n",- " tool_outputs.append(\n",- " {\n",- " \"tool_call_id\": tool_call.id,\n",- " \"output\": json.dumps(responses),\n",- " }\n",- " )"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "run = client.beta.threads.runs.submit_tool_outputs(thread_id=thread.id, run_id=run.id, tool_outputs=tool_outputs)\n",- "show_json(run)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "We can now wait for the Run to complete once again, and check our Thread!\n"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "run = wait_on_run(run, thread)\n",- "pretty_print(get_response(thread))"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Woohoo 🎉"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Conclusion\n",- "\n",- "We covered the basics of the Assistants API using OpenAI's Python SDK and AgentOps for observability.\n",- "\n",- "For more information, check out the Assistants API deep [deep dive](https://platform.openai.com/docs/assistants/deep-dive) guide and its [documentation](https://platform.openai.com/docs/api-reference/assistants)."- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.11.9"- }- },- "nbformat": 4,- "nbformat_minor": 2-}diff --git a/examples/openai_responses/FINDINGS.md b/examples/openai_responses/FINDINGS.mddeleted file mode 100644index b1ceab43..00000000--- a/examples/openai_responses/FINDINGS.md+++ /dev/null@@ -1,71 +0,0 @@-# OpenAI Responses Instrumentation Findings--This document summarizes the findings from implementing and testing the OpenAI Responses instrumentation in AgentOps.--## Summary--We successfully implemented a comprehensive instrumentation solution for both OpenAI API formats:--1. **Chat Completions API** (Traditional format)-2. **Response API** (Newer format used by the Agents SDK)--The implementation allows AgentOps to capture telemetry data from both formats consistently, normalizing different field names and extracting important attributes from complex nested structures.--## Key Achievements--1. **Unified Instrumentation**: Created a single instrumentor that handles both API formats-2. **Attribute Normalization**: Mapped different field names to consistent semantic conventions-3. **Context Propagation**: Ensured proper trace hierarchy between different API calls-4. **Non-invasive Patching**: Implemented instrumentation that doesn't break existing functionality--## Testing Results--The `dual_api_example.py` script demonstrates:--1. **Both API Formats Working**: Successfully makes calls to both API formats-2. **Instrumentation Active**: Creates spans for both API calls with appropriate attributes-3. **Response Parsing**: Correctly extracts content from both response structures-4. **Trace Context**: Maintains the context between different API operations--Example output:-```-Chat Completions Result: Async/await in Python allows for concurrent execution of code, enabling non-blocking operations and efficient handling of multiple tasks.--Responses Result: Response(id='resp_67d637f76d0881929a0f213b928f999a00bc342f16c03baf', created_at=1742092279.0, error=None, ...truncated...)-```--Debug logs show:-```-(DEBUG) 🖇 AgentOps: Patched OpenAI v1+ Response API-(DEBUG) 🖇 AgentOps: Patched OpenAI Legacy Response API-(DEBUG) 🖇 AgentOps: Successfully instrumented OpenAI responses-(DEBUG) 🖇 AgentOps: Started span: openai.chat (kind: CLIENT)-(DEBUG) 🖇 AgentOps: Started span: openai.response.parse (kind: CLIENT)-```--## Observations--1. **Performance**: The instrumentation adds minimal overhead to API calls-2. **Compatibility**: Works with both API formats without requiring code changes-3. **Resilience**: Handles different OpenAI client versions and structures-4. **Telemetry Data**: Captures essential metrics like token usage and response content--## Challenges Addressed--1. **API Format Variations**: Handled the structural differences between API formats-2. **Method Patching**: Implemented robust, non-invasive patching of core methods-3. **Token Normalization**: Created a consistent representation of different token metrics-4. **Error Handling**: Added graceful error handling to avoid breaking application code--## Next Steps--1. **Multi-modal Support**: Extend the extractors to handle non-text content types-2. **Enhanced Metrics**: Add more detailed metrics for specialized use cases-3. **Performance Optimization**: Further optimize the instrumentation for minimal overhead-4. **Documentation**: Create comprehensive documentation for users to understand the telemetry data--## Conclusion--The OpenAI Responses instrumentation implementation is successful and provides valuable telemetry data from both API formats. It integrates seamlessly with the existing AgentOps instrumentation system and offers users a unified view of their OpenAI API usage regardless of which format they use.--This implementation allows AgentOps to stay current with OpenAI's evolving API landscape while maintaining backward compatibility with existing code.\ No newline at end of filediff --git a/examples/openai_responses/README.md b/examples/openai_responses/README.mddeleted file mode 100644index c0c80d7b..00000000--- a/examples/openai_responses/README.md+++ /dev/null@@ -1,33 +0,0 @@-# OpenAI Responses Instrumentation Examples--This directory contains examples demonstrating the instrumentation of both OpenAI API formats:-1. Traditional Chat Completions API-2. New Response API format (used by the Agents SDK)--## Dual API Example--The `dual_api_example.py` script shows both API formats in action with AgentOps instrumentation. It makes consecutive requests to:-1. The OpenAI Chat Completions API-2. The OpenAI Agents SDK (which uses the Response API format)--This demonstrates how our instrumentation correctly handles both formats and maintains proper trace context between them.--## Running the Example--```bash-# From the project root directory-AGENTOPS_LOG_LEVEL=debug uv run examples/openai_responses/dual_api_example.py-```--You'll need:-- An OpenAI API key set in your environment-- The OpenAI Python client installed-- The OpenAI Agents SDK installed--## What to Observe--In the AgentOps dashboard, you'll see:-- Both API formats correctly instrumented with appropriate spans-- Token usage metrics from both formats normalized to consistent attributes-- Content extraction from both formats mapped to semantic conventions-- All spans properly connected in the trace hierarchy\ No newline at end of filediff --git a/examples/openai_responses/dual_api_example.py b/examples/openai_responses/dual_api_example.pydeleted file mode 100644index d5c62859..00000000--- a/examples/openai_responses/dual_api_example.py+++ /dev/null@@ -1,54 +0,0 @@-# To run this file from project root: AGENTOPS_LOG_LEVEL=debug uv run examples/openai_responses/dual_api_example.py-import asyncio-from dotenv import load_dotenv--# Import OpenAI for both API types-from openai import OpenAI--# Import AgentOps-import agentops--# Load environment variables for API keys-load_dotenv()---async def chat_completions_request(client, prompt):- """Make a request using the OpenAI Chat Completions API."""- response = client.chat.completions.create(- model="gpt-3.5-turbo",- messages=[{"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": prompt}],- )-- return response.choices[0].message.content---async def responses_request(client, prompt):- """Make a request using the OpenAI Agents SDK (Response API format)."""- response = client.responses.create(- model="gpt-4o",- input=prompt,- )- return response---async def main():- """Run both API formats to demonstrate response instrumentation."""- # Initialize AgentOps with instrumentation enabled- agentops.init()-- # Set up the OpenAI client- client = OpenAI()-- # Make a Chat Completions API request- chat_result = await chat_completions_request(- client, "Explain the concept of async/await in Python in one sentence."- )- print(f"Chat Completions Result: {chat_result}")-- # Make an Responses API request- responses_result = await responses_request(client, "Explain the concept of recursion in one sentence.")- print(f"Responses Result: {responses_result}")---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/openai_responses/sync_and_async.py b/examples/openai_responses/sync_and_async.pydeleted file mode 100644index bb17b814..00000000--- a/examples/openai_responses/sync_and_async.py+++ /dev/null@@ -1,43 +0,0 @@-# To run this file from project root: AGENTOPS_LOG_LEVEL=debug uv run examples/openai_responses/sync_and_async.py-import asyncio-from dotenv import load_dotenv--from openai import OpenAI, AsyncOpenAI-import agentops--load_dotenv()---def sync_responses_request():- client = OpenAI()- response = client.responses.create(- model="gpt-4o",- input="Explain the concept of synchronous Python in one sentence.",- )- return response---async def async_responses_request():- client = AsyncOpenAI()- response = await client.responses.create(- model="gpt-4o",- input="Explain the concept of async/await in Python in one sentence.",- stream=False,- )- return response---async def main():- agentops.init()-- # Synchronous request- sync_response = sync_responses_request()- print(f"Synchronous Response:\n {sync_response.output_text}")-- # Asynchronous request- async_response = await async_responses_request()- print(f"Asynchronous Response:\n {async_response.output_text}")---if __name__ == "__main__":- asyncio.run(main())diff --git a/examples/opentelemetry/token_importance.py b/examples/opentelemetry/token_importance.pydeleted file mode 100644index 18f5d7d7..00000000--- a/examples/opentelemetry/token_importance.py+++ /dev/null@@ -1,502 +0,0 @@-from opentelemetry import trace, context, baggage-from opentelemetry.sdk.trace import TracerProvider-from opentelemetry.sdk.trace.export import BatchSpanProcessor, SpanExporter-from opentelemetry.trace import Status, StatusCode-import time-from typing import Dict, Any, Sequence---# Create a no-op exporter to prevent spans from being printed-class NoopExporter(SpanExporter):- """A span exporter that doesn't export spans anywhere."""-- def export(self, spans: Sequence) -> None:- """Do nothing with the spans."""- pass-- def shutdown(self) -> None:- """Shutdown the exporter."""- pass---# Set up basic tracing-provider = TracerProvider()-# Use the NoopExporter instead of ConsoleSpanExporter-processor = BatchSpanProcessor(NoopExporter())-provider.add_span_processor(processor)-trace.set_tracer_provider(provider)-tracer = trace.get_tracer("token_demo")--# Second tracer for demonstration-llm_tracer = trace.get_tracer("llm_tracer")--# ======== Visualization Helpers ========---def print_header(title):- """Print a formatted header"""- print("\n" + "=" * 80)- print(f" {title}")- print("=" * 80)---def print_step(step_num, description):- """Print a step in the process"""- print(f"\n[Step {step_num}] {description}")---def print_span_tree(spans, indent=0):- """Print a visual representation of the span tree"""- for i, span in enumerate(spans):- is_last = i == len(spans) - 1- prefix = "└── " if is_last else "├── "- print("│ " * indent + prefix + span)---def print_context_state(active_span_name, context_stack=None, baggage_items=None):- """Print the current context state with visualization"""- print("\n Current Context State:")- print(" --------------------")- print(f" Active span: {active_span_name}")-- if context_stack:- print("\n Context Stack (top to bottom):")- for i, span in enumerate(context_stack):- if i == 0:- print(f" ┌─ {span} ← Current")- else:- print(f" │ {span}")- print(" └─────────────")-- if baggage_items:- print("\n Baggage Items:")- print(" -------------")- for key, value in baggage_items.items():- print(f" 🔷 {key}: {value}")---def print_span_details(span, title="Span Details"):- """Print detailed information about a span"""- if not hasattr(span, "get_span_context"):- print(" No span details available")- return-- ctx = span.get_span_context()- print(f"\n {title}:")- print(" " + "-" * len(title))- print(f" Name: {getattr(span, 'name', 'Unknown')}")- print(f" Trace ID: {ctx.trace_id:x}")- print(f" Span ID: {ctx.span_id:x}")-- # Try to get attributes if possible- attributes = getattr(span, "_attributes", {})- if attributes:- print("\n Attributes:")- for key, value in attributes.items():- print(f" 📎 {key}: {str(value)}")---def get_current_span_name():- """Get the name of the current span or 'None' if no span is active"""- current = trace.get_current_span()- return getattr(current, "name", "None")---def get_current_baggage() -> Dict[str, str]:- """Get all baggage items in the current context"""- items = {}- # This is a simplified approach - in a real app you'd enumerate all baggage items- for key in ["user.id", "tenant.id", "request.id", "environment"]:- value = baggage.get_baggage(key)- if value:- items[key] = value- return items---# ======== Simulated Application Functions ========---def simulate_database_query(query: str) -> Dict[str, Any]:- """Simulate a database query with proper context propagation"""- with tracer.start_as_current_span("database.query") as span:- span.set_attribute("db.statement", query)- span.set_attribute("db.system", "postgresql")-- # Simulate query execution time- time.sleep(0.01)-- # Add current baggage to demonstrate propagation- user_id = baggage.get_baggage("user.id")- if user_id:- span.set_attribute("user.id", str(user_id))-- # Return simulated data- return {"id": 1234, "name": "Sample Data", "status": "active"}---def call_external_api(endpoint: str) -> Dict[str, Any]:- """Simulate an external API call with a different tracer"""- with llm_tracer.start_as_current_span("http.request") as span:- span.set_attribute("http.url", f"https://api.example.com/{endpoint}")- span.set_attribute("http.method", "GET")-- # Simulate API call latency- time.sleep(0.02)-- # Add baggage to simulate cross-service propagation- tenant_id = baggage.get_baggage("tenant.id")- if tenant_id:- span.set_attribute("tenant.id", str(tenant_id))-- # Sometimes operations fail- if endpoint == "error":- span.set_status(Status(StatusCode.ERROR))- span.set_attribute("error.message", "API returned 500 status code")- return {"error": "Internal Server Error"}-- return {"status": "success", "data": {"key": "value"}}---def process_user_request(user_id: str, action: str) -> Dict[str, Any]:- """Process a user request with nested spans and context propagation"""- # Set baggage for the entire operation- ctx = baggage.set_baggage("user.id", user_id)- ctx = baggage.set_baggage("tenant.id", "tenant-1234", context=ctx)- ctx = baggage.set_baggage("request.id", f"req-{int(time.time())}", context=ctx)-- # Attach the context with baggage- token = context.attach(ctx)-- try:- with tracer.start_as_current_span("process_request") as span:- span.set_attribute("user.id", user_id)- span.set_attribute("request.action", action)-- # Query the database (creates a child span)- db_result = simulate_database_query(f"SELECT * FROM users WHERE id = '{user_id}'")-- # Call an external API (creates a child span with a different tracer)- api_result = call_external_api("users/profile")-- # Combine results- return {"user": db_result, "profile": api_result, "processed_at": time.time()}- finally:- # Always detach the context to clean up- context.detach(token)---# ======== Scenarios ========---def run_basic_scenarios():- """Run the original basic scenarios to demonstrate token importance"""- # Scenario 1: Proper token management- print_header("Scenario 1: Proper Token Management")- print("This scenario demonstrates correct context management with proper token handling.")- print("We'll create a parent span, then a child span, and properly detach the context.")-- with tracer.start_as_current_span("parent"):- print_step(1, "Created parent span and set as current")- parent_name = get_current_span_name()- print_context_state(parent_name, ["parent"])- print_span_tree(["parent"])-- print_step(2, "Creating child span and attaching to context")- # Manually create a child span and save the token- child = tracer.start_span("child")- ctx = trace.set_span_in_context(child)- token = context.attach(ctx)-- child_name = get_current_span_name()- print_context_state(child_name, ["child", "parent"])- print_span_tree(["parent", "child"])-- print_step(3, "Ending child span AND detaching token (proper cleanup)")- # End the child span and detach the token- child.end()- context.detach(token)-- restored_name = get_current_span_name()- print_context_state(restored_name, ["parent"])- print_span_tree(["parent"])-- print("\n✅ Result: Context properly restored to parent after child span ended")-- # Scenario 2: Missing token detachment- print_header("Scenario 2: Missing Token Detachment (Context Leak)")- print("This scenario demonstrates what happens when we don't detach the context token.")- print("We'll create a parent span, then a child span, but NOT detach the context.")-- with tracer.start_as_current_span("parent2"):- print_step(1, "Created parent2 span and set as current")- parent_name = get_current_span_name()- print_context_state(parent_name, ["parent2"])- print_span_tree(["parent2"])-- print_step(2, "Creating child2 span and attaching to context")- # Manually create a child span but don't save the token- child = tracer.start_span("child2")- ctx = trace.set_span_in_context(child)- token = context.attach(ctx) # Token saved but not used later-- child_name = get_current_span_name()- print_context_state(child_name, ["child2", "parent2"])- print_span_tree(["parent2", "child2"])-- print_step(3, "Ending child2 span WITHOUT detaching token (improper cleanup)")- # End the child span but don't detach the token- child.end()- # No context.detach(token) call!-- leaked_name = get_current_span_name()- print_context_state(leaked_name, ["child2 (ended but context still active)", "parent2"])- print_span_tree(["parent2", "child2 (ended)"])-- print("\n⚠️ Result: Context LEAK! Still showing child2 as current context even though span ended")- print(" Any new spans created here would incorrectly use child2 as parent instead of parent2")-- # Scenario 3: Nested spans with context restoration- print_header("Scenario 3: Nested Spans with Context Restoration")- print("This scenario demonstrates proper context management with multiple nested spans.")- print("We'll create an outer → middle1 → middle2 span hierarchy and properly restore contexts.")-- with tracer.start_as_current_span("outer"):- print_step(1, "Created outer span and set as current")- outer_name = get_current_span_name()- print_context_state(outer_name, ["outer"])- print_span_tree(["outer"])-- print_step(2, "Creating middle1 span and attaching to context")- # First middle span- middle1 = tracer.start_span("middle1")- ctx1 = trace.set_span_in_context(middle1)- token1 = context.attach(ctx1)-- middle1_name = get_current_span_name()- print_context_state(middle1_name, ["middle1", "outer"])- print_span_tree(["outer", "middle1"])-- print_step(3, "Creating middle2 span and attaching to context")- # Second middle span- middle2 = tracer.start_span("middle2")- ctx2 = trace.set_span_in_context(middle2)- token2 = context.attach(ctx2)-- middle2_name = get_current_span_name()- print_context_state(middle2_name, ["middle2", "middle1", "outer"])- print_span_tree(["outer", "middle1", "middle2"])-- print_step(4, "Ending middle2 span and detaching token2")- # End spans in reverse order with proper token management- middle2.end()- context.detach(token2)-- restored_middle1_name = get_current_span_name()- print_context_state(restored_middle1_name, ["middle1", "outer"])- print_span_tree(["outer", "middle1", "middle2 (ended)"])-- print_step(5, "Ending middle1 span and detaching token1")- middle1.end()- context.detach(token1)-- restored_outer_name = get_current_span_name()- print_context_state(restored_outer_name, ["outer"])- print_span_tree(["outer", "middle1 (ended)", "middle2 (ended)"])-- print("\n✅ Result: Context properly restored through multiple levels")-- # Scenario 4: What happens if we create new spans after a context leak- print_header("Scenario 4: Creating New Spans After Context Leak")- print("This scenario demonstrates the impact of context leaks on the span hierarchy.")- print("We'll create a parent span, leak a child context, then create another span.")-- with tracer.start_as_current_span("root"):- print_step(1, "Created root span and set as current")- root_name = get_current_span_name()- print_context_state(root_name, ["root"])- print_span_tree(["root"])-- print_step(2, "Creating leaky_child span and attaching to context")- # Create a child span but don't save the token- leaky = tracer.start_span("leaky_child")- ctx = trace.set_span_in_context(leaky)- context.attach(ctx) # Token not saved-- leaky_name = get_current_span_name()- print_context_state(leaky_name, ["leaky_child", "root"])- print_span_tree(["root", "leaky_child"])-- print_step(3, "Ending leaky_child span WITHOUT detaching token")- # End the child span but don't detach the token- leaky.end()- # No context.detach() call!-- print_step(4, "Creating new_child span after context leak")- # This span will be created with leaky_child as parent, not root!- with tracer.start_as_current_span("new_child"):- new_child_name = get_current_span_name()- print_context_state(new_child_name, ["new_child", "leaky_child (ended but context active)", "root"])- print_span_tree(["root", "leaky_child (ended)", "new_child"])-- print("\n⚠️ Problem: new_child is incorrectly parented to leaky_child instead of root")- print(" This creates an incorrect trace hierarchy that doesn't match execution flow")---def run_advanced_scenarios():- """Run the new advanced scenarios demonstrating more complex context patterns"""-- # Scenario 5: Cross-function context propagation- print_header("Scenario 5: Cross-Function Context Propagation")- print("This scenario demonstrates how context and baggage propagate across function boundaries.")- print("We'll create a request processing flow with multiple nested functions and spans.")-- print_step(1, "Starting user request processing with baggage")- # Process a simulated request that will create nested spans across functions- result = process_user_request("user-5678", "update_profile")-- print_step(2, "Request processing completed")- print("\n Request processing result:")- print(f" User data: {result['user']['name']}")- print(f" Profile status: {result['profile']['status']}")-- print("\n✅ Result: Context and baggage successfully propagated across multiple function calls")- print(" Each function created properly nested spans that maintained the baggage context")-- # Scenario 6: Using different tracers with the same context- print_header("Scenario 6: Multiple Tracers with Shared Context")- print("This scenario demonstrates using multiple tracers while maintaining a consistent context.")-- print_step(1, "Creating context with baggage")- # Set up a context with baggage- ctx = baggage.set_baggage("environment", "production")- ctx = baggage.set_baggage("tenant.id", "tenant-9876", context=ctx)- token = context.attach(ctx)-- try:- print_step(2, "Starting span with main tracer")- with tracer.start_as_current_span("main_operation") as main_span:- main_span_name = get_current_span_name()- baggage_items = get_current_baggage()- print_context_state(main_span_name, ["main_operation"], baggage_items)- print_span_details(main_span)-- print_step(3, "Creating span with LLM tracer (different tracer)")- with llm_tracer.start_as_current_span("llm_inference") as llm_span:- llm_span.set_attribute("model", "gpt-4")- llm_span.set_attribute("tokens", 150)-- llm_span_name = get_current_span_name()- print_context_state(llm_span_name, ["llm_inference", "main_operation"], baggage_items)- print_span_details(llm_span, "LLM Span Details")-- print_step(4, "Back to main tracer")- # Create another span with the first tracer- with tracer.start_as_current_span("post_processing"):- post_span_name = get_current_span_name()- print_context_state(- post_span_name, ["post_processing", "llm_inference", "main_operation"], baggage_items- )- finally:- context.detach(token)-- print("\n✅ Result: Multiple tracers successfully shared the same context")- print(" Baggage was accessible to spans from both tracers")-- # Scenario 7: Handling errors in spans- print_header("Scenario 7: Error Handling in Spans")- print("This scenario demonstrates proper error handling with spans.")-- print_step(1, "Starting operation that will encounter an error")- with tracer.start_as_current_span("error_prone_operation") as error_span:- try:- print_step(2, "Calling API that will fail")- result = call_external_api("error")- print(f" API result: {result}")- except Exception as e:- print_step(3, "Handling exception in span")- error_span.record_exception(e)- error_span.set_status(Status(StatusCode.ERROR))- print(f" Recorded exception: {str(e)}")-- print("\n✅ Result: Properly recorded error in span without breaking execution flow")- print(" Errors should be visible in the trace visualization")-- # Scenario 8: Manual context saving and restoring- print_header("Scenario 8: Manual Context Saving and Restoring")- print("This scenario demonstrates saving a context and restoring it later.")-- print_step(1, "Creating initial context")- with tracer.start_as_current_span("initial_operation"):- # Set some baggage- ctx = baggage.set_baggage("checkpoint", "saved_point")-- # Save the current context for later use- saved_context = context.get_current()- print_context_state("initial_operation", ["initial_operation"], {"checkpoint": "saved_point"})-- print_step(2, "Creating a different context")- with tracer.start_as_current_span("intermediate_operation"):- # Change the baggage- ctx = baggage.set_baggage("checkpoint", "intermediate_point")- print_context_state(- "intermediate_operation",- ["intermediate_operation", "initial_operation"],- {"checkpoint": "intermediate_point"},- )-- print_step(3, "Restoring saved context")- # Restore the saved context- token = context.attach(saved_context)- try:- current_span = trace.get_current_span()- current_name = getattr(current_span, "name", "Unknown")- checkpoint = baggage.get_baggage("checkpoint")- print_context_state(current_name, ["initial_operation"], {"checkpoint": checkpoint})-- print("\n✅ Result: Successfully restored previous context")- finally:- context.detach(token)-- print_step(4, "Back to intermediate context")- print_context_state(- "intermediate_operation",- ["intermediate_operation", "initial_operation"],- {"checkpoint": "intermediate_point"},- )---print_header("OpenTelemetry Context Management Demonstration")-print("This example illustrates the importance of proper context management in OpenTelemetry.")-print("It covers basic and advanced scenarios showing how context affects span relationships.")--print("\n1. Basic Scenarios - Demonstrating context token importance")-print("2. Advanced Scenarios - Real-world patterns with nested functionality")-print("3. Run All Scenarios")-print("4. Exit")--while True:- choice = input("\nEnter your choice (1-4): ")-- if choice == "1":- run_basic_scenarios()- elif choice == "2":- run_advanced_scenarios()- elif choice == "3":- run_basic_scenarios()- run_advanced_scenarios()- elif choice == "4":- print("\nExiting...")- break- else:- print("Invalid choice. Please enter 1, 2, 3, or 4.")--print_header("Conclusion")-print("The token returned by context.attach() is crucial for proper context management.")-print("Without proper token detachment:")-print("1. Context leaks occur - the active context doesn't revert to the parent")-print("2. New spans are created with incorrect parent relationships")-print("3. The trace hierarchy doesn't accurately represent the execution flow")-print("\nIn AgentOps, if end_session() doesn't detach the token:")-print("- Sessions might appear to be active even after they've ended")-print("- New operations might be incorrectly associated with ended sessions")-print("- The overall trace hierarchy would be inaccurate")diff --git a/examples/opentelemetry/token_importance_2.py b/examples/opentelemetry/token_importance_2.pydeleted file mode 100644index 024c4a30..00000000--- a/examples/opentelemetry/token_importance_2.py+++ /dev/null@@ -1,53 +0,0 @@-from opentelemetry import trace, context-from opentelemetry.sdk.trace import TracerProvider-from opentelemetry.sdk.trace.export import ConsoleSpanExporter, BatchSpanProcessor--# Set up tracing-provider = TracerProvider()-processor = BatchSpanProcessor(ConsoleSpanExporter())-provider.add_span_processor(processor)-trace.set_tracer_provider(provider)-tracer = trace.get_tracer("demo")---def get_current_span_name():- return getattr(trace.get_current_span(), "name", "None")---print("\n=== Scenario: Multiple contexts with the same span ===")-print("This demonstrates why coupling spans and tokens can be problematic")--# Create a span that we'll use in multiple contexts-shared_span = tracer.start_span("shared_span")-print(f"Created shared_span (not in any context yet): {shared_span.name}")--# Create context A with the shared span-ctx_a = trace.set_span_in_context(shared_span)-token_a = context.attach(ctx_a)-print(f"Current span after attaching context A: {get_current_span_name()}")--# Save context A state-first_context_span = trace.get_current_span()--# Create context B with the same shared span-# If span and token were coupled, this would detach context A!-ctx_b = trace.set_span_in_context(shared_span)-token_b = context.attach(ctx_b)-print(f"Current span after attaching context B: {get_current_span_name()}")--# Now detach context B-context.detach(token_b)-print(f"Current span after detaching context B: {get_current_span_name()}")--# Detach context A-context.detach(token_a)-print(f"Current span after detaching context A: {get_current_span_name()}")--# End the shared span once - if we did this twice with coupled tokens, it would error-shared_span.end()-print("Ended shared_span once")--print("\nIf spans and tokens were coupled:")-print("1. Creating context B would have implicitly detached context A")-print("2. We couldn't use the same span in two different trace contexts")-print("3. Ending the span would have also detached all contexts using it")diff --git a/examples/recording-operations.ipynb b/examples/recording-operations.ipynbdeleted file mode 100644index fc044aa9..00000000--- a/examples/recording-operations.ipynb+++ /dev/null@@ -1,287 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "dc8cfd2cfa8a594b",- "metadata": {- "collapsed": false- },- "source": [- "# Recording Operations with Spans\n",- "AgentOps v0.4 uses spans to track different types of operations in your agent workflows.\n",- "\n",- "We automatically instrument your LLM Calls from OpenAI, Anthropic, OpenAi Agents, and more. Just make sure their SDKs are imported before initializing AgentOps like we see below."- ]- },- {- "cell_type": "markdown",- "id": "0c475b2e",- "metadata": {},- "source": [- "First let's install the required packages"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "ef2a575d",- "metadata": {},- "outputs": [],- "source": [- "%pip install -U openai\n",- "%pip install -U agentops\n",- "%pip install -U python-dotenv"- ]- },- {- "cell_type": "markdown",- "id": "45f3c28f",- "metadata": {},- "source": [- "Then import them"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "54b0b276",- "metadata": {},- "outputs": [],- "source": [- "from openai import OpenAI\n",- "import agentops\n",- "from agentops.sdk.decorators import session, agent, operation\n",- "import os\n",- "from dotenv import load_dotenv"- ]- },- {- "cell_type": "markdown",- "id": "985ed1da",- "metadata": {},- "source": [- "Next, we'll set our API keys. There are several ways to do this, the code below is just the most foolproof way for the purposes of this notebook. It accounts for both users who use environment variables and those who just want to set the API Key here in this notebook.\n",- "\n",- "[Get an AgentOps API key](https://agentops.ai/settings/projects)\n",- "\n",- "1. Create an environment variable in a .env file or other method. By default, the AgentOps `init()` function will look for an environment variable named `AGENTOPS_API_KEY`. Or...\n",- "\n",- "2. Replace `<your_agentops_key>` below and pass in the optional `api_key` parameter to the AgentOps `init(api_key=...)` function. Remember not to commit your API key to a public repo!"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "0c3f4b1a",- "metadata": {},- "outputs": [],- "source": [- "load_dotenv()\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "168ecd05cc123de0",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "# Initialize the client\n",- "agentops.init()\n",- "\n",- "# Optionally, we can add default tags to all sessions\n",- "# agentops.init(tags=['Hello Tracker'])\n",- "\n",- "openai_client = OpenAI()\n",- "\n",- "\n",- "# Create a session to track all operations\n",- "@session\n",- "def my_session():\n",- " messages = [{\"role\": \"user\", \"content\": \"Hello\"}]\n",- " response = openai_client.chat.completions.create(model=\"gpt-3.5-turbo\", messages=messages, temperature=0.5)\n",- " print(response.choices[0].message.content)\n",- "\n",- " # Call our operation\n",- " result = add(2, 4)\n",- " print(f\"Addition result: {result}\")\n",- "\n",- " # Call our agent\n",- " agent = MyAgent()\n",- " agent.process_data(\"test data\")\n",- "\n",- "\n",- "# Run the session\n",- "my_session()"- ]- },- {- "cell_type": "markdown",- "id": "c6d06ee8c66dad17",- "metadata": {- "collapsed": false- },- "source": [- "Click the AgentOps link above to see your session!\n",- "## Operations\n",- "AgentOps allows you to record operations using the `@operation` decorator:"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "b460318317adc624",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "@operation\n",- "def add(x, y):\n",- " return x + y"- ]- },- {- "cell_type": "markdown",- "id": "9068a4cdd328f652",- "metadata": {- "collapsed": false- },- "source": [- "## Agents\n",- "You can create agent spans that contain operations using the `@agent` decorator:"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "b62ad88921ff26f2",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "from agentops.sdk.decorators import operation\n",- "\n",- "\n",- "@agent\n",- "class MyAgent:\n",- " @operation\n",- " def process_data(self, data):\n",- " print(f\"Processing data: {data}\")\n",- " return f\"Processed: {data.upper()}\""- ]- },- {- "cell_type": "markdown",- "id": "f7c947d815f581e7",- "metadata": {- "collapsed": false- },- "source": [- "## Error Handling\n",- "Errors are automatically captured by the spans. When an exception occurs within a decorated function, it's recorded in the span:"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "5d387a071a1c70cf",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "from agentops.sdk.decorators import operation\n",- "\n",- "\n",- "@operation\n",- "def risky_operation():\n",- " # This exception will be recorded in the span\n",- " try:\n",- " 1 / 0 # Ooops! Something went wrong\n",- " except Exception as e:\n",- " print(f\"Error occurred: {e}\")\n",- " raise\n",- "\n",- "\n",- "# Create a session that includes the error\n",- "@session\n",- "def error_session():\n",- " try:\n",- " risky_operation()\n",- " except Exception:\n",- " print(\"Caught the error, but it's still recorded in the span\")\n",- "\n",- "\n",- "# Run the error session\n",- "error_session()"- ]- },- {- "cell_type": "markdown",- "id": "968d1503dd0aae9a",- "metadata": {- "collapsed": false- },- "source": [- "## Custom Span Attributes\n",- "You can add custom attributes to spans for additional context:"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "eb23c1325298e22f",- "metadata": {- "collapsed": false- },- "outputs": [],- "source": [- "from agentops.sdk.decorators import operation\n",- "\n",- "\n",- "@operation(name=\"custom-operation\")\n",- "def custom_operation(data):\n",- " # Your operation logic here\n",- " return f\"Custom: {data}\"\n",- "\n",- "\n",- "# Create a session with custom operation\n",- "@session(name=\"custom-session\")\n",- "def custom_session():\n",- " result = custom_operation(\"test\")\n",- " print(result)\n",- "\n",- "\n",- "# Run the custom session\n",- "custom_session()"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.11.5"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/sdk/basic.py b/examples/sdk/basic.pydeleted file mode 100644index 6c008d4f..00000000--- a/examples/sdk/basic.py+++ /dev/null@@ -1,32 +0,0 @@-import agentops-from agentops.sdk.decorators import agent, operation, session--agentops.init()---@agent-class Agent:- @operation- def nested_operation(self):- print("Hello, world!")-- @operation- def my_operation(self):- print("Hello, world!")- self.nested_operation()---@session-def session_one():- agent = Agent()- agent.my_operation()---@session-def session_two():- agent = Agent()- agent.my_operation()---session_one()-session_two()diff --git a/examples/sdk/basic_session_example.py b/examples/sdk/basic_session_example.pydeleted file mode 100644index 1477a5ef..00000000--- a/examples/sdk/basic_session_example.py+++ /dev/null@@ -1,26 +0,0 @@-import agentops-from agentops.sdk.decorators import session--# Initialize AgentOps-agentops.init()---# Example 1: Using the session decorator with a function-@session-def process_data(data):- """Process some data within a session."""- print(f"Processing data: {data}")- import openai-- openai.chat.completions.create(- model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Write a one-line joke"}]- )-- # Simulate some processing- result = data.upper()- return result---# Call the decorated function-result = process_data("hello world")-print(f"Result: {result}")diff --git a/examples/smolagents/README.md b/examples/smolagents/README.mdnew file mode 100644index 00000000..bfe99cf3--- /dev/null+++ b/examples/smolagents/README.md@@ -0,0 +1,32 @@+# SmolAgents Examples with AgentOps++This directory contains examples of using SmolAgents with AgentOps instrumentation.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops smolagents+ ```++## Examples++### 1. Multi-Agent System++Example: `multi_smolagents_system`+This example demonstrates:+- Multi-agent system coordination++### 2. Text to SQL++Example: `text_to_sql`++This example demonstrates:+- Natural language to SQL conversion++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your SmolAgents calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/smolagents/multi_smolagents_system.ipynb b/examples/smolagents/multi_smolagents_system.ipynbnew file mode 100644index 00000000..17d0bdd4--- /dev/null+++ b/examples/smolagents/multi_smolagents_system.ipynb@@ -0,0 +1,211 @@+{+ "cells": [+ {+ "cell_type": "markdown",+ "id": "7d4c41ff",+ "metadata": {},+ "source": [+ "# Orchestrate a Multi-Agent System\n",+ "\n",+ "In this notebook, we will make a multi-agent web browser: an agentic system with several agents collaborating to solve problems using the web!\n",+ "\n",+ "It will be a simple hierarchy, using a `ManagedAgent` object to wrap the managed web search agent:"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "446d088d",+ "metadata": {},+ "source": [+ "```\n",+ "+----------------+\n",+ "| Manager agent |\n",+ "+----------------+\n",+ " |\n",+ "_________|______________\n",+ "| |\n",+ "Code interpreter +--------------------------------+\n",+ " tool | Managed agent |\n",+ " | +------------------+ |\n",+ " | | Web Search agent | |\n",+ " | +------------------+ |\n",+ " | | | |\n",+ " | Web Search tool | |\n",+ " | Visit webpage tool |\n",+ " +--------------------------------+\n",+ "```\n",+ "Let\u2019s set up this system.\n",+ "\n",+ "Run the line below to install the required dependencies:"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "015b0a87",+ "metadata": {},+ "outputs": [],+ "source": [+ "%pip install markdownify\n",+ "%pip install duckduckgo-search\n",+ "%pip install smolagents\n",+ "%pip install agentops"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "00509499",+ "metadata": {},+ "source": [+ "\ud83d\udd87\ufe0f Now we initialize the AgentOps client and load the environment variables to use the API keys."+ ]+ },+ {+ "cell_type": "code",+ "id": "330770fd",+ "metadata": {},+ "outputs": [],+ "source": "import agentops\nfrom dotenv import load_dotenv\nimport os\nimport re\nimport requests\nfrom markdownify import markdownify\nfrom requests.exceptions import RequestException\nfrom smolagents import tool\nfrom smolagents import LiteLLMModel\nfrom smolagents import (\n CodeAgent,\n ToolCallingAgent,\n ManagedAgent,\n DuckDuckGoSearchTool,\n)\n\nload_dotenv()\nos.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\nos.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")",+ "execution_count": null+ },+ {+ "cell_type": "markdown",+ "id": "9516d2a7",+ "metadata": {},+ "source": [+ "\u26a1\ufe0f Our agent will be powered by `openai/gpt-4o-mini` using the `LiteLLMModel` class."+ ]+ },+ {+ "cell_type": "code",+ "id": "5f78927c",+ "metadata": {},+ "outputs": [],+ "source": "agentops.init(auto_start_session=False)\ntracer = agentops.start_trace(\n trace_name=\"Orchestrate a Multi-Agent System\", tags=[\"smolagents\", \"example\", \"multi-agent\", \"agentops-example\"]\n)\nmodel = LiteLLMModel(\"openai/gpt-4o-mini\")",+ "execution_count": null+ },+ {+ "cell_type": "markdown",+ "id": "a08cc376",+ "metadata": {},+ "source": [+ "## Create a Web Search Tool\n",+ "\n",+ "For web browsing, we can already use our pre-existing `DuckDuckGoSearchTool`. However, we will also create a `VisitWebpageTool` from scratch using `markdownify`. Here\u2019s how:"+ ]+ },+ {+ "cell_type": "code",+ "id": "01689447",+ "metadata": {},+ "outputs": [],+ "source": "@tool\ndef visit_webpage(url: str) -> str:\n \"\"\"Visits a webpage at the given URL and returns its content as a markdown string.\n\n Args:\n url: The URL of the webpage to visit.\n\n Returns:\n The content of the webpage converted to Markdown, or an error message if the request fails.\n \"\"\"\n try:\n # Send a GET request to the URL\n response = requests.get(url)\n response.raise_for_status() # Raise an exception for bad status codes\n\n # Convert the HTML content to Markdown\n markdown_content = markdownify(response.text).strip()\n\n # Remove multiple line breaks\n markdown_content = re.sub(r\"\\n{3,}\", \"\\n\\n\", markdown_content)\n\n return markdown_content\n\n except RequestException as e:\n return f\"Error fetching the webpage: {str(e)}\"\n except Exception as e:\n return f\"An unexpected error occurred: {str(e)}\"",+ "execution_count": null+ },+ {+ "cell_type": "markdown",+ "id": "3c45517b",+ "metadata": {},+ "source": [+ "Let\u2019s test our tool:"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "51cc54f1",+ "metadata": {},+ "outputs": [],+ "source": [+ "print(visit_webpage(\"https://en.wikipedia.org/wiki/Hugging_Face\")[:500])"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "921df68d",+ "metadata": {},+ "source": [+ "## Build Our Multi-Agent System\n",+ "\n",+ "We will now use the tools `search` and `visit_webpage` to create the web agent."+ ]+ },+ {+ "cell_type": "code",+ "id": "f274b34f",+ "metadata": {},+ "outputs": [],+ "source": "web_agent = ToolCallingAgent(\n tools=[DuckDuckGoSearchTool(), visit_webpage],\n model=model,\n max_iterations=10,\n)\n\nmanaged_web_agent = ManagedAgent(\n agent=web_agent,\n name=\"search\",\n description=\"Runs web searches for you. Give it your query as an argument.\",\n)\n\nmanager_agent = CodeAgent(\n tools=[],\n model=model,\n managed_agents=[managed_web_agent],\n additional_authorized_imports=[\"time\", \"numpy\", \"pandas\"],\n)",+ "execution_count": null+ },+ {+ "cell_type": "markdown",+ "id": "d5977883",+ "metadata": {},+ "source": [+ "Let\u2019s run our system with the following query:"+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "e1e497c1",+ "metadata": {},+ "outputs": [],+ "source": [+ "answer = manager_agent.run(\n",+ " \"If LLM trainings continue to scale up at the current rhythm until 2030, what would be the electric power in GW required to power the biggest training runs by 2030? What does that correspond to, compared to some countries? Please provide a source for any number used.\"\n",+ ")\n",+ "\n",+ "print(answer)"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "169583c6",+ "metadata": {},+ "source": [+ "Awesome! We've successfully run a multi-agent system. Let's end the agentops session with a \"Success\" state. You can also end the session with a \"Failure\" or \"Indeterminate\" state, which is set as default."+ ]+ },+ {+ "cell_type": "code",+ "execution_count": null,+ "id": "f82fafac",+ "metadata": {},+ "outputs": [],+ "source": [+ "agentops.end_trace(tracer, end_state=\"Success\")"+ ]+ },+ {+ "cell_type": "markdown",+ "id": "d373e4ea",+ "metadata": {},+ "source": [+ "You can view the session in the [AgentOps dashboard](https://app.agentops.ai/sessions) by clicking the link provided after ending the session."+ ]+ }+ ],+ "metadata": {+ "kernelspec": {+ "display_name": "test",+ "language": "python",+ "name": "python3"+ },+ "language_info": {+ "codemirror_mode": {+ "name": "ipython",+ "version": 3+ },+ "file_extension": ".py",+ "mimetype": "text/x-python",+ "name": "python",+ "nbconvert_exporter": "python",+ "pygments_lexer": "ipython3",+ "version": "3.12.8"+ }+ },+ "nbformat": 4,+ "nbformat_minor": 5+}\ No newline at end of filediff --git a/examples/smolagents/multi_smolagents_system.py b/examples/smolagents/multi_smolagents_system.pynew file mode 100644index 00000000..b7d0319d--- /dev/null+++ b/examples/smolagents/multi_smolagents_system.py@@ -0,0 +1,122 @@+# # Orchestrate a Multi-Agent System+#+# In this notebook, we will make a multi-agent web browser: an agentic system with several agents collaborating to solve problems using the web!+#+# It will be a simple hierarchy, using a `ManagedAgent` object to wrap the managed web search agent:+# ```+# +----------------++# | Manager agent |+# +----------------++# |+# _________|______________+# | |+# Code interpreter +--------------------------------++# tool | Managed agent |+# | +------------------+ |+# | | Web Search agent | |+# | +------------------+ |+# | | | |+# | Web Search tool | |+# | Visit webpage tool |+# +--------------------------------++# ```+# Let’s set up this system.+#+# Run the line below to install the required dependencies:+# %pip install markdownify+# %pip install duckduckgo-search+# %pip install smolagents+# %pip install agentops+# 🖇️ Now we initialize the AgentOps client and load the environment variables to use the API keys.+import agentops+from dotenv import load_dotenv+import os+import re+import requests+from markdownify import markdownify+from requests.exceptions import RequestException+from smolagents import tool+from smolagents import LiteLLMModel+from smolagents import (+ CodeAgent,+ ToolCallingAgent,+ ManagedAgent,+ DuckDuckGoSearchTool,+)++load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++agentops.init(auto_start_session=False)+tracer = agentops.start_trace(+ trace_name="Orchestrate a Multi-Agent System", tags=["smolagents", "example", "multi-agent", "agentops-example"]+)+model = LiteLLMModel("openai/gpt-4o-mini")+# ## Create a Web Search Tool+#+# For web browsing, we can already use our pre-existing `DuckDuckGoSearchTool`. However, we will also create a `VisitWebpageTool` from scratch using `markdownify`. Here's how:+++@tool+def visit_webpage(url: str) -> str:+ """Visits a webpage at the given URL and returns its content as a markdown string.++ Args:+ url: The URL of the webpage to visit.++ Returns:+ The content of the webpage converted to Markdown, or an error message if the request fails.+ """+ try:+ # Send a GET request to the URL+ response = requests.get(url)+ response.raise_for_status() # Raise an exception for bad status codes++ # Convert the HTML content to Markdown+ markdown_content = markdownify(response.text).strip()++ # Remove multiple line breaks+ markdown_content = re.sub(r"\\n{3,}", "\\n\\n", markdown_content)++ return markdown_content++ except RequestException as e:+ return f"Error fetching the webpage: {str(e)}"+ except Exception as e:+ return f"An unexpected error occurred: {str(e)}"+++# Let’s test our tool:+print(visit_webpage("https://en.wikipedia.org/wiki/Hugging_Face")[:500])+# ## Build Our Multi-Agent System+#+# We will now use the tools `search` and `visit_webpage` to create the web agent.++web_agent = ToolCallingAgent(+ tools=[DuckDuckGoSearchTool(), visit_webpage],+ model=model,+ max_iterations=10,+)++managed_web_agent = ManagedAgent(+ agent=web_agent,+ name="search",+ description="Runs web searches for you. Give it your query as an argument.",+)++manager_agent = CodeAgent(+ tools=[],+ model=model,+ managed_agents=[managed_web_agent],+ additional_authorized_imports=["time", "numpy", "pandas"],+)+# Let’s run our system with the following query:+answer = manager_agent.run(+ "If LLM trainings continue to scale up at the current rhythm until 2030, what would be the electric power in GW required to power the biggest training runs by 2030? What does that correspond to, compared to some countries? Please provide a source for any number used."+)++print(answer)+# Awesome! We've successfully run a multi-agent system. Let's end the agentops session with a "Success" state. You can also end the session with a "Failure" or "Indeterminate" state, which is set as default.+agentops.end_trace(tracer, end_state="Success")+# You can view the session in the [AgentOps dashboard](https://app.agentops.ai/sessions) by clicking the link provided after ending the session.diff --git a/examples/smolagents_examples/text_to_sql.ipynb b/examples/smolagents/text_to_sql.ipynbsimilarity index 72%rename from examples/smolagents_examples/text_to_sql.ipynbrename to examples/smolagents/text_to_sql.ipynbindex 871605af..c44bf574 100644--- a/examples/smolagents_examples/text_to_sql.ipynb+++ b/examples/smolagents/text_to_sql.ipynb@@ -55,50 +55,10 @@},{"cell_type": "code",- "execution_count": 1,"id": "b12ee7a2","metadata": {},"outputs": [],- "source": [- "from sqlalchemy import (\n",- " create_engine,\n",- " MetaData,\n",- " Table,\n",- " Column,\n",- " String,\n",- " Integer,\n",- " Float,\n",- " insert,\n",- " inspect,\n",- " text,\n",- ")\n",- "\n",- "engine = create_engine(\"sqlite:///:memory:\")\n",- "metadata_obj = MetaData()\n",- "\n",- "# create city SQL table\n",- "table_name = \"receipts\"\n",- "receipts = Table(\n",- " table_name,\n",- " metadata_obj,\n",- " Column(\"receipt_id\", Integer, primary_key=True),\n",- " Column(\"customer_name\", String(16), primary_key=True),\n",- " Column(\"price\", Float),\n",- " Column(\"tip\", Float),\n",- ")\n",- "metadata_obj.create_all(engine)\n",- "\n",- "rows = [\n",- " {\"receipt_id\": 1, \"customer_name\": \"Alan Payne\", \"price\": 12.06, \"tip\": 1.20},\n",- " {\"receipt_id\": 2, \"customer_name\": \"Alex Mason\", \"price\": 23.86, \"tip\": 0.24},\n",- " {\"receipt_id\": 3, \"customer_name\": \"Woodrow Wilson\", \"price\": 53.43, \"tip\": 5.43},\n",- " {\"receipt_id\": 4, \"customer_name\": \"Margaret James\", \"price\": 21.11, \"tip\": 1.00},\n",- "]\n",- "for row in rows:\n",- " stmt = insert(receipts).values(**row)\n",- " with engine.begin() as connection:\n",- " cursor = connection.execute(stmt)"- ]+ "source": "from sqlalchemy import (\n create_engine,\n MetaData,\n Table,\n Column,\n String,\n Integer,\n Float,\n insert,\n inspect,\n text,\n)\nfrom smolagents import tool\nimport agentops\nfrom dotenv import load_dotenv\nimport os\nfrom smolagents import CodeAgent, LiteLLMModel\n\nengine = create_engine(\"sqlite:///:memory:\")\nmetadata_obj = MetaData()\n\n# create city SQL table\ntable_name = \"receipts\"\nreceipts = Table(\n table_name,\n metadata_obj,\n Column(\"receipt_id\", Integer, primary_key=True),\n Column(\"customer_name\", String(16), primary_key=True),\n Column(\"price\", Float),\n Column(\"tip\", Float),\n)\nmetadata_obj.create_all(engine)\n\nrows = [\n {\"receipt_id\": 1, \"customer_name\": \"Alan Payne\", \"price\": 12.06, \"tip\": 1.20},\n {\"receipt_id\": 2, \"customer_name\": \"Alex Mason\", \"price\": 23.86, \"tip\": 0.24},\n {\"receipt_id\": 3, \"customer_name\": \"Woodrow Wilson\", \"price\": 53.43, \"tip\": 5.43},\n {\"receipt_id\": 4, \"customer_name\": \"Margaret James\", \"price\": 21.11, \"tip\": 1.00},\n]\nfor row in rows:\n stmt = insert(receipts).values(**row)\n with engine.begin() as connection:\n cursor = connection.execute(stmt)"},{"cell_type": "markdown",@@ -140,35 +100,10 @@},{"cell_type": "code",- "execution_count": null,"id": "84fd9b4d","metadata": {},"outputs": [],- "source": [- "from smolagents import tool\n",- "\n",- "\n",- "@tool\n",- "def sql_engine(query: str) -> str:\n",- " \"\"\"\n",- " Allows you to perform SQL queries on the table. Returns a string representation of the result.\n",- " The table is named 'receipts'. Its description is as follows:\n",- " Columns:\n",- " - receipt_id: INTEGER\n",- " - customer_name: VARCHAR(16)\n",- " - price: FLOAT\n",- " - tip: FLOAT\n",- "\n",- " Args:\n",- " query: The query to perform. This should be correct SQL.\n",- " \"\"\"\n",- " output = \"\"\n",- " with engine.connect() as con:\n",- " rows = con.execute(text(query))\n",- " for row in rows:\n",- " output += \"\\n\" + str(row)\n",- " return output"- ]+ "source": "@tool\ndef sql_engine(query: str) -> str:\n \"\"\"\n Allows you to perform SQL queries on the table. Returns a string representation of the result.\n The table is named 'receipts'. Its description is as follows:\n Columns:\n - receipt_id: INTEGER\n - customer_name: VARCHAR(16)\n - price: FLOAT\n - tip: FLOAT\n\n Args:\n query: The query to perform. This should be correct SQL.\n \"\"\"\n output = \"\"\n with engine.connect() as con:\n rows = con.execute(text(query))\n for row in rows:\n output += \"\\n\" + str(row)\n return output"},{"cell_type": "markdown",@@ -182,24 +117,10 @@},{"cell_type": "code",- "execution_count": null,"id": "0cc00a36","metadata": {},"outputs": [],- "source": [- "import agentops\n",- "from dotenv import load_dotenv\n",- "import os\n",- "from smolagents import CodeAgent, LiteLLMModel\n",- "\n",- "load_dotenv()\n",- "\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"your_agentops_api_key\"\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"your_openai_api_key\"\n",- "\n",- "agentops.init(api_key=AGENTOPS_API_KEY, default_tags=[\"smolagents\", \"example\", \"text-to-sql\"])\n",- "model = LiteLLMModel(\"openai/gpt-4o-mini\")"- ]+ "source": "load_dotenv()\n\nos.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\nos.environ[\"OPENAI_API_KEY\"] = os.getenv(\"OPENAI_API_KEY\", \"your_openai_api_key_here\")\n\nagentops.init(auto_start_session=False)\ntracer = agentops.start_trace(\n trace_name=\"Text-to-SQL\", tags=[\"smolagents\", \"example\", \"text-to-sql\", \"agentops-example\"]\n)\nmodel = LiteLLMModel(\"openai/gpt-4o-mini\")"},{"cell_type": "code",@@ -331,7 +252,7 @@"metadata": {},"outputs": [],"source": [- "agentops.end_session(\"Success\")"+ "agentops.end_trace(tracer, end_state=\"Success\")"]},{@@ -364,4 +285,4 @@},"nbformat": 4,"nbformat_minor": 5-}+}\ No newline at end of filediff --git a/examples/smolagents/text_to_sql.py b/examples/smolagents/text_to_sql.pynew file mode 100644index 00000000..10eeefa6--- /dev/null+++ b/examples/smolagents/text_to_sql.py@@ -0,0 +1,159 @@+# # Text-to-SQL+#+# In this tutorial, we’ll see how to implement an agent that leverages SQL using `smolagents`.+# > Let’s start with the golden question: why not keep it simple and use a standard text-to-SQL pipeline?+#+# A standard text-to-sql pipeline is brittle, since the generated SQL query can be incorrect. Even worse, the query could be incorrect, but not raise an error, instead giving some incorrect/useless outputs without raising an alarm.+#+# Instead, an agent system is able to critically inspect outputs and decide if the query needs to be changed or not, thus giving it a huge performance boost.+#+# Let’s build this agent!+# ## Installation+# We will install the necessary packages for this example. We are going to use `sqlalchemy` to create a database and `smolagents` to build our agent. We will use `litellm` for LLM inference and `agentops` for observability.+# %pip install smolagents+# %pip install sqlalchemy+# %pip install agentops+# ## Setting up the SQL Table+from sqlalchemy import (+ create_engine,+ MetaData,+ Table,+ Column,+ String,+ Integer,+ Float,+ insert,+ inspect,+ text,+)+from smolagents import tool+import agentops+from dotenv import load_dotenv+import os+from smolagents import CodeAgent, LiteLLMModel++engine = create_engine("sqlite:///:memory:")+metadata_obj = MetaData()++# create city SQL table+table_name = "receipts"+receipts = Table(+ table_name,+ metadata_obj,+ Column("receipt_id", Integer, primary_key=True),+ Column("customer_name", String(16), primary_key=True),+ Column("price", Float),+ Column("tip", Float),+)+metadata_obj.create_all(engine)++rows = [+ {"receipt_id": 1, "customer_name": "Alan Payne", "price": 12.06, "tip": 1.20},+ {"receipt_id": 2, "customer_name": "Alex Mason", "price": 23.86, "tip": 0.24},+ {"receipt_id": 3, "customer_name": "Woodrow Wilson", "price": 53.43, "tip": 5.43},+ {"receipt_id": 4, "customer_name": "Margaret James", "price": 21.11, "tip": 1.00},+]+for row in rows:+ stmt = insert(receipts).values(**row)+ with engine.begin() as connection:+ cursor = connection.execute(stmt)+# ## Build our Agent+# We need to create the table description first because the agent will use it to generate the SQL query.+inspector = inspect(engine)+columns_info = [(col["name"], col["type"]) for col in inspector.get_columns("receipts")]++table_description = "Columns:\\n" + "\\n".join([f" - {name}: {col_type}" for name, col_type in columns_info])+print(table_description)+# Now we can create the tool that will be used by the agent to perform the SQL query.+++@tool+def sql_engine(query: str) -> str:+ """+ Allows you to perform SQL queries on the table. Returns a string representation of the result.+ The table is named 'receipts'. Its description is as follows:+ Columns:+ - receipt_id: INTEGER+ - customer_name: VARCHAR(16)+ - price: FLOAT+ - tip: FLOAT++ Args:+ query: The query to perform. This should be correct SQL.+ """+ output = ""+ with engine.connect() as con:+ rows = con.execute(text(query))+ for row in rows:+ output += "\\n" + str(row)+ return output+++# Everything is ready to create the agent. We will use the `CodeAgent` class from `smolagents` to create the agent. `litellm` is used to create the model and the agent will use the `sql_engine` tool to perform the SQL query.+#+# `agentops` is used to track the agents. We will initialize it with our API key, which can be found in the [AgentOps settings](https://app.agentops.ai/settings/projects).++load_dotenv()++os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["OPENAI_API_KEY"] = os.getenv("OPENAI_API_KEY", "your_openai_api_key_here")++agentops.init(auto_start_session=False)+tracer = agentops.start_trace(+ trace_name="Text-to-SQL", tags=["smolagents", "example", "text-to-sql", "agentops-example"]+)+model = LiteLLMModel("openai/gpt-4o-mini")+agent = CodeAgent(+ tools=[sql_engine],+ model=model,+)+agent.run("Can you give me the name of the client who got the most expensive receipt?")+# ## Level 2: Table Joins+# Now let’s make it more challenging! We want our agent to handle joins across multiple tables.+#+# So let’s make a second table recording the names of waiters for each receipt_id!+table_name = "waiters"+receipts = Table(+ table_name,+ metadata_obj,+ Column("receipt_id", Integer, primary_key=True),+ Column("waiter_name", String(16), primary_key=True),+)+metadata_obj.create_all(engine)++rows = [+ {"receipt_id": 1, "waiter_name": "Corey Johnson"},+ {"receipt_id": 2, "waiter_name": "Michael Watts"},+ {"receipt_id": 3, "waiter_name": "Michael Watts"},+ {"receipt_id": 4, "waiter_name": "Margaret James"},+]+for row in rows:+ stmt = insert(receipts).values(**row)+ with engine.begin() as connection:+ cursor = connection.execute(stmt)+# Since we changed the table, we update the `SQLExecutorTool` with this table’s description to let the LLM properly leverage information from this table.+updated_description = """Allows you to perform SQL queries on the table. Beware that this tool's output is a string representation of the execution output.+It can use the following tables:"""++inspector = inspect(engine)+for table in ["receipts", "waiters"]:+ columns_info = [(col["name"], col["type"]) for col in inspector.get_columns(table)]++ table_description = f"Table '{table}':\\n"++ table_description += "Columns:\\n" + "\\n".join([f" - {name}: {col_type}" for name, col_type in columns_info])+ updated_description += "\\n\\n" + table_description++print(updated_description)+# Now let's update the `SQLExecutorTool` with the updated description and run the agent again.+sql_engine.description = updated_description++agent = CodeAgent(+ tools=[sql_engine],+ model=model,+)++agent.run("Which waiter got more total money from tips?")+# All done! Now we can end the agentops session with a "Success" state. You can also end the session with a "Failure" or "Indeterminate" state, where the "Indeterminate" state is used by default.+agentops.end_trace(tracer, end_state="Success")+# You can view the session in the [AgentOps dashboard](https://app.agentops.ai/sessions) by clicking the link provided after ending the session.diff --git a/examples/smolagents_examples/multi_smolagents_system.ipynb b/examples/smolagents_examples/multi_smolagents_system.ipynbdeleted file mode 100644index cc2806e0..00000000--- a/examples/smolagents_examples/multi_smolagents_system.ipynb+++ /dev/null@@ -1,285 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "id": "7d4c41ff",- "metadata": {},- "source": [- "# Orchestrate a Multi-Agent System\n",- "\n",- "In this notebook, we will make a multi-agent web browser: an agentic system with several agents collaborating to solve problems using the web!\n",- "\n",- "It will be a simple hierarchy, using a `ManagedAgent` object to wrap the managed web search agent:"- ]- },- {- "cell_type": "markdown",- "id": "446d088d",- "metadata": {},- "source": [- "```\n",- "+----------------+\n",- "| Manager agent |\n",- "+----------------+\n",- " |\n",- "_________|______________\n",- "| |\n",- "Code interpreter +--------------------------------+\n",- " tool | Managed agent |\n",- " | +------------------+ |\n",- " | | Web Search agent | |\n",- " | +------------------+ |\n",- " | | | |\n",- " | Web Search tool | |\n",- " | Visit webpage tool |\n",- " +--------------------------------+\n",- "```\n",- "Let’s set up this system.\n",- "\n",- "Run the line below to install the required dependencies:"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "015b0a87",- "metadata": {},- "outputs": [],- "source": [- "%pip install markdownify\n",- "%pip install duckduckgo-search\n",- "%pip install smolagents\n",- "%pip install agentops"- ]- },- {- "cell_type": "markdown",- "id": "00509499",- "metadata": {},- "source": [- "🖇️ Now we initialize the AgentOps client and load the environment variables to use the API keys."- ]- },- {- "cell_type": "code",- "execution_count": 1,- "id": "330770fd",- "metadata": {},- "outputs": [],- "source": [- "import agentops\n",- "from dotenv import load_dotenv\n",- "import os\n",- "\n",- "load_dotenv()\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_api_key>\"\n",- "OPENAI_API_KEY = os.getenv(\"OPENAI_API_KEY\") or \"<your_openai_api_key>\""- ]- },- {- "cell_type": "markdown",- "id": "9516d2a7",- "metadata": {},- "source": [- "⚡️ Our agent will be powered by `openai/gpt-4o-mini` using the `LiteLLMModel` class."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "5f78927c",- "metadata": {},- "outputs": [],- "source": [- "from smolagents import LiteLLMModel\n",- "\n",- "agentops.init(api_key=AGENTOPS_API_KEY, default_tags=[\"smolagents\", \"example\", \"multi-agent\"])\n",- "model = LiteLLMModel(\"openai/gpt-4o-mini\")"- ]- },- {- "cell_type": "markdown",- "id": "a08cc376",- "metadata": {},- "source": [- "## Create a Web Search Tool\n",- "\n",- "For web browsing, we can already use our pre-existing `DuckDuckGoSearchTool`. However, we will also create a `VisitWebpageTool` from scratch using `markdownify`. Here’s how:"- ]- },- {- "cell_type": "code",- "execution_count": 3,- "id": "01689447",- "metadata": {},- "outputs": [],- "source": [- "import re\n",- "import requests\n",- "from markdownify import markdownify\n",- "from requests.exceptions import RequestException\n",- "from smolagents import tool\n",- "\n",- "\n",- "@tool\n",- "def visit_webpage(url: str) -> str:\n",- " \"\"\"Visits a webpage at the given URL and returns its content as a markdown string.\n",- "\n",- " Args:\n",- " url: The URL of the webpage to visit.\n",- "\n",- " Returns:\n",- " The content of the webpage converted to Markdown, or an error message if the request fails.\n",- " \"\"\"\n",- " try:\n",- " # Send a GET request to the URL\n",- " response = requests.get(url)\n",- " response.raise_for_status() # Raise an exception for bad status codes\n",- "\n",- " # Convert the HTML content to Markdown\n",- " markdown_content = markdownify(response.text).strip()\n",- "\n",- " # Remove multiple line breaks\n",- " markdown_content = re.sub(r\"\\n{3,}\", \"\\n\\n\", markdown_content)\n",- "\n",- " return markdown_content\n",- "\n",- " except RequestException as e:\n",- " return f\"Error fetching the webpage: {str(e)}\"\n",- " except Exception as e:\n",- " return f\"An unexpected error occurred: {str(e)}\""- ]- },- {- "cell_type": "markdown",- "id": "3c45517b",- "metadata": {},- "source": [- "Let’s test our tool:"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "51cc54f1",- "metadata": {},- "outputs": [],- "source": [- "print(visit_webpage(\"https://en.wikipedia.org/wiki/Hugging_Face\")[:500])"- ]- },- {- "cell_type": "markdown",- "id": "921df68d",- "metadata": {},- "source": [- "## Build Our Multi-Agent System\n",- "\n",- "We will now use the tools `search` and `visit_webpage` to create the web agent."- ]- },- {- "cell_type": "code",- "execution_count": 5,- "id": "f274b34f",- "metadata": {},- "outputs": [],- "source": [- "from smolagents import (\n",- " CodeAgent,\n",- " ToolCallingAgent,\n",- " ManagedAgent,\n",- " DuckDuckGoSearchTool,\n",- ")\n",- "\n",- "web_agent = ToolCallingAgent(\n",- " tools=[DuckDuckGoSearchTool(), visit_webpage],\n",- " model=model,\n",- " max_iterations=10,\n",- ")\n",- "\n",- "managed_web_agent = ManagedAgent(\n",- " agent=web_agent,\n",- " name=\"search\",\n",- " description=\"Runs web searches for you. Give it your query as an argument.\",\n",- ")\n",- "\n",- "manager_agent = CodeAgent(\n",- " tools=[],\n",- " model=model,\n",- " managed_agents=[managed_web_agent],\n",- " additional_authorized_imports=[\"time\", \"numpy\", \"pandas\"],\n",- ")"- ]- },- {- "cell_type": "markdown",- "id": "d5977883",- "metadata": {},- "source": [- "Let’s run our system with the following query:"- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "e1e497c1",- "metadata": {},- "outputs": [],- "source": [- "answer = manager_agent.run(\n",- " \"If LLM trainings continue to scale up at the current rhythm until 2030, what would be the electric power in GW required to power the biggest training runs by 2030? What does that correspond to, compared to some countries? Please provide a source for any number used.\"\n",- ")\n",- "\n",- "print(answer)"- ]- },- {- "cell_type": "markdown",- "id": "169583c6",- "metadata": {},- "source": [- "Awesome! We've successfully run a multi-agent system. Let's end the agentops session with a \"Success\" state. You can also end the session with a \"Failure\" or \"Indeterminate\" state, which is set as default."- ]- },- {- "cell_type": "code",- "execution_count": null,- "id": "f82fafac",- "metadata": {},- "outputs": [],- "source": [- "agentops.end_session(\"Success\")"- ]- },- {- "cell_type": "markdown",- "id": "d373e4ea",- "metadata": {},- "source": [- "You can view the session in the [AgentOps dashboard](https://app.agentops.ai/sessions) by clicking the link provided after ending the session."- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "test",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.12.8"- }- },- "nbformat": 4,- "nbformat_minor": 5-}diff --git a/examples/swarmzero_examples/README.md b/examples/swarmzero_examples/README.mddeleted file mode 100644index 0210b8ba..00000000--- a/examples/swarmzero_examples/README.md+++ /dev/null@@ -1,71 +0,0 @@-# Web Search Agent--A powerful web search agent built using SwarmZero framework that enables intelligent web searching capabilities.--## Description--This agent utilizes the Tavily API for performing web searches and is built on top of the SwarmZero framework, providing enhanced search capabilities with AI-powered processing.--## Prerequisites--- Python 3.11 or higher-- Poetry package manager-- Tavily API key-- AgentOps API key--## Installation--1. Clone the repository:-```bash-git clone https://github.com/swarmzero/examples.git-cd examples/agents/web_search_agent-```--2. Install dependencies using Poetry:-```bash-poetry install --no-root-```--3. Set up environment variables:-Create a `.env` file in the root directory and add your API keys:-```-TAVILY_API_KEY=your_tavily_api_key_here-AGENTOPS_API_KEY=your_agentops_api_key_here-OPENAI_API_KEY=your_openai_api_key_here-```--## Usage--1. Activate the Poetry shell:-```bash-poetry shell-```--2. Run the agent:-```bash-poetry run python main.py-```--3. Send a message to the agent:-```bash-curl -X 'POST' \- 'http://localhost:8000/api/v1/chat' \- -H 'accept: application/json' \- -H 'Content-Type: multipart/form-data' \- -F 'user_id=test_user' \- -F 'session_id=test_web_search_agent' \- -F 'chat_data={"messages":[{"role":"user","content":"what is swarmzero.ai about?"}]}'-```--4. AgentOps will automatically capture the session:-- View the _agentops.log_ file-- See the [AgentOps Dashboard](https://app.agentops.ai/drilldown)--## Dependencies--- `swarmzero`: Framework for multi-agent development-- `agentops`: Agent observability and monitoring-- `tavily-python`: Web search API client--## Learn more-Visit [SwarmZero](https://swarmzero.ai) to learn more about the SwarmZero framework.diff --git a/examples/swarmzero_examples/swarmzero_config.toml b/examples/swarmzero_examples/swarmzero_config.tomldeleted file mode 100644index e16851c4..00000000--- a/examples/swarmzero_examples/swarmzero_config.toml+++ /dev/null@@ -1,11 +0,0 @@-[model]-model = "gpt-4o"--[environment]-type = "dev"--[timeout]-llm = 30--[sample_prompts]-prompts = []diff --git a/examples/swarmzero_examples/web_search_agent.ipynb b/examples/swarmzero_examples/web_search_agent.ipynbdeleted file mode 100644index 90e58bf1..00000000--- a/examples/swarmzero_examples/web_search_agent.ipynb+++ /dev/null@@ -1,176 +0,0 @@-{- "cells": [- {- "cell_type": "markdown",- "metadata": {},- "source": [- "# Web Search Agent\n",- "This notebook demonstrates a web search agent using SwarmZero framework and Tavily API."- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "import os\n",- "\n",- "import agentops\n",- "from dotenv import load_dotenv\n",- "from swarmzero import Agent\n",- "from tavily import TavilyClient\n",- "\n",- "load_dotenv()\n",- "agentops.init(os.getenv(\"AGENTOPS_API_KEY\"))\n",- "tavily_client = TavilyClient(api_key=os.getenv(\"TAVILY_API_KEY\"))"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Define Search Functions"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "async def web_search(query: str) -> dict:\n",- " response = tavily_client.search(query)\n",- " results = []\n",- " for result in response[\"results\"][:3]:\n",- " results.append({\"title\": result[\"title\"], \"url\": result[\"url\"], \"content\": result[\"content\"]})\n",- " return results\n",- "\n",- "\n",- "async def extract_from_urls(urls: list[str]) -> dict:\n",- " response = tavily_client.extract(urls=urls)\n",- "\n",- " if response[\"failed_results\"]:\n",- " print(f\"Failed to extract from {response['failed_results']}\")\n",- "\n",- " results = []\n",- " for result in response[\"results\"]:\n",- " results.append({\"url\": result[\"url\"], \"raw_content\": result[\"raw_content\"]})\n",- "\n",- " return results"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "## Initialize and Run Agent"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "my_agent = Agent(\n",- " name=\"workflow-assistant\",\n",- " functions=[\n",- " web_search,\n",- " extract_from_urls,\n",- " ],\n",- " config_path=\"./swarmzero_config.toml\", # see https://github.com/swarmzero/swarmzero/blob/main/swarmzero_config_example.toml\n",- " instruction=\"You are a helpful assistant that can search the web and extract information from a given URL.\",\n",- " # chat_only_mode=True # remove comment only if using `my_agent.chat()`\n",- ")"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Option 1: Chat directly without starting the agent's server"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "import asyncio"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "response = asyncio.run(my_agent.chat(prompt=\"what is Decentralized-AI about about?\"))"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "print(response)"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "### Option 2: Run agent server"- ]- },- {- "cell_type": "code",- "execution_count": null,- "metadata": {},- "outputs": [],- "source": [- "# my_agent.run() # see agent API at localhost:8000/docs"- ]- },- {- "cell_type": "markdown",- "metadata": {},- "source": [- "Send a message to the agent:\n",- "```bash\n",- "curl -X 'POST' \\\n",- " 'http://localhost:8000/api/v1/chat' \\\n",- " -H 'accept: application/json' \\\n",- " -H 'Content-Type: multipart/form-data' \\\n",- " -F 'user_id=test_user' \\\n",- " -F 'session_id=test_web_search_agent' \\\n",- " -F 'chat_data={\"messages\":[{\"role\":\"user\",\"content\":\"what is swarmzero.ai about?\"}]}'\n",- "```"- ]- }- ],- "metadata": {- "kernelspec": {- "display_name": "Python 3",- "language": "python",- "name": "python3"- },- "language_info": {- "codemirror_mode": {- "name": "ipython",- "version": 3- },- "file_extension": ".py",- "mimetype": "text/x-python",- "name": "python",- "nbconvert_exporter": "python",- "pygments_lexer": "ipython3",- "version": "3.11"- }- },- "nbformat": 4,- "nbformat_minor": 4-}diff --git a/examples/watsonx_examples/README.md b/examples/watsonx/README.mdsimilarity index 74%rename from examples/watsonx_examples/README.mdrename to examples/watsonx/README.mdindex 27e317b5..c07f94a7 100644--- a/examples/watsonx_examples/README.md+++ b/examples/watsonx/README.md@@ -5,7 +5,7 @@ This directory contains examples of using IBM Watsonx AI with AgentOps instrumen## Prerequisites- IBM Watsonx AI account with API key-- Python >=3.10 <3.13+- Python >= 3.10 < 3.13- Install required dependencies:```pip install agentops ibm-watsonx-ai python-dotenv@@ -25,26 +25,26 @@ WATSONX_PROJECT_ID=your-project-id-here### 1. Basic Text Generation and Chat Completion-File: [watsonx-text-chat.ipynb](https://github.com/AgentOps-AI/agentops/blob/0.4.9/examples/watsonx_examples/watsonx-text-chat.ipynb)-This notebook demonstrates:+Example: `watsonx-text-chat`+This example demonstrates:- Basic text generation with IBM Watsonx AI- Chat completion with system and user messages- Multiple examples of chat interactions### 2. Streaming Generation-File: [watsonx-streaming.ipynb](https://github.com/AgentOps-AI/agentops/blob/0.4.9/examples/watsonx_examples/watsonx-streaming.ipynb)+Example: `watsonx-streaming`-This notebook demonstrates:+This example demonstrates:- Streaming text generation- Streaming chat completion- Processing streaming responses### 3. Tokenization and Model Details-File: [watsonx-tokenization-model.ipynb](https://github.com/AgentOps-AI/agentops/blob/0.4.9/examples/watsonx_examples/watsonx-tokeniation-model.ipynb)+Example: `watsonx-tokenization-model`-This notebook demonstrates:+This example demonstrates:- Tokenizing text with IBM Watsonx AI models- Retrieving model details- Comparing tokenization between different models@@ -61,4 +61,4 @@ You can explore other available models through the IBM Watsonx platform.These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your IBM Watsonx AI calls to provide insights into performance, usage patterns, and model behavior.-To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)\ No newline at end of file+To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/watsonx_examples/watsonx-streaming.ipynb b/examples/watsonx/watsonx-streaming.ipynbsimilarity index 86%rename from examples/watsonx_examples/watsonx-streaming.ipynbrename to examples/watsonx/watsonx-streaming.ipynbindex 069a807a..a21d22ae 100644--- a/examples/watsonx_examples/watsonx-streaming.ipynb+++ b/examples/watsonx/watsonx-streaming.ipynb@@ -20,22 +20,9 @@},{"cell_type": "code",- "execution_count": null,"metadata": {},"outputs": [],- "source": [- "import agentops\n",- "from ibm_watsonx_ai import Credentials\n",- "from ibm_watsonx_ai.foundation_models import ModelInference\n",- "from dotenv import load_dotenv\n",- "import os\n",- "\n",- "# Load environment variables\n",- "load_dotenv()\n",- "\n",- "# Initialize AgentOps\n",- "agentops.init()"- ]+ "source": "import agentops\nfrom ibm_watsonx_ai import Credentials\nfrom ibm_watsonx_ai.foundation_models import ModelInference\nfrom dotenv import load_dotenv\nimport os\n\n# Load environment variables\nload_dotenv()\nos.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n\n# Initialize AgentOps\nagentops.init(tags=[\"watsonx-streaming\", \"agentops-example\"])"},{"cell_type": "markdown",@@ -48,20 +35,9 @@},{"cell_type": "code",- "execution_count": 2,"metadata": {},"outputs": [],- "source": [- "# Initialize credentials - replace with your own API key\n",- "# Best practice: Store API keys in environment variables\n",- "credentials = Credentials(\n",- " url=os.getenv(\"WATSONX_URL\", \"https://eu-de.ml.cloud.ibm.com\"),\n",- " api_key=os.getenv(\"WATSONX_API_KEY\", \"your-api-key-here\"),\n",- ")\n",- "\n",- "# Project ID for your IBM Watsonx project\n",- "project_id = os.getenv(\"WATSONX_PROJECT_ID\", \"your-project-id-here\")"- ]+ "source": "# Initialize credentials - replace with your own API key\n# Best practice: Store API keys in environment variables\n# Ensure WATSONX_API_KEY is set in your .env file or environment\nos.environ[\"WATSONX_API_KEY\"] = os.getenv(\"WATSONX_API_KEY\", \"your_watsonx_api_key_here\")\n\ncredentials = Credentials(\n url=os.getenv(\"WATSONX_URL\", \"https://eu-de.ml.cloud.ibm.com\"),\n api_key=os.environ[\"WATSONX_API_KEY\"],\n)\n\n# Project ID for your IBM Watsonx project\nproject_id = os.getenv(\"WATSONX_PROJECT_ID\", \"your-project-id-here\")"},{"cell_type": "markdown",@@ -241,4 +217,4 @@},"nbformat": 4,"nbformat_minor": 4-}+}\ No newline at end of filediff --git a/examples/watsonx/watsonx-streaming.py b/examples/watsonx/watsonx-streaming.pynew file mode 100644index 00000000..a78214f4--- /dev/null+++ b/examples/watsonx/watsonx-streaming.py@@ -0,0 +1,119 @@+# # IBM Watsonx AI Streaming with AgentOps+#+# This notebook demonstrates how to use IBM Watsonx AI for streaming text generation and streaming chat completion with AgentOps instrumentation.+# ## Setup+#+# First, let's import the necessary libraries and initialize AgentOps:+import agentops+from ibm_watsonx_ai import Credentials+from ibm_watsonx_ai.foundation_models import ModelInference+from dotenv import load_dotenv+import os++# Load environment variables+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")++# Initialize AgentOps+agentops.init(tags=["watsonx-streaming", "agentops-example"])+# ## Initialize IBM Watsonx AI Credentials+#+# To use IBM Watsonx AI, you need to set up your credentials and project ID.+# Initialize credentials - replace with your own API key+# Best practice: Store API keys in environment variables+# Ensure WATSONX_API_KEY is set in your .env file or environment+os.environ["WATSONX_API_KEY"] = os.getenv("WATSONX_API_KEY", "your_watsonx_api_key_here")++credentials = Credentials(+ url=os.getenv("WATSONX_URL", "https://eu-de.ml.cloud.ibm.com"),+ api_key=os.environ["WATSONX_API_KEY"],+)++# Project ID for your IBM Watsonx project+project_id = os.getenv("WATSONX_PROJECT_ID", "your-project-id-here")+# ## Initialize Models+#+# Let's initialize models for our streaming examples:+# Initialize text generation model+gen_model = ModelInference(model_id="google/flan-ul2", credentials=credentials, project_id=project_id)++# Initialize chat model+chat_model = ModelInference(+ model_id="meta-llama/llama-3-3-70b-instruct", credentials=credentials, project_id=project_id+)+# ## Streaming Text Generation+#+# Let's use IBM Watsonx AI to generate streaming text:+# Streaming text generation+prompt = "List 3 benefits of machine learning:"+stream_response = gen_model.generate_text_stream(prompt)++print("Streaming Response:")+full_stream_response = ""+for chunk in stream_response:+ if isinstance(chunk, str):+ print(chunk, end="", flush=True)+ full_stream_response += chunk+print("\\n\\nComplete Response:")+print(full_stream_response)+# ## Streaming Chat Completion+#+# Now, let's try streaming chat completion:+# Format messages for chat+chat_stream_messages = [+ {"role": "system", "content": "You are a concise assistant."},+ {"role": "user", "content": "Explain the concept of photosynthesis in one sentence."},+]++# Get streaming chat response+chat_stream_response_gen = chat_model.chat_stream(messages=chat_stream_messages)++print("Chat Stream Response:")+full_chat_stream_response = ""+for chunk in chat_stream_response_gen:+ try:+ # Check structure based on SDK docstring example+ if chunk and "choices" in chunk and chunk["choices"]:+ delta = chunk["choices"][0].get("delta", {})+ content_chunk = delta.get("content")+ if content_chunk:+ print(content_chunk, end="", flush=True)+ full_chat_stream_response += content_chunk+ except Exception as e:+ print(f"Error processing chat stream chunk: {e}, Chunk: {chunk}")++print("\\n\\nComplete Chat Response:")+print(full_chat_stream_response)+# ## Another Streaming Chat Example+#+# Let's try another example with a more complex query:+# New chat messages for streaming+chat_stream_messages = [+ {"role": "system", "content": "You are a helpful assistant that provides step-by-step explanations."},+ {"role": "user", "content": "Explain how to make a simple chocolate cake."},+]++# Get streaming chat response+chat_stream_response_gen = chat_model.chat_stream(messages=chat_stream_messages)++print("Chat Stream Response:")+full_chat_stream_response = ""+for chunk in chat_stream_response_gen:+ try:+ if chunk and "choices" in chunk and chunk["choices"]:+ delta = chunk["choices"][0].get("delta", {})+ content_chunk = delta.get("content")+ if content_chunk:+ print(content_chunk, end="", flush=True)+ full_chat_stream_response += content_chunk+ except Exception as e:+ print(f"Error processing chat stream chunk: {e}, Chunk: {chunk}")++print("\\n\\nComplete Chat Response:")+print(full_chat_stream_response)+# ## Clean Up+#+# Finally, let's close the persistent connection with the models:+# Close connections+gen_model.close_persistent_connection()+chat_model.close_persistent_connection()diff --git a/examples/watsonx_examples/watsonx-text-chat.ipynb b/examples/watsonx/watsonx-text-chat.ipynbsimilarity index 80%rename from examples/watsonx_examples/watsonx-text-chat.ipynbrename to examples/watsonx/watsonx-text-chat.ipynbindex 6d44a972..602dbe2f 100644--- a/examples/watsonx_examples/watsonx-text-chat.ipynb+++ b/examples/watsonx/watsonx-text-chat.ipynb@@ -20,22 +20,9 @@},{"cell_type": "code",- "execution_count": null,"metadata": {},"outputs": [],- "source": [- "import agentops\n",- "from ibm_watsonx_ai import Credentials\n",- "from ibm_watsonx_ai.foundation_models import ModelInference\n",- "from dotenv import load_dotenv\n",- "import os\n",- "\n",- "# Load environment variables\n",- "load_dotenv()\n",- "\n",- "# Initialize AgentOps\n",- "agentops.init()"- ]+ "source": "import agentops\nfrom ibm_watsonx_ai import Credentials\nfrom ibm_watsonx_ai.foundation_models import ModelInference\nfrom dotenv import load_dotenv\nimport os\n\n# Load environment variables\nload_dotenv()\nos.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n\n# Initialize AgentOps\nagentops.init(tags=[\"watsonx-text-chat\", \"agentops-example\"])"},{"cell_type": "markdown",@@ -48,20 +35,9 @@},{"cell_type": "code",- "execution_count": 2,"metadata": {},"outputs": [],- "source": [- "# Initialize credentials - replace with your own API key\n",- "# Best practice: Store API keys in environment variables\n",- "credentials = Credentials(\n",- " url=os.getenv(\"WATSONX_URL\", \"https://eu-de.ml.cloud.ibm.com\"),\n",- " api_key=os.getenv(\"WATSONX_API_KEY\", \"your-api-key-here\"),\n",- ")\n",- "\n",- "# Project ID for your IBM Watsonx project\n",- "project_id = os.getenv(\"WATSONX_PROJECT_ID\", \"your-project-id-here\")"- ]+ "source": "# Initialize credentials - replace with your own API key\n# Best practice: Store API keys in environment variables\n# Ensure WATSONX_API_KEY is set in your .env file or environment\nos.environ[\"WATSONX_API_KEY\"] = os.getenv(\"WATSONX_API_KEY\", \"your_watsonx_api_key_here\")\n\ncredentials = Credentials(\n url=os.getenv(\"WATSONX_URL\", \"https://eu-de.ml.cloud.ibm.com\"),\n api_key=os.environ[\"WATSONX_API_KEY\"],\n)\n\n# Project ID for your IBM Watsonx project\nproject_id = os.getenv(\"WATSONX_PROJECT_ID\", \"your-project-id-here\")"},{"cell_type": "markdown",@@ -186,4 +162,4 @@},"nbformat": 4,"nbformat_minor": 4-}+}\ No newline at end of filediff --git a/examples/watsonx/watsonx-text-chat.py b/examples/watsonx/watsonx-text-chat.pynew file mode 100644index 00000000..c2139158--- /dev/null+++ b/examples/watsonx/watsonx-text-chat.py@@ -0,0 +1,78 @@+# # IBM Watsonx AI Text Generation and Chat with AgentOps+#+# This notebook demonstrates how to use IBM Watsonx AI for basic text generation and chat completion tasks with AgentOps instrumentation.+# ## Setup+#+# First, let's import the necessary libraries and initialize AgentOps:+import agentops+from ibm_watsonx_ai import Credentials+from ibm_watsonx_ai.foundation_models import ModelInference+from dotenv import load_dotenv+import os++# Load environment variables+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")++# Initialize AgentOps+agentops.init(tags=["watsonx-text-chat", "agentops-example"])+# ## Initialize IBM Watsonx AI Credentials+#+# To use IBM Watsonx AI, you need to set up your credentials and project ID.+# Initialize credentials - replace with your own API key+# Best practice: Store API keys in environment variables+# Ensure WATSONX_API_KEY is set in your .env file or environment+os.environ["WATSONX_API_KEY"] = os.getenv("WATSONX_API_KEY", "your_watsonx_api_key_here")++credentials = Credentials(+ url=os.getenv("WATSONX_URL", "https://eu-de.ml.cloud.ibm.com"),+ api_key=os.environ["WATSONX_API_KEY"],+)++# Project ID for your IBM Watsonx project+project_id = os.getenv("WATSONX_PROJECT_ID", "your-project-id-here")+# ## Text Generation+#+# Let's use IBM Watsonx AI to generate text based on a prompt:+# Initialize text generation model+gen_model = ModelInference(model_id="google/flan-ul2", credentials=credentials, project_id=project_id)++# Generate text with a prompt+prompt = "Write a short poem about artificial intelligence:"+response = gen_model.generate_text(prompt)+print(f"Generated Text:\\n{response}")+# ## Chat Completion+#+# Now, let's use a different model for chat completion:+# Initialize chat model+chat_model = ModelInference(+ model_id="meta-llama/llama-3-3-70b-instruct", credentials=credentials, project_id=project_id+)++# Format messages for chat+messages = [+ {"role": "system", "content": "You are a helpful AI assistant."},+ {"role": "user", "content": "What are the three laws of robotics?"},+]++# Get chat response+chat_response = chat_model.chat(messages)+print(f"Chat Response:\\n{chat_response['choices'][0]['message']['content']}")+# ## Another Chat Example+#+# Let's try a different type of query:+# New chat messages+messages = [+ {"role": "system", "content": "You are an expert in machine learning."},+ {"role": "user", "content": "Explain the difference between supervised and unsupervised learning in simple terms."},+]++# Get chat response+chat_response = chat_model.chat(messages)+print(f"Chat Response:\\n{chat_response['choices'][0]['message']['content']}")+# ## Clean Up+#+# Finally, let's close the persistent connection with the models:+# Close connections+gen_model.close_persistent_connection()+chat_model.close_persistent_connection()diff --git a/examples/watsonx_examples/watsonx-tokeniation-model.ipynb b/examples/watsonx/watsonx-tokeniation-model.ipynbsimilarity index 84%rename from examples/watsonx_examples/watsonx-tokeniation-model.ipynbrename to examples/watsonx/watsonx-tokeniation-model.ipynbindex da0974c2..3581899f 100644--- a/examples/watsonx_examples/watsonx-tokeniation-model.ipynb+++ b/examples/watsonx/watsonx-tokeniation-model.ipynb@@ -20,22 +20,9 @@},{"cell_type": "code",- "execution_count": null,"metadata": {},"outputs": [],- "source": [- "import agentops\n",- "from ibm_watsonx_ai import Credentials\n",- "from ibm_watsonx_ai.foundation_models import ModelInference\n",- "from dotenv import load_dotenv\n",- "import os\n",- "\n",- "# Load environment variables\n",- "load_dotenv()\n",- "\n",- "# Initialize AgentOps\n",- "agentops.init()"- ]+ "source": "import agentops\nfrom ibm_watsonx_ai import Credentials\nfrom ibm_watsonx_ai.foundation_models import ModelInference\nfrom dotenv import load_dotenv\nimport os\n\n# Load environment variables\nload_dotenv()\nos.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n\n# Initialize AgentOps\nagentops.init(tags=[\"watsonx-tokenization\", \"agentops-example\"])"},{"cell_type": "markdown",@@ -48,20 +35,9 @@},{"cell_type": "code",- "execution_count": 2,"metadata": {},"outputs": [],- "source": [- "# Initialize credentials - replace with your own API key\n",- "# Best practice: Store API keys in environment variables\n",- "credentials = Credentials(\n",- " url=os.getenv(\"WATSONX_URL\", \"https://eu-de.ml.cloud.ibm.com\"),\n",- " api_key=os.getenv(\"WATSONX_API_KEY\", \"your-api-key-here\"),\n",- ")\n",- "\n",- "# Project ID for your IBM Watsonx project\n",- "project_id = os.getenv(\"WATSONX_PROJECT_ID\", \"your-project-id-here\")"- ]+ "source": "# Initialize credentials - replace with your own API key\n# Best practice: Store API keys in environment variables\n# Ensure WATSONX_API_KEY is set in your .env file or environment\nos.environ[\"WATSONX_API_KEY\"] = os.getenv(\"WATSONX_API_KEY\", \"your_watsonx_api_key_here\")\n\ncredentials = Credentials(\n url=os.getenv(\"WATSONX_URL\", \"https://eu-de.ml.cloud.ibm.com\"),\n api_key=os.environ[\"WATSONX_API_KEY\"],\n)\n\n# Project ID for your IBM Watsonx project\nproject_id = os.getenv(\"WATSONX_PROJECT_ID\", \"your-project-id-here\")"},{"cell_type": "markdown",@@ -247,4 +223,4 @@},"nbformat": 4,"nbformat_minor": 4-}+}\ No newline at end of filediff --git a/examples/watsonx/watsonx-tokeniation-model.py b/examples/watsonx/watsonx-tokeniation-model.pynew file mode 100644index 00000000..90d8210d--- /dev/null+++ b/examples/watsonx/watsonx-tokeniation-model.py@@ -0,0 +1,97 @@+# # IBM Watsonx AI Tokenization and Model Details with AgentOps+#+# This notebook demonstrates how to use IBM Watsonx AI for tokenization and retrieving model details with AgentOps instrumentation.+# ## Setup+#+# First, let's import the necessary libraries and initialize AgentOps:+import agentops+from ibm_watsonx_ai import Credentials+from ibm_watsonx_ai.foundation_models import ModelInference+from dotenv import load_dotenv+import os++# Load environment variables+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")++# Initialize AgentOps+agentops.init(tags=["watsonx-tokenization", "agentops-example"])+# ## Initialize IBM Watsonx AI Credentials+#+# To use IBM Watsonx AI, you need to set up your credentials and project ID.+# Initialize credentials - replace with your own API key+# Best practice: Store API keys in environment variables+# Ensure WATSONX_API_KEY is set in your .env file or environment+os.environ["WATSONX_API_KEY"] = os.getenv("WATSONX_API_KEY", "your_watsonx_api_key_here")++credentials = Credentials(+ url=os.getenv("WATSONX_URL", "https://eu-de.ml.cloud.ibm.com"),+ api_key=os.environ["WATSONX_API_KEY"],+)++# Project ID for your IBM Watsonx project+project_id = os.getenv("WATSONX_PROJECT_ID", "your-project-id-here")+# ## Initialize Model+#+# Let's initialize a model to work with:+# Initialize model+model = ModelInference(model_id="google/flan-ul2", credentials=credentials, project_id=project_id)+# ## Tokenization+#+# Let's use IBM Watsonx AI to tokenize text:+# Example text to tokenize+text_to_tokenize = "Hello, how are you today?"+tokens = model.tokenize(text_to_tokenize)+print(f"Tokenization Result:\\n{tokens}")+# ## Tokenizing Longer Text+#+# Let's try tokenizing a longer piece of text:+# Longer text to tokenize+longer_text = """Artificial intelligence (AI) is intelligence demonstrated by machines,+as opposed to intelligence displayed by humans or other animals.+Example tasks in which this is done include speech recognition, computer vision,+translation between languages, and decision-making."""++tokens = model.tokenize(longer_text)+print(f"Tokens: {tokens}")+# ## Model Details+#+# Let's retrieve and display details about the model we're using:+# Get model details+model_details = model.get_details()+print(f"Model Details:\\n{model_details}")+# ## Exploring a Different Model+#+# Let's initialize a different model and get its details:+# Initialize another model+llama_model = ModelInference(+ model_id="meta-llama/llama-3-3-70b-instruct", credentials=credentials, project_id=project_id+)++# Get details of the new model+llama_model_details = llama_model.get_details()+print(f"Llama Model Details:\\n{llama_model_details}")++# Example text tokenization with the new model+example_text = "Let's see how this model tokenizes text."+llama_tokens = llama_model.tokenize(example_text)+print(f"\\nTokenization with Llama model:\\n{llama_tokens}")+# ## Comparing Tokenization Between Models+#+# Let's compare how different models tokenize the same text:+# Text to compare tokenization+comparison_text = "The quick brown fox jumps over the lazy dog."++# Tokenize with first model+flan_tokens = model.tokenize(comparison_text)+print(f"FLAN-UL2 tokens: {flan_tokens}")++# Tokenize with second model+llama_tokens = llama_model.tokenize(comparison_text)+print(f"\\nLlama tokens: {llama_tokens}")+# ## Clean Up+#+# Finally, let's close the persistent connection with the models:+# Close connections+model.close_persistent_connection()+llama_model.close_persistent_connection()diff --git a/examples/xai/README.md b/examples/xai/README.mdnew file mode 100644index 00000000..826fd32e--- /dev/null+++ b/examples/xai/README.md@@ -0,0 +1,32 @@+# xAI Examples with AgentOps++This directory contains examples of using the xAI (Grok) API with AgentOps instrumentation.++## Prerequisites++- Python >= 3.10 < 3.13+- Install required dependencies:+ ```+ pip install agentops openai+ ```++## Examples++### 1. Grok Examples++Example: `grok_examples`+This example demonstrates:+- Basic Grok API usage++### 2. Grok Vision Examples++Example: `grok_vision_examples`++This example demonstrates:+- Vision capabilities with Grok++## AgentOps Integration++These examples show how to use AgentOps to monitor and analyze your AI applications. AgentOps automatically instruments your xAI calls to provide insights into performance, usage patterns, and model behavior.++To learn more about AgentOps, visit [https://www.agentops.ai](https://www.agentops.ai)diff --git a/examples/xai_examples/grok_examples.ipynb b/examples/xai/grok_examples.ipynbsimilarity index 91%rename from examples/xai_examples/grok_examples.ipynbrename to examples/xai/grok_examples.ipynbindex dd50d4c5..513a31d5 100755--- a/examples/xai_examples/grok_examples.ipynb+++ b/examples/xai/grok_examples.ipynb@@ -4,7 +4,7 @@"cell_type": "markdown","metadata": {},"source": [- "# XAI Examples\n",+ "# XAI Example\n","This notebook demonstrates how to use XAI with AgentOps via the OpenAI python client. \n","\n","We are going to use the latest Grok model from XAI to create a transliteration chatbot that can understand the major languages of the world and translate them to a user's native language! We will use AgentOps to track the chatbot's performance."@@ -36,7 +36,7 @@},{"cell_type": "code",- "execution_count": 1,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -55,13 +55,12 @@},{"cell_type": "code",- "execution_count": 2,+ "execution_count": null,"metadata": {},"outputs": [],"source": ["load_dotenv()\n",- "XAI_API_KEY = os.getenv(\"XAI_API_KEY\") or \"<your_xai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")"]},{@@ -77,7 +76,8 @@"metadata": {},"outputs": [],"source": [- "agentops.init(AGENTOPS_API_KEY, default_tags=[\"xai-example\", \"grok\"])"+ "agentops.init(auto_start_session=False)\n",+ "tracer = agentops.start_trace(trace_name=\"XAI Example\", tags=[\"xai-example\", \"grok\", \"agentops-example\"])"]},{@@ -91,13 +91,13 @@},{"cell_type": "code",- "execution_count": 4,+ "execution_count": null,"metadata": {},"outputs": [],"source": ["client = OpenAI(\n",- " api_key=XAI_API_KEY,\n"," base_url=\"https://api.x.ai/v1\",\n",+ " api_key=os.getenv(\"XAI_API_KEY\", \"your_xai_api_key_here\"),\n",")"]},@@ -110,7 +110,7 @@},{"cell_type": "code",- "execution_count": 16,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -166,12 +166,12 @@},{"cell_type": "code",- "execution_count": 14,+ "execution_count": null,"metadata": {},"outputs": [],"source": ["response = client.chat.completions.create(\n",- " model=\"grok-beta\",\n",+ " model=\"grok-3-mini\",\n"," messages=[{\"role\": \"system\", \"content\": SYSTEM_PROMPT}, {\"role\": \"user\", \"content\": INSTRUCTION_PROMPT}],\n",")"]@@ -200,7 +200,7 @@"metadata": {},"outputs": [],"source": [- "agentops.end_session(\"Success\")"+ "agentops.end_trace(tracer, end_state=\"Success\")"]},{@@ -213,7 +213,7 @@],"metadata": {"kernelspec": {- "display_name": "ops",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -227,7 +227,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.10.15"+ "version": "3.11.11"}},"nbformat": 4,diff --git a/examples/xai/grok_examples.py b/examples/xai/grok_examples.pynew file mode 100644index 00000000..43718a2c--- /dev/null+++ b/examples/xai/grok_examples.py@@ -0,0 +1,80 @@+# XAI Example+#+# This notebook demonstrates how to use XAI with AgentOps via the OpenAI python client.+#+# We are going to use the latest Grok model from XAI to create a transliteration chatbot that can understand the major languages of the world and translate them to a user's native language! We will use AgentOps to track the chatbot's performance.+# First let's install the required packages+# %pip install -U openai+# %pip install -U agentops+# Then import them+from openai import OpenAI+import agentops+import os+from dotenv import load_dotenv++# Next, we'll grab our API keys. You can use dotenv like below or however else you like to load environment variables+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")++# Next we initialize the AgentOps client.+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(trace_name="XAI Example", tags=["xai-example", "grok", "agentops-example"])++# And we are all set! Note the seesion url above. We will use it to track the chatbot.+#+# Let's initialize the OpenAI client with the XAI API key and base url.+client = OpenAI(+ base_url="https://api.x.ai/v1",+ api_key=os.getenv("XAI_API_KEY", "your_xai_api_key_here"),+)++# Now we will set the system and instruction prompts for the chatbot. We will set the native language to Spanish and the user prompt to transliterate an excerpt from Haruki Murakami's "Kafka On The Shore".+SYSTEM_PROMPT = """+You are a highly intelligent, multilingual assistant designed to understand user prompts in English and respond in the user's specified native language.+Your key responsibilities include:+1. Translating and generating meaningful, contextually appropriate responses in the user's native language.+2. Ensuring the output is accurate, coherent, and in Unicode format for proper display in the specified language.+3. Adhering to the nuances of the specified language's grammar, tone, and cultural context.++When asked to respond in a language, generate the response entirely in that language without using English unless explicitly requested.++If the specified language is unfamiliar or ambiguous, politely ask for clarification in English.+"""++native_language = "Spanish"++USER_PROMPT = """+Sometimes fate is like a small sandstorm that keeps changing directions. You change direction but the sandstorm chases you.+You turn again, but the storm adjusts. Over and over you play this out, like some ominous dance with death just before dawn. Why?+Because this storm isn’t something that blew in from far away, something that has nothing to do with you. This storm is you.+Something inside of you. So all you can do is give in to it, step right inside the storm, closing your eyes and plugging up your ears so the sand doesn’t get in, and walk through it, step by step.+There’s no sun there, no moon, no direction, no sense of time. Just fine white sand swirling up into the sky like pulverized bones.+That’s the kind of sandstorm you need to imagine.++And you really will have to make it through that violent, metaphysical, symbolic storm.+No matter how metaphysical or symbolic it might be, make no mistake about it: it will cut through flesh like a thousand razor blades. People will bleed there, and you will bleed too.+Hot, red blood. You’ll catch that blood in your hands, your own blood and the blood of others.++And once the storm is over you won’t remember how you made it through, how you managed to survive. You won’t even be sure, in fact, whether the storm is really over.+But one thing is certain. When you come out of the storm you won’t be the same person who walked in. That’s what this storm’s all about.+"""++INSTRUCTION_PROMPT = f"""+You are a multilingual chatbot. Take the user's prompt: "{USER_PROMPT}" and respond naturally in {native_language}.+Ensure that the response is in Unicode characters appropriate for {native_language}.+"""++# Now we will use the OpenAI client to generate the response by passing in the system and instruction prompts.+response = client.chat.completions.create(+ model="grok-3-mini",+ messages=[{"role": "system", "content": SYSTEM_PROMPT}, {"role": "user", "content": INSTRUCTION_PROMPT}],+)++print(f"Original Response:\n{USER_PROMPT}")+generated_response = response.choices[0].message.content+print(f"Response in {native_language}:\n{generated_response}")++# Awesome! We can now transliterate from English to any language! And all of this can be tracked with AgentOps by going to the session url above.+agentops.end_trace(tracer, end_state="Success")++# We end the session with a success state and a success reason. This is useful if you want to track the success or failure of the chatbot. In that case you can set the end state to failure and provide a reason. By default the session will have an indeterminate end state.diff --git a/examples/xai_examples/grok_vision_examples.ipynb b/examples/xai/grok_vision_examples.ipynbsimilarity index 86%rename from examples/xai_examples/grok_vision_examples.ipynbrename to examples/xai/grok_vision_examples.ipynbindex 99dd5b1b..7ee60aa9 100755--- a/examples/xai_examples/grok_vision_examples.ipynb+++ b/examples/xai/grok_vision_examples.ipynb@@ -4,7 +4,7 @@"cell_type": "markdown","metadata": {},"source": [- "# XAI Vision Examples\n",+ "# XAI Vision Example\n","This notebook demonstrates how to use XAI with AgentOps via the OpenAI python client. \n","\n","We are going to use the latest Grok model from XAI to create a program that will capture the text in an image and explain it. We will use AgentOps to track the program's performance."@@ -36,7 +36,7 @@},{"cell_type": "code",- "execution_count": 1,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -55,13 +55,13 @@},{"cell_type": "code",- "execution_count": 2,+ "execution_count": null,"metadata": {},"outputs": [],"source": ["load_dotenv()\n",- "XAI_API_KEY = os.getenv(\"XAI_API_KEY\") or \"<your_xai_key>\"\n",- "AGENTOPS_API_KEY = os.getenv(\"AGENTOPS_API_KEY\") or \"<your_agentops_key>\""+ "os.environ[\"AGENTOPS_API_KEY\"] = os.getenv(\"AGENTOPS_API_KEY\", \"your_api_key_here\")\n",+ "os.environ[\"XAI_API_KEY\"] = os.getenv(\"XAI_API_KEY\", \"your_xai_api_key_here\")"]},{@@ -77,13 +77,8 @@"metadata": {},"outputs": [],"source": [- "agentops.init(\n",- " AGENTOPS_API_KEY,\n",- " default_tags=[\n",- " \"xai-example\",\n",- " \"grok-vision\",\n",- " ],\n",- ")"+ "agentops.init(auto_start_session=False)\n",+ "tracer = agentops.start_trace(trace_name=\"XAI Vision Example\", tags=[\"xai-example\", \"grok-vision\", \"agentops-example\"])"]},{@@ -97,13 +92,13 @@},{"cell_type": "code",- "execution_count": 4,+ "execution_count": null,"metadata": {},"outputs": [],"source": ["client = OpenAI(\n",- " api_key=XAI_API_KEY,\n"," base_url=\"https://api.x.ai/v1\",\n",+ " api_key=os.getenv(\"XAI_API_KEY\", \"your_xai_api_key_here\"),\n",")"]},@@ -116,7 +111,7 @@},{"cell_type": "code",- "execution_count": 8,+ "execution_count": null,"metadata": {},"outputs": [],"source": [@@ -153,7 +148,7 @@"outputs": [],"source": ["response = client.chat.completions.create(\n",- " model=\"grok-vision-beta\",\n",+ " model=\"grok-2-vision-1212\",\n"," messages=[{\"role\": \"system\", \"content\": SYSTEM_PROMPT}, {\"role\": \"user\", \"content\": USER_PROMPT}],\n"," max_tokens=4096,\n",")\n",@@ -174,7 +169,7 @@"metadata": {},"outputs": [],"source": [- "agentops.end_session(\"Success\")"+ "agentops.end_trace(tracer, end_state=\"Success\")"]},{@@ -187,7 +182,7 @@],"metadata": {"kernelspec": {- "display_name": "ops",+ "display_name": "agentops (3.11.11)","language": "python","name": "python3"},@@ -201,7 +196,7 @@"name": "python","nbconvert_exporter": "python","pygments_lexer": "ipython3",- "version": "3.10.15"+ "version": "3.11.11"}},"nbformat": 4,diff --git a/examples/xai/grok_vision_examples.py b/examples/xai/grok_vision_examples.pynew file mode 100644index 00000000..3f620d63--- /dev/null+++ b/examples/xai/grok_vision_examples.py@@ -0,0 +1,63 @@+# XAI Vision Example+#+# This notebook demonstrates how to use XAI with AgentOps via the OpenAI python client.+#+# We are going to use the latest Grok model from XAI to create a program that will capture the text in an image and explain it. We will use AgentOps to track the program's performance.+# First let's install the required packages+# %pip install -U openai+# %pip install -U agentops+# Then import them+from openai import OpenAI+import agentops+import os+from dotenv import load_dotenv++# Next, we'll grab our API keys. You can use dotenv like below or however else you like to load environment variables+load_dotenv()+os.environ["AGENTOPS_API_KEY"] = os.getenv("AGENTOPS_API_KEY", "your_api_key_here")+os.environ["XAI_API_KEY"] = os.getenv("XAI_API_KEY", "your_xai_api_key_here")++# Next we initialize the AgentOps client.+agentops.init(auto_start_session=False)+tracer = agentops.start_trace(trace_name="XAI Vision Example", tags=["xai-example", "grok-vision", "agentops-example"])++# And we are all set! Note the seesion url above. We will use it to track the program's performance.+#+# Let's initialize the OpenAI client with the XAI API key and base url.+client = OpenAI(+ base_url="https://api.x.ai/v1",+ api_key=os.getenv("XAI_API_KEY", "your_xai_api_key_here"),+)++# Next we will set the system and instruction prompts for the program.+SYSTEM_PROMPT = """You are an expert image analysis assistant. When presented with an image, carefully examine and describe its contents in detail.++For this task, your goal is to:+1. Identify all key elements, objects, people, or text in the image+2. Provide a comprehensive description of what you observe+3. Explain the context or historical significance if applicable+4. Describe the image in a clear, objective, and informative manner++Please be precise, thorough, and focus on providing meaningful insights about the visual content."""++USER_PROMPT = [+ {"type": "text", "text": "Analyze the image and provide a detailed description of what you see."},+ {+ "type": "image_url",+ "image_url": {"url": "https://upload.wikimedia.org/wikipedia/commons/f/ff/First_Computer_Bug%2C_1945.jpg"},+ },+]++# Now we will use the OpenAI client to process the image and generate a response.+response = client.chat.completions.create(+ model="grok-2-vision-1212",+ messages=[{"role": "system", "content": SYSTEM_PROMPT}, {"role": "user", "content": USER_PROMPT}],+ max_tokens=4096,+)++print(response.choices[0].message.content)++# Awesome! It returns a fascinating response explaining the image and also deciphering the text content. All of this can be tracked with AgentOps by going to the session url above.+agentops.end_trace(tracer, end_state="Success")++# We end the session with a success state and a success reason. This is useful if you want to track the success or failure of the chatbot. In that case you can set the end state to failure and provide a reason. By default the session will have an indeterminate end state.