Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
Python agentagentopsagents-sdkaianthropicautogencost-estimationcrewaievalsevaluation-metricsgroqlangchainllmmistralollamaopenaiopenai-agents
<svg width="35" height="33" viewBox="0 0 35 33" fill="none" xmlns="http://www.w3.org/2000/svg">
<path d="M10.9003 7.04449C10.8828 6.93639 10.8698 6.83276 10.8612 6.72425L10.8593 6.70545C10.8514 6.62965 10.8434 6.55375 10.8397 6.47757L0.749639 23.9503C0.00593054 25.2389 -0.193205 26.7442 0.191654 28.18C0.381849 28.9022 0.710625 29.5598 1.15197 30.1348C1.59332 30.7099 2.14684 31.1943 2.79098 31.5666C3.64726 32.064 4.60311 32.3192 5.56749 32.3192C6.05192 32.3192 6.54041 32.2542 7.02077 32.1245C8.46105 31.7397 9.66317 30.8184 10.4073 29.5252L16.8731 18.3237V18.3192L17.5002 17.2422L18.7502 15.0798L17.5002 12.9174L16.8776 11.8359L16.8731 11.8315L14.529 7.77032C14.3993 7.54965 14.2998 7.32044 14.2307 7.08716C13.9799 6.30851 14.032 5.47376 14.3388 4.74306L14.5595 4.3582C15.152 3.33326 16.1985 2.72773 17.3014 2.65864C17.362 2.65011 17.4181 2.65011 17.4786 2.65011C17.5461 2.65011 17.6135 2.65386 17.6809 2.65762L17.6993 2.65864C18.8023 2.72773 19.8487 3.33326 20.4413 4.3582L22.6643 8.20313L23.3129 9.32764L23.3429 9.38372L32.3776 25.0313C32.8315 25.8229 32.9526 26.7398 32.7194 27.6221C32.4816 28.5044 31.9192 29.2395 31.1279 29.6939C30.3367 30.1523 29.4194 30.2734 28.5371 30.0357C27.6548 29.802 26.9197 29.2355 26.4653 28.4442L19.3724 16.1612L18.1224 18.3192L24.5926 29.5252C25.3363 30.8184 26.5389 31.7397 27.9791 32.1245C28.4591 32.2542 28.9435 32.3192 29.4324 32.3192C30.3968 32.3192 31.3482 32.064 32.2089 31.5666C33.4976 30.8229 34.4234 29.6203 34.8083 28.18C35.1931 26.7442 34.9944 25.2389 34.2503 23.9503L22.5598 3.70512C22.0969 2.70172 21.3317 1.82796 20.3023 1.23544C19.7183 0.902595 19.1087 0.68192 18.4816 0.577883C18.378 0.560407 18.2739 0.543339 18.1703 0.530334C18.0577 0.517329 17.9456 0.508795 17.833 0.50026C17.6123 0.487256 17.3876 0.482785 17.1624 0.50026C17.0499 0.508795 16.9377 0.517736 16.8251 0.530334C16.7289 0.54241 16.6323 0.558339 16.536 0.574219L16.5138 0.577883C15.8912 0.681514 15.2768 0.902189 14.6972 1.23544C13.6593 1.8365 12.8806 2.72326 12.4181 3.73966C12.3312 3.92945 12.2576 4.12493 12.1922 4.32284C12.1801 4.35966 12.17 4.39679 12.1599 4.43394C12.1538 4.45663 12.1476 4.47942 12.141 4.50206C12.0995 4.6443 12.0613 4.78736 12.0309 4.93244C12.0187 4.99148 12.0087 5.05114 11.9988 5.11089L11.9947 5.13523C11.9703 5.27869 11.9508 5.42296 11.9378 5.56805C11.9321 5.63307 11.9268 5.69769 11.9232 5.76312C11.9146 5.91714 11.9134 6.07157 11.9179 6.22641C11.9184 6.24462 11.9178 6.26283 11.9171 6.28104C11.9163 6.30184 11.9156 6.32265 11.9167 6.34345C11.9167 6.37393 11.9167 6.40401 11.9211 6.43855C11.9216 6.44776 11.9225 6.45682 11.9234 6.46591C11.9241 6.47207 11.9247 6.47824 11.9252 6.48448C11.9268 6.50561 11.9288 6.52674 11.9309 6.54787C11.9324 6.56484 11.9338 6.5818 11.9352 6.59883C11.9374 6.62584 11.9397 6.65313 11.9427 6.68077L11.9687 6.8799C11.9772 6.95346 11.9902 7.03149 12.0032 7.10464C12.0382 7.28142 12.0825 7.45739 12.1337 7.63174C12.1345 7.63438 12.1351 7.63712 12.1357 7.63987C12.136 7.64142 12.1364 7.64298 12.1368 7.64452C12.1371 7.64569 12.1374 7.64685 12.1377 7.64799C12.1934 7.83494 12.2588 8.02025 12.3361 8.20313C12.4271 8.42381 12.5352 8.64001 12.6563 8.85174L12.9331 9.3317V9.33617L13.1232 9.66048L13.3655 10.0844H13.3699L13.3744 10.0974L15.6189 13.9813V13.9858L15.6279 13.9947V13.9992L16.2505 15.0806L15.6279 16.162L8.53501 28.445C8.07659 29.2363 7.34142 29.8032 6.46319 30.0365C6.16896 30.1145 5.86619 30.1576 5.57237 30.1576C4.97984 30.1576 4.39584 30.0019 3.87281 29.6947C3.08115 29.2407 2.51463 28.5052 2.28135 27.6229C2.04361 26.7406 2.16472 25.8238 2.62314 25.0321L11.6578 9.38453L11.6878 9.33698V9.33252C11.6228 9.21994 11.5667 9.11184 11.5107 8.99967C11.4959 8.9677 11.481 8.93603 11.4662 8.90451C11.4251 8.81666 11.3845 8.72995 11.3465 8.64082C11.3442 8.63851 11.343 8.6351 11.3419 8.63173C11.3409 8.6286 11.3399 8.6255 11.3379 8.62335V8.61482C11.3119 8.55427 11.2859 8.4937 11.2644 8.43316C11.2083 8.29051 11.1608 8.14786 11.1173 8.00481C11.0482 7.79308 10.9962 7.58094 10.9571 7.3692C10.9311 7.2611 10.9141 7.15747 10.9011 7.04896C10.9011 7.04896 10.9047 7.04896 10.9003 7.04449Z" fill="#191222"/>
<path d="M6.47578 25.495C6.64444 25.5946 6.83463 25.6377 7.01629 25.6377C7.38814 25.6377 7.75146 25.4475 7.95466 25.0971L14.3684 13.9862L13.1228 11.8238L6.08198 24.0157C5.78369 24.5347 5.96128 25.1963 6.47578 25.495Z" fill="#191222"/>
<path d="M28.3652 25.3593C28.195 25.4576 28.0089 25.5043 27.8257 25.5044C27.4519 25.5043 27.0887 25.3105 26.8883 24.9635L17.7037 9.0554C17.405 8.53846 17.5822 7.87725 18.0996 7.57855C18.6161 7.27904 19.2777 7.45704 19.5764 7.97438L28.761 23.8824C29.0597 24.3994 28.8825 25.0606 28.3652 25.3593Z" fill="#191222"/>
</svg>