Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
Python agentagentopsagents-sdkaianthropicautogencost-estimationcrewaievalsevaluation-metricsgroqlangchainllmmistralollamaopenaiopenai-agents
Update README.md (#38)
Alex Reibman5ca4d0518b00
diff --git a/README.md b/README.mdindex 39b88180..7a0aa546 100644--- a/README.md+++ b/README.md@@ -39,12 +39,12 @@ Agent developers often work in the dark, with little to no visibility into agent| Performance testing | Environments | LAA (LLM augmented agents) specific tests | Reasoning and execution testing ||---|---|---|---|-|🔜 Event latency analysis | 🔜 Non-stationary environment testing | 🔜 LLM non-deterministic function detection | 🔜 Infinite loops and recursive thought detection |-|🔜 Regression testing | 🔜 Multi-modal environments | 🔜 Token limit overflow flags | 🔜 Faulty reasoning detection |+|✅ Event latency analysis | 🔜 Non-stationary environment testing | 🔜 LLM non-deterministic function detection | 🔜 Infinite loops and recursive thought detection |+|✅ Agent workflow execution pricing | 🔜 Multi-modal environments | 🔜 Token limit overflow flags | 🔜 Faulty reasoning detection ||🔜 Success validators (external) | 🔜 Execution containers | 🔜 Context limit overflow flags | 🔜 Generative code validators ||🔜 Agent controllers/skill tests | 🔜 Honeypot and prompt injection evaluation | 🔜 API bill tracking | 🔜 Error breakpoint analysis ||🔜 Information context constraint testing | 🔜 Anti-agent roadblocks (i.e. Captchas) | | |-|🔜 Agent workflow execution pricing | | | |+|🔜 Regression testing | | | |## Agent Arena 🥊(coming soon!)