Skip to content

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

3.6 KB
Raw Blame

Restart and verify

docker compose -f app/compose.yaml -f app/opentelemetry-collector/compose.yaml down --remove-orphans docker compose -f app/compose.yaml -f app/opentelemetry-collector/compose.yaml up -d docker compose -f app/compose.yaml -f app/opentelemetry-collector/compose.yaml logs --since=90s api docker compose -f app/compose.yaml -f app/opentelemetry-collector/compose.yaml logs --since=90s otelcollector docker compose -f app/compose.yaml -f app/opentelemetry-collector/compose.yaml logs --since=90s clickhouse

Open http://localhost:3000/signin

Local ClickHouse Setup

  1. Environment (.env) CLICKHOUSE_HOST=127.0.0.1 CLICKHOUSE_PORT=8123 CLICKHOUSE_USER=default CLICKHOUSE_PASSWORD=password CLICKHOUSE_DATABASE=otel_2 CLICKHOUSE_SECURE=false CLICKHOUSE_ENDPOINT=http://clickhouse:8123 CLICKHOUSE_USERNAME=default

  2. Start services (includes local ClickHouse and otelcollector) docker compose -f app/compose.yaml -f app/opentelemetry-collector/compose.yaml up -d

  3. Initialize ClickHouse schema curl -u default:password 'http://localhost:8123/?query=CREATE%20DATABASE%20IF%20NOT%20EXISTS%20otel_2' curl --data-binary @app/clickhouse/migrations/0000_init.sql -u default:password 'http://localhost:8123/?query='

  4. Run OpenAI example with local OTLP AGENTOPS_API_KEY=
    AGENTOPS_API_ENDPOINT=http://localhost:8000
    AGENTOPS_APP_URL=http://localhost:3000
    AGENTOPS_EXPORTER_ENDPOINT=http://localhost:4318/v1/traces
    OPENAI_API_KEY=
    python examples/openai/openai_example_sync.py

  5. Verify

Quick Start (Local ClickHouse)

Run these to get OSS working fast:

  1. Ensure ClickHouse is running (HTTP 8123, native 9000)
  2. Create DB and base schema curl -u default:password "http://localhost:8123/?query=CREATE%20DATABASE%20IF%20NOT%20EXISTS%20otel_2" curl -u default:password --data-binary @app/clickhouse/migrations/0000_init.sql "http://localhost:8123/?query="
  3. Enable costs + span counts curl -u default:password --data-binary @app/clickhouse/migrations/0001_udfs_and_pricing.sql "http://localhost:8123/?query=" curl -u default:password --data-binary @app/clickhouse/migrations/0002_span_counts_mv.sql "http://localhost:8123/?query="
  4. Seed pricing

Option A (basic): small starter set

curl -u default:password --data-binary @app/clickhouse/migrations/0003_seed_model_costs.sql "http://localhost:8123/?query="

Option B (full): full offline pricing parity

curl -u default:password --data-binary @app/clickhouse/migrations/0004_seed_model_costs_full.sql "http://localhost:8123/?query=" 5) Quick verify curl -s -u default:password "http://localhost:8123/?query=SHOW%20FUNCTIONS%20LIKE%20'calculate_%25'" curl -s -u default:password "http://localhost:8123/?query=EXISTS%20TABLE%20otel_2.trace_span_counts"

Advanced (Optional): Deeper Verification

Use these to confirm everything loaded: