Skip to content

Same agent Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.

1.6 KB
Raw Blame
---
title: 'Monitor GitHub Models using OpenTelemetry'
description: 'Monitor GitHub Models LLM apps built on azure-ai-inference with OpenTelemetry auto-instrumentation for AI observability, tokens, and cost.'
sidebarTitle: 'GitHub Models'
---

import IntegrationMethods from '/snippets/integration-methods.mdx';

OpenLIT uses OpenTelemetry Auto-Instrumentation to help you monitor LLM applications built using GitHub AI Models. This includes tracking performance, token usage, costs, and how users interact with the application.

Auto-instrumentation means you don't have to set up monitoring manually for different LLMs, frameworks, or databases. By simply adding OpenLIT in your application, all the necessary monitoring configurations are automatically set up.

The integration is compatible with  
- azure-ai-inference Python SDK client `>=1.0.0b4` 

## Get started 

<Steps>
  <Step title="Install OpenLIT">
    Open your command line or terminal and run:
    ```shell
    pip install openlit
    ```
  </Step>
  <IntegrationMethods />
</Steps>

---

<CardGroup cols={3}>
  <Card title="Quickstart: LLM Observability" href="/latest/sdk/quickstart-ai-observability" icon='bolt'>
    Production-ready AI monitoring setup in 2 simple steps with zero code changes
  </Card>
  <Card title="Configuration" href="/latest/sdk/configuration" icon='bolt'>
    Configure the OpenLIT SDK according to you requirements.
  </Card>
  <Card title="Destinations" href="/latest/sdk/destinations/overview" icon='link'>
    Send telemetry to Datadog, Grafana, New Relic, and other observability stacks
  </Card>
</CardGroup>