Same agent Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.
TypeScript agent-harnessagent-harness-engineeringai-engineeringai-observabilityamd-gpuclaude-codeclickhousecodexcoding-agentcoding-agentscursorgenaigpu-monitoringllm-observabilityllmopsnvidia-smiobservabilityopen-sourceopenaiopentelemetry
Add Docs for `0.0.7` (#97)
Patcher99d5b9edf3eb32
diff --git a/README.md b/README.mdindex e34ad1cc..fe945f21 100644--- a/README.md+++ b/README.md@@ -12,14 +12,13 @@[](https://join.slack.com/t/doku-0tq5728/shared_invite/zt-2a9aql9xx-FN5EIZ2DtZ~XtJoYdxUDtA)[](https://twitter.com/doku_labs)+[](https://github.com/dokulabs/doku/tags)[](https://github.com/dokulabs/helm/tags)[](https://pypi.org/project/dokumetry/)[](https://www.npmjs.com/package/dokumetry)</div>--Doku is an **open-source LLMOps tool** engineered to enables developers with comprehensive capabilities to monitor, analyze, and optimize LLM applications. It provides valuable real-time data on **LLM usage, performance, and costs**. Through seamless integrations with leading LLM platforms, including OpenAI, Cohere, and Anthropic, Doku acts as a central command center for all your LLM needs. It effectively guides your efforts, ensuring that your LLM applications not only operate at peak efficiency but also scale successfully.## Why use Doku?@@ -40,14 +39,14 @@ For Python```python pythonimport dokumetry-dokumetry.init(llm=openai, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")+dokumetry.init(llm=openai, doku_url="YOUR_DOKU_INGESTER_URL", api_key="YOUR_DOKU_TOKEN")```For NodeJS```javascriptimport DokuMetry from 'dokumetry';-DokuMetry.init({llm: openai, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})+DokuMetry.init({llm: openai, dokuUrl: "YOUR_DOKU_INGESTER_URL", apiKey: "YOUR_DOKU_TOKEN"})```### Step 2: Data processed by Doku Ingester@@ -55,10 +54,12 @@ Once the `dokumetry` SDKs are configured in your LLM application, Monitoring datYou can choose to use a new ClickHouse database setup or connect to your existing one to work with Doku.-### Step 3: Visualize in your Observability Platform-With your LLM monitoring data processed, connect Doku to your preferred Observability Platform to begin visualizing and analyzing your data in-depth.-Stay tuned for the upcoming release of Doku UI, enhancing your data visualization capabilities further.+### Step 3: Visualize and analyze++With your LLM monitoring data processed and securely stored, you can now leverage the Doku UI for in-depth visualization and analysis. Doku UI allows you to explore LLM costs, token usage, performance metrics, and user interactions in an intuitive interface. This powerful tool enhances your ability to observe and optimize your LLM applications, ensuring you make data-driven decisions for improvement.++For those with a preferred observability platform, you can also integrate and visualize this data elsewhere with ease. This flexibility ensures optimal monitoring workflow integration, regardless of your platform choice. For more details on how to set up these connections, check out the [Connections](https://docs.dokulabs.com/latest/connections/intro) guide.## π Getting Started with Doku@@ -69,45 +70,65 @@ Jumpstart your journey with Doku by deploying it via our Helm chart, designed toTo install the Doku using Docker, follow these steps:1. Create `docker-compose.yml`-```yaml-version: '3.8'--services:- clickhouse:- image: clickhouse/clickhouse-server:24.1.5- container_name: clickhouse- environment:- CLICKHOUSE_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}- CLICKHOUSE_USER: ${DOKU_DB_USER:-default}- volumes:- - clickhouse-data:/var/lib/clickhouse- ports:- - "${DOKU_DB_PORT:-9000}:9000"- restart: always-- doku-ingester:- image: ghcr.io/patcher99/doku-ingester:0.0.8- container_name: doku-ingester- environment:- DOKU_DB_HOST: clickhouse- DOKU_DB_PORT: ${DOKU_DB_PORT:-9000}- DOKU_DB_NAME: ${DOKU_DB_NAME:-default}- DOKU_DB_USER: ${DOKU_DB_USER:-default}- DOKU_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}- ports:- - "9044:9044"- depends_on:- - clickhouse- restart: always--volumes:- clickhouse-data:-```+ ```yaml+ version: '3.8'++ services:+ clickhouse:+ image: clickhouse/clickhouse-server:24.1.5+ container_name: clickhouse+ environment:+ CLICKHOUSE_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ CLICKHOUSE_USER: ${DOKU_DB_USER:-default}+ volumes:+ - clickhouse-data:/var/lib/clickhouse+ ports:+ - "9000:9000"+ - "8123:8123"+ restart: always++ doku-ingester:+ image: ghcr.io/dokulabs/doku-ingester:0.0.7+ container_name: doku-ingester+ environment:+ DOKU_DB_HOST: clickhouse+ DOKU_DB_PORT: 9000+ DOKU_DB_NAME: ${DOKU_DB_NAME:-default}+ DOKU_DB_USER: ${DOKU_DB_USER:-default}+ DOKU_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ ports:+ - "9044:9044"+ depends_on:+ - clickhouse+ restart: always++ doku-client:+ image: ghcr.io/dokulabs/doku-client:0.0.7+ container_name: doku-client+ environment:+ INIT_DB_HOST: clickhouse+ INIT_DB_PORT: 8123+ INIT_DB_DATABASE: ${DOKU_DB_NAME:-default}+ INIT_DB_USERNAME: ${DOKU_DB_USER:-default}+ INIT_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ SQLITE_DATABASE_URL: file:/app/client/data/data.db+ ports:+ - "3000:3000"+ depends_on:+ - clickhouse+ volumes:+ - doku-client-data:/app/client/data+ restart: always++ volumes:+ clickhouse-data:+ doku-client-data:+ ```2. Start Docker Compose-```shell-docker-compose up -d-```+ ```shell+ docker-compose up -d+ ```#### Kubernetes@@ -115,44 +136,33 @@ To install the Doku Helm chart, follow these steps:1. Add the Doku Helm repository to your Helm setup:-```shell-helm repo add dokulabs https://dokulabs.github.io/helm/-```+ ```shell+ helm repo add dokulabs https://dokulabs.github.io/helm/+ ```2. Update your Helm repositories to fetch the latest chart information:-```shell-helm repo update-```+ ```shell+ helm repo update+ ```3. Install the Doku chart with the release name `doku`:-```shell-helm install doku dokulabs/doku-```+ ```shell+ helm install doku dokulabs/doku+ ```For a detailed list of configurable parameters for the Helm chart, refer to the `values.yaml` file in the [Helm chart](https://github.com/dokulabs/doku/tree/main/helm/doku).-### π Generating an API Key+### π Access Doku UI and Generate an API Key-With Doku running, the next step is to generate an API key for secure communication between your applications and Doku.--To generate your first API key, you can use the following command:--```shell shell-curl --request POST \- --url https://<YOUR_DOKU_INGESTER_URL>/api/keys \- --header 'Authorization: ""' \- --header 'Content-Type: application/json' \- --data '{- "name": "Patcher"- }'-```+With Doku running, the next step is to access the Doku UI and generate an API key for secure communication between your applications and Doku.-**Note**:-> **Save the API Key** β This key is essential for configuring the `dokumetry` SDK.--> For your first API call to generate the key, the Authorization header should be left blank. However, remember to include this API key in the Authorization header for all future API interactions and SDK configurations.+1. Open your browser and go to Doku UI at `127.0.0.1:3000/login`+2. Login using theb default credentials+ - Email as `[email protected]`+ - Password as `dokulabsuser`+3. Once you have logged into Doku UI, Go to [API Keys page](http://127.0.0.1:3000/api-keys) and Create an API Key. Copy the generated API Key.### β‘οΈ Instrument your Application@@ -241,6 +251,14 @@ main();Refer to the `dokumetry` [NodeJS SDK repository](https://github.com/dokulabs/dokumetry-node) for more advanced configurations and use cases.+### Visualize and Analyze++Once you have Doku Ingester and `DokuMetry` SDKs set up, you can instantly get insights into how your LLM applications. Just head over to Doku UI at `127.0.0.1:3000` on your browser to start exploring.++++With Doku, you get a simple, powerful view into important info like how much youβre spending on LLMs, which parts of your app are using them the most, and how well theyβre performing. Find out which LLM models are favorites among your applications, and dive deep into performance details to make smart decisions. This setup is perfect for optimizing your app performance and keeping an eye on costs.+## SecurityDoku uses key based authentication mechanism to ensure the security of your data and as Doku is self-hosted, The data stays within your environment.@@ -259,4 +277,4 @@ For support, issues, or feature requests, submit an issue through the [GitHub is## Visualize! Analyze! Optimize!-Join us on this voyage to reshape the future of AI insights. Share your thoughts, suggest features, and explore contributions. Engage with us on [GitHub](https://github.com/dokulabs/doku) and be part of Doku's community-led innovation.+Join us on this voyage to reshape the future of AI Observability. Share your thoughts, suggest features, and explore contributions. Engage with us on [GitHub](https://github.com/dokulabs/doku) and be part of Doku's community-led innovation.diff --git a/docker-compose.yml b/docker-compose.ymlindex 5e81ee64..86bf380f 100644--- a/docker-compose.yml+++ b/docker-compose.yml@@ -10,7 +10,7 @@ services:volumes:- clickhouse-data:/var/lib/clickhouseports:- - "9000:9000"+ - "9000:9000"- "8123:8123"restart: always@@ -28,6 +28,24 @@ services:depends_on:- clickhouserestart: always++ doku-client:+ image: ghcr.io/patcher99/doku-client:0.0.10+ container_name: doku-client+ environment:+ INIT_DB_HOST: clickhouse+ INIT_DB_PORT: 8123+ INIT_DB_DATABASE: ${DOKU_DB_NAME:-default}+ INIT_DB_USERNAME: ${DOKU_DB_USER:-default}+ INIT_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ SQLITE_DATABASE_URL: file:/app/client/data/data.db+ ports:+ - "3000:3000"+ depends_on:+ - clickhouse+ volumes:+ - doku-client-data:/app/client/data+ restart: alwaysdoku-client:image: doku-clientdiff --git a/docs/0.0.5/api-reference/endpoint/retention/update.mdx b/docs/0.0.5/api-reference/endpoint/retention/update.mdxdeleted file mode 100644index 6014ae56..00000000--- a/docs/0.0.5/api-reference/endpoint/retention/update.mdx+++ /dev/null@@ -1,4 +0,0 @@-----title: 'Update Retention'-openapi: 'POST /api/data/retention'----\ No newline at end of filediff --git a/docs/0.0.5/api-reference/introduction.mdx b/docs/0.0.5/api-reference/introduction.mdxdeleted file mode 100644index 04fad64d..00000000--- a/docs/0.0.5/api-reference/introduction.mdx+++ /dev/null@@ -1,25 +0,0 @@-----title: 'Introduction'-description: 'OpenAPI specification for API Endpoints in Doku'------<Card- title="API Keys Endpoints"- icon="key"- href="/0.0.5/api-reference/endpoint/api-keys/create"->- View the documentation for API Keys-</Card>--## Authentication--All API endpoints are authenticated using Authetication Header.--```json-Authorization: <api-key>-```--<Info>-For your initial API call, Authorization header can be set to "".-Store the provided API key securely; it will be required to pass the generated and a valid API Key in Authorization header for subsequent API calls.-</Info>\ No newline at end of filediff --git a/docs/0.0.5/configuration.mdx b/docs/0.0.5/configuration.mdxdeleted file mode 100644index 2f9124d9..00000000--- a/docs/0.0.5/configuration.mdx+++ /dev/null@@ -1,142 +0,0 @@-----title: 'Configuration'-description: 'Configuring Options for Doku'-icon: 'sliders'------This document outlines the various options available for configuring Doku using Envionment variables.--## Environment Varibales--<ResponseField name="DOKU_DB_HOST" required>- Host address for the TimescaleDB to be used by Doku-- **Example**:- ```yaml- export DOKU_DB_HOST=127.0.0.1- ```-</ResponseField>--<ResponseField name="DOKU_DB_PORT" required>- Port on which TimescaleDB is running-- **Example**:- ```yaml- export DOKU_DB_PORT=5432- ```-</ResponseField>--<ResponseField name="DOKU_DB_NAME" required>- Name of the database in TimescaleDB to be used by Doku-- **Example**:- ```yaml- export DOKU_DB_NAME=postgres- ```-</ResponseField>--<ResponseField name="DOKU_DB_USER" required>- Username to be used when connecting to TimescaleDB-- **Example**:- ```yaml- export DOKU_DB_USER=admin- ```-</ResponseField>--<ResponseField name="DOKU_DB_PASSWORD" required>- Password for the Database user to be used when connecting to TimescaleDB-- **Example**:- ```yaml- export DOKU_DB_PASSWORD=DOKU- ```-</ResponseField>--<ResponseField name="DOKU_DB_SLLMODE" required>- SSL Mode to be used when connecting to TimescaleDB-- **Example**:- ```yaml- export DOKU_DB_SLLMODE=require- ```-</ResponseField>--<ResponseField name="DOKU_INGESTER_PORT">- The `DOKU_INGESTER_PORT` specifies the network port that the Ingestion Server will listen to for incoming data. You can set this to any available port on your system.--**Default Value**:-```shell-9044-```--**Example**:-```shell-export DOKU_INGESTER_PORT=9044-```-</ResponseField>--<ResponseField name="DOKU_PRICING_JSON_URL">- Doku supports using a Json file retrived from a URL for the LLM Pricing data.--**Default Value**:-```shell-https://raw.githubusercontent.com/dokulabs/ingester/main/assets/pricing.json-```--**Example**:-```yaml-export DOKU_PRICING_JSON_URL=https://raw.githubusercontent.com/dokulabs/ingester/main/assets/pricing.json- ```-</ResponseField>--<ResponseField name="DOKU_DB_MAX_IDLE_CONNS">- Maximum number of concurrent idle database connections.--**Default Value**:-```shell-10-```--**Example**:-```shell-export DOKU_DB_MAX_IDLE_CONNS=10-```-</ResponseField>--<ResponseField name="DOKU_DB_MAX_OPEN_CONNS">- Maximum number of concurrent open database connections.--**Default Value**:-```shell-20-```--**Example**:-```shell-export DOKU_DB_MAX_OPEN_CONNS=20-```-</ResponseField>---## Example Env File--```.env.example .env-DOKU_DB_HOST="127.0.0.1"-DOKU_DB_PORT="5432"-DOKU_DB_NAME="postgres"-DOKU_DB_USER="admin"-DOKU_DB_PASSWORD="DOKU"-DOKU_DB_SSLMODE="require-```-------<CardGroup cols={2}>-<Card title="Integrations" href="0.0.5/integrations/introduction" icon='circle-nodes'>-Integrate your LLM Provider with Doku-</Card>-<Card title="Connections" href="/0.0.5/connections/intro" icon='link'>-Connect to your existing Observablity Platform-</Card>-</CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/connections/intro.mdx b/docs/0.0.5/connections/intro.mdxdeleted file mode 100644index 517038d2..00000000--- a/docs/0.0.5/connections/intro.mdx+++ /dev/null@@ -1,36 +0,0 @@-----title: 'Introduction'-description: 'Connect to your existing Observablity Platform'------Doku streamlines the observability experience by delivering processed LLM data right to the observability platform you are already familiar with. We recognize how crucial it is for developers to aggregate all application-related data, encompassing LLM usage metrics, into a single source of truth.--This integration allows you to visualize and assess your entire application landscape in one integrated Observability platform, thereby refining your monitoring approaches and sharpening your decision-making.--Below is a list of observability platforms that work seamlessly with Doku, allowing for integrated and expanded insights.--<CardGroup cols={2}>- <Card title="Grafana OSS" href="/0.0.5/connections/grafanaoss" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grafana</title><path d="M23.02 10.59a8.578 8.578 0 0 0-.862-3.034 8.911 8.911 0 0 0-1.789-2.445c.337-1.342-.413-2.505-.413-2.505-1.292-.08-2.113.4-2.416.62-.052-.02-.102-.044-.154-.064-.22-.089-.446-.172-.677-.247-.231-.073-.47-.14-.711-.197a9.867 9.867 0 0 0-.875-.161C14.557.753 12.94 0 12.94 0c-1.804 1.145-2.147 2.744-2.147 2.744l-.018.093c-.098.029-.2.057-.298.088-.138.042-.275.094-.413.143-.138.055-.275.107-.41.166a8.869 8.869 0 0 0-1.557.87l-.063-.029c-2.497-.955-4.716.195-4.716.195-.203 2.658.996 4.33 1.235 4.636a11.608 11.608 0 0 0-.607 2.635C1.636 12.677.953 15.014.953 15.014c1.926 2.214 4.171 2.351 4.171 2.351.003-.002.006-.002.006-.005.285.509.615.994.986 1.446.156.19.32.371.488.548-.704 2.009.099 3.68.099 3.68 2.144.08 3.553-.937 3.849-1.173a9.784 9.784 0 0 0 3.164.501h.08l.055-.003.107-.002.103-.005.003.002c1.01 1.44 2.788 1.646 2.788 1.646 1.264-1.332 1.337-2.653 1.337-2.94v-.058c0-.02-.003-.039-.003-.06.265-.187.52-.387.758-.6a7.875 7.875 0 0 0 1.415-1.7c1.43.083 2.437-.885 2.437-.885-.236-1.49-1.085-2.216-1.264-2.354l-.018-.013-.016-.013a.217.217 0 0 1-.031-.02c.008-.092.016-.18.02-.27.011-.162.016-.323.016-.48v-.253l-.005-.098-.008-.135a1.891 1.891 0 0 0-.01-.13c-.003-.042-.008-.083-.013-.125l-.016-.124-.018-.122a6.215 6.215 0 0 0-2.032-3.73 6.015 6.015 0 0 0-3.222-1.46 6.292 6.292 0 0 0-.85-.048l-.107.002h-.063l-.044.003-.104.008a4.777 4.777 0 0 0-3.335 1.695c-.332.4-.592.84-.768 1.297a4.594 4.594 0 0 0-.312 1.817l.003.091c.005.055.007.11.013.164a3.615 3.615 0 0 0 .698 1.82 3.53 3.53 0 0 0 1.827 1.282c.33.098.66.14.971.137.039 0 .078 0 .114-.002l.063-.003c.02 0 .041-.003.062-.003.034-.002.065-.007.099-.01.007 0 .018-.003.028-.003l.031-.005.06-.008a1.18 1.18 0 0 0 .112-.02c.036-.008.072-.013.109-.024a2.634 2.634 0 0 0 .914-.415c.028-.02.056-.041.085-.065a.248.248 0 0 0 .039-.35.244.244 0 0 0-.309-.06l-.078.042c-.09.044-.184.083-.283.116a2.476 2.476 0 0 1-.475.096c-.028.003-.054.006-.083.006l-.083.002c-.026 0-.054 0-.08-.002l-.102-.006h-.012l-.024.006c-.016-.003-.031-.003-.044-.006-.031-.002-.06-.007-.091-.01a2.59 2.59 0 0 1-.724-.213 2.557 2.557 0 0 1-.667-.438 2.52 2.52 0 0 1-.805-1.475 2.306 2.306 0 0 1-.029-.444l.006-.122v-.023l.002-.031c.003-.021.003-.04.005-.06a3.163 3.163 0 0 1 1.352-2.29 3.12 3.12 0 0 1 .937-.43 2.946 2.946 0 0 1 .776-.101h.06l.07.002.045.003h.026l.07.005a4.041 4.041 0 0 1 1.635.49 3.94 3.94 0 0 1 1.602 1.662 3.77 3.77 0 0 1 .397 1.414l.005.076.003.075c.002.026.002.05.002.075 0 .024.003.052 0 .07v.065l-.002.073-.008.174a6.195 6.195 0 0 1-.08.639 5.1 5.1 0 0 1-.267.927 5.31 5.31 0 0 1-.624 1.13 5.052 5.052 0 0 1-3.237 2.014 4.82 4.82 0 0 1-.649.066l-.039.003h-.287a6.607 6.607 0 0 1-1.716-.265 6.776 6.776 0 0 1-3.4-2.274 6.75 6.75 0 0 1-.746-1.15 6.616 6.616 0 0 1-.714-2.596l-.005-.083-.002-.02v-.056l-.003-.073v-.096l-.003-.104v-.07l.003-.163c.008-.22.026-.45.054-.678a8.707 8.707 0 0 1 .28-1.355c.128-.444.286-.872.473-1.277a7.04 7.04 0 0 1 1.456-2.1 5.925 5.925 0 0 1 .953-.763c.169-.111.343-.213.524-.306.089-.05.182-.091.273-.135.047-.02.093-.042.138-.062a7.177 7.177 0 0 1 .714-.267l.145-.045c.049-.015.098-.026.148-.041.098-.029.197-.052.296-.076.049-.013.1-.02.15-.033l.15-.032.151-.028.076-.013.075-.01.153-.024c.057-.01.114-.013.171-.023l.169-.021c.036-.003.073-.008.106-.01l.073-.008.036-.003.042-.002c.057-.003.114-.008.171-.01l.086-.006h.023l.037-.003.145-.007a7.999 7.999 0 0 1 1.708.125 7.917 7.917 0 0 1 2.048.68 8.253 8.253 0 0 1 1.672 1.09l.09.077.089.078c.06.052.114.107.171.159.057.052.112.106.166.16.052.055.107.107.159.164a8.671 8.671 0 0 1 1.41 1.978c.012.026.028.052.04.078l.04.078.075.156c.023.051.05.1.07.153l.065.15a8.848 8.848 0 0 1 .45 1.34.19.19 0 0 0 .201.142.186.186 0 0 0 .172-.184c.01-.246.002-.532-.024-.856z"/></svg>}>- </Card>- <Card title="Grafana Cloud" href="/0.0.5/connections/grafanacloud" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grafana</title><path d="M23.02 10.59a8.578 8.578 0 0 0-.862-3.034 8.911 8.911 0 0 0-1.789-2.445c.337-1.342-.413-2.505-.413-2.505-1.292-.08-2.113.4-2.416.62-.052-.02-.102-.044-.154-.064-.22-.089-.446-.172-.677-.247-.231-.073-.47-.14-.711-.197a9.867 9.867 0 0 0-.875-.161C14.557.753 12.94 0 12.94 0c-1.804 1.145-2.147 2.744-2.147 2.744l-.018.093c-.098.029-.2.057-.298.088-.138.042-.275.094-.413.143-.138.055-.275.107-.41.166a8.869 8.869 0 0 0-1.557.87l-.063-.029c-2.497-.955-4.716.195-4.716.195-.203 2.658.996 4.33 1.235 4.636a11.608 11.608 0 0 0-.607 2.635C1.636 12.677.953 15.014.953 15.014c1.926 2.214 4.171 2.351 4.171 2.351.003-.002.006-.002.006-.005.285.509.615.994.986 1.446.156.19.32.371.488.548-.704 2.009.099 3.68.099 3.68 2.144.08 3.553-.937 3.849-1.173a9.784 9.784 0 0 0 3.164.501h.08l.055-.003.107-.002.103-.005.003.002c1.01 1.44 2.788 1.646 2.788 1.646 1.264-1.332 1.337-2.653 1.337-2.94v-.058c0-.02-.003-.039-.003-.06.265-.187.52-.387.758-.6a7.875 7.875 0 0 0 1.415-1.7c1.43.083 2.437-.885 2.437-.885-.236-1.49-1.085-2.216-1.264-2.354l-.018-.013-.016-.013a.217.217 0 0 1-.031-.02c.008-.092.016-.18.02-.27.011-.162.016-.323.016-.48v-.253l-.005-.098-.008-.135a1.891 1.891 0 0 0-.01-.13c-.003-.042-.008-.083-.013-.125l-.016-.124-.018-.122a6.215 6.215 0 0 0-2.032-3.73 6.015 6.015 0 0 0-3.222-1.46 6.292 6.292 0 0 0-.85-.048l-.107.002h-.063l-.044.003-.104.008a4.777 4.777 0 0 0-3.335 1.695c-.332.4-.592.84-.768 1.297a4.594 4.594 0 0 0-.312 1.817l.003.091c.005.055.007.11.013.164a3.615 3.615 0 0 0 .698 1.82 3.53 3.53 0 0 0 1.827 1.282c.33.098.66.14.971.137.039 0 .078 0 .114-.002l.063-.003c.02 0 .041-.003.062-.003.034-.002.065-.007.099-.01.007 0 .018-.003.028-.003l.031-.005.06-.008a1.18 1.18 0 0 0 .112-.02c.036-.008.072-.013.109-.024a2.634 2.634 0 0 0 .914-.415c.028-.02.056-.041.085-.065a.248.248 0 0 0 .039-.35.244.244 0 0 0-.309-.06l-.078.042c-.09.044-.184.083-.283.116a2.476 2.476 0 0 1-.475.096c-.028.003-.054.006-.083.006l-.083.002c-.026 0-.054 0-.08-.002l-.102-.006h-.012l-.024.006c-.016-.003-.031-.003-.044-.006-.031-.002-.06-.007-.091-.01a2.59 2.59 0 0 1-.724-.213 2.557 2.557 0 0 1-.667-.438 2.52 2.52 0 0 1-.805-1.475 2.306 2.306 0 0 1-.029-.444l.006-.122v-.023l.002-.031c.003-.021.003-.04.005-.06a3.163 3.163 0 0 1 1.352-2.29 3.12 3.12 0 0 1 .937-.43 2.946 2.946 0 0 1 .776-.101h.06l.07.002.045.003h.026l.07.005a4.041 4.041 0 0 1 1.635.49 3.94 3.94 0 0 1 1.602 1.662 3.77 3.77 0 0 1 .397 1.414l.005.076.003.075c.002.026.002.05.002.075 0 .024.003.052 0 .07v.065l-.002.073-.008.174a6.195 6.195 0 0 1-.08.639 5.1 5.1 0 0 1-.267.927 5.31 5.31 0 0 1-.624 1.13 5.052 5.052 0 0 1-3.237 2.014 4.82 4.82 0 0 1-.649.066l-.039.003h-.287a6.607 6.607 0 0 1-1.716-.265 6.776 6.776 0 0 1-3.4-2.274 6.75 6.75 0 0 1-.746-1.15 6.616 6.616 0 0 1-.714-2.596l-.005-.083-.002-.02v-.056l-.003-.073v-.096l-.003-.104v-.07l.003-.163c.008-.22.026-.45.054-.678a8.707 8.707 0 0 1 .28-1.355c.128-.444.286-.872.473-1.277a7.04 7.04 0 0 1 1.456-2.1 5.925 5.925 0 0 1 .953-.763c.169-.111.343-.213.524-.306.089-.05.182-.091.273-.135.047-.02.093-.042.138-.062a7.177 7.177 0 0 1 .714-.267l.145-.045c.049-.015.098-.026.148-.041.098-.029.197-.052.296-.076.049-.013.1-.02.15-.033l.15-.032.151-.028.076-.013.075-.01.153-.024c.057-.01.114-.013.171-.023l.169-.021c.036-.003.073-.008.106-.01l.073-.008.036-.003.042-.002c.057-.003.114-.008.171-.01l.086-.006h.023l.037-.003.145-.007a7.999 7.999 0 0 1 1.708.125 7.917 7.917 0 0 1 2.048.68 8.253 8.253 0 0 1 1.672 1.09l.09.077.089.078c.06.052.114.107.171.159.057.052.112.106.166.16.052.055.107.107.159.164a8.671 8.671 0 0 1 1.41 1.978c.012.026.028.052.04.078l.04.078.075.156c.023.051.05.1.07.153l.065.15a8.848 8.848 0 0 1 .45 1.34.19.19 0 0 0 .201.142.186.186 0 0 0 .172-.184c.01-.246.002-.532-.024-.856z"/></svg>}>- </Card>- <Card title="DataDog" href="/0.0.5/connections/datadog" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Datadog</title><path d="M19.57 17.04l-1.997-1.316-1.665 2.782-1.937-.567-1.706 2.604.087.82 9.274-1.71-.538-5.794zm-8.649-2.498l1.488-.204c.241.108.409.15.697.223.45.117.97.23 1.741-.16.18-.088.553-.43.704-.625l6.096-1.106.622 7.527-10.444 1.882zm11.325-2.712l-.602.115L20.488 0 .789 2.285l2.427 19.693 2.306-.334c-.184-.263-.471-.581-.96-.989-.68-.564-.44-1.522-.039-2.127.53-1.022 3.26-2.322 3.106-3.956-.056-.594-.15-1.368-.702-1.898-.02.22.017.432.017.432s-.227-.289-.34-.683c-.112-.15-.2-.199-.319-.4-.085.233-.073.503-.073.503s-.186-.437-.216-.807c-.11.166-.137.48-.137.48s-.241-.69-.186-1.062c-.11-.323-.436-.965-.343-2.424.6.421 1.924.321 2.44-.439.171-.251.288-.939-.086-2.293-.24-.868-.835-2.16-1.066-2.651l-.028.02c.122.395.374 1.223.47 1.625.293 1.218.372 1.642.234 2.204-.116.488-.397.808-1.107 1.165-.71.358-1.653-.514-1.713-.562-.69-.55-1.224-1.447-1.284-1.883-.062-.477.275-.763.445-1.153-.243.07-.514.192-.514.192s.323-.334.722-.624c.165-.109.262-.178.436-.323a9.762 9.762 0 0 0-.456.003s.42-.227.855-.392c-.318-.014-.623-.003-.623-.003s.937-.419 1.678-.727c.509-.208 1.006-.147 1.286.257.367.53.752.817 1.569.996.501-.223.653-.337 1.284-.509.554-.61.99-.688.99-.688s-.216.198-.274.51c.314-.249.66-.455.66-.455s-.134.164-.259.426l.03.043c.366-.22.797-.394.797-.394s-.123.156-.268.358c.277-.002.838.012 1.056.037 1.285.028 1.552-1.374 2.045-1.55.618-.22.894-.353 1.947.68.903.888 1.609 2.477 1.259 2.833-.294.295-.874-.115-1.516-.916a3.466 3.466 0 0 1-.716-1.562 1.533 1.533 0 0 0-.497-.85s.23.51.23.96c0 .246.03 1.165.424 1.68-.039.076-.057.374-.1.43-.458-.554-1.443-.95-1.604-1.067.544.445 1.793 1.468 2.273 2.449.453.927.186 1.777.416 1.997.065.063.976 1.197 1.15 1.767.306.994.019 2.038-.381 2.685l-1.117.174c-.163-.045-.273-.068-.42-.153.08-.143.241-.5.243-.572l-.063-.111c-.348.492-.93.97-1.414 1.245-.633.359-1.363.304-1.838.156-1.348-.415-2.623-1.327-2.93-1.566 0 0-.01.191.048.234.34.383 1.119 1.077 1.872 1.56l-1.605.177.759 5.908c-.337.048-.39.071-.757.124-.325-1.147-.946-1.895-1.624-2.332-.599-.384-1.424-.47-2.214-.314l-.05.059a2.851 2.851 0 0 1 1.863.444c.654.413 1.181 1.481 1.375 2.124.248.822.42 1.7-.248 2.632-.476.662-1.864 1.028-2.986.237.3.481.705.876 1.25.95.809.11 1.577-.03 2.106-.574.452-.464.69-1.434.628-2.456l.714-.104.258 1.834 11.827-1.424zM15.05 6.848c-.034.075-.085.125-.007.37l.004.014.013.032.032.073c.14.287.295.558.552.696.067-.011.136-.019.207-.023.242-.01.395.028.492.08.009-.048.01-.119.005-.222-.018-.364.072-.982-.626-1.308-.264-.122-.634-.084-.757.068a.302.302 0 0 1 .058.013c.186.066.06.13.027.207m1.958 3.392c-.092-.05-.52-.03-.821.005-.574.068-1.193.267-1.328.372-.247.191-.135.523.047.66.511.382.96.638 1.432.575.29-.038.546-.497.728-.914.124-.288.124-.598-.058-.698m-5.077-2.942c.162-.154-.805-.355-1.556.156-.554.378-.571 1.187-.041 1.646.053.046.096.078.137.104a4.77 4.77 0 0 1 1.396-.412c.113-.125.243-.345.21-.745-.044-.542-.455-.456-.146-.749"/></svg>}>- </Card>- <Card title="New Relic" href="/0.0.5/connections/new-relic" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>New Relic</title><path d="M8.0015 14.3091v7.384L12.0008 24V12.0008L1.6078 5.9996v4.6167ZM12.0008 0 2.8232 5.2976 6.8209 7.606l5.1799-2.9893 6.3936 3.6913v7.384l-5.1783 2.9908v4.6167l9.176-5.2991V5.9996Z"/></svg>}>- </Card>- <Card title="SigNoz" href="/0.0.5/connections/signoz" icon={<svg role="img" viewBox="0 0 200 200" xmlns="http://www.w3.org/2000/svg"><title>SigNoz</title><path opacity="0.1" d="M100.279 199.833C44.5682 199.833 0 156.12 0 101.479C0 47.3844 44.5682 3.125 100.279 3.125H163.231C183.844 3.125 200 19.5174 200 39.1882V101.479C200 156.12 155.432 199.833 100.279 199.833Z"/><path d="M99.4919 58.9008C57.8802 58.9008 34.4413 93.3585 33.4637 94.8253C31.0537 98.4385 31.0537 103.111 33.4655 106.727C34.4413 108.191 57.8802 142.649 99.4919 142.649C141.103 142.649 164.543 108.191 165.52 106.724C167.93 103.111 167.93 98.4385 165.518 94.8227C164.542 93.3585 141.103 58.9008 99.4919 58.9008ZM39.2234 102.886C38.3677 101.604 38.3677 99.9463 39.2234 98.6633C40.0095 97.4834 56.6976 72.9705 86.5341 67.0904C73.0136 72.3095 63.393 85.4356 63.393 100.775C63.393 116.114 73.0136 129.24 86.5341 134.459C56.6976 128.579 40.0095 104.066 39.2234 102.886ZM82.8568 100.775C82.8568 102.686 81.3074 104.235 79.396 104.235C77.4845 104.235 75.9352 102.686 75.9352 100.775C75.9352 87.7858 86.5024 77.2185 99.4916 77.2185C101.403 77.2185 102.952 78.7676 102.952 80.6792C102.952 82.5908 101.403 84.1398 99.4916 84.1398C90.3189 84.1398 82.8568 91.6019 82.8568 100.775ZM99.4919 109.188C94.8525 109.188 91.0783 105.414 91.0783 100.775C91.0783 96.1356 94.8525 92.3612 99.4919 92.3612C104.132 92.3612 107.906 96.1354 107.906 100.775C107.906 105.414 104.132 109.188 99.4919 109.188ZM159.76 102.886C158.974 104.066 142.286 128.579 112.45 134.459C125.971 129.24 135.591 116.114 135.591 100.775C135.591 85.4358 125.971 72.3096 112.45 67.0905C142.286 72.971 158.974 97.4837 159.76 98.6634C160.616 99.9463 160.616 101.604 159.76 102.886Z"/></svg>}>- </Card>- <Card title="Dynatrace" href="/0.0.5/connections/dynatrace" icon={<svg viewBox="0 0 24 24" role="img" xmlns="http://www.w3.org/2000/svg"><title>Dynatrace icon</title><path d="M9.373 0c-.31.006-.93.09-1.521.654C6.98 1.478 2.628 5.61.88 7.27.09 8.024.16 8.865.16 8.934v.377c.067-.292.187-.499.427-.825.496-.616 1.3-.788 1.627-.822a64.233 64.233 0 0 1 .002 0 64.233 64.233 0 0 1 6.527-.549c4.335-.137 7.197.225 7.197.225l6.084-5.793s-3.188-.6-6.82-1.027A93.394 93.394 0 0 0 9.566.006c-.021 0-.09-.008-.193-.006zm13.56 2.508l-6.066 5.79s.222 2.88-.137 7.198c-.189 2.45-.584 4.866-.875 6.494-.052.326-.256 1.114-.925 1.594-.29.198-.491.295-.748.363 1.546-.51 1.091-7.047 1.091-7.047-4.335.137-7.214-.222-7.214-.222L1.975 22.47s3.222.634 6.855 1.045c2.056.24 4.833.429 5.227.463.023 0 .045-.007.068-.012-.013.003-.022.009-.035.012.138 0 .259.015.379.015.085 0 .925.105 1.713-.648 1.748-1.663 6.083-5.81 6.94-6.633.788-.754.72-1.594.72-1.68a81.84 81.84 0 0 0-.207-5.654c-.24-3.65-.701-6.871-.701-6.871zM3.856 8.305C2.125 8.307.348 8.513.16 9.326c.017 1.216.05 3.137.205 5.28.24 3.65.703 6.886.703 6.886l6.082-5.79c-.017.017-.239-2.88.121-7.198H7.27s-1.684-.202-3.415-.2z"/></svg>}>- </Card>-</CardGroup>-------<CardGroup cols={2}>-<Card title="Integrations" href="/0.0.5/integrations/introduction" icon='circle-nodes'>-Integrate your LLM Provider with Doku-</Card>-<Card title="API Refernce" href="/0.0.5/api-reference/introduction" icon='code'>-OpenAPI specification for API Endpoints in Doku-</Card>-</CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/integrations/anthropic/examples/completions.mdx b/docs/0.0.5/integrations/anthropic/examples/completions.mdxdeleted file mode 100644index 38a0a011..00000000--- a/docs/0.0.5/integrations/anthropic/examples/completions.mdx+++ /dev/null@@ -1,53 +0,0 @@-----title: 'Completions'-description: 'Monitor Anthropic Completions API Usage'------## Completions-<Tabs>- <Tab title="Python">- ```python- from anthropic import Anthropic, HUMAN_PROMPT, AI_PROMPT- import dokumetry-- anthropic = Anthropic(- # defaults to os.environ.get("ANTHROPIC_API_KEY")- api_key="my_api_key",- )-- # Pass the above `anthropic` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.- dokumetry.init(llm=anthropic, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")-- completion = anthropic.completions.create(- model="claude-2",- max_tokens_to_sample=300,- prompt=f"{HUMAN_PROMPT} Hello, Claude{AI_PROMPT}",- )- print(completion.completion)- ```- </Tab>- <Tab title="Javascript">- ```javascript- import Anthropic from '@anthropic-ai/sdk';- import DokuMetry from 'dokumetry';-- const anthropic = new Anthropic({- apiKey: 'my_api_key', // defaults to process.env["ANTHROPIC_API_KEY"]- });-- // Pass the above `anthropic` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.- DokuMetry.init({llm: anthropic, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})-- async function main() {- const completion = await anthropic.completions.create({- model: 'claude-2',- max_tokens_to_sample: 300,- prompt: `${Anthropic.HUMAN_PROMPT} Hello, Claude{Anthropic.AI_PROMPT}`,- });- console.log(completion.completion);- }- main().catch(console.error);- ```- </Tab>-</Tabs>-diff --git a/docs/0.0.5/integrations/anthropic/introduction.mdx b/docs/0.0.5/integrations/anthropic/introduction.mdxdeleted file mode 100644index 6987ffea..00000000--- a/docs/0.0.5/integrations/anthropic/introduction.mdx+++ /dev/null@@ -1,83 +0,0 @@-----title: 'Anthropic Integration'-sidebarTitle: 'Get Started'------DokuMetry SDKs (`dokumetry`) empowers you to effortlessly track and monitor Anthropic usage data and metrics from your Python/NodeJS code.--## Get Started--The integration is compatible with OpenAI SDK versions >=1.0.0.--<Tabs>- <Tab title="Python">- ```shell- pip install dokumetry- ```-- ```python- from anthropic import Anthropic, HUMAN_PROMPT, AI_PROMPT- import dokumetry-- anthropic = Anthropic(- api_key="anthropic_api_key",- )-- dokumetry.init(llm = anthropic, doku_url = "YOUR_DOKU_URL", api_key = "YOUR_DOKU_TOKEN")- ```- </Tab>- <Tab title="Javascript">- ```shell- npm install dokumetry- ```-- ```javascript- import Anthropic from '@anthropic-ai/sdk';- import DokuMetry from 'dokumetry';-- const anthropic = new Anthropic({- apiKey: 'anthropic_api_key',- });-- DokuMetry.init({llm: anthropic, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})- ```- </Tab>-</Tabs>--## Supported Endpoints--The following Anthropic Endpoints are supported for monitoring with DokuMetry--- [Completions](/0.0.5/integrations/anthropic/examples/completions)--## Parameters--| Parameter | Description | Required |-|-------------------|-----------------------------------------------------------|---------------|-| llm | Language Learning Model (LLM) Object to track | Yes |-| doku_url | URL of your Doku Instance | Yes |-| api_key | Your Doku API key | Yes |-| environment | Custom environment tag to include in your metrics | Optional |-| application_name | Custom application name tag for your metrics | Optional |-| skip_resp | Skip response from the Doku Ingester for faster execution | Optional |--## Advanced Usage-When using DokuMetry in Production environments, It is recommened to set `skip_resp = true` for faster porcessing.--To filter your LLM Usage according application or the environment, set the `application` and `environment` paramaters with the actual values.--## Requirements-Python >= 3.7 is supported.--If you are interested in other runtime environments, please open or upvote an issue on [GitHub](https://github.com/dokulabs/doku/issues).-------<CardGroup cols={2}>-<Card title="Connections" href="/0.0.5/connections/intro" icon='link'>-Connect to your existing Observablity Platform-</Card>-<Card title="API Refernce" href="/0.0.5/api-reference/introduction" icon='code'>-OpenAPI specification for API Endpoints in Doku-</Card>-</CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/integrations/cohere/introduction.mdx b/docs/0.0.5/integrations/cohere/introduction.mdxdeleted file mode 100644index 4d5e23e8..00000000--- a/docs/0.0.5/integrations/cohere/introduction.mdx+++ /dev/null@@ -1,83 +0,0 @@-----title: 'Cohere integration'-sidebarTitle: 'Get Started'------DokuMetry SDKs (`dokumetry`) empowers you to effortlessly track and monitor Cohere usage data and metrics from your Python/NodeJS code.--## Get Started--The integration is compatible with Cohere SDK versions >=4.0.0.--<Tabs>- <Tab title="Python">- ```shell- pip install dokumetry- ```-- ```python- import cohere- import dokumetry-- co = cohere.Client('YOUR_API_KEY')-- dokumetry.init(llm = co, doku_url = "YOUR_DOKU_URL", api_key = "YOUR_DOKU_TOKEN")- ```- </Tab>- <Tab title="Javascript">- ```shell- npm install dokumetry- ```-- ```javascript- import { CohereClient } from "cohere-ai";- import DokuMetry from 'dokumetry';-- const co = new CohereClient({- token: "<<apiKey>>",- });-- DokuMetry.init({llm: co, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})- ```- </Tab>-</Tabs>--## Supported Endpoints-The following Cohere Endpoints are supported for monitoring with DokuMetry--- [Chat](/0.0.5/integrations/cohere/examples/chat)-- [Generate](/0.0.5/integrations/cohere/examples/generate)-- [Summarize](/0.0.5/integrations/cohere/examples/summarize)-- [Embed](/0.0.5/integrations/cohere/examples/embed)--## Parameters--| Parameter | Description | Required |-|-------------------|-----------------------------------------------------------|---------------|-| llm | Language Learning Model (LLM) Object to track | Yes |-| doku_url | URL of your Doku Instance | Yes |-| api_key | Your Doku API key | Yes |-| environment | Custom environment tag to include in your metrics | Optional |-| application_name | Custom application name tag for your metrics | Optional |-| skip_resp | Skip response from the Doku Ingester for faster execution | Optional |--## Advanced Usage-When using DokuMetry in Production environments, It is recommened to set `skip_resp = true` for faster porcessing.--To filter your LLM Usage according application or the environment, set the `application` and `environment` paramaters with the actual values.--## Requirements-Python >= 3.7 is supported.--If you are interested in other runtime environments, please open or upvote an issue on [GitHub](https://github.com/dokulabs/doku/issues).-------<CardGroup cols={2}>-<Card title="Connections" href="/0.0.5/connections/intro" icon='link'>-Connect to your existing Observablity Platform-</Card>-<Card title="API Refernce" href="/0.0.5/api-reference/introduction" icon='code'>-OpenAPI specification for API Endpoints in Doku-</Card>-</CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/integrations/openai/introduction.mdx b/docs/0.0.5/integrations/openai/introduction.mdxdeleted file mode 100644index af42e6fc..00000000--- a/docs/0.0.5/integrations/openai/introduction.mdx+++ /dev/null@@ -1,84 +0,0 @@-----title: 'OpenAI Integration'-sidebarTitle: 'Get Started'------DokuMetry SDKs (`dokumetry`) empowers you to effortlessly track and monitor OpenAI usage data and metrics from your Python/NodeJS code.--## Get Started--The integration is compatible with OpenAI SDK versions >=1.0.0.--<Tabs>- <Tab title="Python">- ```shell- pip install dokumetry- ```-- ```python- from openai import OpenAI- import dokumetry-- client = OpenAI()-- dokumetry.init(llm = client, doku_url = "YOUR_DOKU_URL", api_key = "YOUR_DOKU_TOKEN")- ```- </Tab>- <Tab title="Javascript">- ```shell- npm install dokumetry- ```-- ```javascript- import OpenAI from "openai";- import DokuMetry from 'dokumetry';-- const client = new OpenAI();-- DokuMetry.init({llm: client, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})- ```- </Tab>-</Tabs>--## Supported Endpoints--The following OpenAI Endpoints are supported for monitoring with DokuMetry--- [Chat completions](/0.0.5/integrations/openai/examples/chat)-- [Image Create](/0.0.5/integrations/openai/examples/image#create-image) and [Image Variations](/0.0.5/integrations/openai/examples/image#create-image-variation)-- [Audio Speech Create](/0.0.5/integrations/openai/examples/audio)-- [Embeddings](/0.0.5/integrations/openai/examples/embeddings)-- [Fine Tunings](/0.0.5/integrations/openai/examples/fine-tuning)-- [Completions](/0.0.5/integrations/openai/examples/completions)--## Parameters--| Parameter | Description | Required |-|-------------------|-----------------------------------------------------------|---------------|-| llm | Language Learning Model (LLM) Object to track | Yes |-| doku_url | URL of your Doku Instance | Yes |-| api_key | Your Doku API key | Yes |-| environment | Custom environment tag to include in your metrics | Optional |-| application_name | Custom application name tag for your metrics | Optional |-| skip_resp | Skip response from the Doku Ingester for faster execution | Optional |--## Advanced Usage-When using DokuMetry in Production environments, It is recommened to set `skip_resp = true` for faster porcessing.--To filter your LLM Usage according application or the environment, set the `application` and `environment` paramaters with the actual values.--## Requirements-Python >= 3.7 is supported.--If you are interested in other runtime environments, please open or upvote an issue on [GitHub](https://github.com/dokulabs/doku/issues).-------<CardGroup cols={2}>-<Card title="Connections" href="/0.0.5/connections/intro" icon='link'>-Connect to your existing Observablity Platform-</Card>-<Card title="API Refernce" href="/0.0.5/api-reference/introduction" icon='code'>-OpenAPI specification for API Endpoints in Doku-</Card>-</CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/introduction.mdx b/docs/0.0.5/introduction.mdxdeleted file mode 100644index 08c09326..00000000--- a/docs/0.0.5/introduction.mdx+++ /dev/null@@ -1,120 +0,0 @@-----title: What is Doku?-description: 'Monitor and evalute your LLM Applications'------Doku is an open-source observability tool engineered for Large Language Models (LLMs). Designed for ease of integration into existing LLM applications, Doku offers unparalleled insights into usage, performance, and overheadβallowing you to analyze, optimize, and scale your AI applications and LLM usage effectively.--Whether you're working with OpenAI, Cohere, or Anthropic, It tracks all your LLM requests transparently and conveys the insights needed to make data-driven decisions. From monitoring usage and understanding latencies to managing costs and collaborating effortlessly, Doku grants you the lens to view your models in high definition.--## How it works--<Frame>- <img src="https://raw.githubusercontent.com/dokulabs/.github/main/profile/assets/banner.gif" />-</Frame>-### Application Integration with Two Lines of Code-Start by incorporating the DokuMetry SDK into your application. With SDKs tailored for both Python and NodeJS, Doku fits into your tech stack with minimal changes. Just a **two lines** of code is all it takes to begin:--For Python and NodeJS projects, just import the DokuMetry SDK and initialize it as follows:- <CodeGroup>- ```python python- import dokumetry- dokumetry.init(llm=openai, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")- ```-- ```javascript NodeJS- import DokuMetry from 'dokumetry';- DokuMetry.init({llm: openai, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})- ```- </CodeGroup>-Find detailed instructions at the [DokuMetry SDK Documentation](https://github.com/dokulabs/dokumetry-node).--### The Doku Ingester: Your Data Processing Workhorse--Upon SDK setup, data from your LLM operations is automatically collected. The DokuMetry SDKs transmit this usage data over HTTP in the background to the [Doku Ingester](https://github.com/dokulabs/doku/tree/main/src/ingester#readme).--The ingester is the core engine where the magic happens:-- **Data Collection**: Effortlessly captures live data from your LLM interactions without complicating your existing codebase.-- **Cost Analysis**: Enriches your data with cost considerations, providing a financial perspective to your analytics.-- **Secure Storage**: All processed information is securely stored in TimescaleDB, providing you with a scalable, time-series database that can handle large volumes of observability data.--You have the choice to set up a fresh TimescaleDB instance or connect Doku to your existing one. Whichever path you choose, your data resides within your control, reinforcing your data security and operational compliance.--## Features-Leveraging Doku, you can get:--- **In-depth LLM Monitoring**: Track every request to LLM platforms like OpenAI with precision, ensuring comprehensive visibility over your model's interactions.-- **Granular Usage Insights of your LLM Applications**: Assess your LLM's performance and costs with fine-grained control, breaking down metrics by environment (such as staging or production) or application, to optimize for efficiency and scalability.-- **Connect to Observability Platforms**: Export LLM Observablity data and insights from Doku to popular observability platforms such as Grafana Cloud or Datadog.-- **Team-centric Workflow**: Enhance team collaboration with seamless data sharing capabilities, creating an integrated environment for observability-driven teamwork.--## Integrations-<CardGroup cols={3}>- <Card- title="OpenAI"- href="/0.0.5/integrations/openai/introduction"- icon={- <svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg">- <title>OpenAI</title>- <path d="M22.2819 9.8211a5.9847 5.9847 0 0 0-.5157-4.9108 6.0462 6.0462 0 0 0-6.5098-2.9A6.0651 6.0651 0 0 0 4.9807 4.1818a5.9847 5.9847 0 0 0-3.9977 2.9 6.0462 6.0462 0 0 0 .7427 7.0966 5.98 5.98 0 0 0 .511 4.9107 6.051 6.051 0 0 0 6.5146 2.9001A5.9847 5.9847 0 0 0 13.2599 24a6.0557 6.0557 0 0 0 5.7718-4.2058 5.9894 5.9894 0 0 0 3.9977-2.9001 6.0557 6.0557 0 0 0-.7475-7.0729zm-9.022 12.6081a4.4755 4.4755 0 0 1-2.8764-1.0408l.1419-.0804 4.7783-2.7582a.7948.7948 0 0 0 .3927-.6813v-6.7369l2.02 1.1686a.071.071 0 0 1 .038.052v5.5826a4.504 4.504 0 0 1-4.4945 4.4944zm-9.6607-4.1254a4.4708 4.4708 0 0 1-.5346-3.0137l.142.0852 4.783 2.7582a.7712.7712 0 0 0 .7806 0l5.8428-3.3685v2.3324a.0804.0804 0 0 1-.0332.0615L9.74 19.9502a4.4992 4.4992 0 0 1-6.1408-1.6464zM2.3408 7.8956a4.485 4.485 0 0 1 2.3655-1.9728V11.6a.7664.7664 0 0 0 .3879.6765l5.8144 3.3543-2.0201 1.1685a.0757.0757 0 0 1-.071 0l-4.8303-2.7865A4.504 4.504 0 0 1 2.3408 7.872zm16.5963 3.8558L13.1038 8.364 15.1192 7.2a.0757.0757 0 0 1 .071 0l4.8303 2.7913a4.4944 4.4944 0 0 1-.6765 8.1042v-5.6772a.79.79 0 0 0-.407-.667zm2.0107-3.0231l-.142-.0852-4.7735-2.7818a.7759.7759 0 0 0-.7854 0L9.409 9.2297V6.8974a.0662.0662 0 0 1 .0284-.0615l4.8303-2.7866a4.4992 4.4992 0 0 1 6.6802 4.66zM8.3065 12.863l-2.02-1.1638a.0804.0804 0 0 1-.038-.0567V6.0742a4.4992 4.4992 0 0 1 7.3757-3.4537l-.142.0805L8.704 5.459a.7948.7948 0 0 0-.3927.6813zm1.0976-2.3654l2.602-1.4998 2.6069 1.4998v2.9994l-2.5974 1.4997-2.6067-1.4997Z" />- </svg>- }- iconType="duotone"- >- </Card>- <Card- title="Cohere"- href="/0.0.5/integrations/cohere/introduction"- icon={- <svg role="image" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 75 75">- <g>- <g>- <g>- <path d="M24.3,44.7c2,0,6-0.1,11.6-2.4c6.5-2.7,19.3-7.5,28.6-12.5c6.5-3.5,9.3-8.1,9.3-14.3C73.8,7,66.9,0,58.3,0- h-36C10,0,0,10,0,22.3S9.4,44.7,24.3,44.7z">- </path>- <path d="M30.4,60c0-6,3.6-11.5,9.2-13.8l11.3-4.7C62.4,36.8,75,45.2,75,57.6C75,67.2,67.2,75,57.6,75l-12.3,0- C37.1,75,30.4,68.3,30.4,60z">- </path>- <path d="M12.9,47.6L12.9,47.6C5.8,47.6,0,53.4,0,60.5v1.7C0,69.2,5.8,75,12.9,75h0c7.1,0,12.9-5.8,12.9-12.9v-1.7- C25.7,53.4,20,47.6,12.9,47.6z">- </path>- </g>- </g>- </g>- </svg>- }- iconType="duotone"- >- </Card>- <Card- title="Anthropic"- href="/0.0.5/integrations/anthropic/introduction"- icon={- <svg viewBox="0 0 256 176" xmlns="http://www.w3.org/2000/svg">- <path d="M147.486878,0 C147.486878,0 217.568251,175.780074 217.568251,175.780074 C217.568251,175.780074 256,175.780074 256,175.780074 C256,175.780074 185.918621,0 185.918621,0 C185.918621,0 147.486878,0 147.486878,0 C147.486878,0 147.486878,0 147.486878,0 Z"></path>- <path d="M66.1828124,106.221191 C66.1828124,106.221191 90.1624677,44.4471185 90.1624677,44.4471185 C90.1624677,44.4471185 114.142128,106.221191 114.142128,106.221191 C114.142128,106.221191 66.1828124,106.221191 66.1828124,106.221191 C66.1828124,106.221191 66.1828124,106.221191 66.1828124,106.221191 Z M70.0705318,0 C70.0705318,0 0,175.780074 0,175.780074 C0,175.780074 39.179211,175.780074 39.179211,175.780074 C39.179211,175.780074 53.5097704,138.86606 53.5097704,138.86606 C53.5097704,138.86606 126.817544,138.86606 126.817544,138.86606 C126.817544,138.86606 141.145724,175.780074 141.145724,175.780074 C141.145724,175.780074 180.324935,175.780074 180.324935,175.780074 C180.324935,175.780074 110.254409,0 110.254409,0 C110.254409,0 70.0705318,0 70.0705318,0 C70.0705318,0 70.0705318,0 70.0705318,0 Z"></path>- </svg>- }- iconType="duotone"- >- </Card>-</CardGroup>--## Getting Started-Select from the following guides to learn more about how to use Doku:--<CardGroup cols={2}>-<Card title="Quickstart" href="/0.0.5/quickstart" icon='bolt'>-Get Started with monitoring your LLM Applications in 2 simple steps-</Card>-<Card title="Integrations" href="/0.0.5/integrations/introduction" icon='circle-nodes'>-Integrate your LLM Provider with Doku-</Card>-<Card title="Installation" href="/0.0.5/installation" icon='circle-down'>-Deploy Doku in your preferred environment-</Card>-<Card title="Connections" href="/0.0.5/connections/intro" icon='link'>-Connect to your existing Observablity Platform-</Card>-</CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/quickstart.mdx b/docs/0.0.5/quickstart.mdxdeleted file mode 100644index 5d590ebf..00000000--- a/docs/0.0.5/quickstart.mdx+++ /dev/null@@ -1,156 +0,0 @@-----title: 'Quickstart'-description: 'Quickly start **monitoring** your **LLM Applications** in just **two lines** of code'-icon: 'bolt'------This guide will walk you through setting up your monitoring system with minimal effort. In just a few steps, you'll be able to track and analyze the performance and usage of your Large Language Model (LLM) applications.--## Prerequistes-- Ensure you have access to a **Kubernetes Cluster**. You can quickly spin up a Kubernetes Cluster using [Kind](https://github.com/kubernetes-sigs/kind?tab=readme-ov-file#installation-and-usage)--## Get Started--<Steps>- <Step title="Install Doku in a Kubernetes Cluster">- <Steps>- <Step title="Helm Repo Setup">- ```shell shell- helm repo add dokulabs https://dokulabs.github.io/helm/- helm repo update- ```- </Step>- <Step title="Installing the Helm Chart">- ```shell shell- helm install doku dokulabs/doku- ```- </Step>- </Steps>- </Step>- <Step title="Generate an API Key">- With Doku running, the next step is to [generate an API key](/0.0.5/api-reference/endpoint/api-keys/create) for secure communication between your applications and Doku.-- To generate your first API key, you can use the following command:-- ```shell shell- curl --request POST \- --url https://<your-doku-url>/api/keys \- --header 'Authorization: ""' \- --header 'Content-Type: application/json' \- --data '{- "name": "Admin"- }'- ```-- Make sure to store the returned API key securely, as it's necessary for authorizing future API calls with Doku.-- <Info>- During your initial request to generate an API key, you can leave the Authorization header empty (i.e., `""`). For subsequent requests, you will need to supply the generated API key.- </Info>-- </Step>- <Step title="Instrument your code">- Choose the appropriate SDK for your application's programming language and follow the steps to integrate monitoring with just a couple of lines of code.- <Tabs>- <Tab title="Python">- <Steps>- <Step title="Install the dokumetry Python SDK using pip">- ```shell- pip install dokumetry- ```- </Step>- <Step title="Add the following two lines to your application code:">- Add the snippet below to your Python application, replacing `YOUR_DOKU_URL` and `YOUR_DOKU_TOKEN` with corresponding values.-- ```python- import dokumetry-- dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")- ```-- Example Usage for monitoring `OpenAI` Usage:-- ```python- from openai import OpenAI- import dokumetry-- client = OpenAI(- api_key="YOUR_OPENAI_KEY"- )-- # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.- dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")-- chat_completion = client.chat.completions.create(- messages=[- {- "role": "user",- "content": "What is LLM Observability",- }- ],- model="gpt-3.5-turbo",- )- ```-- Refer to the `dokumetry` [Python SDK repository](https://github.com/dokulabs/dokumetry-python) for more advanced configurations and use cases.- </Step>- </Steps>- </Tab>- <Tab title="NodeJS">- <Steps>- <Step title="Install the dokumetry NodeJS SDK using npm">- ```shell- npm install dokumetry- ```- </Step>- <Step title="Add the following two lines to your application code">- Add the snippet below to your NodeJS application, replacing `YOUR_DOKU_URL` and `YOUR_DOKU_TOKEN` with corresponding values.- ```javascript- import DokuMetry from 'dokumetry';-- DokuMetry.init({llm: openai, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})- ```-- Example Usage for monitoring `OpenAI` Usage:-- ```javascript- import OpenAI from 'openai';- import DokuMetry from 'dokumetry';-- const openai = new OpenAI({- apiKey: 'My API Key', // defaults to process.env["OPENAI_API_KEY"]- });-- // Pass the above `openai` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.- DokuMetry.init({llm: openai, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})-- async function main() {- const chatCompletion = await openai.chat.completions.create({- messages: [{ role: 'user', content: 'What are the key to effective observability?' }],- model: 'gpt-3.5-turbo',- });- }-- main();- ```-- Refer to the `dokumetry` [NodeJS SDK repository](https://github.com/dokulabs/dokumetry-node) for more advanced configurations and use cases.- </Step>- </Steps>- </Tab>- </Tabs>- </Step>-</Steps>--You're all set! Following these steps should have you on your way to effectively monitoring your LLM applications. If you have any questions or need support, reach out to our [community](https://join.slack.com/t/doku-0tq5728/shared_invite/zt-2a9aql9xx-FN5EIZ2DtZ~XtJoYdxUDtA).-------<CardGroup cols={2}>-<Card title="Integrations" href="/0.0.5/integrations/introduction" icon='circle-nodes'>-Integrate your LLM Provider with Doku-</Card>-<Card title="Connections" href="/0.0.5/connections/intro" icon='link'>-Connect to your existing Observablity Platform-</Card>-</CardGroup>\ No newline at end of filediff --git a/docs/0.0.6/integrations/anthropic/examples/completions.mdx b/docs/0.0.6/integrations/anthropic/examples/completions.mdxdeleted file mode 100644index 38a0a011..00000000--- a/docs/0.0.6/integrations/anthropic/examples/completions.mdx+++ /dev/null@@ -1,53 +0,0 @@-----title: 'Completions'-description: 'Monitor Anthropic Completions API Usage'------## Completions-<Tabs>- <Tab title="Python">- ```python- from anthropic import Anthropic, HUMAN_PROMPT, AI_PROMPT- import dokumetry-- anthropic = Anthropic(- # defaults to os.environ.get("ANTHROPIC_API_KEY")- api_key="my_api_key",- )-- # Pass the above `anthropic` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.- dokumetry.init(llm=anthropic, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")-- completion = anthropic.completions.create(- model="claude-2",- max_tokens_to_sample=300,- prompt=f"{HUMAN_PROMPT} Hello, Claude{AI_PROMPT}",- )- print(completion.completion)- ```- </Tab>- <Tab title="Javascript">- ```javascript- import Anthropic from '@anthropic-ai/sdk';- import DokuMetry from 'dokumetry';-- const anthropic = new Anthropic({- apiKey: 'my_api_key', // defaults to process.env["ANTHROPIC_API_KEY"]- });-- // Pass the above `anthropic` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.- DokuMetry.init({llm: anthropic, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})-- async function main() {- const completion = await anthropic.completions.create({- model: 'claude-2',- max_tokens_to_sample: 300,- prompt: `${Anthropic.HUMAN_PROMPT} Hello, Claude{Anthropic.AI_PROMPT}`,- });- console.log(completion.completion);- }- main().catch(console.error);- ```- </Tab>-</Tabs>-diff --git a/docs/0.0.5/api-reference/endpoint/api-keys/create.mdx b/docs/0.0.7/api-reference/endpoint/api-keys/create.mdxsimilarity index 100%rename from docs/0.0.5/api-reference/endpoint/api-keys/create.mdxrename to docs/0.0.7/api-reference/endpoint/api-keys/create.mdxdiff --git a/docs/0.0.5/api-reference/endpoint/api-keys/delete.mdx b/docs/0.0.7/api-reference/endpoint/api-keys/delete.mdxsimilarity index 100%rename from docs/0.0.5/api-reference/endpoint/api-keys/delete.mdxrename to docs/0.0.7/api-reference/endpoint/api-keys/delete.mdxdiff --git a/docs/0.0.5/api-reference/endpoint/api-keys/get.mdx b/docs/0.0.7/api-reference/endpoint/api-keys/get.mdxsimilarity index 100%rename from docs/0.0.5/api-reference/endpoint/api-keys/get.mdxrename to docs/0.0.7/api-reference/endpoint/api-keys/get.mdxdiff --git a/docs/0.0.5/api-reference/endpoint/connections/create.mdx b/docs/0.0.7/api-reference/endpoint/connections/create.mdxsimilarity index 100%rename from docs/0.0.5/api-reference/endpoint/connections/create.mdxrename to docs/0.0.7/api-reference/endpoint/connections/create.mdxdiff --git a/docs/0.0.5/api-reference/endpoint/connections/delete.mdx b/docs/0.0.7/api-reference/endpoint/connections/delete.mdxsimilarity index 100%rename from docs/0.0.5/api-reference/endpoint/connections/delete.mdxrename to docs/0.0.7/api-reference/endpoint/connections/delete.mdxdiff --git a/docs/0.0.6/api-reference/introduction.mdx b/docs/0.0.7/api-reference/introduction.mdxsimilarity index 83%rename from docs/0.0.6/api-reference/introduction.mdxrename to docs/0.0.7/api-reference/introduction.mdxindex 787f9d04..c17cda0f 100644--- a/docs/0.0.6/api-reference/introduction.mdx+++ b/docs/0.0.7/api-reference/introduction.mdx@@ -6,13 +6,13 @@ description: 'OpenAPI specification for API Endpoints in Doku'<Cardtitle="API Keys"icon="key"- href="/0.0.6/api-reference/endpoint/api-keys/create"+ href="/0.0.7/api-reference/endpoint/api-keys/create"></Card><Cardtitle="Connections API"icon="link"- href="/0.0.6/api-reference/endpoint/Connections/create"+ href="/0.0.7/api-reference/endpoint/connections/create"></Card></CardGroup>diff --git a/docs/0.0.6/api-reference/openiapi.yml b/docs/0.0.7/api-reference/openiapi.ymlsimilarity index 100%rename from docs/0.0.6/api-reference/openiapi.ymlrename to docs/0.0.7/api-reference/openiapi.ymldiff --git a/docs/0.0.6/configuration.mdx b/docs/0.0.7/configuration.mdxsimilarity index 59%rename from docs/0.0.6/configuration.mdxrename to docs/0.0.7/configuration.mdxindex c262ffe5..e79e8f82 100644--- a/docs/0.0.6/configuration.mdx+++ b/docs/0.0.7/configuration.mdx@@ -6,7 +6,78 @@ icon: 'sliders'This guide covers all the available environment variables to fine-tune Doku according to your needs.-## Environment Varibales+## Doku Client++### Environment Varibales++<ResponseField name="INIT_DB_HOST" required>+ Sets the password for the user authenticating with ClickHouse.++ **Example**:+ ```yaml+ export INIT_DB_HOST=127.0.0.1+ ```+</ResponseField>++<ResponseField name="INIT_DB_PORT" required>+ Sets the password for the user authenticating with ClickHouse.++ **Example**:+ ```yaml+ export INIT_DB_PORT=8123+ ```+</ResponseField>++<ResponseField name="INIT_DB_DATABASE" required>+ Name of the database in Clickhouse to be used by Doku++ **Example**:+ ```yaml+ export INIT_DB_DATABASE=default+ ```+</ResponseField>++<ResponseField name="INIT_DB_USERNAME" required>+ Sets the username for authenticating with ClickHouse.++ **Example**:+ ```yaml+ export INIT_DB_USERNAME=default+ ```+</ResponseField>++<ResponseField name="INIT_DB_PASSWORD" required>+ Sets the password for authenticating with ClickHouse.++ **Example**:+ ```yaml+ export INIT_DB_PASSWORD=default+ ```+</ResponseField>++<ResponseField name="SQLITE_DATABASE_URL" required>+ Specifies the location where SQLITE data is stored.++ **Example**:+ ```yaml+ export SQLITE_DATABASE_URL=file:/app/client/data/data.db+ ```+</ResponseField>++### Sample Environment File (.env)++```.env.example .env+INIT_DB_HOST: 127.0.0.1+INIT_DB_PORT: 8123+INIT_DB_DATABASE: default+INIT_DB_USERNAME: default+INIT_DB_PASSWORD: DOKU+SQLITE_DATABASE_URL: file:/app/client/data/data.db+```++## Doku Ingester++### Environment Varibales<ResponseField name="DOKU_DB_HOST" required>Specifies the host address of the ClickHouse server for Doku to connect to.@@ -110,7 +181,7 @@ export DOKU_DB_RETENTION_PERIOD="6 MONTH"</ResponseField>-## Sample Environment File (.env)+### Sample Environment File (.env)```.env.example .envDOKU_DB_HOST="127.0.0.1"@@ -123,10 +194,10 @@ DOKU_DB_PASSWORD="DOKU"---<CardGroup cols={2}>-<Card title="Integrations" href="/0.0.6/integrations/introduction" icon='circle-nodes'>+<Card title="Integrations" href="/0.0.7/integrations/introduction" icon='circle-nodes'>Integrate your LLM Provider with Doku</Card>-<Card title="Connections" href="/0.0.6/connections/intro" icon='link'>+<Card title="Connections" href="/0.0.7/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.6/connections/datadog.mdx b/docs/0.0.7/connections/datadog.mdxsimilarity index 99%rename from docs/0.0.6/connections/datadog.mdxrename to docs/0.0.7/connections/datadog.mdxindex 44d11791..42337c86 100644--- a/docs/0.0.6/connections/datadog.mdx+++ b/docs/0.0.7/connections/datadog.mdx@@ -10,11 +10,11 @@ description: 'Connect Doku to DataDog'Doku can automatically send LLM usage data from Doku to DataDog using the [Submit Metrics API](https://docs.datadoghq.com/api/latest/metrics/#submit-metrics) and [Send Logs API](https://docs.datadoghq.com/api/latest/logs/#send-logs)-Make the following curl request to Doku to add a connection for DataDog. See more on the [Connections API](/0.0.6/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for DataDog. See more on the [Connections API](/0.0.7/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.5/connections/dynatrace.mdx b/docs/0.0.7/connections/dynatrace.mdxsimilarity index 99%rename from docs/0.0.5/connections/dynatrace.mdxrename to docs/0.0.7/connections/dynatrace.mdxindex 3f449e74..9414d82f 100644--- a/docs/0.0.5/connections/dynatrace.mdx+++ b/docs/0.0.7/connections/dynatrace.mdx@@ -11,11 +11,11 @@ description: 'Connect Doku to Dynatrace'Doku can automatically send LLM usage data from Doku to Dynatrace using the [Ingest Metrics API](https://docs.dynatrace.com/docs/dynatrace-api/environment-api/metric-v2/post-ingest-metrics) and [Ingest Logs API](https://docs.dynatrace.com/docs/dynatrace-api/environment-api/log-monitoring-v2/post-ingest-logs)-Make the following curl request to Doku to add a connection for Dynatrace. See more on the [Connections API](/0.0.5/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for Dynatrace. See more on the [Connections API](/0.0.7/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.5/connections/grafanacloud.mdx b/docs/0.0.7/connections/grafanacloud.mdxsimilarity index 99%rename from docs/0.0.5/connections/grafanacloud.mdxrename to docs/0.0.7/connections/grafanacloud.mdxindex 2b9b3c30..c1282956 100644--- a/docs/0.0.5/connections/grafanacloud.mdx+++ b/docs/0.0.7/connections/grafanacloud.mdx@@ -10,11 +10,11 @@ description: 'Connect Doku to Grafana Cloud'Doku can automatically send LLM usage data from Doku to Grafana Cloud using the [Grafana Cloud Influx Telegraf](https://grafana.com/docs/grafana-cloud/send-data/metrics/metrics-influxdb/push-from-telegraf/) and [Loki Push HTTP API](https://grafana.com/docs/loki/latest/reference/api/#push-log-entries-to-loki)-Make the following curl request to Doku to add a connection for Grafana Cloud. See more on the [Connections API](/0.0.5/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for Grafana Cloud. See more on the [Connections API](/0.0.7/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.5/connections/grafanaoss.mdx b/docs/0.0.7/connections/grafanaoss.mdxsimilarity index 100%rename from docs/0.0.5/connections/grafanaoss.mdxrename to docs/0.0.7/connections/grafanaoss.mdxdiff --git a/docs/0.0.6/connections/intro.mdx b/docs/0.0.7/connections/intro.mdxsimilarity index 96%rename from docs/0.0.6/connections/intro.mdxrename to docs/0.0.7/connections/intro.mdxindex fbefe1ac..e4dd0384 100644--- a/docs/0.0.6/connections/intro.mdx+++ b/docs/0.0.7/connections/intro.mdx@@ -7,27 +7,27 @@ Doku enhances observability by seamlessly exporting processed LLM data to your oBelow is a list of observability platforms that work seamlessly with Doku:<CardGroup cols={2}>- <Card title="Grafana OSS" href="/0.0.6/connections/grafanaoss" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grafana</title><path d="M23.02 10.59a8.578 8.578 0 0 0-.862-3.034 8.911 8.911 0 0 0-1.789-2.445c.337-1.342-.413-2.505-.413-2.505-1.292-.08-2.113.4-2.416.62-.052-.02-.102-.044-.154-.064-.22-.089-.446-.172-.677-.247-.231-.073-.47-.14-.711-.197a9.867 9.867 0 0 0-.875-.161C14.557.753 12.94 0 12.94 0c-1.804 1.145-2.147 2.744-2.147 2.744l-.018.093c-.098.029-.2.057-.298.088-.138.042-.275.094-.413.143-.138.055-.275.107-.41.166a8.869 8.869 0 0 0-1.557.87l-.063-.029c-2.497-.955-4.716.195-4.716.195-.203 2.658.996 4.33 1.235 4.636a11.608 11.608 0 0 0-.607 2.635C1.636 12.677.953 15.014.953 15.014c1.926 2.214 4.171 2.351 4.171 2.351.003-.002.006-.002.006-.005.285.509.615.994.986 1.446.156.19.32.371.488.548-.704 2.009.099 3.68.099 3.68 2.144.08 3.553-.937 3.849-1.173a9.784 9.784 0 0 0 3.164.501h.08l.055-.003.107-.002.103-.005.003.002c1.01 1.44 2.788 1.646 2.788 1.646 1.264-1.332 1.337-2.653 1.337-2.94v-.058c0-.02-.003-.039-.003-.06.265-.187.52-.387.758-.6a7.875 7.875 0 0 0 1.415-1.7c1.43.083 2.437-.885 2.437-.885-.236-1.49-1.085-2.216-1.264-2.354l-.018-.013-.016-.013a.217.217 0 0 1-.031-.02c.008-.092.016-.18.02-.27.011-.162.016-.323.016-.48v-.253l-.005-.098-.008-.135a1.891 1.891 0 0 0-.01-.13c-.003-.042-.008-.083-.013-.125l-.016-.124-.018-.122a6.215 6.215 0 0 0-2.032-3.73 6.015 6.015 0 0 0-3.222-1.46 6.292 6.292 0 0 0-.85-.048l-.107.002h-.063l-.044.003-.104.008a4.777 4.777 0 0 0-3.335 1.695c-.332.4-.592.84-.768 1.297a4.594 4.594 0 0 0-.312 1.817l.003.091c.005.055.007.11.013.164a3.615 3.615 0 0 0 .698 1.82 3.53 3.53 0 0 0 1.827 1.282c.33.098.66.14.971.137.039 0 .078 0 .114-.002l.063-.003c.02 0 .041-.003.062-.003.034-.002.065-.007.099-.01.007 0 .018-.003.028-.003l.031-.005.06-.008a1.18 1.18 0 0 0 .112-.02c.036-.008.072-.013.109-.024a2.634 2.634 0 0 0 .914-.415c.028-.02.056-.041.085-.065a.248.248 0 0 0 .039-.35.244.244 0 0 0-.309-.06l-.078.042c-.09.044-.184.083-.283.116a2.476 2.476 0 0 1-.475.096c-.028.003-.054.006-.083.006l-.083.002c-.026 0-.054 0-.08-.002l-.102-.006h-.012l-.024.006c-.016-.003-.031-.003-.044-.006-.031-.002-.06-.007-.091-.01a2.59 2.59 0 0 1-.724-.213 2.557 2.557 0 0 1-.667-.438 2.52 2.52 0 0 1-.805-1.475 2.306 2.306 0 0 1-.029-.444l.006-.122v-.023l.002-.031c.003-.021.003-.04.005-.06a3.163 3.163 0 0 1 1.352-2.29 3.12 3.12 0 0 1 .937-.43 2.946 2.946 0 0 1 .776-.101h.06l.07.002.045.003h.026l.07.005a4.041 4.041 0 0 1 1.635.49 3.94 3.94 0 0 1 1.602 1.662 3.77 3.77 0 0 1 .397 1.414l.005.076.003.075c.002.026.002.05.002.075 0 .024.003.052 0 .07v.065l-.002.073-.008.174a6.195 6.195 0 0 1-.08.639 5.1 5.1 0 0 1-.267.927 5.31 5.31 0 0 1-.624 1.13 5.052 5.052 0 0 1-3.237 2.014 4.82 4.82 0 0 1-.649.066l-.039.003h-.287a6.607 6.607 0 0 1-1.716-.265 6.776 6.776 0 0 1-3.4-2.274 6.75 6.75 0 0 1-.746-1.15 6.616 6.616 0 0 1-.714-2.596l-.005-.083-.002-.02v-.056l-.003-.073v-.096l-.003-.104v-.07l.003-.163c.008-.22.026-.45.054-.678a8.707 8.707 0 0 1 .28-1.355c.128-.444.286-.872.473-1.277a7.04 7.04 0 0 1 1.456-2.1 5.925 5.925 0 0 1 .953-.763c.169-.111.343-.213.524-.306.089-.05.182-.091.273-.135.047-.02.093-.042.138-.062a7.177 7.177 0 0 1 .714-.267l.145-.045c.049-.015.098-.026.148-.041.098-.029.197-.052.296-.076.049-.013.1-.02.15-.033l.15-.032.151-.028.076-.013.075-.01.153-.024c.057-.01.114-.013.171-.023l.169-.021c.036-.003.073-.008.106-.01l.073-.008.036-.003.042-.002c.057-.003.114-.008.171-.01l.086-.006h.023l.037-.003.145-.007a7.999 7.999 0 0 1 1.708.125 7.917 7.917 0 0 1 2.048.68 8.253 8.253 0 0 1 1.672 1.09l.09.077.089.078c.06.052.114.107.171.159.057.052.112.106.166.16.052.055.107.107.159.164a8.671 8.671 0 0 1 1.41 1.978c.012.026.028.052.04.078l.04.078.075.156c.023.051.05.1.07.153l.065.15a8.848 8.848 0 0 1 .45 1.34.19.19 0 0 0 .201.142.186.186 0 0 0 .172-.184c.01-.246.002-.532-.024-.856z"/></svg>}>+ <Card title="Grafana OSS" href="/0.0.7/connections/grafanaoss" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grafana</title><path d="M23.02 10.59a8.578 8.578 0 0 0-.862-3.034 8.911 8.911 0 0 0-1.789-2.445c.337-1.342-.413-2.505-.413-2.505-1.292-.08-2.113.4-2.416.62-.052-.02-.102-.044-.154-.064-.22-.089-.446-.172-.677-.247-.231-.073-.47-.14-.711-.197a9.867 9.867 0 0 0-.875-.161C14.557.753 12.94 0 12.94 0c-1.804 1.145-2.147 2.744-2.147 2.744l-.018.093c-.098.029-.2.057-.298.088-.138.042-.275.094-.413.143-.138.055-.275.107-.41.166a8.869 8.869 0 0 0-1.557.87l-.063-.029c-2.497-.955-4.716.195-4.716.195-.203 2.658.996 4.33 1.235 4.636a11.608 11.608 0 0 0-.607 2.635C1.636 12.677.953 15.014.953 15.014c1.926 2.214 4.171 2.351 4.171 2.351.003-.002.006-.002.006-.005.285.509.615.994.986 1.446.156.19.32.371.488.548-.704 2.009.099 3.68.099 3.68 2.144.08 3.553-.937 3.849-1.173a9.784 9.784 0 0 0 3.164.501h.08l.055-.003.107-.002.103-.005.003.002c1.01 1.44 2.788 1.646 2.788 1.646 1.264-1.332 1.337-2.653 1.337-2.94v-.058c0-.02-.003-.039-.003-.06.265-.187.52-.387.758-.6a7.875 7.875 0 0 0 1.415-1.7c1.43.083 2.437-.885 2.437-.885-.236-1.49-1.085-2.216-1.264-2.354l-.018-.013-.016-.013a.217.217 0 0 1-.031-.02c.008-.092.016-.18.02-.27.011-.162.016-.323.016-.48v-.253l-.005-.098-.008-.135a1.891 1.891 0 0 0-.01-.13c-.003-.042-.008-.083-.013-.125l-.016-.124-.018-.122a6.215 6.215 0 0 0-2.032-3.73 6.015 6.015 0 0 0-3.222-1.46 6.292 6.292 0 0 0-.85-.048l-.107.002h-.063l-.044.003-.104.008a4.777 4.777 0 0 0-3.335 1.695c-.332.4-.592.84-.768 1.297a4.594 4.594 0 0 0-.312 1.817l.003.091c.005.055.007.11.013.164a3.615 3.615 0 0 0 .698 1.82 3.53 3.53 0 0 0 1.827 1.282c.33.098.66.14.971.137.039 0 .078 0 .114-.002l.063-.003c.02 0 .041-.003.062-.003.034-.002.065-.007.099-.01.007 0 .018-.003.028-.003l.031-.005.06-.008a1.18 1.18 0 0 0 .112-.02c.036-.008.072-.013.109-.024a2.634 2.634 0 0 0 .914-.415c.028-.02.056-.041.085-.065a.248.248 0 0 0 .039-.35.244.244 0 0 0-.309-.06l-.078.042c-.09.044-.184.083-.283.116a2.476 2.476 0 0 1-.475.096c-.028.003-.054.006-.083.006l-.083.002c-.026 0-.054 0-.08-.002l-.102-.006h-.012l-.024.006c-.016-.003-.031-.003-.044-.006-.031-.002-.06-.007-.091-.01a2.59 2.59 0 0 1-.724-.213 2.557 2.557 0 0 1-.667-.438 2.52 2.52 0 0 1-.805-1.475 2.306 2.306 0 0 1-.029-.444l.006-.122v-.023l.002-.031c.003-.021.003-.04.005-.06a3.163 3.163 0 0 1 1.352-2.29 3.12 3.12 0 0 1 .937-.43 2.946 2.946 0 0 1 .776-.101h.06l.07.002.045.003h.026l.07.005a4.041 4.041 0 0 1 1.635.49 3.94 3.94 0 0 1 1.602 1.662 3.77 3.77 0 0 1 .397 1.414l.005.076.003.075c.002.026.002.05.002.075 0 .024.003.052 0 .07v.065l-.002.073-.008.174a6.195 6.195 0 0 1-.08.639 5.1 5.1 0 0 1-.267.927 5.31 5.31 0 0 1-.624 1.13 5.052 5.052 0 0 1-3.237 2.014 4.82 4.82 0 0 1-.649.066l-.039.003h-.287a6.607 6.607 0 0 1-1.716-.265 6.776 6.776 0 0 1-3.4-2.274 6.75 6.75 0 0 1-.746-1.15 6.616 6.616 0 0 1-.714-2.596l-.005-.083-.002-.02v-.056l-.003-.073v-.096l-.003-.104v-.07l.003-.163c.008-.22.026-.45.054-.678a8.707 8.707 0 0 1 .28-1.355c.128-.444.286-.872.473-1.277a7.04 7.04 0 0 1 1.456-2.1 5.925 5.925 0 0 1 .953-.763c.169-.111.343-.213.524-.306.089-.05.182-.091.273-.135.047-.02.093-.042.138-.062a7.177 7.177 0 0 1 .714-.267l.145-.045c.049-.015.098-.026.148-.041.098-.029.197-.052.296-.076.049-.013.1-.02.15-.033l.15-.032.151-.028.076-.013.075-.01.153-.024c.057-.01.114-.013.171-.023l.169-.021c.036-.003.073-.008.106-.01l.073-.008.036-.003.042-.002c.057-.003.114-.008.171-.01l.086-.006h.023l.037-.003.145-.007a7.999 7.999 0 0 1 1.708.125 7.917 7.917 0 0 1 2.048.68 8.253 8.253 0 0 1 1.672 1.09l.09.077.089.078c.06.052.114.107.171.159.057.052.112.106.166.16.052.055.107.107.159.164a8.671 8.671 0 0 1 1.41 1.978c.012.026.028.052.04.078l.04.078.075.156c.023.051.05.1.07.153l.065.15a8.848 8.848 0 0 1 .45 1.34.19.19 0 0 0 .201.142.186.186 0 0 0 .172-.184c.01-.246.002-.532-.024-.856z"/></svg>}></Card>- <Card title="Grafana Cloud" href="/0.0.6/connections/grafanacloud" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grafana</title><path d="M23.02 10.59a8.578 8.578 0 0 0-.862-3.034 8.911 8.911 0 0 0-1.789-2.445c.337-1.342-.413-2.505-.413-2.505-1.292-.08-2.113.4-2.416.62-.052-.02-.102-.044-.154-.064-.22-.089-.446-.172-.677-.247-.231-.073-.47-.14-.711-.197a9.867 9.867 0 0 0-.875-.161C14.557.753 12.94 0 12.94 0c-1.804 1.145-2.147 2.744-2.147 2.744l-.018.093c-.098.029-.2.057-.298.088-.138.042-.275.094-.413.143-.138.055-.275.107-.41.166a8.869 8.869 0 0 0-1.557.87l-.063-.029c-2.497-.955-4.716.195-4.716.195-.203 2.658.996 4.33 1.235 4.636a11.608 11.608 0 0 0-.607 2.635C1.636 12.677.953 15.014.953 15.014c1.926 2.214 4.171 2.351 4.171 2.351.003-.002.006-.002.006-.005.285.509.615.994.986 1.446.156.19.32.371.488.548-.704 2.009.099 3.68.099 3.68 2.144.08 3.553-.937 3.849-1.173a9.784 9.784 0 0 0 3.164.501h.08l.055-.003.107-.002.103-.005.003.002c1.01 1.44 2.788 1.646 2.788 1.646 1.264-1.332 1.337-2.653 1.337-2.94v-.058c0-.02-.003-.039-.003-.06.265-.187.52-.387.758-.6a7.875 7.875 0 0 0 1.415-1.7c1.43.083 2.437-.885 2.437-.885-.236-1.49-1.085-2.216-1.264-2.354l-.018-.013-.016-.013a.217.217 0 0 1-.031-.02c.008-.092.016-.18.02-.27.011-.162.016-.323.016-.48v-.253l-.005-.098-.008-.135a1.891 1.891 0 0 0-.01-.13c-.003-.042-.008-.083-.013-.125l-.016-.124-.018-.122a6.215 6.215 0 0 0-2.032-3.73 6.015 6.015 0 0 0-3.222-1.46 6.292 6.292 0 0 0-.85-.048l-.107.002h-.063l-.044.003-.104.008a4.777 4.777 0 0 0-3.335 1.695c-.332.4-.592.84-.768 1.297a4.594 4.594 0 0 0-.312 1.817l.003.091c.005.055.007.11.013.164a3.615 3.615 0 0 0 .698 1.82 3.53 3.53 0 0 0 1.827 1.282c.33.098.66.14.971.137.039 0 .078 0 .114-.002l.063-.003c.02 0 .041-.003.062-.003.034-.002.065-.007.099-.01.007 0 .018-.003.028-.003l.031-.005.06-.008a1.18 1.18 0 0 0 .112-.02c.036-.008.072-.013.109-.024a2.634 2.634 0 0 0 .914-.415c.028-.02.056-.041.085-.065a.248.248 0 0 0 .039-.35.244.244 0 0 0-.309-.06l-.078.042c-.09.044-.184.083-.283.116a2.476 2.476 0 0 1-.475.096c-.028.003-.054.006-.083.006l-.083.002c-.026 0-.054 0-.08-.002l-.102-.006h-.012l-.024.006c-.016-.003-.031-.003-.044-.006-.031-.002-.06-.007-.091-.01a2.59 2.59 0 0 1-.724-.213 2.557 2.557 0 0 1-.667-.438 2.52 2.52 0 0 1-.805-1.475 2.306 2.306 0 0 1-.029-.444l.006-.122v-.023l.002-.031c.003-.021.003-.04.005-.06a3.163 3.163 0 0 1 1.352-2.29 3.12 3.12 0 0 1 .937-.43 2.946 2.946 0 0 1 .776-.101h.06l.07.002.045.003h.026l.07.005a4.041 4.041 0 0 1 1.635.49 3.94 3.94 0 0 1 1.602 1.662 3.77 3.77 0 0 1 .397 1.414l.005.076.003.075c.002.026.002.05.002.075 0 .024.003.052 0 .07v.065l-.002.073-.008.174a6.195 6.195 0 0 1-.08.639 5.1 5.1 0 0 1-.267.927 5.31 5.31 0 0 1-.624 1.13 5.052 5.052 0 0 1-3.237 2.014 4.82 4.82 0 0 1-.649.066l-.039.003h-.287a6.607 6.607 0 0 1-1.716-.265 6.776 6.776 0 0 1-3.4-2.274 6.75 6.75 0 0 1-.746-1.15 6.616 6.616 0 0 1-.714-2.596l-.005-.083-.002-.02v-.056l-.003-.073v-.096l-.003-.104v-.07l.003-.163c.008-.22.026-.45.054-.678a8.707 8.707 0 0 1 .28-1.355c.128-.444.286-.872.473-1.277a7.04 7.04 0 0 1 1.456-2.1 5.925 5.925 0 0 1 .953-.763c.169-.111.343-.213.524-.306.089-.05.182-.091.273-.135.047-.02.093-.042.138-.062a7.177 7.177 0 0 1 .714-.267l.145-.045c.049-.015.098-.026.148-.041.098-.029.197-.052.296-.076.049-.013.1-.02.15-.033l.15-.032.151-.028.076-.013.075-.01.153-.024c.057-.01.114-.013.171-.023l.169-.021c.036-.003.073-.008.106-.01l.073-.008.036-.003.042-.002c.057-.003.114-.008.171-.01l.086-.006h.023l.037-.003.145-.007a7.999 7.999 0 0 1 1.708.125 7.917 7.917 0 0 1 2.048.68 8.253 8.253 0 0 1 1.672 1.09l.09.077.089.078c.06.052.114.107.171.159.057.052.112.106.166.16.052.055.107.107.159.164a8.671 8.671 0 0 1 1.41 1.978c.012.026.028.052.04.078l.04.078.075.156c.023.051.05.1.07.153l.065.15a8.848 8.848 0 0 1 .45 1.34.19.19 0 0 0 .201.142.186.186 0 0 0 .172-.184c.01-.246.002-.532-.024-.856z"/></svg>}>+ <Card title="Grafana Cloud" href="/0.0.7/connections/grafanacloud" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grafana</title><path d="M23.02 10.59a8.578 8.578 0 0 0-.862-3.034 8.911 8.911 0 0 0-1.789-2.445c.337-1.342-.413-2.505-.413-2.505-1.292-.08-2.113.4-2.416.62-.052-.02-.102-.044-.154-.064-.22-.089-.446-.172-.677-.247-.231-.073-.47-.14-.711-.197a9.867 9.867 0 0 0-.875-.161C14.557.753 12.94 0 12.94 0c-1.804 1.145-2.147 2.744-2.147 2.744l-.018.093c-.098.029-.2.057-.298.088-.138.042-.275.094-.413.143-.138.055-.275.107-.41.166a8.869 8.869 0 0 0-1.557.87l-.063-.029c-2.497-.955-4.716.195-4.716.195-.203 2.658.996 4.33 1.235 4.636a11.608 11.608 0 0 0-.607 2.635C1.636 12.677.953 15.014.953 15.014c1.926 2.214 4.171 2.351 4.171 2.351.003-.002.006-.002.006-.005.285.509.615.994.986 1.446.156.19.32.371.488.548-.704 2.009.099 3.68.099 3.68 2.144.08 3.553-.937 3.849-1.173a9.784 9.784 0 0 0 3.164.501h.08l.055-.003.107-.002.103-.005.003.002c1.01 1.44 2.788 1.646 2.788 1.646 1.264-1.332 1.337-2.653 1.337-2.94v-.058c0-.02-.003-.039-.003-.06.265-.187.52-.387.758-.6a7.875 7.875 0 0 0 1.415-1.7c1.43.083 2.437-.885 2.437-.885-.236-1.49-1.085-2.216-1.264-2.354l-.018-.013-.016-.013a.217.217 0 0 1-.031-.02c.008-.092.016-.18.02-.27.011-.162.016-.323.016-.48v-.253l-.005-.098-.008-.135a1.891 1.891 0 0 0-.01-.13c-.003-.042-.008-.083-.013-.125l-.016-.124-.018-.122a6.215 6.215 0 0 0-2.032-3.73 6.015 6.015 0 0 0-3.222-1.46 6.292 6.292 0 0 0-.85-.048l-.107.002h-.063l-.044.003-.104.008a4.777 4.777 0 0 0-3.335 1.695c-.332.4-.592.84-.768 1.297a4.594 4.594 0 0 0-.312 1.817l.003.091c.005.055.007.11.013.164a3.615 3.615 0 0 0 .698 1.82 3.53 3.53 0 0 0 1.827 1.282c.33.098.66.14.971.137.039 0 .078 0 .114-.002l.063-.003c.02 0 .041-.003.062-.003.034-.002.065-.007.099-.01.007 0 .018-.003.028-.003l.031-.005.06-.008a1.18 1.18 0 0 0 .112-.02c.036-.008.072-.013.109-.024a2.634 2.634 0 0 0 .914-.415c.028-.02.056-.041.085-.065a.248.248 0 0 0 .039-.35.244.244 0 0 0-.309-.06l-.078.042c-.09.044-.184.083-.283.116a2.476 2.476 0 0 1-.475.096c-.028.003-.054.006-.083.006l-.083.002c-.026 0-.054 0-.08-.002l-.102-.006h-.012l-.024.006c-.016-.003-.031-.003-.044-.006-.031-.002-.06-.007-.091-.01a2.59 2.59 0 0 1-.724-.213 2.557 2.557 0 0 1-.667-.438 2.52 2.52 0 0 1-.805-1.475 2.306 2.306 0 0 1-.029-.444l.006-.122v-.023l.002-.031c.003-.021.003-.04.005-.06a3.163 3.163 0 0 1 1.352-2.29 3.12 3.12 0 0 1 .937-.43 2.946 2.946 0 0 1 .776-.101h.06l.07.002.045.003h.026l.07.005a4.041 4.041 0 0 1 1.635.49 3.94 3.94 0 0 1 1.602 1.662 3.77 3.77 0 0 1 .397 1.414l.005.076.003.075c.002.026.002.05.002.075 0 .024.003.052 0 .07v.065l-.002.073-.008.174a6.195 6.195 0 0 1-.08.639 5.1 5.1 0 0 1-.267.927 5.31 5.31 0 0 1-.624 1.13 5.052 5.052 0 0 1-3.237 2.014 4.82 4.82 0 0 1-.649.066l-.039.003h-.287a6.607 6.607 0 0 1-1.716-.265 6.776 6.776 0 0 1-3.4-2.274 6.75 6.75 0 0 1-.746-1.15 6.616 6.616 0 0 1-.714-2.596l-.005-.083-.002-.02v-.056l-.003-.073v-.096l-.003-.104v-.07l.003-.163c.008-.22.026-.45.054-.678a8.707 8.707 0 0 1 .28-1.355c.128-.444.286-.872.473-1.277a7.04 7.04 0 0 1 1.456-2.1 5.925 5.925 0 0 1 .953-.763c.169-.111.343-.213.524-.306.089-.05.182-.091.273-.135.047-.02.093-.042.138-.062a7.177 7.177 0 0 1 .714-.267l.145-.045c.049-.015.098-.026.148-.041.098-.029.197-.052.296-.076.049-.013.1-.02.15-.033l.15-.032.151-.028.076-.013.075-.01.153-.024c.057-.01.114-.013.171-.023l.169-.021c.036-.003.073-.008.106-.01l.073-.008.036-.003.042-.002c.057-.003.114-.008.171-.01l.086-.006h.023l.037-.003.145-.007a7.999 7.999 0 0 1 1.708.125 7.917 7.917 0 0 1 2.048.68 8.253 8.253 0 0 1 1.672 1.09l.09.077.089.078c.06.052.114.107.171.159.057.052.112.106.166.16.052.055.107.107.159.164a8.671 8.671 0 0 1 1.41 1.978c.012.026.028.052.04.078l.04.078.075.156c.023.051.05.1.07.153l.065.15a8.848 8.848 0 0 1 .45 1.34.19.19 0 0 0 .201.142.186.186 0 0 0 .172-.184c.01-.246.002-.532-.024-.856z"/></svg>}></Card>- <Card title="DataDog" href="/0.0.6/connections/datadog" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Datadog</title><path d="M19.57 17.04l-1.997-1.316-1.665 2.782-1.937-.567-1.706 2.604.087.82 9.274-1.71-.538-5.794zm-8.649-2.498l1.488-.204c.241.108.409.15.697.223.45.117.97.23 1.741-.16.18-.088.553-.43.704-.625l6.096-1.106.622 7.527-10.444 1.882zm11.325-2.712l-.602.115L20.488 0 .789 2.285l2.427 19.693 2.306-.334c-.184-.263-.471-.581-.96-.989-.68-.564-.44-1.522-.039-2.127.53-1.022 3.26-2.322 3.106-3.956-.056-.594-.15-1.368-.702-1.898-.02.22.017.432.017.432s-.227-.289-.34-.683c-.112-.15-.2-.199-.319-.4-.085.233-.073.503-.073.503s-.186-.437-.216-.807c-.11.166-.137.48-.137.48s-.241-.69-.186-1.062c-.11-.323-.436-.965-.343-2.424.6.421 1.924.321 2.44-.439.171-.251.288-.939-.086-2.293-.24-.868-.835-2.16-1.066-2.651l-.028.02c.122.395.374 1.223.47 1.625.293 1.218.372 1.642.234 2.204-.116.488-.397.808-1.107 1.165-.71.358-1.653-.514-1.713-.562-.69-.55-1.224-1.447-1.284-1.883-.062-.477.275-.763.445-1.153-.243.07-.514.192-.514.192s.323-.334.722-.624c.165-.109.262-.178.436-.323a9.762 9.762 0 0 0-.456.003s.42-.227.855-.392c-.318-.014-.623-.003-.623-.003s.937-.419 1.678-.727c.509-.208 1.006-.147 1.286.257.367.53.752.817 1.569.996.501-.223.653-.337 1.284-.509.554-.61.99-.688.99-.688s-.216.198-.274.51c.314-.249.66-.455.66-.455s-.134.164-.259.426l.03.043c.366-.22.797-.394.797-.394s-.123.156-.268.358c.277-.002.838.012 1.056.037 1.285.028 1.552-1.374 2.045-1.55.618-.22.894-.353 1.947.68.903.888 1.609 2.477 1.259 2.833-.294.295-.874-.115-1.516-.916a3.466 3.466 0 0 1-.716-1.562 1.533 1.533 0 0 0-.497-.85s.23.51.23.96c0 .246.03 1.165.424 1.68-.039.076-.057.374-.1.43-.458-.554-1.443-.95-1.604-1.067.544.445 1.793 1.468 2.273 2.449.453.927.186 1.777.416 1.997.065.063.976 1.197 1.15 1.767.306.994.019 2.038-.381 2.685l-1.117.174c-.163-.045-.273-.068-.42-.153.08-.143.241-.5.243-.572l-.063-.111c-.348.492-.93.97-1.414 1.245-.633.359-1.363.304-1.838.156-1.348-.415-2.623-1.327-2.93-1.566 0 0-.01.191.048.234.34.383 1.119 1.077 1.872 1.56l-1.605.177.759 5.908c-.337.048-.39.071-.757.124-.325-1.147-.946-1.895-1.624-2.332-.599-.384-1.424-.47-2.214-.314l-.05.059a2.851 2.851 0 0 1 1.863.444c.654.413 1.181 1.481 1.375 2.124.248.822.42 1.7-.248 2.632-.476.662-1.864 1.028-2.986.237.3.481.705.876 1.25.95.809.11 1.577-.03 2.106-.574.452-.464.69-1.434.628-2.456l.714-.104.258 1.834 11.827-1.424zM15.05 6.848c-.034.075-.085.125-.007.37l.004.014.013.032.032.073c.14.287.295.558.552.696.067-.011.136-.019.207-.023.242-.01.395.028.492.08.009-.048.01-.119.005-.222-.018-.364.072-.982-.626-1.308-.264-.122-.634-.084-.757.068a.302.302 0 0 1 .058.013c.186.066.06.13.027.207m1.958 3.392c-.092-.05-.52-.03-.821.005-.574.068-1.193.267-1.328.372-.247.191-.135.523.047.66.511.382.96.638 1.432.575.29-.038.546-.497.728-.914.124-.288.124-.598-.058-.698m-5.077-2.942c.162-.154-.805-.355-1.556.156-.554.378-.571 1.187-.041 1.646.053.046.096.078.137.104a4.77 4.77 0 0 1 1.396-.412c.113-.125.243-.345.21-.745-.044-.542-.455-.456-.146-.749"/></svg>}>+ <Card title="DataDog" href="/0.0.7/connections/datadog" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Datadog</title><path d="M19.57 17.04l-1.997-1.316-1.665 2.782-1.937-.567-1.706 2.604.087.82 9.274-1.71-.538-5.794zm-8.649-2.498l1.488-.204c.241.108.409.15.697.223.45.117.97.23 1.741-.16.18-.088.553-.43.704-.625l6.096-1.106.622 7.527-10.444 1.882zm11.325-2.712l-.602.115L20.488 0 .789 2.285l2.427 19.693 2.306-.334c-.184-.263-.471-.581-.96-.989-.68-.564-.44-1.522-.039-2.127.53-1.022 3.26-2.322 3.106-3.956-.056-.594-.15-1.368-.702-1.898-.02.22.017.432.017.432s-.227-.289-.34-.683c-.112-.15-.2-.199-.319-.4-.085.233-.073.503-.073.503s-.186-.437-.216-.807c-.11.166-.137.48-.137.48s-.241-.69-.186-1.062c-.11-.323-.436-.965-.343-2.424.6.421 1.924.321 2.44-.439.171-.251.288-.939-.086-2.293-.24-.868-.835-2.16-1.066-2.651l-.028.02c.122.395.374 1.223.47 1.625.293 1.218.372 1.642.234 2.204-.116.488-.397.808-1.107 1.165-.71.358-1.653-.514-1.713-.562-.69-.55-1.224-1.447-1.284-1.883-.062-.477.275-.763.445-1.153-.243.07-.514.192-.514.192s.323-.334.722-.624c.165-.109.262-.178.436-.323a9.762 9.762 0 0 0-.456.003s.42-.227.855-.392c-.318-.014-.623-.003-.623-.003s.937-.419 1.678-.727c.509-.208 1.006-.147 1.286.257.367.53.752.817 1.569.996.501-.223.653-.337 1.284-.509.554-.61.99-.688.99-.688s-.216.198-.274.51c.314-.249.66-.455.66-.455s-.134.164-.259.426l.03.043c.366-.22.797-.394.797-.394s-.123.156-.268.358c.277-.002.838.012 1.056.037 1.285.028 1.552-1.374 2.045-1.55.618-.22.894-.353 1.947.68.903.888 1.609 2.477 1.259 2.833-.294.295-.874-.115-1.516-.916a3.466 3.466 0 0 1-.716-1.562 1.533 1.533 0 0 0-.497-.85s.23.51.23.96c0 .246.03 1.165.424 1.68-.039.076-.057.374-.1.43-.458-.554-1.443-.95-1.604-1.067.544.445 1.793 1.468 2.273 2.449.453.927.186 1.777.416 1.997.065.063.976 1.197 1.15 1.767.306.994.019 2.038-.381 2.685l-1.117.174c-.163-.045-.273-.068-.42-.153.08-.143.241-.5.243-.572l-.063-.111c-.348.492-.93.97-1.414 1.245-.633.359-1.363.304-1.838.156-1.348-.415-2.623-1.327-2.93-1.566 0 0-.01.191.048.234.34.383 1.119 1.077 1.872 1.56l-1.605.177.759 5.908c-.337.048-.39.071-.757.124-.325-1.147-.946-1.895-1.624-2.332-.599-.384-1.424-.47-2.214-.314l-.05.059a2.851 2.851 0 0 1 1.863.444c.654.413 1.181 1.481 1.375 2.124.248.822.42 1.7-.248 2.632-.476.662-1.864 1.028-2.986.237.3.481.705.876 1.25.95.809.11 1.577-.03 2.106-.574.452-.464.69-1.434.628-2.456l.714-.104.258 1.834 11.827-1.424zM15.05 6.848c-.034.075-.085.125-.007.37l.004.014.013.032.032.073c.14.287.295.558.552.696.067-.011.136-.019.207-.023.242-.01.395.028.492.08.009-.048.01-.119.005-.222-.018-.364.072-.982-.626-1.308-.264-.122-.634-.084-.757.068a.302.302 0 0 1 .058.013c.186.066.06.13.027.207m1.958 3.392c-.092-.05-.52-.03-.821.005-.574.068-1.193.267-1.328.372-.247.191-.135.523.047.66.511.382.96.638 1.432.575.29-.038.546-.497.728-.914.124-.288.124-.598-.058-.698m-5.077-2.942c.162-.154-.805-.355-1.556.156-.554.378-.571 1.187-.041 1.646.053.046.096.078.137.104a4.77 4.77 0 0 1 1.396-.412c.113-.125.243-.345.21-.745-.044-.542-.455-.456-.146-.749"/></svg>}></Card>- <Card title="New Relic" href="/0.0.6/connections/new-relic" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>New Relic</title><path d="M8.0015 14.3091v7.384L12.0008 24V12.0008L1.6078 5.9996v4.6167ZM12.0008 0 2.8232 5.2976 6.8209 7.606l5.1799-2.9893 6.3936 3.6913v7.384l-5.1783 2.9908v4.6167l9.176-5.2991V5.9996Z"/></svg>}>+ <Card title="New Relic" href="/0.0.7/connections/new-relic" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>New Relic</title><path d="M8.0015 14.3091v7.384L12.0008 24V12.0008L1.6078 5.9996v4.6167ZM12.0008 0 2.8232 5.2976 6.8209 7.606l5.1799-2.9893 6.3936 3.6913v7.384l-5.1783 2.9908v4.6167l9.176-5.2991V5.9996Z"/></svg>}></Card>- <Card title="SigNoz" href="/0.0.6/connections/signoz" icon={<svg role="img" viewBox="0 0 200 200" xmlns="http://www.w3.org/2000/svg"><title>SigNoz</title><path opacity="0.1" d="M100.279 199.833C44.5682 199.833 0 156.12 0 101.479C0 47.3844 44.5682 3.125 100.279 3.125H163.231C183.844 3.125 200 19.5174 200 39.1882V101.479C200 156.12 155.432 199.833 100.279 199.833Z"/><path d="M99.4919 58.9008C57.8802 58.9008 34.4413 93.3585 33.4637 94.8253C31.0537 98.4385 31.0537 103.111 33.4655 106.727C34.4413 108.191 57.8802 142.649 99.4919 142.649C141.103 142.649 164.543 108.191 165.52 106.724C167.93 103.111 167.93 98.4385 165.518 94.8227C164.542 93.3585 141.103 58.9008 99.4919 58.9008ZM39.2234 102.886C38.3677 101.604 38.3677 99.9463 39.2234 98.6633C40.0095 97.4834 56.6976 72.9705 86.5341 67.0904C73.0136 72.3095 63.393 85.4356 63.393 100.775C63.393 116.114 73.0136 129.24 86.5341 134.459C56.6976 128.579 40.0095 104.066 39.2234 102.886ZM82.8568 100.775C82.8568 102.686 81.3074 104.235 79.396 104.235C77.4845 104.235 75.9352 102.686 75.9352 100.775C75.9352 87.7858 86.5024 77.2185 99.4916 77.2185C101.403 77.2185 102.952 78.7676 102.952 80.6792C102.952 82.5908 101.403 84.1398 99.4916 84.1398C90.3189 84.1398 82.8568 91.6019 82.8568 100.775ZM99.4919 109.188C94.8525 109.188 91.0783 105.414 91.0783 100.775C91.0783 96.1356 94.8525 92.3612 99.4919 92.3612C104.132 92.3612 107.906 96.1354 107.906 100.775C107.906 105.414 104.132 109.188 99.4919 109.188ZM159.76 102.886C158.974 104.066 142.286 128.579 112.45 134.459C125.971 129.24 135.591 116.114 135.591 100.775C135.591 85.4358 125.971 72.3096 112.45 67.0905C142.286 72.971 158.974 97.4837 159.76 98.6634C160.616 99.9463 160.616 101.604 159.76 102.886Z"/></svg>}>+ <Card title="SigNoz" href="/0.0.7/connections/signoz" icon={<svg role="img" viewBox="0 0 200 200" xmlns="http://www.w3.org/2000/svg"><title>SigNoz</title><path opacity="0.1" d="M100.279 199.833C44.5682 199.833 0 156.12 0 101.479C0 47.3844 44.5682 3.125 100.279 3.125H163.231C183.844 3.125 200 19.5174 200 39.1882V101.479C200 156.12 155.432 199.833 100.279 199.833Z"/><path d="M99.4919 58.9008C57.8802 58.9008 34.4413 93.3585 33.4637 94.8253C31.0537 98.4385 31.0537 103.111 33.4655 106.727C34.4413 108.191 57.8802 142.649 99.4919 142.649C141.103 142.649 164.543 108.191 165.52 106.724C167.93 103.111 167.93 98.4385 165.518 94.8227C164.542 93.3585 141.103 58.9008 99.4919 58.9008ZM39.2234 102.886C38.3677 101.604 38.3677 99.9463 39.2234 98.6633C40.0095 97.4834 56.6976 72.9705 86.5341 67.0904C73.0136 72.3095 63.393 85.4356 63.393 100.775C63.393 116.114 73.0136 129.24 86.5341 134.459C56.6976 128.579 40.0095 104.066 39.2234 102.886ZM82.8568 100.775C82.8568 102.686 81.3074 104.235 79.396 104.235C77.4845 104.235 75.9352 102.686 75.9352 100.775C75.9352 87.7858 86.5024 77.2185 99.4916 77.2185C101.403 77.2185 102.952 78.7676 102.952 80.6792C102.952 82.5908 101.403 84.1398 99.4916 84.1398C90.3189 84.1398 82.8568 91.6019 82.8568 100.775ZM99.4919 109.188C94.8525 109.188 91.0783 105.414 91.0783 100.775C91.0783 96.1356 94.8525 92.3612 99.4919 92.3612C104.132 92.3612 107.906 96.1354 107.906 100.775C107.906 105.414 104.132 109.188 99.4919 109.188ZM159.76 102.886C158.974 104.066 142.286 128.579 112.45 134.459C125.971 129.24 135.591 116.114 135.591 100.775C135.591 85.4358 125.971 72.3096 112.45 67.0905C142.286 72.971 158.974 97.4837 159.76 98.6634C160.616 99.9463 160.616 101.604 159.76 102.886Z"/></svg>}></Card>- <Card title="Dynatrace" href="/0.0.6/connections/dynatrace" icon={<svg viewBox="0 0 24 24" role="img" xmlns="http://www.w3.org/2000/svg"><title>Dynatrace icon</title><path d="M9.373 0c-.31.006-.93.09-1.521.654C6.98 1.478 2.628 5.61.88 7.27.09 8.024.16 8.865.16 8.934v.377c.067-.292.187-.499.427-.825.496-.616 1.3-.788 1.627-.822a64.233 64.233 0 0 1 .002 0 64.233 64.233 0 0 1 6.527-.549c4.335-.137 7.197.225 7.197.225l6.084-5.793s-3.188-.6-6.82-1.027A93.394 93.394 0 0 0 9.566.006c-.021 0-.09-.008-.193-.006zm13.56 2.508l-6.066 5.79s.222 2.88-.137 7.198c-.189 2.45-.584 4.866-.875 6.494-.052.326-.256 1.114-.925 1.594-.29.198-.491.295-.748.363 1.546-.51 1.091-7.047 1.091-7.047-4.335.137-7.214-.222-7.214-.222L1.975 22.47s3.222.634 6.855 1.045c2.056.24 4.833.429 5.227.463.023 0 .045-.007.068-.012-.013.003-.022.009-.035.012.138 0 .259.015.379.015.085 0 .925.105 1.713-.648 1.748-1.663 6.083-5.81 6.94-6.633.788-.754.72-1.594.72-1.68a81.84 81.84 0 0 0-.207-5.654c-.24-3.65-.701-6.871-.701-6.871zM3.856 8.305C2.125 8.307.348 8.513.16 9.326c.017 1.216.05 3.137.205 5.28.24 3.65.703 6.886.703 6.886l6.082-5.79c-.017.017-.239-2.88.121-7.198H7.27s-1.684-.202-3.415-.2z"/></svg>}>+ <Card title="Dynatrace" href="/0.0.7/connections/dynatrace" icon={<svg viewBox="0 0 24 24" role="img" xmlns="http://www.w3.org/2000/svg"><title>Dynatrace icon</title><path d="M9.373 0c-.31.006-.93.09-1.521.654C6.98 1.478 2.628 5.61.88 7.27.09 8.024.16 8.865.16 8.934v.377c.067-.292.187-.499.427-.825.496-.616 1.3-.788 1.627-.822a64.233 64.233 0 0 1 .002 0 64.233 64.233 0 0 1 6.527-.549c4.335-.137 7.197.225 7.197.225l6.084-5.793s-3.188-.6-6.82-1.027A93.394 93.394 0 0 0 9.566.006c-.021 0-.09-.008-.193-.006zm13.56 2.508l-6.066 5.79s.222 2.88-.137 7.198c-.189 2.45-.584 4.866-.875 6.494-.052.326-.256 1.114-.925 1.594-.29.198-.491.295-.748.363 1.546-.51 1.091-7.047 1.091-7.047-4.335.137-7.214-.222-7.214-.222L1.975 22.47s3.222.634 6.855 1.045c2.056.24 4.833.429 5.227.463.023 0 .045-.007.068-.012-.013.003-.022.009-.035.012.138 0 .259.015.379.015.085 0 .925.105 1.713-.648 1.748-1.663 6.083-5.81 6.94-6.633.788-.754.72-1.594.72-1.68a81.84 81.84 0 0 0-.207-5.654c-.24-3.65-.701-6.871-.701-6.871zM3.856 8.305C2.125 8.307.348 8.513.16 9.326c.017 1.216.05 3.137.205 5.28.24 3.65.703 6.886.703 6.886l6.082-5.79c-.017.017-.239-2.88.121-7.198H7.27s-1.684-.202-3.415-.2z"/></svg>}></Card></CardGroup>---<CardGroup cols={2}>-<Card title="Integrations" href="/0.0.6/integrations/introduction" icon='circle-nodes'>+<Card title="Integrations" href="/0.0.7/integrations/introduction" icon='circle-nodes'>Integrate your LLM Provider with Doku</Card>-<Card title="API Refernce" href="/0.0.6/api-reference/introduction" icon='code'>+<Card title="API Refernce" href="/0.0.7/api-reference/introduction" icon='code'>OpenAPI specification for API Endpoints in Doku</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/connections/new-relic.mdx b/docs/0.0.7/connections/new-relic.mdxsimilarity index 99%rename from docs/0.0.5/connections/new-relic.mdxrename to docs/0.0.7/connections/new-relic.mdxindex 48ca143d..d875856a 100644--- a/docs/0.0.5/connections/new-relic.mdx+++ b/docs/0.0.7/connections/new-relic.mdx@@ -11,11 +11,11 @@ description: 'Connect Doku to New Relic'Doku can automatically send LLM usage data from Doku to New Relic using the [Report Metrics HTTP API](https://docs.newrelic.com/docs/data-apis/ingest-apis/metric-api/report-metrics-metric-api/) and [Send Logs API](https://docs.newrelic.com/docs/logs/log-api/introduction-log-api/)-Make the following curl request to Doku to add a connection for New Relic. See more on the [Connections API](/0.0.5/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for New Relic. See more on the [Connections API](/0.0.7/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.5/connections/signoz.mdx b/docs/0.0.7/connections/signoz.mdxsimilarity index 99%rename from docs/0.0.5/connections/signoz.mdxrename to docs/0.0.7/connections/signoz.mdxindex c0201dd5..07619edb 100644--- a/docs/0.0.5/connections/signoz.mdx+++ b/docs/0.0.7/connections/signoz.mdx@@ -10,11 +10,11 @@ description: 'Connect Doku to SigNoz'Doku can automatically send LLM usage data from Doku to SigNoz using the [HTTP Logs API](https://signoz.io/docs/userguide/send-logs-http/)-Make the following curl request to Doku to add a connection for SigNoz. See more on the [Connections API](/0.0.5/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for SigNoz. See more on the [Connections API](/0.0.7/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.6/installation.mdx b/docs/0.0.7/installation.mdxsimilarity index 86%rename from docs/0.0.6/installation.mdxrename to docs/0.0.7/installation.mdxindex ca2656cc..439dea0f 100644--- a/docs/0.0.6/installation.mdx+++ b/docs/0.0.7/installation.mdx@@ -12,14 +12,14 @@ Doku flexibly adapts to your preferred environment. Select a deployment method ticon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Kubernetes</title><path fill="#FFA500" d="M10.204 14.35l.007.01-.999 2.413a5.171 5.171 0 0 1-2.075-2.597l2.578-.437.004.005a.44.44 0 0 1 .484.606zm-.833-2.129a.44.44 0 0 0 .173-.756l.002-.011L7.585 9.7a5.143 5.143 0 0 0-.73 3.255l2.514-.725.002-.009zm1.145-1.98a.44.44 0 0 0 .699-.337l.01-.005.15-2.62a5.144 5.144 0 0 0-3.01 1.442l2.147 1.523.004-.002zm.76 2.75l.723.349.722-.347.18-.78-.5-.623h-.804l-.5.623.179.779zm1.5-3.095a.44.44 0 0 0 .7.336l.008.003 2.134-1.513a5.188 5.188 0 0 0-2.992-1.442l.148 2.615.002.001zm10.876 5.97l-5.773 7.181a1.6 1.6 0 0 1-1.248.594l-9.261.003a1.6 1.6 0 0 1-1.247-.596l-5.776-7.18a1.583 1.583 0 0 1-.307-1.34L2.1 5.573c.108-.47.425-.864.863-1.073L11.305.513a1.606 1.606 0 0 1 1.385 0l8.345 3.985c.438.209.755.604.863 1.073l2.062 8.955c.108.47-.005.963-.308 1.34zm-3.289-2.057c-.042-.01-.103-.026-.145-.034-.174-.033-.315-.025-.479-.038-.35-.037-.638-.067-.895-.148-.105-.04-.18-.165-.216-.216l-.201-.059a6.45 6.45 0 0 0-.105-2.332 6.465 6.465 0 0 0-.936-2.163c.052-.047.15-.133.177-.159.008-.09.001-.183.094-.282.197-.185.444-.338.743-.522.142-.084.273-.137.415-.242.032-.024.076-.062.11-.089.24-.191.295-.52.123-.736-.172-.216-.506-.236-.745-.045-.034.027-.08.062-.111.088-.134.116-.217.23-.33.35-.246.25-.45.458-.673.609-.097.056-.239.037-.303.033l-.19.135a6.545 6.545 0 0 0-4.146-2.003l-.012-.223c-.065-.062-.143-.115-.163-.25-.022-.268.015-.557.057-.905.023-.163.061-.298.068-.475.001-.04-.001-.099-.001-.142 0-.306-.224-.555-.5-.555-.275 0-.499.249-.499.555l.001.014c0 .041-.002.092 0 .128.006.177.044.312.067.475.042.348.078.637.056.906a.545.545 0 0 1-.162.258l-.012.211a6.424 6.424 0 0 0-4.166 2.003 8.373 8.373 0 0 1-.18-.128c-.09.012-.18.04-.297-.029-.223-.15-.427-.358-.673-.608-.113-.12-.195-.234-.329-.349-.03-.026-.077-.062-.111-.088a.594.594 0 0 0-.348-.132.481.481 0 0 0-.398.176c-.172.216-.117.546.123.737l.007.005.104.083c.142.105.272.159.414.242.299.185.546.338.743.522.076.082.09.226.1.288l.16.143a6.462 6.462 0 0 0-1.02 4.506l-.208.06c-.055.072-.133.184-.215.217-.257.081-.546.11-.895.147-.164.014-.305.006-.48.039-.037.007-.09.02-.133.03l-.004.002-.007.002c-.295.071-.484.342-.423.608.061.267.349.429.645.365l.007-.001.01-.003.129-.029c.17-.046.294-.113.448-.172.33-.118.604-.217.87-.256.112-.009.23.069.288.101l.217-.037a6.5 6.5 0 0 0 2.88 3.596l-.09.218c.033.084.069.199.044.282-.097.252-.263.517-.452.813-.091.136-.185.242-.268.399-.02.037-.045.095-.064.134-.128.275-.034.591.213.71.248.12.556-.007.69-.282v-.002c.02-.039.046-.09.062-.127.07-.162.094-.301.144-.458.132-.332.205-.68.387-.897.05-.06.13-.082.215-.105l.113-.205a6.453 6.453 0 0 0 4.609.012l.106.192c.086.028.18.042.256.155.136.232.229.507.342.84.05.156.074.295.145.457.016.037.043.09.062.129.133.276.442.402.69.282.247-.118.341-.435.213-.71-.02-.039-.045-.096-.065-.134-.083-.156-.177-.261-.268-.398-.19-.296-.346-.541-.443-.793-.04-.13.007-.21.038-.294-.018-.022-.059-.144-.083-.202a6.499 6.499 0 0 0 2.88-3.622c.064.01.176.03.213.038.075-.05.144-.114.28-.104.266.039.54.138.87.256.154.06.277.128.448.173.036.01.088.019.13.028l.009.003.007.001c.297.064.584-.098.645-.365.06-.266-.128-.537-.423-.608zM16.4 9.701l-1.95 1.746v.005a.44.44 0 0 0 .173.757l.003.01 2.526.728a5.199 5.199 0 0 0-.108-1.674A5.208 5.208 0 0 0 16.4 9.7zm-4.013 5.325a.437.437 0 0 0-.404-.232.44.44 0 0 0-.372.233h-.002l-1.268 2.292a5.164 5.164 0 0 0 3.326.003l-1.27-2.296h-.01zm1.888-1.293a.44.44 0 0 0-.27.036.44.44 0 0 0-.214.572l-.003.004 1.01 2.438a5.15 5.15 0 0 0 2.081-2.615l-2.6-.44-.004.005z"/></svg>}- href="/0.0.6/installation#kubernetes"+ href="/0.0.7/installation#kubernetes">Deploy Doku on a Kubernetes for scalable LLM Monitoring capabilities.</Card><Cardtitle="Docker"icon="docker"- href="/0.0.6/installation#docker"+ href="/0.0.7/installation#docker">Deploy Doku using Docker for an easy-to-manage LLM Monitoring setup.</Card>@@ -41,14 +41,13 @@ Deploy Doku on your Kubernetes cluster using the [Doku Helm chart](https://githu```</Step></Steps>-<Info>As Doku does not have a built-in visualization UI yet, it is preferred that you set up the `connections` configuration within the [values.yaml](https://github.com/dokulabs/helm/blob/main/charts/doku/values.yaml) file. Doing so enables visualization of the LLM Observability data processed by Doku using an external observability platform.</Info>## DockerFor a quick and straightforward setup, Docker Compose can be used to deploy Doku.<Steps><Step title="Create `docker-compose.yml`">- ```yml+ ```yamlversion: '3.8'services:@@ -61,12 +60,12 @@ For a quick and straightforward setup, Docker Compose can be used to deploy Dokuvolumes:- clickhouse-data:/var/lib/clickhouseports:- - "9000:9000"+ - "9000:9000"- "8123:8123"restart: alwaysdoku-ingester:- image: ghcr.io/dokulabs/doku-ingester:0.0.6+ image: ghcr.io/dokulabs/doku-ingester:0.0.7container_name: doku-ingesterenvironment:DOKU_DB_HOST: clickhouse@@ -79,9 +78,28 @@ For a quick and straightforward setup, Docker Compose can be used to deploy Dokudepends_on:- clickhouserestart: always++ doku-client:+ image: ghcr.io/dokulabs/doku-client:0.0.7+ container_name: doku-client+ environment:+ INIT_DB_HOST: clickhouse+ INIT_DB_PORT: 8123+ INIT_DB_DATABASE: ${DOKU_DB_NAME:-default}+ INIT_DB_USERNAME: ${DOKU_DB_USER:-default}+ INIT_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ SQLITE_DATABASE_URL: file:/app/client/data/data.db+ ports:+ - "3000:3000"+ depends_on:+ - clickhouse+ volumes:+ - doku-client-data:/app/client/data+ restart: alwaysvolumes:clickhouse-data:+ doku-client-data:```</Step><Step title="Start Docker Compose">@@ -94,10 +112,10 @@ For a quick and straightforward setup, Docker Compose can be used to deploy Doku---<CardGroup cols={2}>-<Card title="Integrations" href="/0.0.6/integrations/introduction" icon='circle-nodes'>+<Card title="Integrations" href="/0.0.7/integrations/introduction" icon='circle-nodes'>Integrate your LLM Provider with Doku</Card>-<Card title="Connections" href="/0.0.6/connections/intro" icon='link'>+<Card title="Connections" href="/0.0.7/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.7/integrations/anthropic/examples/messages.mdx b/docs/0.0.7/integrations/anthropic/examples/messages.mdxnew file mode 100644index 00000000..2e6da911--- /dev/null+++ b/docs/0.0.7/integrations/anthropic/examples/messages.mdx@@ -0,0 +1,177 @@+---+title: 'Messages'+description: 'Monitor Anthropic Messages API Usage'+---++## Completions+<Tabs>+ <Tab title="Python">++ ### Synchronous Usage+ <CodeGroup>+ ```python default+ from anthropic import Anthropic+ import dokumetry++ client = Anthropic(+ # This is the default and can be omitted+ api_key="YOUR_ANTHROPIC_API_KEY",+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ message = client.messages.create(+ max_tokens=1024,+ messages=[+ {+ "role": "user",+ "content": "Hello, Claude",+ }+ ],+ model="claude-3-opus-20240229",+ )+ print(message.content)+ ```+ ```python streaming+ from anthropic import Anthropic+ import dokumetry++ client = Anthropic(+ # This is the default and can be omitted+ api_key="YOUR_ANTHROPIC_API_KEY",+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ stream = client.messages.create(+ max_tokens=1024,+ messages=[+ {+ "role": "user",+ "content": "Hello, Claude",+ }+ ],+ model="claude-3-opus-20240229",+ stream=True,+ )+ for event in stream:+ print(event.type)+ ```+ </CodeGroup>++ ### Asynchronous usage+ <CodeGroup>+ ```python default+ import asyncio+ from anthropic import AsyncAnthropic+ import dokumetry++ client = AsyncAnthropic(+ # This is the default and can be omitted+ api_key="YOUR_ANTHROPIC_API_KEY",+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")+++ async def main() -> None:+ message = await client.messages.create(+ max_tokens=1024,+ messages=[+ {+ "role": "user",+ "content": "Hello, Claude",+ }+ ],+ model="claude-3-opus-20240229",+ )++ asyncio.run(main())++ ```+ ```python streaming+ import asyncio+ from anthropic import AsyncAnthropic+ import dokumetry++ client = AsyncAnthropic(+ # This is the default and can be omitted+ api_key="YOUR_ANTHROPIC_API_KEY",+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main():+ stream = client.messages.create(+ max_tokens=1024,+ messages=[+ {+ "role": "user",+ "content": "Hello, Claude",+ }+ ],+ model="claude-3-opus-20240229",+ stream=True,+ )+ for event in stream:+ print(event.type)++ asyncio.run(main())+ ```+ </CodeGroup>+ </Tab>+ <Tab title="Javascript">+ <CodeGroup>+ ```javascript default+ import Anthropic from '@anthropic-ai/sdk';+ import DokuMetry from 'dokumetry';++ const anthropic = new Anthropic({+ apiKey: 'my_api_key', // defaults to process.env["ANTHROPIC_API_KEY"]+ });++ // Pass the above `anthropic` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ DokuMetry.init({llm: anthropic, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})++ async function main() {+ const message = await anthropic.messages.create({+ max_tokens: 1024,+ messages: [{ role: 'user', content: 'Hello, Claude' }],+ model: 'claude-3-opus-20240229',+ });++ console.log(message.content);+ }++ main();+ ```++ ```javascript streaming+ import Anthropic from '@anthropic-ai/sdk';+ import DokuMetry from 'dokumetry';++ const anthropic = new Anthropic({+ apiKey: 'my_api_key', // defaults to process.env["ANTHROPIC_API_KEY"]+ });++ // Pass the above `anthropic` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ DokuMetry.init({llm: anthropic, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})++ const stream = await anthropic.messages.create({+ max_tokens: 1024,+ messages: [{ role: 'user', content: 'Hello, Claude' }],+ model: 'claude-3-opus-20240229',+ stream: true,+ });+ for await (const messageStreamEvent of stream) {+ console.log(messageStreamEvent.type);+ }+ ```+ </CodeGroup>+ </Tab>+</Tabs>+diff --git a/docs/0.0.6/integrations/anthropic/introduction.mdx b/docs/0.0.7/integrations/anthropic/introduction.mdxsimilarity index 90%rename from docs/0.0.6/integrations/anthropic/introduction.mdxrename to docs/0.0.7/integrations/anthropic/introduction.mdxindex 5ddfd673..7259e1ad 100644--- a/docs/0.0.6/integrations/anthropic/introduction.mdx+++ b/docs/0.0.7/integrations/anthropic/introduction.mdx@@ -7,7 +7,7 @@ DokuMetry SDKs (`dokumetry`) empowers you to effortlessly track and monitor Anth## Get Started-The integration is compatible with Anthropic SDK versions >=0.10.0+The integration is compatible with Anthropic Python SDK version >=0.19.0 and Typescript SDK version >=0.9.0<Tabs><Tab title="Python">@@ -16,7 +16,7 @@ The integration is compatible with Anthropic SDK versions >=0.10.0``````python- from anthropic import Anthropic, HUMAN_PROMPT, AI_PROMPT+ from anthropic import Anthropicimport dokumetryanthropic = Anthropic(@@ -48,7 +48,7 @@ The integration is compatible with Anthropic SDK versions >=0.10.0The following Anthropic Endpoints are supported for monitoring with DokuMetry-- [Completions](/0.0.6/integrations/anthropic/examples/completions)+- [messages](/0.0.7/integrations/anthropic/examples/messages)## Parameters<Tabs>@@ -82,10 +82,10 @@ To filter your LLM Usage according application or the environment, set the Appli---<CardGroup cols={2}>-<Card title="Connections" href="/0.0.6/connections/intro" icon='link'>+<Card title="Connections" href="/0.0.7/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card>-<Card title="API Refernce" href="/0.0.6/api-reference/introduction" icon='code'>+<Card title="API Refernce" href="/0.0.7/api-reference/introduction" icon='code'>OpenAPI specification for API Endpoints in Doku</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/integrations/cohere/examples/chat.mdx b/docs/0.0.7/integrations/cohere/examples/chat.mdxsimilarity index 100%rename from docs/0.0.5/integrations/cohere/examples/chat.mdxrename to docs/0.0.7/integrations/cohere/examples/chat.mdxdiff --git a/docs/0.0.5/integrations/cohere/examples/embed.mdx b/docs/0.0.7/integrations/cohere/examples/embed.mdxsimilarity index 100%rename from docs/0.0.5/integrations/cohere/examples/embed.mdxrename to docs/0.0.7/integrations/cohere/examples/embed.mdxdiff --git a/docs/0.0.5/integrations/cohere/examples/generate.mdx b/docs/0.0.7/integrations/cohere/examples/generate.mdxsimilarity index 100%rename from docs/0.0.5/integrations/cohere/examples/generate.mdxrename to docs/0.0.7/integrations/cohere/examples/generate.mdxdiff --git a/docs/0.0.5/integrations/cohere/examples/summarize.mdx b/docs/0.0.7/integrations/cohere/examples/summarize.mdxsimilarity index 100%rename from docs/0.0.5/integrations/cohere/examples/summarize.mdxrename to docs/0.0.7/integrations/cohere/examples/summarize.mdxdiff --git a/docs/0.0.6/integrations/cohere/introduction.mdx b/docs/0.0.7/integrations/cohere/introduction.mdxsimilarity index 89%rename from docs/0.0.6/integrations/cohere/introduction.mdxrename to docs/0.0.7/integrations/cohere/introduction.mdxindex b5c067c8..329f05a0 100644--- a/docs/0.0.6/integrations/cohere/introduction.mdx+++ b/docs/0.0.7/integrations/cohere/introduction.mdx@@ -45,10 +45,10 @@ The integration is compatible with Cohere SDK versions >=4.0.0## Supported EndpointsThe following Cohere Endpoints are supported for monitoring with DokuMetry-- [Chat](/0.0.6/integrations/cohere/examples/chat)-- [Generate](/0.0.6/integrations/cohere/examples/generate)-- [Summarize](/0.0.6/integrations/cohere/examples/summarize)-- [Embed](/0.0.6/integrations/cohere/examples/embed)+- [Chat](/0.0.7/integrations/cohere/examples/chat)+- [Generate](/0.0.7/integrations/cohere/examples/generate)+- [Summarize](/0.0.7/integrations/cohere/examples/summarize)+- [Embed](/0.0.7/integrations/cohere/examples/embed)## Parameters@@ -83,10 +83,10 @@ To filter your LLM Usage according application or the environment, set the Appli---<CardGroup cols={2}>-<Card title="Connections" href="/0.0.6/connections/intro" icon='link'>+<Card title="Connections" href="/0.0.7/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card>-<Card title="API Refernce" href="/0.0.6/api-reference/introduction" icon='code'>+<Card title="API Refernce" href="/0.0.7/api-reference/introduction" icon='code'>OpenAPI specification for API Endpoints in Doku</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.6/integrations/introduction.mdx b/docs/0.0.7/integrations/introduction.mdxsimilarity index 93%rename from docs/0.0.6/integrations/introduction.mdxrename to docs/0.0.7/integrations/introduction.mdxindex cf05c5d2..2dd3d54a 100644--- a/docs/0.0.6/integrations/introduction.mdx+++ b/docs/0.0.7/integrations/introduction.mdx@@ -8,7 +8,7 @@ Start integrating and monitoring your applications with Doku effortlessly. Choos<CardGroup cols={3}><Cardtitle="OpenAI"- href="/0.0.6/integrations/openai/introduction"+ href="/0.0.7/integrations/openai/introduction"icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title>@@ -20,7 +20,7 @@ Start integrating and monitoring your applications with Doku effortlessly. Choos</Card><Cardtitle="Cohere"- href="/0.0.6/integrations/cohere/introduction"+ href="/0.0.7/integrations/cohere/introduction"icon={<svg role="image" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 75 75"><g>@@ -45,7 +45,7 @@ Start integrating and monitoring your applications with Doku effortlessly. Choos</Card><Cardtitle="Anthropic"- href="/0.0.6/integrations/anthropic/introduction"+ href="/0.0.7/integrations/anthropic/introduction"icon={<svg viewBox="0 0 256 176" xmlns="http://www.w3.org/2000/svg"><path d="M147.486878,0 C147.486878,0 217.568251,175.780074 217.568251,175.780074 C217.568251,175.780074 256,175.780074 256,175.780074 C256,175.780074 185.918621,0 185.918621,0 C185.918621,0 147.486878,0 147.486878,0 C147.486878,0 147.486878,0 147.486878,0 Z"></path>@@ -60,10 +60,10 @@ Start integrating and monitoring your applications with Doku effortlessly. Choos---<CardGroup cols={2}>-<Card title="Quickstart" href="/0.0.6/quickstart" icon='bolt'>+<Card title="Quickstart" href="/0.0.7/quickstart" icon='bolt'>Get Started with monitoring your LLM Applications in 2 simple steps</Card>-<Card title="Connections" href="/0.0.6/connections/intro" icon='link'>+<Card title="Connections" href="/0.0.7/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/integrations/openai/examples/audio.mdx b/docs/0.0.7/integrations/openai/examples/audio.mdxsimilarity index 95%rename from docs/0.0.5/integrations/openai/examples/audio.mdxrename to docs/0.0.7/integrations/openai/examples/audio.mdxindex 4cf99fbe..3d6ddbfe 100644--- a/docs/0.0.5/integrations/openai/examples/audio.mdx+++ b/docs/0.0.7/integrations/openai/examples/audio.mdx@@ -12,7 +12,9 @@ description: 'Monitor OpenAI Audio API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/0.0.6/integrations/openai/examples/chat.mdx b/docs/0.0.7/integrations/openai/examples/chat.mdxsimilarity index 63%rename from docs/0.0.6/integrations/openai/examples/chat.mdxrename to docs/0.0.7/integrations/openai/examples/chat.mdxindex f0ca6753..a7cf5a1a 100644--- a/docs/0.0.6/integrations/openai/examples/chat.mdx+++ b/docs/0.0.7/integrations/openai/examples/chat.mdx@@ -6,12 +6,16 @@ description: 'Monitor OpenAI Chat Completions API usage'<Tabs><Tab title="Python">++ ### Synchronous Usage<CodeGroup>```python Defaultfrom openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -31,7 +35,9 @@ description: 'Monitor OpenAI Chat Completions API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -60,7 +66,9 @@ description: 'Monitor OpenAI Chat Completions API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -82,7 +90,9 @@ description: 'Monitor OpenAI Chat Completions API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -122,7 +132,9 @@ description: 'Monitor OpenAI Chat Completions API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -140,6 +152,164 @@ description: 'Monitor OpenAI Chat Completions API usage'print(completion.choices[0].logprobs)```</CodeGroup>++ ### Asynchronous Usage++ <CodeGroup>+ ```python Default+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main() -> None:+ chat_completion = await client.chat.completions.create(+ messages=[+ {+ "role": "user",+ "content": "Say this is a test",+ }+ ],+ model="gpt-3.5-turbo",+ )++ asyncio.run(main())+ ```++ ```python Image Input+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main() -> None:+ response = await client.chat.completions.create(+ model="gpt-4-vision-preview",+ messages=[+ {+ "role": "user",+ "content": [+ {"type": "text", "text": "Whatβs in this image?"},+ {+ "type": "image_url",+ "image_url": "https://upload.wikimedia.org/wikipedia/commons/thumb/d/dd/Gfp-wisconsin-madison-the-nature-boardwalk.jpg/2560px-Gfp-wisconsin-madison-the-nature-boardwalk.jpg",+ },+ ],+ }+ ],+ max_tokens=300,+ )++ asyncio.run(main())+ ```++ ```python Streaming+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main():+ stream = await client.chat.completions.create(+ model="gpt-4",+ messages=[{"role": "user", "content": "Say this is a test"}],+ stream=True,+ )+ async for chunk in stream:+ print(chunk.choices[0].delta.content or "", end="")+++ asyncio.run(main())+ ```++ ```python Functions+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ tools = [+ {+ "type": "function",+ "function": {+ "name": "get_current_weather",+ "description": "Get the current weather in a given location",+ "parameters": {+ "type": "object",+ "properties": {+ "location": {+ "type": "string",+ "description": "The city and state, e.g. San Francisco, CA",+ },+ "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]},+ },+ "required": ["location"],+ },+ }+ }+ ]+ messages = [{"role": "user", "content": "What's the weather like in Boston today?"}]++ async def main() -> None:+ completion = await client.chat.completions.create(+ model="gpt-3.5-turbo",+ messages=messages,+ tools=tools,+ tool_choice="auto"+ )++ asyncio.run(main())+ ```++ ```python LogProbs+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main() -> None:+ completion = await client.chat.completions.create(+ model="gpt-3.5-turbo",+ messages=[+ {"role": "user", "content": "Hello!"}+ ],+ logprobs=True,+ top_logprobs=2+ )++ asyncio.run(main())+ ```+ </CodeGroup></Tab><Tab title="NodeJS"><CodeGroup>diff --git a/docs/0.0.6/integrations/openai/examples/completions.mdx b/docs/0.0.7/integrations/openai/examples/completions.mdxsimilarity index 94%rename from docs/0.0.6/integrations/openai/examples/completions.mdxrename to docs/0.0.7/integrations/openai/examples/completions.mdxindex 4071b67b..d7e4908b 100644--- a/docs/0.0.6/integrations/openai/examples/completions.mdx+++ b/docs/0.0.7/integrations/openai/examples/completions.mdx@@ -10,7 +10,9 @@ description: 'Monitor OpenAI Completions API Usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -27,7 +29,9 @@ description: 'Monitor OpenAI Completions API Usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/0.0.6/integrations/openai/examples/embeddings.mdx b/docs/0.0.7/integrations/openai/examples/embeddings.mdxsimilarity index 94%rename from docs/0.0.6/integrations/openai/examples/embeddings.mdxrename to docs/0.0.7/integrations/openai/examples/embeddings.mdxindex 80ddf22d..ec50145e 100644--- a/docs/0.0.6/integrations/openai/examples/embeddings.mdx+++ b/docs/0.0.7/integrations/openai/examples/embeddings.mdx@@ -10,7 +10,9 @@ description: 'Monitor OpenAI Embeddings API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/0.0.6/integrations/openai/examples/fine-tuning.mdx b/docs/0.0.7/integrations/openai/examples/fine-tuning.mdxsimilarity index 94%rename from docs/0.0.6/integrations/openai/examples/fine-tuning.mdxrename to docs/0.0.7/integrations/openai/examples/fine-tuning.mdxindex dbb9c06d..aa049513 100644--- a/docs/0.0.6/integrations/openai/examples/fine-tuning.mdx+++ b/docs/0.0.7/integrations/openai/examples/fine-tuning.mdx@@ -10,7 +10,9 @@ description: 'Monitor OpenAI Fine Tuning API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/0.0.5/integrations/openai/examples/image.mdx b/docs/0.0.7/integrations/openai/examples/image.mdxsimilarity index 94%rename from docs/0.0.5/integrations/openai/examples/image.mdxrename to docs/0.0.7/integrations/openai/examples/image.mdxindex 1c59e680..d0c82139 100644--- a/docs/0.0.5/integrations/openai/examples/image.mdx+++ b/docs/0.0.7/integrations/openai/examples/image.mdx@@ -11,7 +11,9 @@ description: 'Monitor OpenAI Image API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -52,7 +54,9 @@ description: 'Monitor OpenAI Image API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/0.0.6/integrations/openai/introduction.mdx b/docs/0.0.7/integrations/openai/introduction.mdxsimilarity index 84%rename from docs/0.0.6/integrations/openai/introduction.mdxrename to docs/0.0.7/integrations/openai/introduction.mdxindex 693fc801..a1ff47a3 100644--- a/docs/0.0.6/integrations/openai/introduction.mdx+++ b/docs/0.0.7/integrations/openai/introduction.mdx@@ -44,12 +44,12 @@ The integration is compatible with OpenAI SDK versions >=1.0.0The following OpenAI Endpoints are supported for monitoring with DokuMetry-- [Chat completions](/0.0.6/integrations/openai/examples/chat)-- [Image Create](/0.0.6/integrations/openai/examples/image#create-image) and [Image Variations](/0.0.6/integrations/openai/examples/image#create-image-variation)-- [Audio Speech Create](/0.0.6/integrations/openai/examples/audio)-- [Embeddings](/0.0.6/integrations/openai/examples/embeddings)-- [Fine Tunings](/0.0.6/integrations/openai/examples/fine-tuning)-- [Completions](/0.0.6/integrations/openai/examples/completions)+- [Chat completions](/0.0.7/integrations/openai/examples/chat)+- [Image Create](/0.0.7/integrations/openai/examples/image#create-image) and [Image Variations](/0.0.7/integrations/openai/examples/image#create-image-variation)+- [Audio Speech Create](/0.0.7/integrations/openai/examples/audio)+- [Embeddings](/0.0.7/integrations/openai/examples/embeddings)+- [Fine Tunings](/0.0.7/integrations/openai/examples/fine-tuning)+- [Completions](/0.0.7/integrations/openai/examples/completions)## Parameters@@ -84,10 +84,10 @@ To filter your LLM Usage according application or the environment, set the Appli---<CardGroup cols={2}>-<Card title="Connections" href="/0.0.6/connections/intro" icon='link'>+<Card title="Connections" href="/0.0.7/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card>-<Card title="API Refernce" href="/0.0.6/api-reference/introduction" icon='code'>+<Card title="API Refernce" href="/0.0.7/api-reference/introduction" icon='code'>OpenAPI specification for API Endpoints in Doku</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.6/introduction.mdx b/docs/0.0.7/introduction.mdxsimilarity index 67%rename from docs/0.0.6/introduction.mdxrename to docs/0.0.7/introduction.mdxindex dd389e0d..1d66daf0 100644--- a/docs/0.0.6/introduction.mdx+++ b/docs/0.0.7/introduction.mdx@@ -3,6 +3,10 @@ title: What is Doku?description: 'Open-source platform for monitoring and evaluating LLMs at scale'---+<Frame>+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-1.jpg?raw=true" />+</Frame>+Doku is an **open-source LLMOps tool** engineered to enables developers with comprehensive capabilities to monitor, analyze, and optimize LLM applications. It provides valuable real-time data on **LLM usage, performance, and costs**. Through seamless integrations with leading LLM platforms, including OpenAI, Cohere, and Anthropic, Doku acts as a central command center for all your LLM needs. It effectively guides your efforts, ensuring that your LLM applications not only operate at peak efficiency but also scale successfully.## Why use Doku?@@ -40,25 +44,30 @@ Once the `dokumetry` SDKs are configured in your LLM application, Monitoring datYou can choose to use a new ClickHouse database setup or connect to your existing one to work with Doku.-### Step 3: Visualize in your Observability Platform-With your LLM monitoring data processed, connect Doku to your preferred Observability Platform to begin visualizing and analyzing your data in-depth.+### Step 3: Visualize and analyze+With your LLM monitoring data processed and securely stored, you can now leverage the Doku UI for in-depth visualization and analysis. Doku UI allows you to explore LLM costs, token usage, performance metrics, and user interactions in an intuitive interface. This powerful tool enhances your ability to observe and optimize your LLM applications, ensuring you make data-driven decisions for improvement.-Stay tuned for the upcoming release of Doku UI, enhancing your data visualization capabilities further.+<Frame>+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-1.jpg?raw=true" />+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-2.jpg?raw=true" />+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-3.jpg?raw=true" />+</Frame>+For those with a preferred observability platform, you can also integrate and visualize this data elsewhere with ease. This flexibility ensures optimal monitoring workflow integration, regardless of your platform choice. For more details on how to set up these connections, check out the [Connections](https://example.com/0.0.7/connections/intro) guide.## Getting StartedSelect from the following guides to learn more about how to use Doku:<CardGroup cols={2}>-<Card title="Quickstart" href="/0.0.6/quickstart" icon='bolt'>+<Card title="Quickstart" href="/0.0.7/quickstart" icon='bolt'>Get Started with monitoring your LLM Applications in 2 simple steps</Card>-<Card title="Integrations" href="/0.0.6/integrations/introduction" icon='circle-nodes'>+<Card title="Integrations" href="/0.0.7/integrations/introduction" icon='circle-nodes'>Integrate your LLM Provider with Doku</Card>-<Card title="Installation" href="/0.0.6/installation" icon='circle-down'>+<Card title="Installation" href="/0.0.7/installation" icon='circle-down'>Deploy Doku in your preferred environment</Card>-<Card title="Connections" href="/0.0.6/connections/intro" icon='link'>+<Card title="Connections" href="/0.0.7/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.6/quickstart.mdx b/docs/0.0.7/quickstart.mdxsimilarity index 70%rename from docs/0.0.6/quickstart.mdxrename to docs/0.0.7/quickstart.mdxindex 4dee1ba6..985d79a7 100644--- a/docs/0.0.6/quickstart.mdx+++ b/docs/0.0.7/quickstart.mdx@@ -28,7 +28,7 @@ This guide will walk you through setting up monitoring for your LLM Applicationrestart: alwaysdoku-ingester:- image: ghcr.io/dokulabs/doku-ingester:0.0.6+ image: ghcr.io/dokulabs/doku-ingester:0.0.7container_name: doku-ingesterenvironment:DOKU_DB_HOST: clickhouse@@ -41,9 +41,28 @@ This guide will walk you through setting up monitoring for your LLM Applicationdepends_on:- clickhouserestart: always++ doku-client:+ image: ghcr.io/dokulabs/doku-client:0.0.7+ container_name: doku-client+ environment:+ INIT_DB_HOST: clickhouse+ INIT_DB_PORT: 8123+ INIT_DB_DATABASE: ${DOKU_DB_NAME:-default}+ INIT_DB_USERNAME: ${DOKU_DB_USER:-default}+ INIT_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ SQLITE_DATABASE_URL: file:/app/client/data/data.db+ ports:+ - "3000:3000"+ depends_on:+ - clickhouse+ volumes:+ - doku-client-data:/app/client/data+ restart: alwaysvolumes:clickhouse-data:+ doku-client-data:```</Step><Step title="Launch Doku">@@ -53,26 +72,13 @@ This guide will walk you through setting up monitoring for your LLM Application</Step></Steps></Step>- <Step title="Generate an API Key">- With Doku running, the next step is to [generate an API key](/0.0.6/api-reference/endpoint/api-keys/create) for secure communication between your applications and Doku.-- To generate your first API key, you can use the following command:-- ```shell shell- curl --request POST \- --url https://127.0.0.1:9044/api/keys \- --header 'Authorization: ""' \- --header 'Content-Type: application/json' \- --data '{- "name": "Patcher"- }'- ```-- <Note>- **Save the API Key** β This key is essential for configuring the `dokumetry` SDK.-- For your first API call to generate the key, the Authorization header should be left blank. However, remember to include this API key in the Authorization header for all future API interactions and SDK configurations.- </Note>+ <Step title="Access Doku UI and Generate an API Key">+ With Doku running, the next step is to access the Doku UI and generate an API key for secure communication between your applications and Doku.+ 1. Open your browser and go to Doku UI at `127.0.0.1:3000/login`+ 2. Login using theb default credentials+ - Email as `[email protected]`+ - Password as `dokulabsuser`+ 3. Once you have logged into Doku UI, Go to [API Keys page](http://127.0.0.1:3000/api-keys) and Create an API Key. Copy the generated API Key.</Step><Step title="Instrument your Application">Choose the appropriate SDK for your LLM application's programming language and follow the steps to integrate monitoring with just **two lines of code**.@@ -165,6 +171,16 @@ This guide will walk you through setting up monitoring for your LLM Application</Tab></Tabs></Step>+ <Step title="Visualize and Analyze">+ Once you have Doku Ingester and `DokuMetry` SKDs set up, you can instantly get insights into how your LLM applications. Just head over to Doku UI at `127.0.0.1:3000` on your browser to start exploring.++With Doku, you get a simple, powerful view into important info like how much you're spending on LLMs, which parts of your app are using them the most, and how well they're performing. Find out which LLM models are favorites among your applications, and dive deep into performance details to make smart decisions. This setup is perfect for optimizing your app performance and keeping an eye on costs.+ <Frame>+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-1.jpg?raw=true" />+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-2.jpg?raw=true" />+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-3.jpg?raw=true" />+ </Frame>+ </Step></Steps>You're all set! Following these steps should have you on your way to effectively monitoring your LLM applications. If you have any questions or need support, reach out to our [community](https://join.slack.com/t/doku-0tq5728/shared_invite/zt-2a9aql9xx-FN5EIZ2DtZ~XtJoYdxUDtA).@@ -172,10 +188,10 @@ You're all set! Following these steps should have you on your way to effectively---<CardGroup cols={2}>-<Card title="Integrations" href="/0.0.6/integrations/introduction" icon='circle-nodes'>+<Card title="Integrations" href="/0.0.7/integrations/introduction" icon='circle-nodes'>Integrate your LLM Provider with Doku</Card>-<Card title="Connections" href="/0.0.6/connections/intro" icon='link'>+<Card title="Connections" href="/0.0.7/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.6/api-reference/endpoint/api-keys/create.mdx b/docs/latest/api-reference/endpoint/api-keys/create.mdxsimilarity index 100%rename from docs/0.0.6/api-reference/endpoint/api-keys/create.mdxrename to docs/latest/api-reference/endpoint/api-keys/create.mdxdiff --git a/docs/0.0.6/api-reference/endpoint/api-keys/delete.mdx b/docs/latest/api-reference/endpoint/api-keys/delete.mdxsimilarity index 100%rename from docs/0.0.6/api-reference/endpoint/api-keys/delete.mdxrename to docs/latest/api-reference/endpoint/api-keys/delete.mdxdiff --git a/docs/0.0.6/api-reference/endpoint/api-keys/get.mdx b/docs/latest/api-reference/endpoint/api-keys/get.mdxsimilarity index 100%rename from docs/0.0.6/api-reference/endpoint/api-keys/get.mdxrename to docs/latest/api-reference/endpoint/api-keys/get.mdxdiff --git a/docs/0.0.6/api-reference/endpoint/connections/create.mdx b/docs/latest/api-reference/endpoint/connections/create.mdxsimilarity index 100%rename from docs/0.0.6/api-reference/endpoint/connections/create.mdxrename to docs/latest/api-reference/endpoint/connections/create.mdxdiff --git a/docs/0.0.6/api-reference/endpoint/connections/delete.mdx b/docs/latest/api-reference/endpoint/connections/delete.mdxsimilarity index 100%rename from docs/0.0.6/api-reference/endpoint/connections/delete.mdxrename to docs/latest/api-reference/endpoint/connections/delete.mdxdiff --git a/docs/latest/api-reference/introduction.mdx b/docs/latest/api-reference/introduction.mdxnew file mode 100644index 00000000..278fdf41--- /dev/null+++ b/docs/latest/api-reference/introduction.mdx@@ -0,0 +1,32 @@+---+title: 'Introduction'+description: 'OpenAPI specification for API Endpoints in Doku'+---+<CardGroup cols={2}>+ <Card+ title="API Keys"+ icon="key"+ href="/latest/api-reference/endpoint/api-keys/create"+ >+ </Card>+ <Card+ title="Connections API"+ icon="link"+ href="/latest/api-reference/endpoint/connections/create"+ >+ </Card>+</CardGroup>++## Authentication++All API endpoints are authenticated using Authetication Header.++```json+Authorization: <api-key>+```++<Info>+For your initial API call to `/api/keys` endpoint, Authorization header can be set to "".++Store the provided API key securely; it will be required to pass the generated and a valid API Key in Authorization header for subsequent API calls.+</Info>\ No newline at end of filediff --git a/docs/0.0.5/api-reference/openiapi.yml b/docs/latest/api-reference/openiapi.ymlsimilarity index 84%rename from docs/0.0.5/api-reference/openiapi.ymlrename to docs/latest/api-reference/openiapi.ymlindex de79baca..3247711f 100644--- a/docs/0.0.5/api-reference/openiapi.yml+++ b/docs/latest/api-reference/openiapi.yml@@ -104,27 +104,6 @@ paths:application/json:schema:$ref: '#/components/schemas/json201Response'- /api/data/retention:- post:- summary: Set data retention- operationId: setDataRetention- tags:- - Data Retention- security:- - ApiKeyAuth: []- requestBody:- required: true- content:- application/json:- schema:- $ref: '#/components/schemas/RetentionRequest'- responses:- '201':- description: Data retention set- content:- application/json:- schema:- $ref: '#/components/schemas/json201Response'components:schemas:@@ -136,14 +115,6 @@ components:name:type: stringdescription: Name of the API key to be created or deleted. Example - `BIGDADDY`- RetentionRequest:- type: object- required:- - RetentionPeriod- properties:- RetentionPeriod:- type: string- description: Retention period for storing the data. Should be in the format of `<int> days`. Example - `180 days`ConnectionRequest:type: objectrequired:diff --git a/docs/latest/configuration.mdx b/docs/latest/configuration.mdxnew file mode 100644index 00000000..288429e7--- /dev/null+++ b/docs/latest/configuration.mdx@@ -0,0 +1,203 @@+---+title: 'Configuration'+description: 'Configuring Options for Doku'+icon: 'sliders'+---++This guide covers all the available environment variables to fine-tune Doku according to your needs.++## Doku Client++### Environment Varibales++<ResponseField name="INIT_DB_HOST" required>+ Sets the password for the user authenticating with ClickHouse.++ **Example**:+ ```yaml+ export INIT_DB_HOST=127.0.0.1+ ```+</ResponseField>++<ResponseField name="INIT_DB_PORT" required>+ Sets the password for the user authenticating with ClickHouse.++ **Example**:+ ```yaml+ export INIT_DB_PORT=8123+ ```+</ResponseField>++<ResponseField name="INIT_DB_DATABASE" required>+ Name of the database in Clickhouse to be used by Doku++ **Example**:+ ```yaml+ export INIT_DB_DATABASE=default+ ```+</ResponseField>++<ResponseField name="INIT_DB_USERNAME" required>+ Sets the username for authenticating with ClickHouse.++ **Example**:+ ```yaml+ export INIT_DB_USERNAME=default+ ```+</ResponseField>++<ResponseField name="INIT_DB_PASSWORD" required>+ Sets the password for authenticating with ClickHouse.++ **Example**:+ ```yaml+ export INIT_DB_PASSWORD=default+ ```+</ResponseField>++<ResponseField name="SQLITE_DATABASE_URL" required>+ Specifies the location where SQLITE data is stored.++ **Example**:+ ```yaml+ export SQLITE_DATABASE_URL=file:/app/client/data/data.db+ ```+</ResponseField>++### Sample Environment File (.env)++```.env.example .env+INIT_DB_HOST: 127.0.0.1+INIT_DB_PORT: 8123+INIT_DB_DATABASE: default+INIT_DB_USERNAME: default+INIT_DB_PASSWORD: DOKU+SQLITE_DATABASE_URL: file:/app/client/data/data.db+```++## Doku Ingester++### Environment Varibales++<ResponseField name="DOKU_DB_HOST" required>+ Specifies the host address of the ClickHouse server for Doku to connect to.++ **Example**:+ ```yaml+ export DOKU_DB_HOST=127.0.0.1+ ```+</ResponseField>++<ResponseField name="DOKU_DB_PORT" required>+ Defines the port on which ClickHouse listens.++ **Example**:+ ```yaml+ export DOKU_DB_PORT=9000+ ```+</ResponseField>++<ResponseField name="DOKU_DB_NAME" required>+ Name of the database in Clickhouse to be used by Doku++ **Example**:+ ```yaml+ export DOKU_DB_NAME=default+ ```+</ResponseField>++<ResponseField name="DOKU_DB_USER" required>+ Sets the username for authenticating with ClickHouse.++ **Example**:+ ```yaml+ export DOKU_DB_USER=default+ ```+</ResponseField>++<ResponseField name="DOKU_DB_PASSWORD" required>+ Sets the password for authenticating with ClickHouse.++ **Example**:+ ```yaml+ export DOKU_DB_PASSWORD=DOKU+ ```+</ResponseField>++<ResponseField name="DOKU_PRICING_JSON_URL">+ URL of the json file containing the LLM Pricing data.++**Default Value**:+```shell+https://raw.githubusercontent.com/dokulabs/ingester/main/assets/pricing.json+```++**Example**:+```yaml+export DOKU_PRICING_JSON_URL=https://raw.githubusercontent.com/dokulabs/ingester/main/assets/pricing.json+ ```+</ResponseField>++<ResponseField name="DOKU_DB_MAX_IDLE_CONNS">+ Maximum number of concurrent idle database connections.++**Default Value**:+```shell+10+```++**Example**:+```shell+export DOKU_DB_MAX_IDLE_CONNS=10+```+</ResponseField>++<ResponseField name="DOKU_DB_MAX_OPEN_CONNS">+ Maximum number of concurrent open database connections.++**Default Value**:+```shell+20+```++**Example**:+```shell+export DOKU_DB_MAX_OPEN_CONNS=20+```+</ResponseField>++<ResponseField name="DOKU_DB_RETENTION_PERIOD">+ The `DOKU_DB_RETENTION_PERIOD` specifies the TTL for data in Clickhouse.++**Default Value**:+```shell+6 MONTH+```++**Example**:+```shell+export DOKU_DB_RETENTION_PERIOD="6 MONTH"+```+</ResponseField>+++### Sample Environment File (.env)++```.env.example .env+DOKU_DB_HOST="127.0.0.1"+DOKU_DB_PORT="9000"+DOKU_DB_NAME="default"+DOKU_DB_USER="default"+DOKU_DB_PASSWORD="DOKU"+```++---++<CardGroup cols={2}>+<Card title="Integrations" href="/latest/integrations/introduction" icon='circle-nodes'>+Integrate your LLM Provider with Doku+</Card>+<Card title="Connections" href="/latest/connections/intro" icon='link'>+Connect to your existing Observablity Platform+</Card>+</CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/connections/datadog.mdx b/docs/latest/connections/datadog.mdxsimilarity index 99%rename from docs/0.0.5/connections/datadog.mdxrename to docs/latest/connections/datadog.mdxindex 8c24c2ee..b8120776 100644--- a/docs/0.0.5/connections/datadog.mdx+++ b/docs/latest/connections/datadog.mdx@@ -10,11 +10,11 @@ description: 'Connect Doku to DataDog'Doku can automatically send LLM usage data from Doku to DataDog using the [Submit Metrics API](https://docs.datadoghq.com/api/latest/metrics/#submit-metrics) and [Send Logs API](https://docs.datadoghq.com/api/latest/logs/#send-logs)-Make the following curl request to Doku to add a connection for DataDog. See more on the [Connections API](/0.0.5/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for DataDog. See more on the [Connections API](/latest/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.6/connections/dynatrace.mdx b/docs/latest/connections/dynatrace.mdxsimilarity index 99%rename from docs/0.0.6/connections/dynatrace.mdxrename to docs/latest/connections/dynatrace.mdxindex 1c04b557..3ac80cef 100644--- a/docs/0.0.6/connections/dynatrace.mdx+++ b/docs/latest/connections/dynatrace.mdx@@ -11,11 +11,11 @@ description: 'Connect Doku to Dynatrace'Doku can automatically send LLM usage data from Doku to Dynatrace using the [Ingest Metrics API](https://docs.dynatrace.com/docs/dynatrace-api/environment-api/metric-v2/post-ingest-metrics) and [Ingest Logs API](https://docs.dynatrace.com/docs/dynatrace-api/environment-api/log-monitoring-v2/post-ingest-logs)-Make the following curl request to Doku to add a connection for Dynatrace. See more on the [Connections API](/0.0.6/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for Dynatrace. See more on the [Connections API](/latest/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.6/connections/grafanacloud.mdx b/docs/latest/connections/grafanacloud.mdxsimilarity index 99%rename from docs/0.0.6/connections/grafanacloud.mdxrename to docs/latest/connections/grafanacloud.mdxindex ac921511..1355c402 100644--- a/docs/0.0.6/connections/grafanacloud.mdx+++ b/docs/latest/connections/grafanacloud.mdx@@ -10,11 +10,11 @@ description: 'Connect Doku to Grafana Cloud'Doku can automatically send LLM usage data from Doku to Grafana Cloud using the [Grafana Cloud Influx Telegraf](https://grafana.com/docs/grafana-cloud/send-data/metrics/metrics-influxdb/push-from-telegraf/) and [Loki Push HTTP API](https://grafana.com/docs/loki/latest/reference/api/#push-log-entries-to-loki)-Make the following curl request to Doku to add a connection for Grafana Cloud. See more on the [Connections API](/0.0.6/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for Grafana Cloud. See more on the [Connections API](/latest/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.6/connections/grafanaoss.mdx b/docs/latest/connections/grafanaoss.mdxsimilarity index 100%rename from docs/0.0.6/connections/grafanaoss.mdxrename to docs/latest/connections/grafanaoss.mdxdiff --git a/docs/latest/connections/intro.mdx b/docs/latest/connections/intro.mdxnew file mode 100644index 00000000..24510b87--- /dev/null+++ b/docs/latest/connections/intro.mdx@@ -0,0 +1,33 @@+---+title: 'Introduction'+description: 'Connect to your existing Observablity Platform'+---+Doku enhances observability by seamlessly exporting processed LLM data to your observability platform. This assists developers in bringing together all application-related data, including LLM usage metrics, on a unified platform, simplifying the visualization and assessment of the entire application ecosystem.++Below is a list of observability platforms that work seamlessly with Doku:++<CardGroup cols={2}>+ <Card title="Grafana OSS" href="/latest/connections/grafanaoss" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grafana</title><path d="M23.02 10.59a8.578 8.578 0 0 0-.862-3.034 8.911 8.911 0 0 0-1.789-2.445c.337-1.342-.413-2.505-.413-2.505-1.292-.08-2.113.4-2.416.62-.052-.02-.102-.044-.154-.064-.22-.089-.446-.172-.677-.247-.231-.073-.47-.14-.711-.197a9.867 9.867 0 0 0-.875-.161C14.557.753 12.94 0 12.94 0c-1.804 1.145-2.147 2.744-2.147 2.744l-.018.093c-.098.029-.2.057-.298.088-.138.042-.275.094-.413.143-.138.055-.275.107-.41.166a8.869 8.869 0 0 0-1.557.87l-.063-.029c-2.497-.955-4.716.195-4.716.195-.203 2.658.996 4.33 1.235 4.636a11.608 11.608 0 0 0-.607 2.635C1.636 12.677.953 15.014.953 15.014c1.926 2.214 4.171 2.351 4.171 2.351.003-.002.006-.002.006-.005.285.509.615.994.986 1.446.156.19.32.371.488.548-.704 2.009.099 3.68.099 3.68 2.144.08 3.553-.937 3.849-1.173a9.784 9.784 0 0 0 3.164.501h.08l.055-.003.107-.002.103-.005.003.002c1.01 1.44 2.788 1.646 2.788 1.646 1.264-1.332 1.337-2.653 1.337-2.94v-.058c0-.02-.003-.039-.003-.06.265-.187.52-.387.758-.6a7.875 7.875 0 0 0 1.415-1.7c1.43.083 2.437-.885 2.437-.885-.236-1.49-1.085-2.216-1.264-2.354l-.018-.013-.016-.013a.217.217 0 0 1-.031-.02c.008-.092.016-.18.02-.27.011-.162.016-.323.016-.48v-.253l-.005-.098-.008-.135a1.891 1.891 0 0 0-.01-.13c-.003-.042-.008-.083-.013-.125l-.016-.124-.018-.122a6.215 6.215 0 0 0-2.032-3.73 6.015 6.015 0 0 0-3.222-1.46 6.292 6.292 0 0 0-.85-.048l-.107.002h-.063l-.044.003-.104.008a4.777 4.777 0 0 0-3.335 1.695c-.332.4-.592.84-.768 1.297a4.594 4.594 0 0 0-.312 1.817l.003.091c.005.055.007.11.013.164a3.615 3.615 0 0 0 .698 1.82 3.53 3.53 0 0 0 1.827 1.282c.33.098.66.14.971.137.039 0 .078 0 .114-.002l.063-.003c.02 0 .041-.003.062-.003.034-.002.065-.007.099-.01.007 0 .018-.003.028-.003l.031-.005.06-.008a1.18 1.18 0 0 0 .112-.02c.036-.008.072-.013.109-.024a2.634 2.634 0 0 0 .914-.415c.028-.02.056-.041.085-.065a.248.248 0 0 0 .039-.35.244.244 0 0 0-.309-.06l-.078.042c-.09.044-.184.083-.283.116a2.476 2.476 0 0 1-.475.096c-.028.003-.054.006-.083.006l-.083.002c-.026 0-.054 0-.08-.002l-.102-.006h-.012l-.024.006c-.016-.003-.031-.003-.044-.006-.031-.002-.06-.007-.091-.01a2.59 2.59 0 0 1-.724-.213 2.557 2.557 0 0 1-.667-.438 2.52 2.52 0 0 1-.805-1.475 2.306 2.306 0 0 1-.029-.444l.006-.122v-.023l.002-.031c.003-.021.003-.04.005-.06a3.163 3.163 0 0 1 1.352-2.29 3.12 3.12 0 0 1 .937-.43 2.946 2.946 0 0 1 .776-.101h.06l.07.002.045.003h.026l.07.005a4.041 4.041 0 0 1 1.635.49 3.94 3.94 0 0 1 1.602 1.662 3.77 3.77 0 0 1 .397 1.414l.005.076.003.075c.002.026.002.05.002.075 0 .024.003.052 0 .07v.065l-.002.073-.008.174a6.195 6.195 0 0 1-.08.639 5.1 5.1 0 0 1-.267.927 5.31 5.31 0 0 1-.624 1.13 5.052 5.052 0 0 1-3.237 2.014 4.82 4.82 0 0 1-.649.066l-.039.003h-.287a6.607 6.607 0 0 1-1.716-.265 6.776 6.776 0 0 1-3.4-2.274 6.75 6.75 0 0 1-.746-1.15 6.616 6.616 0 0 1-.714-2.596l-.005-.083-.002-.02v-.056l-.003-.073v-.096l-.003-.104v-.07l.003-.163c.008-.22.026-.45.054-.678a8.707 8.707 0 0 1 .28-1.355c.128-.444.286-.872.473-1.277a7.04 7.04 0 0 1 1.456-2.1 5.925 5.925 0 0 1 .953-.763c.169-.111.343-.213.524-.306.089-.05.182-.091.273-.135.047-.02.093-.042.138-.062a7.177 7.177 0 0 1 .714-.267l.145-.045c.049-.015.098-.026.148-.041.098-.029.197-.052.296-.076.049-.013.1-.02.15-.033l.15-.032.151-.028.076-.013.075-.01.153-.024c.057-.01.114-.013.171-.023l.169-.021c.036-.003.073-.008.106-.01l.073-.008.036-.003.042-.002c.057-.003.114-.008.171-.01l.086-.006h.023l.037-.003.145-.007a7.999 7.999 0 0 1 1.708.125 7.917 7.917 0 0 1 2.048.68 8.253 8.253 0 0 1 1.672 1.09l.09.077.089.078c.06.052.114.107.171.159.057.052.112.106.166.16.052.055.107.107.159.164a8.671 8.671 0 0 1 1.41 1.978c.012.026.028.052.04.078l.04.078.075.156c.023.051.05.1.07.153l.065.15a8.848 8.848 0 0 1 .45 1.34.19.19 0 0 0 .201.142.186.186 0 0 0 .172-.184c.01-.246.002-.532-.024-.856z"/></svg>}>+ </Card>+ <Card title="Grafana Cloud" href="/latest/connections/grafanacloud" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Grafana</title><path d="M23.02 10.59a8.578 8.578 0 0 0-.862-3.034 8.911 8.911 0 0 0-1.789-2.445c.337-1.342-.413-2.505-.413-2.505-1.292-.08-2.113.4-2.416.62-.052-.02-.102-.044-.154-.064-.22-.089-.446-.172-.677-.247-.231-.073-.47-.14-.711-.197a9.867 9.867 0 0 0-.875-.161C14.557.753 12.94 0 12.94 0c-1.804 1.145-2.147 2.744-2.147 2.744l-.018.093c-.098.029-.2.057-.298.088-.138.042-.275.094-.413.143-.138.055-.275.107-.41.166a8.869 8.869 0 0 0-1.557.87l-.063-.029c-2.497-.955-4.716.195-4.716.195-.203 2.658.996 4.33 1.235 4.636a11.608 11.608 0 0 0-.607 2.635C1.636 12.677.953 15.014.953 15.014c1.926 2.214 4.171 2.351 4.171 2.351.003-.002.006-.002.006-.005.285.509.615.994.986 1.446.156.19.32.371.488.548-.704 2.009.099 3.68.099 3.68 2.144.08 3.553-.937 3.849-1.173a9.784 9.784 0 0 0 3.164.501h.08l.055-.003.107-.002.103-.005.003.002c1.01 1.44 2.788 1.646 2.788 1.646 1.264-1.332 1.337-2.653 1.337-2.94v-.058c0-.02-.003-.039-.003-.06.265-.187.52-.387.758-.6a7.875 7.875 0 0 0 1.415-1.7c1.43.083 2.437-.885 2.437-.885-.236-1.49-1.085-2.216-1.264-2.354l-.018-.013-.016-.013a.217.217 0 0 1-.031-.02c.008-.092.016-.18.02-.27.011-.162.016-.323.016-.48v-.253l-.005-.098-.008-.135a1.891 1.891 0 0 0-.01-.13c-.003-.042-.008-.083-.013-.125l-.016-.124-.018-.122a6.215 6.215 0 0 0-2.032-3.73 6.015 6.015 0 0 0-3.222-1.46 6.292 6.292 0 0 0-.85-.048l-.107.002h-.063l-.044.003-.104.008a4.777 4.777 0 0 0-3.335 1.695c-.332.4-.592.84-.768 1.297a4.594 4.594 0 0 0-.312 1.817l.003.091c.005.055.007.11.013.164a3.615 3.615 0 0 0 .698 1.82 3.53 3.53 0 0 0 1.827 1.282c.33.098.66.14.971.137.039 0 .078 0 .114-.002l.063-.003c.02 0 .041-.003.062-.003.034-.002.065-.007.099-.01.007 0 .018-.003.028-.003l.031-.005.06-.008a1.18 1.18 0 0 0 .112-.02c.036-.008.072-.013.109-.024a2.634 2.634 0 0 0 .914-.415c.028-.02.056-.041.085-.065a.248.248 0 0 0 .039-.35.244.244 0 0 0-.309-.06l-.078.042c-.09.044-.184.083-.283.116a2.476 2.476 0 0 1-.475.096c-.028.003-.054.006-.083.006l-.083.002c-.026 0-.054 0-.08-.002l-.102-.006h-.012l-.024.006c-.016-.003-.031-.003-.044-.006-.031-.002-.06-.007-.091-.01a2.59 2.59 0 0 1-.724-.213 2.557 2.557 0 0 1-.667-.438 2.52 2.52 0 0 1-.805-1.475 2.306 2.306 0 0 1-.029-.444l.006-.122v-.023l.002-.031c.003-.021.003-.04.005-.06a3.163 3.163 0 0 1 1.352-2.29 3.12 3.12 0 0 1 .937-.43 2.946 2.946 0 0 1 .776-.101h.06l.07.002.045.003h.026l.07.005a4.041 4.041 0 0 1 1.635.49 3.94 3.94 0 0 1 1.602 1.662 3.77 3.77 0 0 1 .397 1.414l.005.076.003.075c.002.026.002.05.002.075 0 .024.003.052 0 .07v.065l-.002.073-.008.174a6.195 6.195 0 0 1-.08.639 5.1 5.1 0 0 1-.267.927 5.31 5.31 0 0 1-.624 1.13 5.052 5.052 0 0 1-3.237 2.014 4.82 4.82 0 0 1-.649.066l-.039.003h-.287a6.607 6.607 0 0 1-1.716-.265 6.776 6.776 0 0 1-3.4-2.274 6.75 6.75 0 0 1-.746-1.15 6.616 6.616 0 0 1-.714-2.596l-.005-.083-.002-.02v-.056l-.003-.073v-.096l-.003-.104v-.07l.003-.163c.008-.22.026-.45.054-.678a8.707 8.707 0 0 1 .28-1.355c.128-.444.286-.872.473-1.277a7.04 7.04 0 0 1 1.456-2.1 5.925 5.925 0 0 1 .953-.763c.169-.111.343-.213.524-.306.089-.05.182-.091.273-.135.047-.02.093-.042.138-.062a7.177 7.177 0 0 1 .714-.267l.145-.045c.049-.015.098-.026.148-.041.098-.029.197-.052.296-.076.049-.013.1-.02.15-.033l.15-.032.151-.028.076-.013.075-.01.153-.024c.057-.01.114-.013.171-.023l.169-.021c.036-.003.073-.008.106-.01l.073-.008.036-.003.042-.002c.057-.003.114-.008.171-.01l.086-.006h.023l.037-.003.145-.007a7.999 7.999 0 0 1 1.708.125 7.917 7.917 0 0 1 2.048.68 8.253 8.253 0 0 1 1.672 1.09l.09.077.089.078c.06.052.114.107.171.159.057.052.112.106.166.16.052.055.107.107.159.164a8.671 8.671 0 0 1 1.41 1.978c.012.026.028.052.04.078l.04.078.075.156c.023.051.05.1.07.153l.065.15a8.848 8.848 0 0 1 .45 1.34.19.19 0 0 0 .201.142.186.186 0 0 0 .172-.184c.01-.246.002-.532-.024-.856z"/></svg>}>+ </Card>+ <Card title="DataDog" href="/latest/connections/datadog" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Datadog</title><path d="M19.57 17.04l-1.997-1.316-1.665 2.782-1.937-.567-1.706 2.604.087.82 9.274-1.71-.538-5.794zm-8.649-2.498l1.488-.204c.241.108.409.15.697.223.45.117.97.23 1.741-.16.18-.088.553-.43.704-.625l6.096-1.106.622 7.527-10.444 1.882zm11.325-2.712l-.602.115L20.488 0 .789 2.285l2.427 19.693 2.306-.334c-.184-.263-.471-.581-.96-.989-.68-.564-.44-1.522-.039-2.127.53-1.022 3.26-2.322 3.106-3.956-.056-.594-.15-1.368-.702-1.898-.02.22.017.432.017.432s-.227-.289-.34-.683c-.112-.15-.2-.199-.319-.4-.085.233-.073.503-.073.503s-.186-.437-.216-.807c-.11.166-.137.48-.137.48s-.241-.69-.186-1.062c-.11-.323-.436-.965-.343-2.424.6.421 1.924.321 2.44-.439.171-.251.288-.939-.086-2.293-.24-.868-.835-2.16-1.066-2.651l-.028.02c.122.395.374 1.223.47 1.625.293 1.218.372 1.642.234 2.204-.116.488-.397.808-1.107 1.165-.71.358-1.653-.514-1.713-.562-.69-.55-1.224-1.447-1.284-1.883-.062-.477.275-.763.445-1.153-.243.07-.514.192-.514.192s.323-.334.722-.624c.165-.109.262-.178.436-.323a9.762 9.762 0 0 0-.456.003s.42-.227.855-.392c-.318-.014-.623-.003-.623-.003s.937-.419 1.678-.727c.509-.208 1.006-.147 1.286.257.367.53.752.817 1.569.996.501-.223.653-.337 1.284-.509.554-.61.99-.688.99-.688s-.216.198-.274.51c.314-.249.66-.455.66-.455s-.134.164-.259.426l.03.043c.366-.22.797-.394.797-.394s-.123.156-.268.358c.277-.002.838.012 1.056.037 1.285.028 1.552-1.374 2.045-1.55.618-.22.894-.353 1.947.68.903.888 1.609 2.477 1.259 2.833-.294.295-.874-.115-1.516-.916a3.466 3.466 0 0 1-.716-1.562 1.533 1.533 0 0 0-.497-.85s.23.51.23.96c0 .246.03 1.165.424 1.68-.039.076-.057.374-.1.43-.458-.554-1.443-.95-1.604-1.067.544.445 1.793 1.468 2.273 2.449.453.927.186 1.777.416 1.997.065.063.976 1.197 1.15 1.767.306.994.019 2.038-.381 2.685l-1.117.174c-.163-.045-.273-.068-.42-.153.08-.143.241-.5.243-.572l-.063-.111c-.348.492-.93.97-1.414 1.245-.633.359-1.363.304-1.838.156-1.348-.415-2.623-1.327-2.93-1.566 0 0-.01.191.048.234.34.383 1.119 1.077 1.872 1.56l-1.605.177.759 5.908c-.337.048-.39.071-.757.124-.325-1.147-.946-1.895-1.624-2.332-.599-.384-1.424-.47-2.214-.314l-.05.059a2.851 2.851 0 0 1 1.863.444c.654.413 1.181 1.481 1.375 2.124.248.822.42 1.7-.248 2.632-.476.662-1.864 1.028-2.986.237.3.481.705.876 1.25.95.809.11 1.577-.03 2.106-.574.452-.464.69-1.434.628-2.456l.714-.104.258 1.834 11.827-1.424zM15.05 6.848c-.034.075-.085.125-.007.37l.004.014.013.032.032.073c.14.287.295.558.552.696.067-.011.136-.019.207-.023.242-.01.395.028.492.08.009-.048.01-.119.005-.222-.018-.364.072-.982-.626-1.308-.264-.122-.634-.084-.757.068a.302.302 0 0 1 .058.013c.186.066.06.13.027.207m1.958 3.392c-.092-.05-.52-.03-.821.005-.574.068-1.193.267-1.328.372-.247.191-.135.523.047.66.511.382.96.638 1.432.575.29-.038.546-.497.728-.914.124-.288.124-.598-.058-.698m-5.077-2.942c.162-.154-.805-.355-1.556.156-.554.378-.571 1.187-.041 1.646.053.046.096.078.137.104a4.77 4.77 0 0 1 1.396-.412c.113-.125.243-.345.21-.745-.044-.542-.455-.456-.146-.749"/></svg>}>+ </Card>+ <Card title="New Relic" href="/latest/connections/new-relic" icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>New Relic</title><path d="M8.0015 14.3091v7.384L12.0008 24V12.0008L1.6078 5.9996v4.6167ZM12.0008 0 2.8232 5.2976 6.8209 7.606l5.1799-2.9893 6.3936 3.6913v7.384l-5.1783 2.9908v4.6167l9.176-5.2991V5.9996Z"/></svg>}>+ </Card>+ <Card title="SigNoz" href="/latest/connections/signoz" icon={<svg role="img" viewBox="0 0 200 200" xmlns="http://www.w3.org/2000/svg"><title>SigNoz</title><path opacity="0.1" d="M100.279 199.833C44.5682 199.833 0 156.12 0 101.479C0 47.3844 44.5682 3.125 100.279 3.125H163.231C183.844 3.125 200 19.5174 200 39.1882V101.479C200 156.12 155.432 199.833 100.279 199.833Z"/><path d="M99.4919 58.9008C57.8802 58.9008 34.4413 93.3585 33.4637 94.8253C31.0537 98.4385 31.0537 103.111 33.4655 106.727C34.4413 108.191 57.8802 142.649 99.4919 142.649C141.103 142.649 164.543 108.191 165.52 106.724C167.93 103.111 167.93 98.4385 165.518 94.8227C164.542 93.3585 141.103 58.9008 99.4919 58.9008ZM39.2234 102.886C38.3677 101.604 38.3677 99.9463 39.2234 98.6633C40.0095 97.4834 56.6976 72.9705 86.5341 67.0904C73.0136 72.3095 63.393 85.4356 63.393 100.775C63.393 116.114 73.0136 129.24 86.5341 134.459C56.6976 128.579 40.0095 104.066 39.2234 102.886ZM82.8568 100.775C82.8568 102.686 81.3074 104.235 79.396 104.235C77.4845 104.235 75.9352 102.686 75.9352 100.775C75.9352 87.7858 86.5024 77.2185 99.4916 77.2185C101.403 77.2185 102.952 78.7676 102.952 80.6792C102.952 82.5908 101.403 84.1398 99.4916 84.1398C90.3189 84.1398 82.8568 91.6019 82.8568 100.775ZM99.4919 109.188C94.8525 109.188 91.0783 105.414 91.0783 100.775C91.0783 96.1356 94.8525 92.3612 99.4919 92.3612C104.132 92.3612 107.906 96.1354 107.906 100.775C107.906 105.414 104.132 109.188 99.4919 109.188ZM159.76 102.886C158.974 104.066 142.286 128.579 112.45 134.459C125.971 129.24 135.591 116.114 135.591 100.775C135.591 85.4358 125.971 72.3096 112.45 67.0905C142.286 72.971 158.974 97.4837 159.76 98.6634C160.616 99.9463 160.616 101.604 159.76 102.886Z"/></svg>}>+ </Card>+ <Card title="Dynatrace" href="/latest/connections/dynatrace" icon={<svg viewBox="0 0 24 24" role="img" xmlns="http://www.w3.org/2000/svg"><title>Dynatrace icon</title><path d="M9.373 0c-.31.006-.93.09-1.521.654C6.98 1.478 2.628 5.61.88 7.27.09 8.024.16 8.865.16 8.934v.377c.067-.292.187-.499.427-.825.496-.616 1.3-.788 1.627-.822a64.233 64.233 0 0 1 .002 0 64.233 64.233 0 0 1 6.527-.549c4.335-.137 7.197.225 7.197.225l6.084-5.793s-3.188-.6-6.82-1.027A93.394 93.394 0 0 0 9.566.006c-.021 0-.09-.008-.193-.006zm13.56 2.508l-6.066 5.79s.222 2.88-.137 7.198c-.189 2.45-.584 4.866-.875 6.494-.052.326-.256 1.114-.925 1.594-.29.198-.491.295-.748.363 1.546-.51 1.091-7.047 1.091-7.047-4.335.137-7.214-.222-7.214-.222L1.975 22.47s3.222.634 6.855 1.045c2.056.24 4.833.429 5.227.463.023 0 .045-.007.068-.012-.013.003-.022.009-.035.012.138 0 .259.015.379.015.085 0 .925.105 1.713-.648 1.748-1.663 6.083-5.81 6.94-6.633.788-.754.72-1.594.72-1.68a81.84 81.84 0 0 0-.207-5.654c-.24-3.65-.701-6.871-.701-6.871zM3.856 8.305C2.125 8.307.348 8.513.16 9.326c.017 1.216.05 3.137.205 5.28.24 3.65.703 6.886.703 6.886l6.082-5.79c-.017.017-.239-2.88.121-7.198H7.27s-1.684-.202-3.415-.2z"/></svg>}>+ </Card>+</CardGroup>++---++<CardGroup cols={2}>+<Card title="Integrations" href="/latest/integrations/introduction" icon='circle-nodes'>+Integrate your LLM Provider with Doku+</Card>+<Card title="API Refernce" href="/latest/api-reference/introduction" icon='code'>+OpenAPI specification for API Endpoints in Doku+</Card>+</CardGroup>\ No newline at end of filediff --git a/docs/0.0.6/connections/new-relic.mdx b/docs/latest/connections/new-relic.mdxsimilarity index 99%rename from docs/0.0.6/connections/new-relic.mdxrename to docs/latest/connections/new-relic.mdxindex 33cdf970..b531f378 100644--- a/docs/0.0.6/connections/new-relic.mdx+++ b/docs/latest/connections/new-relic.mdx@@ -11,11 +11,11 @@ description: 'Connect Doku to New Relic'Doku can automatically send LLM usage data from Doku to New Relic using the [Report Metrics HTTP API](https://docs.newrelic.com/docs/data-apis/ingest-apis/metric-api/report-metrics-metric-api/) and [Send Logs API](https://docs.newrelic.com/docs/logs/log-api/introduction-log-api/)-Make the following curl request to Doku to add a connection for New Relic. See more on the [Connections API](/0.0.6/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for New Relic. See more on the [Connections API](/latest/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.6/connections/signoz.mdx b/docs/latest/connections/signoz.mdxsimilarity index 99%rename from docs/0.0.6/connections/signoz.mdxrename to docs/latest/connections/signoz.mdxindex 3ad27a62..e991535b 100644--- a/docs/0.0.6/connections/signoz.mdx+++ b/docs/latest/connections/signoz.mdx@@ -10,11 +10,11 @@ description: 'Connect Doku to SigNoz'Doku can automatically send LLM usage data from Doku to SigNoz using the [HTTP Logs API](https://signoz.io/docs/userguide/send-logs-http/)-Make the following curl request to Doku to add a connection for SigNoz. See more on the [Connections API](/0.0.6/api-reference/endpoint/connections/create)+Make the following curl request to Doku to add a connection for SigNoz. See more on the [Connections API](/latest/api-reference/endpoint/connections/create)```shellcurl --request POST \- --url https://<YOUR_DOKU_URL>/api/connections \+ --url https://<YOUR_DOKU_INGESTER_URL>/api/connections \--header 'Authorization: <DOKU_API_KEY>' \--header 'Content-Type: application/json' \--data '{diff --git a/docs/0.0.5/installation.mdx b/docs/latest/installation.mdxsimilarity index 72%rename from docs/0.0.5/installation.mdxrename to docs/latest/installation.mdxindex 178d93fb..a072ec88 100644--- a/docs/0.0.5/installation.mdx+++ b/docs/latest/installation.mdx@@ -1,10 +1,10 @@----title: 'Installing Doku'+title: 'Install Doku'description: 'Deploy Doku in your preferred environment'icon: 'circle-down'----Doku flexibly adapts to your preferred environment. Select a deployment method that best fits your setup:+Doku flexibly adapts to your preferred environment. Select a deployment method that best fits your needs:<CardGroup cols={2}><Card@@ -12,16 +12,16 @@ Doku flexibly adapts to your preferred environment. Select a deployment method ticon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>Kubernetes</title><path fill="#FFA500" d="M10.204 14.35l.007.01-.999 2.413a5.171 5.171 0 0 1-2.075-2.597l2.578-.437.004.005a.44.44 0 0 1 .484.606zm-.833-2.129a.44.44 0 0 0 .173-.756l.002-.011L7.585 9.7a5.143 5.143 0 0 0-.73 3.255l2.514-.725.002-.009zm1.145-1.98a.44.44 0 0 0 .699-.337l.01-.005.15-2.62a5.144 5.144 0 0 0-3.01 1.442l2.147 1.523.004-.002zm.76 2.75l.723.349.722-.347.18-.78-.5-.623h-.804l-.5.623.179.779zm1.5-3.095a.44.44 0 0 0 .7.336l.008.003 2.134-1.513a5.188 5.188 0 0 0-2.992-1.442l.148 2.615.002.001zm10.876 5.97l-5.773 7.181a1.6 1.6 0 0 1-1.248.594l-9.261.003a1.6 1.6 0 0 1-1.247-.596l-5.776-7.18a1.583 1.583 0 0 1-.307-1.34L2.1 5.573c.108-.47.425-.864.863-1.073L11.305.513a1.606 1.606 0 0 1 1.385 0l8.345 3.985c.438.209.755.604.863 1.073l2.062 8.955c.108.47-.005.963-.308 1.34zm-3.289-2.057c-.042-.01-.103-.026-.145-.034-.174-.033-.315-.025-.479-.038-.35-.037-.638-.067-.895-.148-.105-.04-.18-.165-.216-.216l-.201-.059a6.45 6.45 0 0 0-.105-2.332 6.465 6.465 0 0 0-.936-2.163c.052-.047.15-.133.177-.159.008-.09.001-.183.094-.282.197-.185.444-.338.743-.522.142-.084.273-.137.415-.242.032-.024.076-.062.11-.089.24-.191.295-.52.123-.736-.172-.216-.506-.236-.745-.045-.034.027-.08.062-.111.088-.134.116-.217.23-.33.35-.246.25-.45.458-.673.609-.097.056-.239.037-.303.033l-.19.135a6.545 6.545 0 0 0-4.146-2.003l-.012-.223c-.065-.062-.143-.115-.163-.25-.022-.268.015-.557.057-.905.023-.163.061-.298.068-.475.001-.04-.001-.099-.001-.142 0-.306-.224-.555-.5-.555-.275 0-.499.249-.499.555l.001.014c0 .041-.002.092 0 .128.006.177.044.312.067.475.042.348.078.637.056.906a.545.545 0 0 1-.162.258l-.012.211a6.424 6.424 0 0 0-4.166 2.003 8.373 8.373 0 0 1-.18-.128c-.09.012-.18.04-.297-.029-.223-.15-.427-.358-.673-.608-.113-.12-.195-.234-.329-.349-.03-.026-.077-.062-.111-.088a.594.594 0 0 0-.348-.132.481.481 0 0 0-.398.176c-.172.216-.117.546.123.737l.007.005.104.083c.142.105.272.159.414.242.299.185.546.338.743.522.076.082.09.226.1.288l.16.143a6.462 6.462 0 0 0-1.02 4.506l-.208.06c-.055.072-.133.184-.215.217-.257.081-.546.11-.895.147-.164.014-.305.006-.48.039-.037.007-.09.02-.133.03l-.004.002-.007.002c-.295.071-.484.342-.423.608.061.267.349.429.645.365l.007-.001.01-.003.129-.029c.17-.046.294-.113.448-.172.33-.118.604-.217.87-.256.112-.009.23.069.288.101l.217-.037a6.5 6.5 0 0 0 2.88 3.596l-.09.218c.033.084.069.199.044.282-.097.252-.263.517-.452.813-.091.136-.185.242-.268.399-.02.037-.045.095-.064.134-.128.275-.034.591.213.71.248.12.556-.007.69-.282v-.002c.02-.039.046-.09.062-.127.07-.162.094-.301.144-.458.132-.332.205-.68.387-.897.05-.06.13-.082.215-.105l.113-.205a6.453 6.453 0 0 0 4.609.012l.106.192c.086.028.18.042.256.155.136.232.229.507.342.84.05.156.074.295.145.457.016.037.043.09.062.129.133.276.442.402.69.282.247-.118.341-.435.213-.71-.02-.039-.045-.096-.065-.134-.083-.156-.177-.261-.268-.398-.19-.296-.346-.541-.443-.793-.04-.13.007-.21.038-.294-.018-.022-.059-.144-.083-.202a6.499 6.499 0 0 0 2.88-3.622c.064.01.176.03.213.038.075-.05.144-.114.28-.104.266.039.54.138.87.256.154.06.277.128.448.173.036.01.088.019.13.028l.009.003.007.001c.297.064.584-.098.645-.365.06-.266-.128-.537-.423-.608zM16.4 9.701l-1.95 1.746v.005a.44.44 0 0 0 .173.757l.003.01 2.526.728a5.199 5.199 0 0 0-.108-1.674A5.208 5.208 0 0 0 16.4 9.7zm-4.013 5.325a.437.437 0 0 0-.404-.232.44.44 0 0 0-.372.233h-.002l-1.268 2.292a5.164 5.164 0 0 0 3.326.003l-1.27-2.296h-.01zm1.888-1.293a.44.44 0 0 0-.27.036.44.44 0 0 0-.214.572l-.003.004 1.01 2.438a5.15 5.15 0 0 0 2.081-2.615l-2.6-.44-.004.005z"/></svg>}- href="/0.0.5/installation#kubernetes"+ href="/latest/installation#kubernetes">- Deploy Doku in a Kubernetes Cluster using Helm+ Deploy Doku on a Kubernetes for scalable LLM Monitoring capabilities.</Card><Cardtitle="Docker"icon="docker"- href="/0.0.5/installation#docker"+ href="/latest/installation#docker">- Deploy Doku using docker compose+ Deploy Doku using Docker for an easy-to-manage LLM Monitoring setup.</Card></CardGroup>@@ -41,46 +41,65 @@ Deploy Doku on your Kubernetes cluster using the [Doku Helm chart](https://githu```</Step></Steps>-<Info>As Doku does not have a built-in visualization UI yet, it is preferred that you set up the `connections` configuration within the [values.yaml](https://github.com/dokulabs/helm/blob/main/charts/doku/values.yaml) file. Doing so enables visualization of the LLM Observability data processed by Doku using an external observability platform.</Info>## Docker-Quickly spin up Doku using Docker Compose for a fast and straightforward setup.+For a quick and straightforward setup, Docker Compose can be used to deploy Doku.<Steps><Step title="Create `docker-compose.yml`">- ```yml- version: '3.7'+ ```yaml+ version: '3.8'services:- timescaledb:- image: timescale/timescaledb-ha:pg14-ts2.14- container_name: timescaledb+ clickhouse:+ image: clickhouse/clickhouse-server:24.1.5+ container_name: clickhouseenvironment:- POSTGRES_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}- POSTGRES_USER: ${DOKU_DB_USER:-admin}- POSTGRES_DB: ${DOKU_DB_NAME:-postgres}+ CLICKHOUSE_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ CLICKHOUSE_USER: ${DOKU_DB_USER:-default}volumes:- - timescaledb-data:/var/lib/postgresql/data+ - clickhouse-data:/var/lib/clickhouseports:- - "${DOKU_DB_PORT:-5432}:5432"+ - "9000:9000"+ - "8123:8123"restart: alwaysdoku-ingester:- image: ghcr.io/patcher99/doku-ingester:0.0.5+ image: ghcr.io/dokulabs/doku-ingester:latestcontainer_name: doku-ingesterenvironment:- DOKU_DB_HOST: timescaledb- DOKU_DB_PORT: ${DOKU_DB_PORT:-5432}- DOKU_DB_NAME: ${DOKU_DB_NAME:-postgres}- DOKU_DB_USER: ${DOKU_DB_USER:-admin}- DOKU_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}- DOKU_DB_SSLMODE: ${DB_DB_SSLMODE:-require}+ DOKU_DB_HOST: clickhouse+ DOKU_DB_PORT: 9000+ DOKU_DB_NAME: ${DOKU_DB_NAME:-default}+ DOKU_DB_USER: ${DOKU_DB_USER:-default}+ DOKU_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ ports:+ - "9044:9044"+ depends_on:+ - clickhouse+ restart: always++ doku-client:+ image: ghcr.io/dokulabs/doku-client:latest+ container_name: doku-client+ environment:+ INIT_DB_HOST: clickhouse+ INIT_DB_PORT: 8123+ INIT_DB_DATABASE: ${DOKU_DB_NAME:-default}+ INIT_DB_USERNAME: ${DOKU_DB_USER:-default}+ INIT_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ SQLITE_DATABASE_URL: file:/app/client/data/data.db+ ports:+ - "3000:3000"depends_on:- - timescaledb+ - clickhouse+ volumes:+ - doku-client-data:/app/client/datarestart: alwaysvolumes:- timescaledb-data:+ clickhouse-data:+ doku-client-data:```</Step><Step title="Start Docker Compose">@@ -93,10 +112,10 @@ Quickly spin up Doku using Docker Compose for a fast and straightforward setup.---<CardGroup cols={2}>-<Card title="Integrations" href="/0.0.5/integrations/introduction" icon='circle-nodes'>+<Card title="Integrations" href="/latest/integrations/introduction" icon='circle-nodes'>Integrate your LLM Provider with Doku</Card>-<Card title="Connections" href="/0.0.5/connections/intro" icon='link'>+<Card title="Connections" href="/latest/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card></CardGroup>\ No newline at end of filediff --git a/docs/latest/integrations/anthropic/examples/messages.mdx b/docs/latest/integrations/anthropic/examples/messages.mdxnew file mode 100644index 00000000..c6c8d07a--- /dev/null+++ b/docs/latest/integrations/anthropic/examples/messages.mdx@@ -0,0 +1,176 @@+---+title: 'Messages'+description: 'Monitor Anthropic Messages API Usage'+---++## Completions+<Tabs>+ <Tab title="Python">++ ### Synchronous Usage+ <CodeGroup>+ ```python default+ from anthropic import Anthropic+ import dokumetry++ client = Anthropic(+ # This is the default and can be omitted+ api_key="YOUR_ANTHROPIC_API_KEY",+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ message = client.messages.create(+ max_tokens=1024,+ messages=[+ {+ "role": "user",+ "content": "Hello, Claude",+ }+ ],+ model="claude-3-opus-20240229",+ )+ print(message.content)+ ```+ ```python streaming+ from anthropic import Anthropic+ import dokumetry++ client = Anthropic(+ # This is the default and can be omitted+ api_key="YOUR_ANTHROPIC_API_KEY",+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ stream = client.messages.create(+ max_tokens=1024,+ messages=[+ {+ "role": "user",+ "content": "Hello, Claude",+ }+ ],+ model="claude-3-opus-20240229",+ stream=True,+ )+ for event in stream:+ print(event.type)+ ```+ </CodeGroup>++ ### Asynchronous usage+ <CodeGroup>+ ```python default+ import asyncio+ from anthropic import AsyncAnthropic+ import dokumetry++ client = AsyncAnthropic(+ # This is the default and can be omitted+ api_key="YOUR_ANTHROPIC_API_KEY",+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main() -> None:+ message = await client.messages.create(+ max_tokens=1024,+ messages=[+ {+ "role": "user",+ "content": "Hello, Claude",+ }+ ],+ model="claude-3-opus-20240229",+ )++ asyncio.run(main())+ ```++ ```python streaming+ import asyncio+ from anthropic import AsyncAnthropic+ import dokumetry++ client = AsyncAnthropic(+ # This is the default and can be omitted+ api_key="YOUR_ANTHROPIC_API_KEY",+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main():+ stream = client.messages.create(+ max_tokens=1024,+ messages=[+ {+ "role": "user",+ "content": "Hello, Claude",+ }+ ],+ model="claude-3-opus-20240229",+ stream=True,+ )+ for event in stream:+ print(event.type)++ asyncio.run(main())+ ```+ </CodeGroup>+ </Tab>+ <Tab title="Javascript">+ <CodeGroup>+ ```javascript default+ import Anthropic from '@anthropic-ai/sdk';+ import DokuMetry from 'dokumetry';++ const anthropic = new Anthropic({+ apiKey: 'my_api_key', // defaults to process.env["ANTHROPIC_API_KEY"]+ });++ // Pass the above `anthropic` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ DokuMetry.init({llm: anthropic, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})++ async function main() {+ const message = await anthropic.messages.create({+ max_tokens: 1024,+ messages: [{ role: 'user', content: 'Hello, Claude' }],+ model: 'claude-3-opus-20240229',+ });++ console.log(message.content);+ }++ main();+ ```++ ```javascript streaming+ import Anthropic from '@anthropic-ai/sdk';+ import DokuMetry from 'dokumetry';++ const anthropic = new Anthropic({+ apiKey: 'my_api_key', // defaults to process.env["ANTHROPIC_API_KEY"]+ });++ // Pass the above `anthropic` object along with your DOKU URL and API key and this will make sure that all Anthropic calls are automatically tracked.+ DokuMetry.init({llm: anthropic, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})++ const stream = await anthropic.messages.create({+ max_tokens: 1024,+ messages: [{ role: 'user', content: 'Hello, Claude' }],+ model: 'claude-3-opus-20240229',+ stream: true,+ });+ for await (const messageStreamEvent of stream) {+ console.log(messageStreamEvent.type);+ }+ ```+ </CodeGroup>+ </Tab>+</Tabs>+diff --git a/docs/latest/integrations/anthropic/introduction.mdx b/docs/latest/integrations/anthropic/introduction.mdxnew file mode 100644index 00000000..83d82c31--- /dev/null+++ b/docs/latest/integrations/anthropic/introduction.mdx@@ -0,0 +1,91 @@+---+title: 'Anthropic Integration'+sidebarTitle: 'Get Started'+---++DokuMetry SDKs (`dokumetry`) empowers you to effortlessly track and monitor Anthropic usage data and metrics from your Python/NodeJS code.++## Get Started++The integration is compatible with Anthropic Python SDK version >=0.19.0 and Typescript SDK version >=0.9.0++<Tabs>+ <Tab title="Python">+ ```shell+ pip install dokumetry+ ```++ ```python+ from anthropic import Anthropic+ import dokumetry++ anthropic = Anthropic(+ api_key="anthropic_api_key",+ )++ dokumetry.init(llm = anthropic, doku_url = "YOUR_DOKU_URL", api_key = "YOUR_DOKU_TOKEN")+ ```+ </Tab>+ <Tab title="Javascript">+ ```shell+ npm install dokumetry+ ```++ ```javascript+ import Anthropic from '@anthropic-ai/sdk';+ import DokuMetry from 'dokumetry';++ const anthropic = new Anthropic({+ apiKey: 'anthropic_api_key',+ });++ DokuMetry.init({llm: anthropic, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})+ ```+ </Tab>+</Tabs>++## Supported Endpoints++The following Anthropic Endpoints are supported for monitoring with DokuMetry++- [messages](/latest/integrations/anthropic/examples/messages)++## Parameters+<Tabs>+ <Tab title="Python">+ | Parameter | Description | Required |+ |-------------------|-----------------------------------------------------------|---------------|+ | llm | Anthropic Object to track | Yes |+ | doku_url | URL of your Doku Ingester | Yes |+ | api_key | Your Doku API key | Yes |+ | environment | Custom environment tag to include in your metrics | Optional |+ | application_name | Custom application name tag for your metrics | Optional |+ | skip_resp | Skip response from the Doku Ingester for faster execution | Optional |+ </Tab>+ <Tab title="NodeJS">+ | Parameter | Description | Required |+ |-------------------|-----------------------------------------------------------|---------------|+ | llm | Anthropic Object to track | Yes |+ | dokuUrl | URL of your Doku Ingester | Yes |+ | apiKey | Your Doku API key | Yes |+ | environment | Custom environment tag to include in your metrics | Optional |+ | applicationName | Custom application name tag for your metrics | Optional |+ | skipResp | Skip response from the Doku Ingester for faster execution | Optional |+ </Tab>+</Tabs>++## Advanced Usage+When using DokuMetry in Production environments, It is recommened to set Skip response parameter to `true` for faster porcessing.++To filter your LLM Usage according application or the environment, set the Application name and Environment paramaters with the actual values.++---++<CardGroup cols={2}>+<Card title="Connections" href="/latest/connections/intro" icon='link'>+Connect to your existing Observablity Platform+</Card>+<Card title="API Refernce" href="/latest/api-reference/introduction" icon='code'>+OpenAPI specification for API Endpoints in Doku+</Card>+</CardGroup>\ No newline at end of filediff --git a/docs/0.0.6/integrations/cohere/examples/chat.mdx b/docs/latest/integrations/cohere/examples/chat.mdxsimilarity index 100%rename from docs/0.0.6/integrations/cohere/examples/chat.mdxrename to docs/latest/integrations/cohere/examples/chat.mdxdiff --git a/docs/0.0.6/integrations/cohere/examples/embed.mdx b/docs/latest/integrations/cohere/examples/embed.mdxsimilarity index 100%rename from docs/0.0.6/integrations/cohere/examples/embed.mdxrename to docs/latest/integrations/cohere/examples/embed.mdxdiff --git a/docs/0.0.6/integrations/cohere/examples/generate.mdx b/docs/latest/integrations/cohere/examples/generate.mdxsimilarity index 100%rename from docs/0.0.6/integrations/cohere/examples/generate.mdxrename to docs/latest/integrations/cohere/examples/generate.mdxdiff --git a/docs/0.0.6/integrations/cohere/examples/summarize.mdx b/docs/latest/integrations/cohere/examples/summarize.mdxsimilarity index 100%rename from docs/0.0.6/integrations/cohere/examples/summarize.mdxrename to docs/latest/integrations/cohere/examples/summarize.mdxdiff --git a/docs/latest/integrations/cohere/introduction.mdx b/docs/latest/integrations/cohere/introduction.mdxnew file mode 100644index 00000000..7b7e3fdd--- /dev/null+++ b/docs/latest/integrations/cohere/introduction.mdx@@ -0,0 +1,92 @@+---+title: 'Cohere integration'+sidebarTitle: 'Get Started'+---++DokuMetry SDKs (`dokumetry`) empowers you to effortlessly track and monitor Cohere usage data and metrics from your Python/NodeJS code.++## Get Started++The integration is compatible with Cohere SDK versions >=4.0.0++<Tabs>+ <Tab title="Python">+ ```shell+ pip install dokumetry+ ```++ ```python+ import cohere+ import dokumetry++ co = cohere.Client('YOUR_API_KEY')++ dokumetry.init(llm = co, doku_url = "YOUR_DOKU_URL", api_key = "YOUR_DOKU_TOKEN")+ ```+ </Tab>+ <Tab title="Javascript">+ ```shell+ npm install dokumetry+ ```++ ```javascript+ import { CohereClient } from "cohere-ai";+ import DokuMetry from 'dokumetry';++ const co = new CohereClient({+ token: "<<apiKey>>",+ });++ DokuMetry.init({llm: co, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})+ ```+ </Tab>+</Tabs>++## Supported Endpoints+The following Cohere Endpoints are supported for monitoring with DokuMetry++- [Chat](/latest/integrations/cohere/examples/chat)+- [Generate](/latest/integrations/cohere/examples/generate)+- [Summarize](/latest/integrations/cohere/examples/summarize)+- [Embed](/latest/integrations/cohere/examples/embed)++## Parameters++<Tabs>+ <Tab title="Python">+ | Parameter | Description | Required |+ |-------------------|-----------------------------------------------------------|---------------|+ | llm | Cohere Object to track | Yes |+ | doku_url | URL of your Doku Ingester | Yes |+ | api_key | Your Doku API key | Yes |+ | environment | Custom environment tag to include in your metrics | Optional |+ | application_name | Custom application name tag for your metrics | Optional |+ | skip_resp | Skip response from the Doku Ingester for faster execution | Optional |+ </Tab>+ <Tab title="NodeJS">+ | Parameter | Description | Required |+ |-------------------|-----------------------------------------------------------|---------------|+ | llm | Cohere Object to track | Yes |+ | dokuUrl | URL of your Doku Ingester | Yes |+ | apiKey | Your Doku API key | Yes |+ | environment | Custom environment tag to include in your metrics | Optional |+ | applicationName | Custom application name tag for your metrics | Optional |+ | skipResp | Skip response from the Doku Ingester for faster execution | Optional |+ </Tab>+</Tabs>++## Advanced Usage+When using DokuMetry in Production environments, It is recommened to set Skip response parameter to `true` for faster porcessing.++To filter your LLM Usage according application or the environment, set the Application name and Environment paramaters with the actual values.++---++<CardGroup cols={2}>+<Card title="Connections" href="/latest/connections/intro" icon='link'>+Connect to your existing Observablity Platform+</Card>+<Card title="API Refernce" href="/latest/api-reference/introduction" icon='code'>+OpenAPI specification for API Endpoints in Doku+</Card>+</CardGroup>\ No newline at end of filediff --git a/docs/0.0.5/integrations/introduction.mdx b/docs/latest/integrations/introduction.mdxsimilarity index 89%rename from docs/0.0.5/integrations/introduction.mdxrename to docs/latest/integrations/introduction.mdxindex e5e5b6f6..049620fc 100644--- a/docs/0.0.5/integrations/introduction.mdx+++ b/docs/latest/integrations/introduction.mdx@@ -3,10 +3,12 @@ title: 'Introduction'description: 'Integrate and Monitor usage from LLM Providers'---+Start integrating and monitoring your applications with Doku effortlessly. Choose from a range of providers to **start tracking LLM performance, usage, and costs** without hassle.+<CardGroup cols={3}><Cardtitle="OpenAI"- href="/0.0.5/integrations/openai/introduction"+ href="/latest/integrations/openai/introduction"icon={<svg role="img" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg"><title>OpenAI</title>@@ -18,7 +20,7 @@ description: 'Integrate and Monitor usage from LLM Providers'</Card><Cardtitle="Cohere"- href="/0.0.5/integrations/cohere/introduction"+ href="/latest/integrations/cohere/introduction"icon={<svg role="image" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 75 75"><g>@@ -43,7 +45,7 @@ description: 'Integrate and Monitor usage from LLM Providers'</Card><Cardtitle="Anthropic"- href="/0.0.5/integrations/anthropic/introduction"+ href="/latest/integrations/anthropic/introduction"icon={<svg viewBox="0 0 256 176" xmlns="http://www.w3.org/2000/svg"><path d="M147.486878,0 C147.486878,0 217.568251,175.780074 217.568251,175.780074 C217.568251,175.780074 256,175.780074 256,175.780074 C256,175.780074 185.918621,0 185.918621,0 C185.918621,0 147.486878,0 147.486878,0 C147.486878,0 147.486878,0 147.486878,0 Z"></path>@@ -58,10 +60,10 @@ description: 'Integrate and Monitor usage from LLM Providers'---<CardGroup cols={2}>-<Card title="Quickstart" href="/0.0.5/quickstart" icon='bolt'>+<Card title="Quickstart" href="/latest/quickstart" icon='bolt'>Get Started with monitoring your LLM Applications in 2 simple steps</Card>-<Card title="Connections" href="/0.0.5/connections/intro" icon='link'>+<Card title="Connections" href="/latest/connections/intro" icon='link'>Connect to your existing Observablity Platform</Card></CardGroup>\ No newline at end of filediff --git a/docs/0.0.6/integrations/openai/examples/audio.mdx b/docs/latest/integrations/openai/examples/audio.mdxsimilarity index 95%rename from docs/0.0.6/integrations/openai/examples/audio.mdxrename to docs/latest/integrations/openai/examples/audio.mdxindex 4cf99fbe..3d6ddbfe 100644--- a/docs/0.0.6/integrations/openai/examples/audio.mdx+++ b/docs/latest/integrations/openai/examples/audio.mdx@@ -12,7 +12,9 @@ description: 'Monitor OpenAI Audio API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/0.0.5/integrations/openai/examples/chat.mdx b/docs/latest/integrations/openai/examples/chat.mdxsimilarity index 63%rename from docs/0.0.5/integrations/openai/examples/chat.mdxrename to docs/latest/integrations/openai/examples/chat.mdxindex f0ca6753..a7cf5a1a 100644--- a/docs/0.0.5/integrations/openai/examples/chat.mdx+++ b/docs/latest/integrations/openai/examples/chat.mdx@@ -6,12 +6,16 @@ description: 'Monitor OpenAI Chat Completions API usage'<Tabs><Tab title="Python">++ ### Synchronous Usage<CodeGroup>```python Defaultfrom openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -31,7 +35,9 @@ description: 'Monitor OpenAI Chat Completions API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -60,7 +66,9 @@ description: 'Monitor OpenAI Chat Completions API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -82,7 +90,9 @@ description: 'Monitor OpenAI Chat Completions API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -122,7 +132,9 @@ description: 'Monitor OpenAI Chat Completions API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -140,6 +152,164 @@ description: 'Monitor OpenAI Chat Completions API usage'print(completion.choices[0].logprobs)```</CodeGroup>++ ### Asynchronous Usage++ <CodeGroup>+ ```python Default+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main() -> None:+ chat_completion = await client.chat.completions.create(+ messages=[+ {+ "role": "user",+ "content": "Say this is a test",+ }+ ],+ model="gpt-3.5-turbo",+ )++ asyncio.run(main())+ ```++ ```python Image Input+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main() -> None:+ response = await client.chat.completions.create(+ model="gpt-4-vision-preview",+ messages=[+ {+ "role": "user",+ "content": [+ {"type": "text", "text": "Whatβs in this image?"},+ {+ "type": "image_url",+ "image_url": "https://upload.wikimedia.org/wikipedia/commons/thumb/d/dd/Gfp-wisconsin-madison-the-nature-boardwalk.jpg/2560px-Gfp-wisconsin-madison-the-nature-boardwalk.jpg",+ },+ ],+ }+ ],+ max_tokens=300,+ )++ asyncio.run(main())+ ```++ ```python Streaming+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main():+ stream = await client.chat.completions.create(+ model="gpt-4",+ messages=[{"role": "user", "content": "Say this is a test"}],+ stream=True,+ )+ async for chunk in stream:+ print(chunk.choices[0].delta.content or "", end="")+++ asyncio.run(main())+ ```++ ```python Functions+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ tools = [+ {+ "type": "function",+ "function": {+ "name": "get_current_weather",+ "description": "Get the current weather in a given location",+ "parameters": {+ "type": "object",+ "properties": {+ "location": {+ "type": "string",+ "description": "The city and state, e.g. San Francisco, CA",+ },+ "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]},+ },+ "required": ["location"],+ },+ }+ }+ ]+ messages = [{"role": "user", "content": "What's the weather like in Boston today?"}]++ async def main() -> None:+ completion = await client.chat.completions.create(+ model="gpt-3.5-turbo",+ messages=messages,+ tools=tools,+ tool_choice="auto"+ )++ asyncio.run(main())+ ```++ ```python LogProbs+ import asyncio+ from openai import AsyncOpenAI+ import dokumetry++ client = AsyncOpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")++ async def main() -> None:+ completion = await client.chat.completions.create(+ model="gpt-3.5-turbo",+ messages=[+ {"role": "user", "content": "Hello!"}+ ],+ logprobs=True,+ top_logprobs=2+ )++ asyncio.run(main())+ ```+ </CodeGroup></Tab><Tab title="NodeJS"><CodeGroup>diff --git a/docs/0.0.5/integrations/openai/examples/completions.mdx b/docs/latest/integrations/openai/examples/completions.mdxsimilarity index 94%rename from docs/0.0.5/integrations/openai/examples/completions.mdxrename to docs/latest/integrations/openai/examples/completions.mdxindex 4071b67b..d7e4908b 100644--- a/docs/0.0.5/integrations/openai/examples/completions.mdx+++ b/docs/latest/integrations/openai/examples/completions.mdx@@ -10,7 +10,9 @@ description: 'Monitor OpenAI Completions API Usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -27,7 +29,9 @@ description: 'Monitor OpenAI Completions API Usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/0.0.5/integrations/openai/examples/embeddings.mdx b/docs/latest/integrations/openai/examples/embeddings.mdxsimilarity index 94%rename from docs/0.0.5/integrations/openai/examples/embeddings.mdxrename to docs/latest/integrations/openai/examples/embeddings.mdxindex 80ddf22d..ec50145e 100644--- a/docs/0.0.5/integrations/openai/examples/embeddings.mdx+++ b/docs/latest/integrations/openai/examples/embeddings.mdx@@ -10,7 +10,9 @@ description: 'Monitor OpenAI Embeddings API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/0.0.5/integrations/openai/examples/fine-tuning.mdx b/docs/latest/integrations/openai/examples/fine-tuning.mdxsimilarity index 94%rename from docs/0.0.5/integrations/openai/examples/fine-tuning.mdxrename to docs/latest/integrations/openai/examples/fine-tuning.mdxindex dbb9c06d..aa049513 100644--- a/docs/0.0.5/integrations/openai/examples/fine-tuning.mdx+++ b/docs/latest/integrations/openai/examples/fine-tuning.mdx@@ -10,7 +10,9 @@ description: 'Monitor OpenAI Fine Tuning API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/0.0.6/integrations/openai/examples/image.mdx b/docs/latest/integrations/openai/examples/image.mdxsimilarity index 94%rename from docs/0.0.6/integrations/openai/examples/image.mdxrename to docs/latest/integrations/openai/examples/image.mdxindex 1c59e680..d0c82139 100644--- a/docs/0.0.6/integrations/openai/examples/image.mdx+++ b/docs/latest/integrations/openai/examples/image.mdx@@ -11,7 +11,9 @@ description: 'Monitor OpenAI Image API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")@@ -52,7 +54,9 @@ description: 'Monitor OpenAI Image API usage'from openai import OpenAIimport dokumetry- client = OpenAI()+ client = OpenAI(+ api_key = "YOUR_OPENAI_API_KEY"+ )# Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.dokumetry.init(llm=client, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")diff --git a/docs/latest/integrations/openai/introduction.mdx b/docs/latest/integrations/openai/introduction.mdxnew file mode 100644index 00000000..7038a420--- /dev/null+++ b/docs/latest/integrations/openai/introduction.mdx@@ -0,0 +1,93 @@+---+title: 'OpenAI Integration'+sidebarTitle: 'Get Started'+---++DokuMetry SDKs (`dokumetry`) empowers you to effortlessly track and monitor OpenAI usage data and metrics from your Python/NodeJS code.++## Get Started++The integration is compatible with OpenAI SDK versions >=1.0.0++<Tabs>+ <Tab title="Python">+ ```shell+ pip install dokumetry+ ```++ ```python+ from openai import OpenAI+ import dokumetry++ client = OpenAI()++ dokumetry.init(llm = client, doku_url = "YOUR_DOKU_URL", api_key = "YOUR_DOKU_TOKEN")+ ```+ </Tab>+ <Tab title="Javascript">+ ```shell+ npm install dokumetry+ ```++ ```javascript+ import OpenAI from "openai";+ import DokuMetry from 'dokumetry';++ const client = new OpenAI();++ DokuMetry.init({llm: client, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})+ ```+ </Tab>+</Tabs>++## Supported Endpoints++The following OpenAI Endpoints are supported for monitoring with DokuMetry++- [Chat completions](/latest/integrations/openai/examples/chat)+- [Image Create](/latest/integrations/openai/examples/image#create-image) and [Image Variations](/latest/integrations/openai/examples/image#create-image-variation)+- [Audio Speech Create](/latest/integrations/openai/examples/audio)+- [Embeddings](/latest/integrations/openai/examples/embeddings)+- [Fine Tunings](/latest/integrations/openai/examples/fine-tuning)+- [Completions](/latest/integrations/openai/examples/completions)++## Parameters++<Tabs>+ <Tab title="Python">+ | Parameter | Description | Required |+ |-------------------|-----------------------------------------------------------|---------------|+ | llm | OpenAI Object to track | Yes |+ | doku_url | URL of your Doku Ingester | Yes |+ | api_key | Your Doku API key | Yes |+ | environment | Custom environment tag to include in your metrics | Optional |+ | application_name | Custom application name tag for your metrics | Optional |+ | skip_resp | Skip response from the Doku Ingester for faster execution | Optional |+ </Tab>+ <Tab title="NodeJS">+ | Parameter | Description | Required |+ |-------------------|-----------------------------------------------------------|---------------|+ | llm | OpenAI Object to track | Yes |+ | dokuUrl | URL of your Doku Ingester | Yes |+ | apiKey | Your Doku API key | Yes |+ | environment | Custom environment tag to include in your metrics | Optional |+ | applicationName | Custom application name tag for your metrics | Optional |+ | skipResp | Skip response from the Doku Ingester for faster execution | Optional |+ </Tab>+</Tabs>++## Advanced Usage+When using DokuMetry in Production environments, It is recommened to set Skip response parameter to `true` for faster porcessing.++To filter your LLM Usage according application or the environment, set the Application name and Environment paramaters with the actual values.++---++<CardGroup cols={2}>+<Card title="Connections" href="/latest/connections/intro" icon='link'>+Connect to your existing Observablity Platform+</Card>+<Card title="API Refernce" href="/latest/api-reference/introduction" icon='code'>+OpenAPI specification for API Endpoints in Doku+</Card>+</CardGroup>\ No newline at end of filediff --git a/docs/latest/introduction.mdx b/docs/latest/introduction.mdxnew file mode 100644index 00000000..9b824408--- /dev/null+++ b/docs/latest/introduction.mdx@@ -0,0 +1,73 @@+---+title: What is Doku?+description: 'Open-source platform for monitoring and evaluating LLMs at scale'+---++<Frame>+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-1.jpg?raw=true" />+</Frame>++Doku is an **open-source LLMOps tool** engineered to enables developers with comprehensive capabilities to monitor, analyze, and optimize LLM applications. It provides valuable real-time data on **LLM usage, performance, and costs**. Through seamless integrations with leading LLM platforms, including OpenAI, Cohere, and Anthropic, Doku acts as a central command center for all your LLM needs. It effectively guides your efforts, ensuring that your LLM applications not only operate at peak efficiency but also scale successfully.++## Why use Doku?+Get advanced monitoring and evaluation for your LLM applications with these key benefits:++- **Granular Usage Insights of your LLM Applications**: Assess your LLM's performance and costs with fine-grained control, breaking down metrics by environment (such as staging or production) or application, to optimize for efficiency and scalability.+- **Real-Time Data Streaming**: Unlike other platforms where you might wait minutes to see your data due to data being sent in batches, Doku is able to display data as it streams. This immediate insight enables quick decision-making and adjustments.+- **Zero Added Latency**: Doku's smart data handling ensures rapid data processing without impacting your application's performance, maintaining the responsiveness of your LLM applications.+- **Connect to Observability Platforms**: Doku seamlessly connects with leading observability platforms like Grafana Cloud and Datadog, among others to automatically export data.++## How it works+<Frame>+ <img src="https://raw.githubusercontent.com/dokulabs/.github/main/profile/assets/banner.gif" />+</Frame>++### Step 1: Instrument your Application+Integrating the `dokumetry` SDK into LLM applications is straightforward with SDKs designed for Python and NodeJS. Start monitoring for your LLM Application with just **two lines of code**:++<CodeGroup>+```python python+import dokumetry++dokumetry.init(llm=openai, doku_url="YOUR_DOKU_URL", api_key="YOUR_DOKU_TOKEN")+```++```javascript NodeJS+import DokuMetry from 'dokumetry';++DokuMetry.init({llm: openai, dokuUrl: "YOUR_DOKU_URL", apiKey: "YOUR_DOKU_TOKEN"})+```+</CodeGroup>++### Step 2: Data processed by Doku Ingester+Once the `dokumetry` SDKs are configured in your LLM application, Monitoring data starts streaming to the [Doku Ingester](https://github.com/dokulabs/doku/tree/main/src/ingester#readme). It processes and safely stores your data in ClickHouse, keeping your LLM Monitoring data **secure** and **compliant** in your environment.++You can choose to use a new ClickHouse database setup or connect to your existing one to work with Doku.++### Step 3: Visualize and analyze+With your LLM monitoring data processed and securely stored, you can now leverage the Doku UI for in-depth visualization and analysis. Doku UI allows you to explore LLM costs, token usage, performance metrics, and user interactions in an intuitive interface. This powerful tool enhances your ability to observe and optimize your LLM applications, ensuring you make data-driven decisions for improvement.++<Frame>+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-1.jpg?raw=true" />+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-2.jpg?raw=true" />+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-3.jpg?raw=true" />+</Frame>++For those with a preferred observability platform, you can also integrate and visualize this data elsewhere with ease. This flexibility ensures optimal monitoring workflow integration, regardless of your platform choice. For more details on how to set up these connections, check out the [Connections](https://example.com/latest/connections/intro) guide.+## Getting Started+Select from the following guides to learn more about how to use Doku:++<CardGroup cols={2}>+<Card title="Quickstart" href="/latest/quickstart" icon='bolt'>+Get Started with monitoring your LLM Applications in 2 simple steps+</Card>+<Card title="Integrations" href="/latest/integrations/introduction" icon='circle-nodes'>+Integrate your LLM Provider with Doku+</Card>+<Card title="Installation" href="/latest/installation" icon='circle-down'>+Deploy Doku in your preferred environment+</Card>+<Card title="Connections" href="/latest/connections/intro" icon='link'>+Connect to your existing Observablity Platform+</Card>+</CardGroup>\ No newline at end of filediff --git a/docs/latest/quickstart.mdx b/docs/latest/quickstart.mdxnew file mode 100644index 00000000..37399bb0--- /dev/null+++ b/docs/latest/quickstart.mdx@@ -0,0 +1,197 @@+---+title: 'Quickstart'+description: 'Quickly start **monitoring** your **LLM Applications** in just **two lines** of code'+icon: 'bolt'+---++This guide will walk you through setting up monitoring for your LLM Application with minimal effort. In just a few steps, you'll be able to track and analyze the performance and usage of your Large Language Model (LLM) applications.++<Steps>+ <Step title="Deploy Doku">+ <Steps>+ <Step title="Prepare your Environment">+ ```yaml docker-compose.yml+ version: '3.8'++ services:+ clickhouse:+ image: clickhouse/clickhouse-server:24.1.5+ container_name: clickhouse+ environment:+ CLICKHOUSE_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ CLICKHOUSE_USER: ${DOKU_DB_USER:-default}+ volumes:+ - clickhouse-data:/var/lib/clickhouse+ ports:+ - "9000:9000"+ - "8123:8123"+ restart: always++ doku-ingester:+ image: ghcr.io/dokulabs/doku-ingester:latest+ container_name: doku-ingester+ environment:+ DOKU_DB_HOST: clickhouse+ DOKU_DB_PORT: 9000+ DOKU_DB_NAME: ${DOKU_DB_NAME:-default}+ DOKU_DB_USER: ${DOKU_DB_USER:-default}+ DOKU_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ ports:+ - "9044:9044"+ depends_on:+ - clickhouse+ restart: always++ doku-client:+ image: ghcr.io/dokulabs/doku-client:latest+ container_name: doku-client+ environment:+ INIT_DB_HOST: clickhouse+ INIT_DB_PORT: 8123+ INIT_DB_DATABASE: ${DOKU_DB_NAME:-default}+ INIT_DB_USERNAME: ${DOKU_DB_USER:-default}+ INIT_DB_PASSWORD: ${DOKU_DB_PASSWORD:-DOKU}+ SQLITE_DATABASE_URL: file:/app/client/data/data.db+ ports:+ - "3000:3000"+ depends_on:+ - clickhouse+ volumes:+ - doku-client-data:/app/client/data+ restart: always++ volumes:+ clickhouse-data:+ doku-client-data:+ ```+ </Step>+ <Step title="Launch Doku">+ ```shell+ docker-compose up -d+ ```+ </Step>+ </Steps>+ </Step>+ <Step title="Access Doku UI and Generate an API Key">+ With Doku running, the next step is to access the Doku UI and generate an API key for secure communication between your applications and Doku.+ 1. Open your browser and go to Doku UI at `127.0.0.1:3000/login`+ 2. Login using theb default credentials+ - Email as `[email protected]`+ - Password as `dokulabsuser`+ 3. Once you have logged into Doku UI, Go to [API Keys page](http://127.0.0.1:3000/api-keys) and Create an API Key. Copy the generated API Key.+ </Step>+ <Step title="Instrument your Application">+ Choose the appropriate SDK for your LLM application's programming language and follow the steps to integrate monitoring with just **two lines of code**.+ <Tabs>+ <Tab title="Python">+ <Steps>+ <Step title="Install the dokumetry Python SDK using pip">+ ```shell+ pip install dokumetry+ ```+ </Step>+ <Step title="Add the following two lines to your application code:">+ Add the snippet below to your Python application, replace `YOUR_DOKU_TOKEN` with API key you created in Step 2.++ ```python+ import dokumetry++ dokumetry.init(llm=client, doku_url="http://127.0.0.1:9044/", api_key="YOUR_DOKU_TOKEN")+ ```++ Example Usage for monitoring `OpenAI` Usage:++ ```python+ from openai import OpenAI+ import dokumetry++ client = OpenAI(+ api_key="YOUR_OPENAI_KEY"+ )++ # Pass the above `client` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ dokumetry.init(llm=client, doku_url="http://127.0.0.1:9044/", api_key="YOUR_DOKU_TOKEN")++ chat_completion = client.chat.completions.create(+ messages=[+ {+ "role": "user",+ "content": "What is LLM Observability",+ }+ ],+ model="gpt-3.5-turbo",+ )+ ```++ Refer to the `dokumetry` [Python SDK repository](https://github.com/dokulabs/dokumetry-python) for more advanced configurations and use cases.+ </Step>+ </Steps>+ </Tab>+ <Tab title="NodeJS">+ <Steps>+ <Step title="Install the dokumetry NodeJS SDK using npm">+ ```shell+ npm install dokumetry+ ```+ </Step>+ <Step title="Add the following two lines to your application code">+ Add the snippet below to your NodeJS application, replace `YOUR_DOKU_TOKEN` with API key you created in Step 2.+ ```javascript+ import DokuMetry from 'dokumetry';++ DokuMetry.init({llm: openai, dokuUrl: "http://127.0.0.1:9044/", apiKey: "YOUR_DOKU_TOKEN"})+ ```++ Example Usage for monitoring `OpenAI` Usage:++ ```javascript+ import OpenAI from 'openai';+ import DokuMetry from 'dokumetry';++ const openai = new OpenAI({+ apiKey: 'My API Key', // defaults to process.env["OPENAI_API_KEY"]+ });++ // Pass the above `openai` object along with your DOKU URL and API key and this will make sure that all OpenAI calls are automatically tracked.+ DokuMetry.init({llm: openai, dokuUrl: "http://127.0.0.1:9044/", apiKey: "YOUR_DOKU_TOKEN"})++ async function main() {+ const chatCompletion = await openai.chat.completions.create({+ messages: [{ role: 'user', content: 'What are the key to effective observability?' }],+ model: 'gpt-3.5-turbo',+ });+ }++ main();+ ```++ Refer to the `dokumetry` [NodeJS SDK repository](https://github.com/dokulabs/dokumetry-node) for more advanced configurations and use cases.+ </Step>+ </Steps>+ </Tab>+ </Tabs>+ </Step>+ <Step title="Visualize and Analyze">+ Once you have Doku Ingester and `DokuMetry` SKDs set up, you can instantly get insights into how your LLM applications. Just head over to Doku UI at `127.0.0.1:3000` on your browser to start exploring.++With Doku, you get a simple, powerful view into important info like how much you're spending on LLMs, which parts of your app are using them the most, and how well they're performing. Find out which LLM models are favorites among your applications, and dive deep into performance details to make smart decisions. This setup is perfect for optimizing your app performance and keeping an eye on costs.+ <Frame>+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-1.jpg?raw=true" />+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-2.jpg?raw=true" />+ <img src="https://github.com/dokulabs/.github/blob/main/profile/assets/doku-client-3.jpg?raw=true" />+ </Frame>+ </Step>+</Steps>++You're all set! Following these steps should have you on your way to effectively monitoring your LLM applications. If you have any questions or need support, reach out to our [community](https://join.slack.com/t/doku-0tq5728/shared_invite/zt-2a9aql9xx-FN5EIZ2DtZ~XtJoYdxUDtA).++---++<CardGroup cols={2}>+<Card title="Integrations" href="/latest/integrations/introduction" icon='circle-nodes'>+Integrate your LLM Provider with Doku+</Card>+<Card title="Connections" href="/latest/connections/intro" icon='link'>+Connect to your existing Observablity Platform+</Card>+</CardGroup>\ No newline at end of filediff --git a/docs/mint.json b/docs/mint.jsonindex c5f90897..4c40d6e2 100644--- a/docs/mint.json+++ b/docs/mint.json@@ -1,6 +1,6 @@{"$schema": "https://mintlify.com/schema.json",- "versions": ["0.0.6", "0.0.5"],+ "versions": ["latest", "0.0.7"],"name": "Doku","logo": {"dark": "https://github.com/dokulabs/.github/blob/main/profile/assets/dark-bg-with-text-logo.jpg?raw=true",@@ -45,64 +45,64 @@{"group": "Introduction","pages": [- "0.0.6/introduction",- "0.0.6/quickstart",- "0.0.6/installation",- "0.0.6/configuration"+ "latest/introduction",+ "latest/quickstart",+ "latest/installation",+ "latest/configuration"],- "version": "0.0.6"+ "version": "latest"},{"group": "Integrations",- "version": "0.0.6",+ "version": "latest","pages": [- "0.0.6/integrations/introduction",+ "latest/integrations/introduction",{"group": "OpenAI",- "version": "0.0.6",+ "version": "latest","pages": [- "0.0.6/integrations/openai/introduction",+ "latest/integrations/openai/introduction",{"group": "Examples",- "version": "0.0.6",+ "version": "latest","pages": [- "0.0.6/integrations/openai/examples/chat",- "0.0.6/integrations/openai/examples/image",- "0.0.6/integrations/openai/examples/embeddings",- "0.0.6/integrations/openai/examples/audio",- "0.0.6/integrations/openai/examples/fine-tuning",- "0.0.6/integrations/openai/examples/completions"+ "latest/integrations/openai/examples/chat",+ "latest/integrations/openai/examples/image",+ "latest/integrations/openai/examples/embeddings",+ "latest/integrations/openai/examples/audio",+ "latest/integrations/openai/examples/fine-tuning",+ "latest/integrations/openai/examples/completions"]}]},{"group": "Cohere",- "version": "0.0.6",+ "version": "latest","pages": [- "0.0.6/integrations/cohere/introduction",+ "latest/integrations/cohere/introduction",{"group": "Examples",- "version": "0.0.6",+ "version": "latest","pages": [- "0.0.6/integrations/cohere/examples/chat",- "0.0.6/integrations/cohere/examples/generate",- "0.0.6/integrations/cohere/examples/summarize",- "0.0.6/integrations/cohere/examples/embed"+ "latest/integrations/cohere/examples/chat",+ "latest/integrations/cohere/examples/generate",+ "latest/integrations/cohere/examples/summarize",+ "latest/integrations/cohere/examples/embed"]}]},{"group": "Anthropic",- "version": "0.0.6",+ "version": "latest","pages": [- "0.0.6/integrations/anthropic/introduction",+ "latest/integrations/anthropic/introduction",{"group": "Examples",- "version": "0.0.6",+ "version": "latest","pages": [- "0.0.6/integrations/anthropic/examples/completions"+ "latest/integrations/anthropic/examples/messages"]}]@@ -112,103 +112,103 @@{"group": "Connections","pages": [- "0.0.6/connections/intro",- "0.0.6/connections/grafanaoss",- "0.0.6/connections/grafanacloud",- "0.0.6/connections/datadog",- "0.0.6/connections/new-relic",- "0.0.6/connections/signoz",- "0.0.6/connections/dynatrace"+ "latest/connections/intro",+ "latest/connections/grafanaoss",+ "latest/connections/grafanacloud",+ "latest/connections/datadog",+ "latest/connections/new-relic",+ "latest/connections/signoz",+ "latest/connections/dynatrace"],- "version": "0.0.6"+ "version": "latest"},{"group": "API Reference","pages": [- "0.0.6/api-reference/introduction",+ "latest/api-reference/introduction",{"group": "API Keys","icon": "key","pages": [- "0.0.6/api-reference/endpoint/api-keys/create",- "0.0.6/api-reference/endpoint/api-keys/get",- "0.0.6/api-reference/endpoint/api-keys/delete"+ "latest/api-reference/endpoint/api-keys/create",+ "latest/api-reference/endpoint/api-keys/get",+ "latest/api-reference/endpoint/api-keys/delete"],- "version": "0.0.6"+ "version": "latest"},{"group": "Connections","icon": "link","pages": [- "0.0.6/api-reference/endpoint/connections/create",- "0.0.6/api-reference/endpoint/connections/delete"+ "latest/api-reference/endpoint/connections/create",+ "latest/api-reference/endpoint/connections/delete"],- "version": "0.0.6"+ "version": "latest"}],- "version": "0.0.6"+ "version": "latest"},{- "group": "Get Started",+ "group": "Introduction","pages": [- "0.0.5/introduction",- "0.0.5/quickstart",- "0.0.5/installation",- "0.0.5/configuration"+ "0.0.7/introduction",+ "0.0.7/quickstart",+ "0.0.7/installation",+ "0.0.7/configuration"],- "version": "0.0.5"+ "version": "0.0.7"},{"group": "Integrations",- "version": "0.0.5",+ "version": "0.0.7","pages": [- "0.0.5/integrations/introduction",+ "0.0.7/integrations/introduction",{"group": "OpenAI",- "version": "0.0.5",+ "version": "0.0.7","pages": [- "0.0.5/integrations/openai/introduction",+ "0.0.7/integrations/openai/introduction",{"group": "Examples",- "version": "0.0.5",+ "version": "0.0.7","pages": [- "0.0.5/integrations/openai/examples/chat",- "0.0.5/integrations/openai/examples/image",- "0.0.5/integrations/openai/examples/embeddings",- "0.0.5/integrations/openai/examples/audio",- "0.0.5/integrations/openai/examples/fine-tuning",- "0.0.5/integrations/openai/examples/completions"+ "0.0.7/integrations/openai/examples/chat",+ "0.0.7/integrations/openai/examples/image",+ "0.0.7/integrations/openai/examples/embeddings",+ "0.0.7/integrations/openai/examples/audio",+ "0.0.7/integrations/openai/examples/fine-tuning",+ "0.0.7/integrations/openai/examples/completions"]}]},{"group": "Cohere",- "version": "0.0.5",+ "version": "0.0.7","pages": [- "0.0.5/integrations/cohere/introduction",+ "0.0.7/integrations/cohere/introduction",{"group": "Examples",- "version": "0.0.5",+ "version": "0.0.7","pages": [- "0.0.5/integrations/cohere/examples/chat",- "0.0.5/integrations/cohere/examples/generate",- "0.0.5/integrations/cohere/examples/summarize",- "0.0.5/integrations/cohere/examples/embed"+ "0.0.7/integrations/cohere/examples/chat",+ "0.0.7/integrations/cohere/examples/generate",+ "0.0.7/integrations/cohere/examples/summarize",+ "0.0.7/integrations/cohere/examples/embed"]}]},{"group": "Anthropic",- "version": "0.0.5",+ "version": "0.0.7","pages": [- "0.0.5/integrations/anthropic/introduction",+ "0.0.7/integrations/anthropic/introduction",{"group": "Examples",- "version": "0.0.5",+ "version": "0.0.7","pages": [- "0.0.5/integrations/anthropic/examples/completions"+ "0.0.7/integrations/anthropic/examples/messages"]}]@@ -218,49 +218,41 @@{"group": "Connections","pages": [- "0.0.5/connections/intro",- "0.0.5/connections/grafanaoss",- "0.0.5/connections/grafanacloud",- "0.0.5/connections/datadog",- "0.0.5/connections/new-relic",- "0.0.5/connections/signoz",- "0.0.5/connections/dynatrace"+ "0.0.7/connections/intro",+ "0.0.7/connections/grafanaoss",+ "0.0.7/connections/grafanacloud",+ "0.0.7/connections/datadog",+ "0.0.7/connections/new-relic",+ "0.0.7/connections/signoz",+ "0.0.7/connections/dynatrace"],- "version": "0.0.5"+ "version": "0.0.7"},{"group": "API Reference","pages": [- "0.0.5/api-reference/introduction",+ "0.0.7/api-reference/introduction",{"group": "API Keys","icon": "key","pages": [- "0.0.5/api-reference/endpoint/api-keys/create",- "0.0.5/api-reference/endpoint/api-keys/get",- "0.0.5/api-reference/endpoint/api-keys/delete"+ "0.0.7/api-reference/endpoint/api-keys/create",+ "0.0.7/api-reference/endpoint/api-keys/get",+ "0.0.7/api-reference/endpoint/api-keys/delete"],- "version": "0.0.5"+ "version": "0.0.7"},{"group": "Connections","icon": "link","pages": [- "0.0.5/api-reference/endpoint/connections/create",- "0.0.5/api-reference/endpoint/connections/delete"- ],- "version": "0.0.5"- },- {- "group": "Data",- "icon": "table",- "pages": [- "0.0.5/api-reference/endpoint/retention/update"+ "0.0.7/api-reference/endpoint/connections/create",+ "0.0.7/api-reference/endpoint/connections/delete"],- "version": "0.0.5"+ "version": "0.0.7"}],- "version": "0.0.5"+ "version": "0.0.7"}],"analytics": {diff --git a/src/client/README.md b/src/client/README.mdindex fa7562bf..ae4239c0 100644--- a/src/client/README.md+++ b/src/client/README.md@@ -1,92 +1,140 @@## Run Doku UI Client server-     --Doku Client frontend uses Nextjs, Typescript and Tailwind. The application uses `@tremor/react` for charts, `react-hot-toast` for toasts, `@clickhouse/client` for clickhouse db client, `@prisma/client` for client's db for user management, db configuration management etc.--# π Table of Contents-- [βοΈ Pre-requisites](#-pre-requisites)-- [π Setup server with docker](#-setup-server-with-docker)-- [π Setup server without docker](#-setup-server-without-docker)-- [π Found a bug or want to request a feature](#found-a-bug-or-want-to-request-a-feature)-- [Give A Star β](#give-a-star-)--### Pre-requisites:-- `node` : version >=20-- `sqlite` : db for the doku client's storage (this will come under docker compose with persistent volumne but if you setup without docker, then you need provide file url as env variable like `file:/path/to/file`)--### Setup server with docker-1. Clone the doku repository- ```sh- git clone [email protected]:dokulabs/doku.git- ````-2. Go to the client folder- ```sh- cd src/client- ````-3. Install the docker on your system if not there, please visit: https://docs.docker.com/get-docker/-4. Run command below to create a docker image- ```sh- docker build -t {doku-client} .- ````- Feel free to replace {doku-client} with your custom image name--5. Run the created image by the following command :- ```sh- docker run -p 3000:3000 -e SQLITE_DATABASE_URL="file:/path/to/file/example.db" -e INIT_DB_HOST="127.0.0.1" -e INIT_DB_PORT=8123 -e INIT_DB_USERNAME="dokutest" -e INIT_DB_PASSWORD="dokutest" -e INIT_DB_DATABASE="default" test-doku-prisma- ````- Update the env variables in the run command as per you need.---### Setup server without docker-1. Clone the doku repository- ```sh- git clone [email protected]:dokulabs/doku.git- ````-2. Go to the client folder- ```sh- cd src/client- ````-3. Install the dependencies- ```sh++[](https://github.com/dokulabs/doku)+[](https://github.com/dokulabs/doku/blob/main/LICENSE)+[](https://github.com/dokulabs/doku/tags)+++++++++Doku Client serves as the frontend UI for displaying visualizations and observability data for Large Language Models (LLM), drawing data from ClickHouse. The platform leverages the power of modern web technologies like Next.js and TailwindCSS to offer an intuitive and responsive user experience.++## Features++- **Rich Analytics Dashboard**: Visualize LLM performance, usage patterns, and cost metrics in real-time.+- **User Management**: Integrated user management for access control and authentication.+- **Flexible Data Source Integration**: Built-in support for ClickHouse, enabling efficient data retrieval and management.+- **Responsive Design**: A UI that adapts to various screen sizes, providing an optimal viewing experience across devices.++## π Quick Start++Follow the steps below to get Doku Client running in your environment. Both Docker and manual installation options are provided.+++### Docker++1. **Pull the Docker image**+ ```bash+ docker pull ghcr.io/dokulabs/doku-client:latest+ ```++2. **Run the container with Environment Variables**+ Here, replace `<YourValues>` with actual values for the environment variables.+ ```bash+ docker run -d -p 3000:3000 \+ -e INIT_DB_HOST="<ClickHouse-URL>" \+ -e INIT_DB_PORT="<ClickHouse-Port>" \+ -e INIT_DB_DATABASE="<ClickHouse-Database-name>" \+ -e INIT_DB_USERNAME="<ClickHouse-username>" \+ -e INIT_DB_PASSWORD="<ClickHouse-password>" \+ -e SQLITE_DATABASE_URL=file:/app/client/data/data.db \+ --name doku_client doku-client+ ```++3. Login to Doku UI at `127.0.0.1:3000` using the default credentials and start monitoring and evaluating your LLM Applications+ - Email as `[email protected]`+ - Password as `dokulabsuser`++You can also use the [Doku Helm Chart](https://github.com/dokulabs/helm/tree/main/charts/doku) to deploy Doku Client in Kubernetes++### Manual Setup (Development)++1. **Clone the doku repository**+ ```sh+ git clone https://github.com/dokulabs/doku.git+ ```+2. **Navigate to the client folder**+ ```sh+ cd doku/src/client+ ```+3. **Install the dependencies**+ ```shnpm install- ````-4. Run command below to create an env file and then update the .env file for the `SQLITE_DATABASE_URL` to point to the sqlite db- ```sh- cp .env.example .env- ````-5. Apply the migrations to the sqlite db using the below commands. First command applies the migrations to the db and the second command generates assets like Prisma Client based on the generator and data model blocks defined in your prisma/schema.prisma file.- ```sh+ ```+4. **Configure Environemnt Variables**++ Below are the commands to set environment variables if needed during manual setup. Replace `<value>` with your actual configuration:+ ```sh+ export INIT_DB_HOST=<value>+ export INIT_DB_PORT=<value>+ export INIT_DB_DATABASE=<value>+ export INIT_DB_USERNAME=<value>+ export INIT_DB_PASSWORD=<value>+ export SQLITE_DATABASE_URL=<value>+ ```++5. **Apply the migrations**++ This creates your SQLite database schema.+ ```shnpx prisma migrate deploynpx prisma generate- ````-6. If you want to create a default user and a default db config run :- ```sh- npx prisma db seed- ````- `Note: Make sure the db is empty.`- This will create a default user with- - email : [email protected]- - password : dokulabsuser- For a default db config you need to pass some environment variables (some have default values):- - `INIT_DB_USERNAME` (optional) ---> "default"- - `INIT_DB_PASSWORD` (optional) ---> ""- - `INIT_DB_HOST` (required)- - `INIT_DB_PORT` (required)- - `INIT_DB_DATABASE` (optional) ---> "default"-7. Start the dev server- ```sh+ ```+6. **(Optional) Seed the database**++ If desired, seed the database to create a default user (`[email protected]` with the password `dokulabsuser`) and database configuration.+ ```sh+ npx prisma db seed+ ```+ Ensure the database is empty before running this command.++7. **Start the development server**+ ```shnpm run dev- ````+ ```+<<<<<<< HEAD+8. Login to Doku UI at `127.0.0.1:3000` using the default credentials and start monitoring and evaluating your LLM Applications+ - Email as `[email protected]`+ - Password as `dokulabsuser`+=======Enjoy Doku!π### Found a bug or want to request a feature+>>>>>>> main++## Configuration++To configure Doku Client, you can pass the following environment values, each tailored to suit your infrastructure and operational preferences. This customization allows Doku Client to seamlessly integrate with your existing setup and respond to its demands effectively.+++| Variable | Description | Required | Example |+|----------------------|-----------------------------------------------------------------------------|:--------:|---------------------------------------|+| `INIT_DB_HOST` | Host address of the ClickHouse server to connect to. | β | `127.0.0.1` |+| `INIT_DB_PORT` | Port on which ClickHouse listens. | β | `8123` |+| `INIT_DB_DATABASE` | Database name in ClickHouse for Doku Client. | | `default` |+| `INIT_DB_USERNAME` | Username for authenticating with ClickHouse. | | `default` |+| `INIT_DB_PASSWORD` | Password for authenticating with ClickHouse. | | `default` |+| `SQLITE_DATABASE_URL`| Location of the SQLITE database for Doku Client data storage. | β | `file:/app/client/data/data.db` |++For more detailed information on configuration options and additional settings, please visit the Doku documentation page: [Doku Configuration Details](https://docs.dokulabs.com/latest/configuration).++## Security++We take security seriously. Doku Client incorporates best practices for authentication, authorization, and secure communication to ensure data privacy and protection.++## Contributing++Contributions to Doku Client are greatly appreciated. Whether you have suggestions for bug fixes, improvements, or new features, please see [CONTRIBUTING](https://github.com/dokulabs/doku/CONTRIBUTING) for more details on submitting pull requests or opening issues.++## License-Please open a [Github issue](https://github.com/dokulabs/doku/issues/new/choose).+Doku Client is available under the [Apache-2.0 license](https://github.com/dokulabs/doku/LICENSE).-### Give A Star β+## Support-You can also give this repository a star to show more people and they can use this repository\ No newline at end of file+For support, issues, or feature requests, please submit an issue through the [GitHub issues](https://github.com/dokulabs/doku/issues) page for this repository.\ No newline at end of filediff --git a/src/ingester/README.md b/src/ingester/README.mdindex 6916404c..d08c1da1 100644--- a/src/ingester/README.md+++ b/src/ingester/README.md@@ -1,9 +1,14 @@# Doku Ingester+[](https://github.com/dokulabs/doku)[](https://github.com/dokulabs/doku/blob/main/LICENSE)[](https://github.com/dokulabs/doku/tags)-Doku Ingester is an integral part of Doku's LLM Observability tools, facilitating real-time data ingestion from `dokumetry` [Python](https://github.com/dokulabs/dokumetry-python) and [Node](https://github.com/dokulabs/dokumetry-node) SDKs for Large Language Models (LLM) analytics. It ensures the secure collection of telemetry data, enabling insights on usage patterns, performance metrics, and cost management for LLMs.+++++Doku Ingester facilitates real-time data ingestion from `dokumetry` [Python](https://github.com/dokulabs/dokumetry-python) and [Node](https://github.com/dokulabs/dokumetry-node) SDKs for Large Language Models (LLM) analytics. It ensures the secure collection of telemetry data, enabling insights on usage patterns, performance metrics, and cost management for LLMs.## Features@@ -12,77 +17,79 @@ Doku Ingester is an integral part of Doku's LLM Observability tools, facilitatin- **Scalable Architecture**: Designed with a scalable mindset to grow with your needs, handling increasing loads smoothly and efficiently.- **Customizable Caching**: Configurable in-memory caching for improved performance.-## Quick Start+## π Quick Start-To start using Doku Ingester, ensure you have Docker installed and configured on your machine. Create a config file as shown in in this [example](./assets/example-config.yml). Then Clone the repository and follow the steps below:+Follow the steps below to get Doku Ingester running in your environment. Both Docker and manual installation options are provided.### Docker-```bash-# Clone the repository-git clone https://github.com/dokulabs/ingester.git--# Build the Docker image-docker build -t doku-ingester .--# Run the container-docker run -d -p 9044:9044 --name doku_ingester doku-ingester --config <path-to-config>.yml-```--### Go--```bash-# Clone the repository and use `src` directory-git clone https://github.com/dokulabs/doku.git-cd src/ingester--# Build the Go Package-go build -o doku-ingester .--# Run the Doku Ingester Go Binary-./doku-ingester --config <path-to-config>.yml-```+1. **Pull the Docker image**++ ```bash+ docker pull ghcr.io/dokulabs/doku-ingester:latest+ ```++2. **Run the container with environment variables**++ In this command, replace `"<ClickHouse-URL>"`, `"<ClickHouse-Port>"`, `"<ClickHouse-Database-name>"`, `"<ClickHouse-username>"`, and `"<ClickHouse-password>"` with your actual ClickHouse configuration details.++ ```bash+ docker run -d -p 9044:9044 \+ -e DOKU_DB_HOST="<ClickHouse-URL>" \+ -e DOKU_DB_PORT="<ClickHouse-Port>" \+ -e DOKU_DB_NAME="<ClickHouse-Database-name>" \+ -e DOKU_DB_USER="<ClickHouse-username>" \+ -e DOKU_DB_PASSWORD="<ClickHouse-password>" \+ --name doku_ingester doku-ingester+ ```+++You can also use the [Doku Helm Chart](https://github.com/dokulabs/helm/tree/main/charts/doku) to deploy Doku Ingester in Kubernetes++### Manual Setup (Development)++1. Clone the doku repository+ ```sh+ git clone [email protected]:dokulabs/doku.git+ ````+2. Go to the ingester folder+ ```sh+ cd src/ingester+ ````+3. Build the Go Package+ ```sh+ go build -o doku-ingester .+ ````+4. **Run the Doku Ingester Go Binary with Environment Variables**++ Before running the following command, ensure you replace `"<ClickHouse-URL>"`, `"<ClickHouse-Port>"`, `"<ClickHouse-Database-name>"`, `"<ClickHouse-username>"`, and `"<ClickHouse-password>"` with your actual values.++ ```sh+ export DOKU_DB_HOST="<ClickHouse-URL>"+ export DOKU_DB_PORT="<ClickHouse-Port>"+ export DOKU_DB_NAME="<ClickHouse-Database-name>"+ export DOKU_DB_USER="<ClickHouse-Username>"+ export DOKU_DB_PASSWORD="<ClickHouse-Password>"+ ./doku-ingester+ ```## Configuration-Before running the Ingester, configure the following environment variables:--| Variable | Description | Example Value |-|---------------------|-------------------------------|--------------------|-| `DB_NAME` | The database name | postgres |-| `DB_USER` | The database user | admin |-| `DB_PASSWORD` | The database password | tsdbpassword |-| `DB_HOST` | The database host | 127.0.0.1 |-| `DB_PORT` | The database port | 5432 |-| `DB_SSLMODE` | The SSL mode for the database | require |-| `DATA_TABLE_NAME` | The name of the data table | DOKU |-| `APIKEY_TABLE_NAME` | The name of the API key table | APIKEYS |-| `DB_MAX_OPEN_CONNS` | Max open database connections | 10 |-| `DB_MAX_IDLE_CONNS` | Max idle database connections | 5 |--Adapt these settings to match your database configuration.--## Optional: Data Export Configuration--To export data from Doku to your observability platform, first set the `OBSERVABILITY_PLATFORM` environment variable. Depending on the specified platform, additional configuration environment variables may be required.--### Observability Platform Settings--Set up the `OBSERVABILITY_PLATFORM` to your chosen platform. Currently supported options include:--- `GRAFANA` for Grafana Cloud.--Based on your selection, provide the additional required environment variables as follows.+To configure Doku Ingester, you can pass the following environment values, each tailored to suit your infrastructure and operational preferences. This customization allows Doku Ingester to seamlessly integrate with your existing setup and respond to its demands effectively.-#### Grafana Cloud-If exporting to Grafana Cloud, set the following environment variables:+| Variable | Description | Default Value | Required | Example |+|-------------------------|---------------------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------|:--------:|----------------------------------------|+| `DOKU_DB_HOST` | Host address of the ClickHouse server for Doku to connect to. | | β | `127.0.0.1` |+| `DOKU_DB_PORT` | Port on which ClickHouse listens. | | β | `9000` |+| `DOKU_DB_NAME` | Database name in ClickHouse to be used by Doku. | | β | `default` |+| `DOKU_DB_USER` | Username for authenticating with ClickHouse. | | β | `default` |+| `DOKU_DB_PASSWORD` | Password for authenticating with ClickHouse. | | β | `DOKU` |+| `DOKU_PRICING_JSON_URL` | URL of the JSON file containing LLM Pricing data. | `https://raw.githubusercontent.com/dokulabs/ingester/main/assets/pricing.json` | | `<URL>` |+| `DOKU_DB_MAX_IDLE_CONNS`| Maximum number of concurrent idle database connections. | `10` | | `10` |+| `DOKU_DB_MAX_OPEN_CONNS`| Maximum number of concurrent open database connections. | `20` | | `20` |+| `DOKU_DB_RETENTION_PERIOD` | TTL for data in ClickHouse. | `6 MONTH` | | `"6 MONTH"` |-| Variable | Description | Example Value |-|--------------------------|-----------------------------------------------|-------------------------------------------------|-| `OBSERVABILITY_PLATFORM` | The observability platform to use | `GRAFANA` |-| `GRAFANA_LOGS_USER` | The username for Grafana Loki | `121313` |-| `GRAFANA_LOKI_URL` | The URL of the Grafana CLoud Loki instance | `https://logs-xx.grafana.net/loki/api/v1/push` |-| `GRAFANA_ACCESS_TOKEN` | The access token for Grafana Cloud | `glc_eyxxxxxxxxxxxxx` |+For more detailed information on configuration options and additional settings, please visit the Doku documentation page: [Doku Configuration Details](https://docs.dokulabs.com/latest/configuration).## Securitydiff --git a/src/ingester/db/db.go b/src/ingester/db/db.goindex 705c023d..73166f0c 100644--- a/src/ingester/db/db.go+++ b/src/ingester/db/db.go@@ -282,11 +282,10 @@ func insertDataToDB(data map[string]interface{}) (string, int) {}// Construct query with placeholders- query := fmt.Sprintf("INSERT INTO %s (time, llmReqId, environment, endpoint, sourceLanguage, applicationName, completionTokens, promptTokens, totalTokens, finishReason, requestDuration, usageCost, model, prompt, response, imageSize, revisedPrompt, image, audioVoice, finetuneJobStatus) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)", doku_llm_data_table)+ query := fmt.Sprintf("INSERT INTO %s (time, llmReqId, environment, endpoint, sourceLanguage, applicationName, completionTokens, promptTokens, totalTokens, finishReason, requestDuration, usageCost, model, prompt, response, imageSize, revisedPrompt, image, audioVoice, finetuneJobStatus) VALUES (NOW(), ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)", doku_llm_data_table)// Create a slice for parameters in the correct orderparams := []interface{}{- time.Now(),data["llmReqId"],data["environment"],data["endpoint"],