Skip to content

The agent that grows with you

768 B
Raw Blame
name: lightningai-rate-limit
repo: https://github.com/dinosauria123/hermes-lightningai-rate-limit
sha: dc7911a946f0b209a81cf680c168382177bb13bf
description: >-
  Per-process throttle for Lightning AI (https://lightning.ai/api/v1) keeping LLM requests
  within the ~15 requests/min limit, using an in-memory token bucket. Gates only calls whose
  provider or base_url points at Lightning AI; no-op otherwise.
  Disclosure — registers one llm_execution middleware and nothing else; no network calls,
  files, or processes of its own.
maintainer: dinosauria123
tier: community
category: models
requires_hermes: ">=0.21.5"
version: "1.1.0"
platforms: []
capabilities:
  provides_tools: []
  provides_hooks: []
  provides_middleware:
  - llm_execution
  requires_env: []