Skip to main content

lightningai-rate-limit

❖ Communityv1.1.0★ 0

Models · by dinosauria123 · added

Per-process throttle for Lightning AI (https://lightning.ai/api/v1) keeping LLM requests within the ~15 requests/min limit, using an in-memory token bucket. Gates only calls whose provider or base_url points at Lightning AI; no-op otherwise.

Open in Hermes Desktop
hermes plugins install lightningai-rate-limit
Repository ↗Reviewed source @ dc7911a ↗

What it adds

Middleware 1

llm_execution

README

From the reviewed commit dc7911a ↗; it updates when the author re-pins.

lightningai-rate-limit Hermes plugin

Per-process token bucket that keeps Lightning AI requests to <=15/minute. Middleware registered as llm_execution; activates only when the active provider/base_url points at Lightning AI.

Disclosure

  • Registers one llm_execution middleware and nothing else.
  • No network, files, or processes of its own. In-memory lock only.

More by dinosauria123

All 2 plugins by dinosauria123 →
lightningai❖ Community★ 0

Lightning AI as a Hermes model provider (--provider lightning, lightning-ai, lightningai): OpenAI-compatible gateway at https://lightning.ai/api/v1, models fetched live from /models. Disclosure — registers one model provider at import and nothing else (no tools, hooks, commands or threads); chat requests and the model list go to lightning.ai through Hermes' own client with LIGHTNING_API_KEY (or LIGHTNING_AI_API_KEY), optional LIGHTNING_BASE_URL overrides the endpoint; the plugin itself opens no connections, reads/writes no files and starts no processes.

Models

← Back to the catalog · catalog built Oct 14, 2026