← all categories
INF · category

Agent infrastructure

The plumbing — protocols, orchestration, and tool layers agents run on.

8 tools in this category

INF·0330k your app one call LiteLLM gateway OpenAI Claude Bedrock local spend tracked

LiteLLM

One OpenAI-compatible interface to 100+ model providers. Swap or load-balance across OpenAI, Anthropic, Bedrock, Vertex, and local models without changing your code — and run it as a proxy that tracks spend, sets budgets, and manages keys.

building blockApache-2.0gateway100+ providers
loved
Dennis · in production at company X
Easy to setup, great to manage llm endpoints from different providers. Nice for first level tracing/observability (tracking costs and budget of deparments for example) or token cost optimisation via headroom as u set it up once and it works for the whole company.