Atlas
← back to all tools
INF · Agent infrastructure

LiteLLM

One OpenAI-compatible interface to 100+ model providers. Swap or load-balance across OpenAI, Anthropic, Bedrock, Vertex, and local models without changing your code — and run it as a proxy that tracks spend, sets budgets, and manages keys.

view source ↗★ 30k stars
your app one call LiteLLM gateway OpenAI Claude Bedrock local spend tracked

license

Apache-2.0

language

Python

status

bookmarked

added

2026-06-30

categories

INF · Agent infrastructure

tags

building blockgateway100+ providersOpenAI-compatible

what we've heard

1 note from the team

loved
Dennis · in production at company X
Easy to setup, great to manage llm endpoints from different providers. Nice for first level tracing/observability (tracking costs and budget of deparments for example) or token cost optimisation via headroom as u set it up once and it works for the whole company.