Trending/MCP servers

MCP serversLLM & modelsAgents & orchestration

BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and…

★ 62KWeek rank 79 · star gain starts at the next snapshot

View on GitHub

From the README

🚅 LiteLLM LiteLLM AI Gateway Open Source AI Gateway for 100+ LLMs. Self-hosted.

Setup prompt

Paste this into Cursor or Claude Code. It only includes install lines found in the README, and it asks the agent to review the code first.

Set up the GitHub repository BerriAI/litellm (The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]).
Repository: https://github.com/BerriAI/litellm

Official install commands found in the README:
uv add litellm

Clone the repository and follow those steps. Do not invent package names or extra install commands.
Review the code before running anything.

Buzz by window

Same mentions, three half-lives. This is not a star history. Star gain appears after a second daily snapshot.

  • Today0.55
  • Week1.60
  • Month2.08

Spotted on

Related

Report a problem or request removal