Trending/LLM & models

LLM & models

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 95.2KWeek rank 67 · star gain starts at the next snapshot

View on GitHub

From the README

Easy, fast, and cheap LLM serving for everyone | Documentation | Blog | Paper | Twitter/X | User Forum | Developer Slack | 🔥 We have built a vLLM website to help you get started with vLLM. Please visit vllm.ai to learn more.

Setup prompt

Paste this into Cursor or Claude Code. It only includes install lines found in the README, and it asks the agent to review the code first.

Set up the GitHub repository vllm-project/vllm (A high-throughput and memory-efficient inference and serving engine for LLMs).
Repository: https://github.com/vllm-project/vllm

Official install commands found in the README:
uv pip install vllm

Clone the repository and follow those steps. Do not invent package names or extra install commands.
Review the code before running anything.

Buzz by window

Same mentions, three half-lives. This is not a star history. Star gain appears after a second daily snapshot.

  • Today1.03
  • Week1.87
  • Month2.28

Spotted on

Related

Report a problem or request removal