Trending/LLM & models

LLM & modelsAgents & orchestration

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 37.8KWeek rank 41 · star gain starts at the next snapshot

View on GitHub

From the README

SGLang: Fast inference for LLMs and multimodal models Docs | Cookbook | Website | Blog | Slack SGLang is an open-source inference framework for large language, vision-language, and diffusion models, optimized for agentic workloads, large-scale serving, and RL rollouts. SGLang Diffusion is its built-in image and video generation engine, included in this repository and the `sglang` Python package.

Setup prompt

Paste this into Cursor or Claude Code. It only includes install lines found in the README, and it asks the agent to review the code first.

Set up the GitHub repository sgl-project/sglang (SGLang is a high-performance serving framework for large language models and multimodal models.).
Repository: https://github.com/sgl-project/sglang

Official install commands found in the README:
docker pull lmsysorg/sglang:latest
uv pip install --prerelease=allow sglang
pip install -e "python"

Clone the repository and follow those steps. Do not invent package names or extra install commands.
Review the code before running anything.

Buzz by window

Same mentions, three half-lives. This is not a star history. Star gain appears after a second daily snapshot.

  • Today1.50
  • Week1.87
  • Month1.94

Spotted on

Related

Report a problem or request removal