GitHub · GitHub: llm

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Stars: 30253 · 语言: Python