GitHub · GitHub: llm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Stars: 86146 · 语言: Python
und
GitHub · GitHub: llm
A high-throughput and memory-efficient inference and serving engine for LLMs
Stars: 86146 · 语言: Python