vLLM icon
Open Source LLMs

vLLM

🇨🇳 中文 / 🇬🇧 English — 双语介绍
🇨🇳 中文

vLLM 是高性能LLM推理引擎,采用PagedAttention技术,是生产环境部署的首选方案。Stars 40k+。

🇬🇧 English

High-throughput LLM inference engine with PagedAttention. Essential for production deployments needing low latency and efficient GPU memory management. 🔗 Stars 40k+ github.com/vllm-project/vllm

📋 Product Info

Category: Open Source LLMs
Listed on: 2026-07-19
Last verified: 2026-08-21
Official site: https://vllm.ai
Tags: LLM, Inference, Performance

🎯 Why This Tool

vLLM belongs to the Open Source LLMs category on hedirbase. Tagged with: LLM, Inference, Performance.

High-throughput LLM inference engine with PagedAttention. Essential for production deployments needing low latency and efficient GPU memory management. 🔗 Stars 40k+ github.com/vllm-project/vllm

✓ Manually reviewed ✅ Last verified: 2026-08-21 🌐 Curated for independents
🌎 访问 vLLM →