vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
At a glance
Is this tool relevant to you?
What it does
A high-throughput and memory-efficient inference and serving engine for LLMs
May suit
People who need to run, serve, or optimize AI models.
Before you try it
The repository reports a Apache-2.0 license. Setup difficulty and device support still need to be checked upstream.
Evidence & freshness
What we know, and how recently we checked
Core repository facts were fetched from GitHub and passed the catalog quality checks at the displayed source timestamp.
- Source
- Verified GitHub snapshot
- Checked
- Snapshot evidence level
- High confidence
- Maintenance signal
- Strong86/100
Strong automated signals across recent activity, community, and project upkeep.
The health score is an automated maintenance signal, not a security audit or a guarantee that the tool fits your needs.
How verification and health scoring work
Catalog-verified records use a timestamped GitHub snapshot that passed source and completeness checks. Basic listings come from the wider automated sync and have not yet passed that stronger verification path.
Health combines recent activity, commit frequency, issue handling, contributor depth, release cadence, documentation, and community signals. Missing evidence lowers how much confidence you should place in the number.
Read the full methodology →⭐
93.1K
Stars
🍴
16.7K
Forks
👥
2.6K
Contributors
💚
Strong86/100
Health Score
Star History
Health Score Breakdown
Star Momentum
93
Commit Frequency
100
Issue Health
60
Contributors
100
Release Cadence
80
Documentation
100
Community Signal
100
Project Info
- Language
- Python
- License
- Apache-2.0
- Last Commit
- 2026-10-04 06:11 UTC
- Last Release
- v0.20.2 (2026-09-22 05:20 UTC)
- Open Issues
- 4.9K
- Bus Factor
- 10
- Commits/Week
- 208.8
- Avg Issue Close
- 10.4 days
amdblackwellcudadeepseekdeepseek-v3gptgpt-ossinferencekimillamallmllm-servingmodel-servingmoeopenaipytorchqwenqwen3tputransformer
Project Badge
Embed a live health badge in a README or docs page.
[](https://ai-tools-scout.com/projects/vllm)Related tools to compare with vllm
Suggested automatically from the same category and shared topics, then ordered by current maintenance and adoption signals.
vllm vs SglangStrong87/100
30.6K stars+3.0K weekly
Basic listing
vllm vs LlamafactoryHealthy75/100
73.5K stars+2.3K weekly
Basic listing
vllm vs ollamaStrong88/100
182.2K stars+450 weekly
Verified snapshot
vllm vs prompts.chatHealthy77/100
172.0K stars+4.2K weekly
Verified snapshot
vllm vs LightragStrong95/100
38.0K stars+3.0K weekly
Basic listing
Weekly AI open-source movers
Get the fastest-growing projects, useful MCP servers, and technical reads in one weekly email.