AI Tools Scout
Open-source ToolsLLM ProjectsMCP ServersMethodology
AI Tools Scout

An open-source AI tools directory with clear use cases, visible source freshness, and maintenance evidence for anyone deciding what to try.

Explore
Open source AI projectsOpen source LLM projectsMCP servers list
More
SkillsContentAbout
Rankings use public ecosystem signals. Treat them as a starting point, then confirm license, setup, safety, and fit with the upstream project.
  1. Home
  2. /Open-source Tools
  3. /Shimmy

Shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

GitHub ↗Apache-2.0⚡ Inference

At a glance

Is this tool relevant to you?

What it does

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

May suit

People who need to run, serve, or optimize AI models.

Before you try it

The repository reports a Apache-2.0 license. Setup difficulty and device support still need to be checked upstream.

Evidence & freshness

What we know, and how recently we checked

Needs recheck· 2026-08-31 11:03 UTC

This wider directory record has not passed catalog verification and its last sync is outside the expected refresh window.

Source
Automated project sync
Checked
2026-08-31 11:03 UTC
Snapshot evidence level
Limited confidence
Maintenance signal
Healthy76/100

Generally healthy automated signals, with some areas worth checking in the breakdown.

The health score is an automated maintenance signal, not a security audit or a guarantee that the tool fits your needs.

How verification and health scoring work

Catalog-verified records use a timestamped GitHub snapshot that passed source and completeness checks. Basic listings come from the wider automated sync and have not yet passed that stronger verification path.

Health combines recent activity, commit frequency, issue handling, contributor depth, release cadence, documentation, and community signals. Missing evidence lowers how much confidence you should place in the number.

Read the full methodology →
⭐
5.8K
Stars
🍴
561
Forks
👥
1
Contributors
💚
Healthy76/100
Health Score

Star History

01.5K2.9K4.4K5.8K2026/5/122026/8/31

Health Score Breakdown

Star Momentum
100
Commit Frequency
49
Issue Health
100
Contributors
10
Release Cadence
50
Documentation
100
Community Signal
100

Project Info

Language
Rust
License
Apache-2.0
Last Commit
2026-08-30 22:45 UTC
Last Release
v2.6.4 (2026-08-30 22:48 UTC)
Open Issues
8
Bus Factor
1
Commits/Week
9.7
Avg Issue Close
1.2 days
api-servercommand-line-tooldeveloper-toolsggufhuggingfacehuggingface-modelshuggingface-transformersinference-serverllamallamacppllm-inferencelocal-aimachine-learningollama-apiopenai-compatiblerustrust-cratetransformerswebgpuwebgpu-shaders

Project Badge

Embed a live health badge in a README or docs page.

Shimmy AI Tools Scout badge
[![AI Tools Scout](https://ai-tools-scout.com/api/badge/shimmy?metric=health&style=shield)](https://ai-tools-scout.com/projects/shimmy)

Related tools to compare with Shimmy

Suggested automatically from the same category and shared topics, then ordered by current maintenance and adoption signals.

Shimmy vs LlamafactoryHealthy75/100
73.5K stars+2.3K weekly
Basic listing
Shimmy vs LlmfitStrong90/100
30.4K stars+4.6K weekly
Basic listing
Shimmy vs ollamaStrong88/100
182.2K stars+450 weekly
Verified snapshot
Shimmy vs SglangStrong87/100
30.6K stars+3.0K weekly
Basic listing
Shimmy vs vllmStrong86/100
93.1K stars+606 weekly
Verified snapshot

Weekly AI open-source movers

Get the fastest-growing projects, useful MCP servers, and technical reads in one weekly email.