#01Framework
ECC
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
232.2K stars95/100 healthJavaScript
Curated from the live project index
Compare 30 leading open source LLM runtimes, serving engines, interfaces, frameworks, and developer tools. The shortlist combines GitHub adoption with current momentum, maintenance health, and recent repository activity.
Side-by-side signals
| Project | Primary role | Stars | Weekly | Health | Language | Updated |
|---|---|---|---|---|---|---|
| ECC | Framework | 232.2K | +52.6K | Strong95/100 | JavaScript | 8h ago |
| hermes-agent | Framework | 218.9K | +74.1K | Strong100/100 | Python | 6h ago |
| AutoGPT | LLM tooling | 185.7K | +174 | Strong90/100 | Python | 6h ago |
| ollama | Runtime & serving | 176.7K | +450 | Strong90/100 | Go | 17h ago |
| prompts.chat | LLM tooling | 166.2K | +4.2K | Healthy77/100 | HTML | 21h ago |
| transformers | Runtime & serving | 162.8K | +220 | Strong91/100 | Python | 7h ago |
| firecrawl | LLM tooling | 154.5K | +36.0K | Strong82/100 | TypeScript | 6h ago |
| langflow | Interface | 152.2K | +4.2K | Strong88/100 | Python | 6h ago |
| dify | Framework | 149.8K | +815 | Strong94/100 | TypeScript | 8h ago |
| open-webui | Runtime & serving | 146.4K | +1.0K | Strong95/100 | Python | 11h ago |
| langchain | Framework | 142.3K | +599 | Strong86/100 | Python | 7h ago |
| awesome-llm-apps | Framework | 126.2K | +16.4K | Healthy76/100 | Python | 20h ago |
| llama.cpp | Runtime & serving | 121.3K | +1.2K | Strong95/100 | C++ | 8h ago |
| generative-ai-for-beginners | Interface | 113.4K | +2.7K | Healthy70/100 | Jupyter Notebook | 1d ago |
| browser-use | LLM tooling | 106.1K | +12.7K | Strong89/100 | Python | 6h ago |
Explore the shortlist
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
The agent that grows with you
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
The API to search, scrape, and interact with the web at scale. 🔥
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
The agent engineering platform.
100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.
LLM inference in C/C++
21 Lessons, Get Started Building with Generative AI
🌐 Make websites accessible for AI agents. Automate tasks online with ease.
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
TradingAgents: Multi-Agents LLM Financial Trading Framework
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.
🪨 why use many token when few token do trick — Claude Code skill that cuts 65% of tokens by talking like caveman
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
A high-throughput and memory-efficient inference and serving engine for LLMs
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
🙌 OpenHands: AI-Driven Development
How to choose
Prioritize hardware support, quantization formats, setup friction, model compatibility, and offline operation.
Evaluate throughput, latency, batching, observability, scaling, API compatibility, and accelerator support.
Check extension points, data connectors, authentication, deployment model, user experience, and upgrade cadence.
Quick answers
This page includes infrastructure and applications built around large language models: local runtimes, inference and serving engines, developer frameworks, model interfaces, evaluation tools, and other repositories with a clear LLM signal. It is not limited to model-weight repositories.
Choose by the layer you need. A local runtime is useful for running models on a workstation, a serving engine targets production inference, an interface adds an end-user experience, and a framework helps developers build applications. Compare projects within the same role before choosing.
Stars are useful evidence of awareness and adoption, but they are not a quality guarantee. Maintenance health, recent releases, hardware support, license, throughput, integrations, and your deployment constraints can be more important.
It depends on both the software license and the license of the model you run. Review the upstream repository, model terms, dependencies, and hosted-service restrictions before commercial use.
Get the fastest-growing projects, useful MCP servers, and technical reads in one weekly email.