LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
At a glance
Is this tool relevant to you?
What it does
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
May suit
People who want a usable interface for interacting with AI models.
Before you try it
The repository reports a NOASSERTION license. Setup difficulty and device support still need to be checked upstream.
Evidence & freshness
What we know, and how recently we checked
Core repository facts were fetched from GitHub and passed the catalog quality checks in the current refresh window.
- Source
- Verified GitHub snapshot
- Checked
- Evidence level
- High confidence
- Maintenance signal
- Healthy67/100
Generally healthy automated signals, with some areas worth checking in the breakdown.
The health score is an automated maintenance signal, not a security audit or a guarantee that the tool fits your needs.
How verification and health scoring work
⭐
99.6K
Stars
🍴
15.3K
Forks
👥
67
Contributors
💚
Healthy67/100
Health Score
Star History
Health Score Breakdown
Star Momentum
100
Commit Frequency
4
Issue Health
100
Contributors
100
Release Cadence
10
Documentation
50
Community Signal
100
Project Info
- Language
- Jupyter Notebook
- License
- NOASSERTION
- Last Commit
- 11d ago
- Last Release
- N/A
- Open Issues
- 4
- Bus Factor
- 6
- Commits/Week
- 0.8
- Avg Issue Close
- 1.0 days
aiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpython
Project Badge
Embed a live health badge in a README or docs page.
[](https://ai-tools-scout.com/projects/llms-from-scratch)Related tools to compare with LLMs-from-scratch
Suggested automatically from the same category and shared topics, then ordered by current maintenance and adoption signals.
Weekly AI open-source movers
Get the fastest-growing projects, useful MCP servers, and technical reads in one weekly email.