OSS Radar
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step. Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Stars
108k
Last 24h
+90est.
Last 7 days
+630est.
Forks
17k
Related repos
All LLMs-from-scratch alternatives →- rohitg00/ai-engineering-from-scratch+2.8k stars this week
Learn AI Engineering! Learn it. Build it. Ship it for others.
- huggingface/transformers+285 stars this week
Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for…
- f/prompts.chat+856 stars this week
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community.
- MakazhanAlpamys/Soup+198 stars this week
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Star history
GitHub stars over time. A steeper line means the repo is gaining attention faster.
Not enough history yet. OSS Radar records stars every hour, so this chart fills in over the next few hours.
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Discussed on Hacker News
Hacker News is a popular tech discussion site. 17 stories link to this repo, with 1.2k upvotes (points) in total.
Implementing a ChatGPT-like LLM from scratch, step by step739 points · 98 comments · Jan 27, 2024See all 17 on HN search →Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/rasbt/LLMs-from-scratch)<a href="https://ossradar.net/repo/rasbt/LLMs-from-scratch"><img src="https://ossradar.net/badge/rasbt/LLMs-from-scratch" alt="Trending on OSS Radar"></a>About LLMs-from-scratch
rasbt/LLMs-from-scratch is a Jupyter Notebook project in the LLM tooling category, created 3 years ago. It has 108k GitHub stars and 17k forks, and gained +630 stars over the last 7 days (early estimate), ranking #48 of 162 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week. Looking for something similar? See LLMs-from-scratch alternatives.
- Language
- Jupyter Notebook
- Category
- LLM tooling
- License
- Other (custom license)
- Created
- Jul 23, 2023
- Last code push
- today (Oct 30, 2026)
- Latest release
- No releases yet
- AI
- artificial intelligence
- attention mechanism
- deep learning
- finetuning
- from scratch
- generative AI
- GPT
- instruction tuning
- language model
- large language models
- LLM
- machine learning
- natural language processing
- pretraining
- Python
- PyTorch
- tokenizer
- transformers
Rising in LLM tooling this week
- DietrichGebert/ponytail+5.4k stars this week
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
- Niko1221/Strata+4.8k stars this week
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux.
- Graphify-Labs/graphify+4.8k stars this week
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph.
- ai-job-search-dev/ai-job-search+3.4k stars this week
The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover…
- lemomo-ai/lemo-opuscar+3.3k stars this week
A toolbox of film styles made in code for Claude Code: 66 ready to use, and your own.
- nightly-labs/openbot+3.1k stars this week
A local-first desktop workspace for persistent AI teammates. Run Codex, Claude, and Grok with dedicated workspaces, task queues, file…
rasbt/LLMs-from-scratch is #134 of 450 on today's leaderboard.