Back to AI Repos
Llm

rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

rasbt/LLMs-from-scratch is an open-source project in the llm space, written mainly in Jupyter Notebook.

It sits at around 104.3k stars and 16k forks, and was last pushed on 2026-09-01.

Everything on this page — the summary, the category and the how-to — is written by HowToPrompts; the link below goes to the original project.

CategoryLlm
Stars104.3k
Forks16k
LanguageJupyter Notebook
Last pushed2026-09-01
Topicsai, artificial-intelligence, attention-mechanism, deep-learning
git clone https://github.com/rasbt/LLMs-from-scratch.git

How to use it

  1. Clone the repository with the command above.
  2. Follow its own README for dependencies and setup.
  3. Check the open issues and last-push date before you build on it.
Compiled and written by HowToPrompts from public sources. Open on GitHub ↗

Related in Llm

ollama/ollamaGet up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.f/prompts.chatF.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source huggingface/transformersTransformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audlangflow-ai/langflowLangflow is a powerful tool for building and deploying AI-powered agents and workflows.open-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)microsoft/generative-ai-for-beginners21 Lessons, Get Started Building with Generative AITauricResearch/TradingAgentsTradingAgents: Multi-Agents LLM Financial Trading Frameworkvllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMsOpenHands/OpenHandsOpenHands: AI-Driven Developmentlobehub/lobehubLobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and r
← Back to AI Repos