Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆214May 12, 2024Updated 2 years ago
Alternatives and similar repositories for create-million-parameter-llm-from-scratch
Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆221Aug 23, 2024Updated 2 years ago
- transformer again in the same manner as I did in my previous blog (for both coders and non-coders), providing a complete guide with a ste…☆10Dec 18, 2023Updated 2 years ago
- Train a 29M parameter GPT from Scratch☆58Mar 4, 2025Updated last year
- A straightforward explanation of how DeepSeek R1 works☆20Feb 7, 2025Updated last year
- This project focuses on generating a diverse and realistic dataset for computer vision training using ChatGPT and a realistic vision imag…☆13Dec 15, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- In this blog, we will build a small scale text-to-video model from scratch. We will input a text prompt, and our trained model will gener…☆239Jun 23, 2024Updated 2 years ago
- Implemented a stable diffusion architecture using PyTorch.☆93Jan 3, 2024Updated 2 years ago
- Contextual Engineering Pipeline☆27Mar 5, 2026Updated 8 months ago
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆82Apr 4, 2025Updated last year
- Generating diverse and realistic datasets for computer vision training using AI.☆19Dec 28, 2024Updated last year
- A Straightforward, Step-by-Step Implementation of a Video Diffusion Model☆90Aug 18, 2025Updated last year
- Building a multi-agent RAG system with advanced RAG methods☆13Jan 12, 2025Updated last year
- An automated Python tool that uses LLMs and internet to automatically fix your code until it runs perfectly.☆34Jan 22, 2025Updated last year
- Train GPT-2 from scratch on a single GPU. Companion code for the Pre-Training from Scratch book.☆13Feb 1, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An autonomous agentic pipeline that finds, proves, and patches real C memory-safety vulnerabilities end-to-end using a single 7B open-sou…☆19Jun 16, 2026Updated 5 months ago
- Reverse Engineering of the Mythos Architecture — What I Think☆26May 15, 2026Updated 6 months ago
- Building LLaMA 4 MoE from Scratch☆83Apr 15, 2025Updated last year
- A straightforward method to reduce your LLM inference API costs and token usage.☆26May 18, 2025Updated last year
- A 45M parameter foundation tool-calling model for phones, wearables, smart home and robots☆13Aug 15, 2026Updated 3 months ago
- A Step-by-Step Implementation of RAPTOR based RAG implementation☆44Sep 1, 2025Updated last year
- Building DeepSeek R1 from Scratch☆809Updated this week
- ☆13Jun 18, 2024Updated 2 years ago
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆170Aug 11, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Llama from scratch, or How to implement a paper without crying☆582May 29, 2024Updated 2 years ago
- A Step-by-Step Implementation of Qwen 3 MoE Architecture from Scratch☆89Aug 5, 2025Updated last year
- AI agent that controls a computer☆64Feb 23, 2025Updated last year
- PaLM-Kosmos-Vision is a foundational project showcasing basic ChatGPT with vision capabilities, inviting further development for advanced…☆16Nov 15, 2023Updated 3 years ago
- Training architecture for self-improving AI agents.☆77Nov 4, 2025Updated last year
- An implementation of the base GPT-3 Model architecture from the paper by OPENAI "Language Models are Few-Shot Learners"☆23Jun 29, 2024Updated 2 years ago
- Maximizing the Performance of a Simple RAG using RL☆97Mar 20, 2025Updated last year
- LLM Based NLP Library.☆90Jul 28, 2024Updated 2 years ago
- This repo walks you through how to use transfer learning to fine tune a LLM (large language model) using UK Supreme Court case law as the…☆46Aug 8, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- NLP/LLM Mlops Pipeline to dev/train/evaluation, scalable deploy and monitoring systems.☆23Mar 15, 2024Updated 2 years ago
- A Step-by-Step Implementation of Google Veo 3 Architecture from Scratch☆85Jun 16, 2025Updated last year
- One billion LLM-grounded social agents that make zero model calls at runtime. A 235B open teacher is paid once, offline, and frozen into …☆18Aug 12, 2026Updated 3 months ago
- Composition of Multimodal Language Models From Scratch☆16Aug 16, 2024Updated 2 years ago
- A Curated Collection of LLM resources (work in progress).☆26Jan 9, 2026Updated 10 months ago
- code for tensorflow wide and deep codelab☆12Sep 23, 2016Updated 10 years ago
- Implementation of 12 AI agents evaluation techniques☆52Jul 31, 2025Updated last year
Are these results useful?