Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆213May 12, 2024Updated 2 years ago
Alternatives and similar repositories for create-million-parameter-llm-from-scratch
Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- transformer again in the same manner as I did in my previous blog (for both coders and non-coders), providing a complete guide with a ste…☆10Dec 18, 2023Updated 2 years ago
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆219Aug 23, 2024Updated 2 years ago
- Train a 29M parameter GPT from Scratch☆56Mar 4, 2025Updated last year
- A straightforward explanation of how DeepSeek R1 works☆20Feb 7, 2025Updated last year
- This project focuses on generating a diverse and realistic dataset for computer vision training using ChatGPT and a realistic vision imag…☆13Dec 15, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- In this blog, we will build a small scale text-to-video model from scratch. We will input a text prompt, and our trained model will gener…☆238Jun 23, 2024Updated 2 years ago
- Gemini, as capable as GPT-4, provides a free API with limited access. I tested it with the help of prompt engineering and found that it c…☆37Jan 19, 2024Updated 2 years ago
- Intelligent Help for Efficient Programming☆18Jan 11, 2024Updated 2 years ago
- A Beginner's Guide to Monetizing Your Python AI Chatbot☆19Apr 22, 2025Updated last year
- We have listed some of the free and powerful GenAI APIs and explore their benefit and usage.☆16Feb 3, 2024Updated 2 years ago
- ☆14May 5, 2026Updated 5 months ago
- This repo is my attempt at a rough implementation of nanoGPT trained on a dataset of 30,000 unique Twitter usernames☆23Apr 7, 2024Updated 2 years ago
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆80Apr 4, 2025Updated last year
- Train GPT-2 from scratch on a single GPU. Companion code for the Pre-Training from Scratch book.☆12Feb 1, 2026Updated 9 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Deep Learning Paper Implementations in PyTorch☆17Mar 26, 2025Updated last year
- An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'☆56Aug 19, 2024Updated 2 years ago
- ☆13Jun 18, 2024Updated 2 years ago
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆170Aug 11, 2025Updated last year
- Building DeepSeek R1 from Scratch☆803Mar 21, 2025Updated last year
- PaLM-Kosmos-Vision is a foundational project showcasing basic ChatGPT with vision capabilities, inviting further development for advanced…☆16Nov 15, 2023Updated 2 years ago
- A step by step implementation of a complex AI Evaluation System Designing☆23Sep 9, 2025Updated last year
- Building LLaMA 4 MoE from Scratch☆80Apr 15, 2025Updated last year
- Llama from scratch, or How to implement a paper without crying☆582May 29, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- NLP/LLM Mlops Pipeline to dev/train/evaluation, scalable deploy and monitoring systems.☆23Mar 15, 2024Updated 2 years ago
- ☆15Apr 21, 2024Updated 2 years ago
- Google AI Chat is an AI-powered chat application built with Streamlit and Python. This application allows you to interact with Google AI …☆14Dec 23, 2023Updated 2 years ago
- ☆30Jun 20, 2024Updated 2 years ago
- A Curated Collection of LLM resources (work in progress).☆26Jan 9, 2026Updated 9 months ago
- Composition of Multimodal Language Models From Scratch☆16Aug 16, 2024Updated 2 years ago
- A Step-by-Step Implementation of Qwen 3 MoE Architecture from Scratch☆87Aug 5, 2025Updated last year
- 100 Days of GPU Challenge☆27Nov 15, 2025Updated 11 months ago
- This repository is a voice search demo using OpenAI Whisper, DuckDB, and the Metaphone algorithm. The associate blog post is here: https:…☆13May 15, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Trained a 114 million Parameter LLM from Scratch.☆19Jul 21, 2024Updated 2 years ago
- 一些 LLM 方面的从零复现笔记☆262Apr 29, 2025Updated last year
- Building a Claude-like agentic system.☆67May 1, 2026Updated 6 months ago
- ☆24Jun 12, 2024Updated 2 years ago
- Meditation generation using streamlit, OpenAI GPT and Google TTS☆10Mar 17, 2025Updated last year
- Handling Big Data with Knowledge Graph: A Detailed Guide☆31May 11, 2025Updated last year
- A straightforward method to reduce your LLM inference API costs and token usage.☆25May 18, 2025Updated last year