Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆212May 12, 2024Updated 2 years ago
Alternatives and similar repositories for create-million-parameter-llm-from-scratch
Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆212Aug 23, 2024Updated last year
- Understanding Large Language Transformer Architecture like a child☆34Apr 3, 2024Updated 2 years ago
- Train a 29M parameter GPT from Scratch☆48Mar 4, 2025Updated last year
- Building a multi-agent RAG system with advanced RAG methods☆13Jan 12, 2025Updated last year
- Implemented a stable diffusion architecture using PyTorch.☆91Jan 3, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Notes and code for Programming Massively Parallel Processors☆13Mar 29, 2025Updated last year
- 100 Days of GPU Challenge☆26Nov 15, 2025Updated 8 months ago
- PaLM-Kosmos-Vision is a foundational project showcasing basic ChatGPT with vision capabilities, inviting further development for advanced…☆16Nov 15, 2023Updated 2 years ago
- ☆15Apr 21, 2024Updated 2 years ago
- ☆12Jan 24, 2025Updated last year
- NLP/LLM Mlops Pipeline to dev/train/evaluation, scalable deploy and monitoring systems.☆22Mar 15, 2024Updated 2 years ago
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆169Aug 11, 2025Updated 11 months ago
- ☆12Feb 16, 2026Updated 5 months ago
- Trained a 114 million Parameter LLM from Scratch.☆19Jul 21, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆24Jun 12, 2024Updated 2 years ago
- An implementation of the base GPT-3 Model architecture from the paper by OPENAI "Language Models are Few-Shot Learners"☆22Jun 29, 2024Updated 2 years ago
- 🚀 A structured data pipeline project using dbt and Snowflake to transform raw data into curated datasets. This project covers data inges…☆14Mar 17, 2025Updated last year
- gantt-view-js extend Jquery☆12Aug 16, 2017Updated 8 years ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆16Apr 30, 2025Updated last year
- An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'☆56Aug 19, 2024Updated last year
- A full-stack web chatbot application integrated with Ollama☆12Jul 31, 2024Updated last year
- A thin veneer of F#ness arround several different frameworks to make a light weight Mvc framework.☆17Sep 5, 2011Updated 14 years ago
- PredictHub is a sophisticated stock price prediction platform that combines machine learning with real-time market data analysis. The app…☆14Aug 15, 2025Updated 11 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A hackable, simple, and reseach-friendly GRPO Training Framework with high speed weight synchronization in a multinode environment.☆38Aug 27, 2025Updated 10 months ago
- We tried to make an app using which users can book Bike and one rider along with a bike can help customers to reach his/her destiny. This…☆13Jul 14, 2021Updated 5 years ago
- prompt提示词工程快速上手☆29Aug 30, 2024Updated last year
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆34May 29, 2023Updated 3 years ago
- 一些 LLM 方面的从零复现笔记☆256Apr 29, 2025Updated last year
- Simple repository for training small reasoning models☆51Feb 17, 2026Updated 5 months ago
- AgenticSearch operates within an agentic workflow, utilizing Gemini 2.0 and an extensive tool registry to handle complex questions. By in…☆32Jan 16, 2025Updated last year
- Algorithms and Data Structures written in Kotlin☆21Aug 1, 2020Updated 5 years ago
- swe-jyotisa-lib (beta version)☆19May 4, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Finetuning and Inference of Llama2 7b model on colab☆14Jul 19, 2023Updated 3 years ago
- Building DeepSeek R1 from Scratch☆782Mar 21, 2025Updated last year
- A simple Vulkan Project written in C☆10Feb 14, 2025Updated last year
- Automate web research way beyond the first page of search results; curate knowledge bases to chat with.☆45Jul 30, 2025Updated 11 months ago
- RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct☆31Feb 23, 2025Updated last year
- Train a 1B LLM with 1T tokens from scratch by personal☆810Apr 27, 2025Updated last year
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆78Apr 4, 2025Updated last year