Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆212May 12, 2024Updated 2 years ago
Alternatives and similar repositories for create-million-parameter-llm-from-scratch
Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆217Aug 23, 2024Updated 2 years ago
- Train a 29M parameter GPT from Scratch☆51Mar 4, 2025Updated last year
- A Straightforward, Step-by-Step Implementation of a Video Diffusion Model☆86Aug 18, 2025Updated last year
- A straightforward explanation of how DeepSeek R1 works☆19Feb 7, 2025Updated last year
- Notes and code for Programming Massively Parallel Processors☆13Mar 29, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Using the OpenAI Gym library, I implemented two reinforcement learning algorithms in the Frozen Lake environment.☆11Feb 10, 2024Updated 2 years ago
- PaLM-Kosmos-Vision is a foundational project showcasing basic ChatGPT with vision capabilities, inviting further development for advanced…☆16Nov 15, 2023Updated 2 years ago
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆79Apr 4, 2025Updated last year
- ☆30Jun 20, 2024Updated 2 years ago
- NLP/LLM Mlops Pipeline to dev/train/evaluation, scalable deploy and monitoring systems.☆23Mar 15, 2024Updated 2 years ago
- Implementation of various data science techniques and research papers☆31Dec 15, 2024Updated last year
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆170Aug 11, 2025Updated last year
- Composition of Multimodal Language Models From Scratch☆15Aug 16, 2024Updated 2 years ago
- Llama from scratch, or How to implement a paper without crying☆582May 29, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Notebooks from YouTube videos☆19Dec 27, 2021Updated 4 years ago
- Intelligent Help for Efficient Programming☆18Jan 11, 2024Updated 2 years ago
- This repository is a voice search demo using OpenAI Whisper, DuckDB, and the Metaphone algorithm. The associate blog post is here: https:…☆13May 15, 2024Updated 2 years ago
- Multivariate Time Series Classification- Activity Recognition☆16Jun 5, 2020Updated 6 years ago
- Trained a 114 million Parameter LLM from Scratch.☆19Jul 21, 2024Updated 2 years ago
- An implementation of the base GPT-3 Model architecture from the paper by OPENAI "Language Models are Few-Shot Learners"☆22Jun 29, 2024Updated 2 years ago
- Building LLaMA 4 MoE from Scratch☆79Apr 15, 2025Updated last year
- An app that extracts your twitter threads into a downloadable CSV file.☆13Apr 8, 2023Updated 3 years ago
- ASL Fingerspelling recognition in the wild☆12Nov 21, 2019Updated 6 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- An LLM-powered advanced RAG pipeline built from scratch☆859Jan 26, 2024Updated 2 years ago
- Code companion for the RL Post-Training Handbook - training reasoning models on a single GPU☆20Jan 30, 2026Updated 7 months ago
- Quick tutorial showing how to fine-tune Llama3.1 with nothing but free tools and text data. All code included in ipynb. For a step by ste…☆10Aug 17, 2024Updated 2 years ago
- PredictHub is a sophisticated stock price prediction platform that combines machine learning with real-time market data analysis. The app…☆14Aug 15, 2025Updated last year
- A hackable, simple, and reseach-friendly GRPO Training Framework with high speed weight synchronization in a multinode environment.☆38Aug 27, 2025Updated last year
- We tried to make an app using which users can book Bike and one rider along with a bike can help customers to reach his/her destiny. This…☆13Jul 14, 2021Updated 5 years ago
- Intuitive RAG system on top of LllamaIndex☆15Nov 8, 2024Updated last year
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆33May 29, 2023Updated 3 years ago
- Building a GPT-like LLM from scratch with PyTorch.☆370Dec 20, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Meditation generation using streamlit, OpenAI GPT and Google TTS☆10Mar 17, 2025Updated last year
- C# Word2Vec object with fast neighbor search. Format compatible with gensim☆25May 18, 2020Updated 6 years ago
- AutoStreamlit Studio is an intelligent assistant designed to streamline the creation of Streamlit applications. Whether you're a seasoned…☆18Jul 1, 2024Updated 2 years ago
- AgenticSearch operates within an agentic workflow, utilizing Gemini 2.0 and an extensive tool registry to handle complex questions. By in…☆31Jan 16, 2025Updated last year
- A pytest plugin to organize and track algorithm visualizations☆18Dec 1, 2024Updated last year
- Simple repository for training small reasoning models☆51Aug 4, 2026Updated last month
- flowchart dataset proposed with FR-DETR☆10Jun 28, 2022Updated 4 years ago