FareedKhan-dev / train-tiny-llmLinks
Train a 29M parameter GPT from Scratch
☆30Updated 9 months ago
Alternatives and similar repositories for train-tiny-llm
Users that are interested in train-tiny-llm are comparing it to the libraries listed below
Sorting:
- Building LLaMA 4 MoE from Scratch☆70Updated 8 months ago
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆195Updated last year
- A straightforward method for training your LLM, from downloading data to generating text.☆493Updated 4 months ago
- A Straightforward, Step-by-Step Implementation of a Video Diffusion Model☆69Updated 4 months ago
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆195Updated last year
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆74Updated 8 months ago
- Maximizing the Performance of a Simple RAG using RL☆87Updated 9 months ago
- First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…☆180Updated 5 months ago
- Building a GPT-like LLM from scratch with PyTorch.☆324Updated last year
- An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning☆37Updated 7 months ago
- ☆103Updated 9 months ago
- 🎈 A series of lightweight GPT models featuring TinyGPT Base (~51M params) and TinyGPT-MoE (~85M params). Fast, creative text generation …☆15Updated 3 weeks ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆126Updated 10 months ago
- Self improving agentic rag pipeline☆105Updated last month
- Structured pruning and bias visualization for Large Language Models. Tools for LLM optimization and fairness analysis.☆26Updated 3 weeks ago
- UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities☆131Updated 7 months ago
- Inference, Fine Tuning and many more recipes with Gemma family of models☆276Updated 5 months ago
- A Deep Thinking RAG Pipeline to Solve Complex Queries☆107Updated 2 months ago
- Verifiers for LLM Reinforcement Learning☆79Updated 3 months ago
- Coding an LLM and its building blocks from scratch.☆104Updated 9 months ago
- [ACL 2025] RetroLLM: Empowering LLMs to Retrieve Fine-grained Evidence within Generation☆118Updated 11 months ago
- BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with …☆114Updated 2 years ago
- minimal GRPO implementation from scratch☆101Updated 9 months ago
- This project is an implementation of the paper from Google Research: DS-STAR: A State-of-the-Art Versatile Data Science Agent.☆102Updated 3 weeks ago
- a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model☆167Updated last year
- An open source implementation of LFMs from Liquid AI: Liquid Foundation Models☆114Updated last year
- This is an open-source version of OpenAI's O1 Model Series by Siraj Raval & O1-Preview☆97Updated last year
- ☆46Updated 9 months ago
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆455Updated 4 months ago
- The code repository of the paper: Competition and Attraction Improve Model Fusion☆169Updated 4 months ago