FareedKhan-dev / train-tiny-llmLinks
Train a 29M parameter GPT from Scratch
☆30Updated 9 months ago
Alternatives and similar repositories for train-tiny-llm
Users that are interested in train-tiny-llm are comparing it to the libraries listed below
Sorting:
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆74Updated 8 months ago
- A Straightforward, Step-by-Step Implementation of a Video Diffusion Model☆67Updated 3 months ago
- Building LLaMA 4 MoE from Scratch☆68Updated 7 months ago
- Building a GPT-like LLM from scratch with PyTorch.☆318Updated 11 months ago
- An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning☆37Updated 6 months ago
- Verifiers for LLM Reinforcement Learning☆79Updated 3 months ago
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆192Updated last year
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆192Updated last year
- A straightforward method for training your LLM, from downloading data to generating text.☆479Updated 4 months ago
- Maximizing the Performance of a Simple RAG using RL☆87Updated 8 months ago
- 🎈 A series of lightweight GPT models featuring TinyGPT Base (~51M params) and TinyGPT-MoE (~85M params). Fast, creative text generation …☆15Updated last week
- A Demo of Cache-Augmented Generation (CAG) in an LLM☆119Updated 6 months ago
- ☆101Updated 8 months ago
- Simple examples using Argilla tools to build AI☆56Updated last year
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆124Updated 10 months ago
- Luth is a state-of-the-art series of fine-tuned LLMs for French☆40Updated last month
- Coding an LLM and its building blocks from scratch.☆103Updated 8 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 8 months ago
- ☆26Updated last year
- minimal GRPO implementation from scratch☆100Updated 8 months ago
- [ACL 2025] RetroLLM: Empowering LLMs to Retrieve Fine-grained Evidence within Generation☆118Updated 10 months ago
- ☆45Updated 7 months ago
- One click templates for inferencing Language Models☆221Updated 3 weeks ago
- Structured pruning and bias visualization for Large Language Models. Tools for LLM optimization and fairness analysis.☆25Updated last week
- ☆57Updated 10 months ago
- Inference, Fine Tuning and many more recipes with Gemma family of models☆275Updated 4 months ago
- AI Agent that researches the lives of historical figures and extracts events into structured JSON timelines using LangGraph multi-agent o…☆206Updated last month
- An automated Python tool that uses LLMs and internet to automatically fix your code until it runs perfectly.☆29Updated 10 months ago
- Super basic implementation (gist-like) of RLMs with REPL environments.☆278Updated last month
- Easy to use, High Performant Knowledge Distillation for LLMs☆97Updated 7 months ago