FareedKhan-dev / train-tiny-llmLinks
Train a 29M parameter GPT from Scratch
☆32Updated 11 months ago
Alternatives and similar repositories for train-tiny-llm
Users that are interested in train-tiny-llm are comparing it to the libraries listed below
Sorting:
- Maximizing the Performance of a Simple RAG using RL☆90Updated 10 months ago
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆197Updated last year
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆200Updated last year
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆77Updated 10 months ago
- Building a GPT-like LLM from scratch with PyTorch.☆334Updated last year
- An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning☆37Updated 8 months ago
- A Straightforward, Step-by-Step Implementation of a Video Diffusion Model☆75Updated 5 months ago
- First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…☆181Updated 6 months ago
- ☆107Updated 10 months ago
- Building LLaMA 4 MoE from Scratch☆72Updated 9 months ago
- An automated Python tool that uses LLMs and internet to automatically fix your code until it runs perfectly.☆31Updated last year
- A straightforward method for training your LLM, from downloading data to generating text.☆512Updated 6 months ago
- A Demo of Cache-Augmented Generation (CAG) in an LLM☆120Updated 7 months ago
- Inference, Fine Tuning and many more recipes with Gemma family of models☆279Updated 6 months ago
- 🎈 A series of lightweight GPT models featuring TinyGPT Base (~51M params) and TinyGPT-MoE (~85M params). Fast, creative text generation …☆15Updated 2 months ago
- UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities☆157Updated 8 months ago
- ☆122Updated last month
- ☆27Updated last year
- Structured pruning and bias visualization for Large Language Models. Tools for LLM optimization and fairness analysis.☆27Updated this week
- Code for Medium blog posts☆107Updated 2 weeks ago
- Verifiers for LLM Reinforcement Learning☆81Updated 4 months ago
- The official implementation of the paper "Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models".☆87Updated 10 months ago
- Intelligent Help for Efficient Programming☆18Updated 2 years ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆128Updated 11 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated last year
- This project implements a demonstrator agent that compares the Cache-Augmented Generation (CAG) Framework with traditional Retrieval-Augm…☆31Updated last year
- Build your own RAG and run it locally on your laptop: ColBERT + DSPy + Streamlit☆60Updated last year
- ☆159Updated 9 months ago
- ☆40Updated last year
- This repository contains a pipeline for fine-tuning Large Language Models (LLMs) for Text-to-SQL conversion using General Reward Proximal…☆44Updated 9 months ago