This project aims to replicate mainstream open-source model architectures with limited computational resources, implementing mini models with 100-200M parameters.
☆292Aug 24, 2026Updated last month
Alternatives and similar repositories for Mini-LLM
Users that are interested in Mini-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.☆4,684Oct 1, 2026Updated 2 weeks ago
- 从零开始学大模型Transformer、GPT2、BERT pre-training and fine-tuning from scratch☆41Jul 1, 2024Updated 2 years ago
- ☆15May 10, 2026Updated 5 months ago
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,323May 17, 2026Updated 5 months ago
- 🧠 Train a 64M-parameter LLM from scratch in just 2h!☆63,891Sep 22, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An LLM training framework built from the ground up, featuring a custom BumbleBee architecture and end-to-end support for multiple open-so…☆72Aug 24, 2026Updated last month
- 手撕transformer并完成一个简单的机器翻译。☆24Feb 19, 2025Updated last year
- 从零构建大模型：从预训练到RLHF的完整实践☆2,700Aug 21, 2026Updated last month
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated last year
- ☆21Apr 21, 2026Updated 5 months ago
- 🎓从0开始训练一个大模型Minimind项目的超详细解析，包括但不限于用到的架构，算法，以及大模型面试经验☆1,801May 25, 2026Updated 4 months ago
- 复现大模型相关算法及一些学习记录☆3,551Jul 2, 2026Updated 3 months ago
- CAD - Memory Efficient Convolutional Adapter for Segment Anything☆12Oct 4, 2024Updated 2 years ago
- My implementation of Stanford CS336 assignments.☆244Mar 15, 2026Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- slime is an LLM training framework for RL Scaling.☆8,677Updated this week
- 通过动画学强化学习笔记☆69Apr 23, 2026Updated 5 months ago
- Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation☆1,078Aug 29, 2026Updated last month
- 这是一个从头训练大语言模型的项目，包括预训练、微调和直接偏好优化，模型拥有1B参数，支持中英文。☆873Feb 18, 2025Updated last year
- A minimal PyTorch re-implementation of Qwen 3.8☆453Aug 30, 2026Updated last month
- ☆56Nov 22, 2025Updated 10 months ago
- ☆152Jan 18, 2026Updated 9 months ago
- A from-scratch Prefill/Decode disaggregation inference engine for LLMs☆161May 10, 2026Updated 5 months ago
- 一份面向实践者的 verl 框架使用教程。verl 是字节跳动开源的大语言模型强化学习训练框架，支持 PPO、GRPO 等多种算法，以及分布式训练、AgentRL 等场景。☆154Jul 2, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Pytorch implementation of WaveNet ASR (Automatic Speech Recognition)☆13Sep 22, 2021Updated 5 years ago
- This repository presents the original implementation of Pretraining Data Detection for Large Language Models: A Divergence-based Calibrat…☆23May 21, 2025Updated last year
- learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen☆4,773Sep 27, 2026Updated 3 weeks ago
- 《汇编语言一发入魂》配套代码☆15May 30, 2020Updated 6 years ago
- Agentic RL最详细入门☆380Aug 6, 2026Updated 2 months ago
- 从零复现 minimind👉minimind-v☆409Dec 24, 2025Updated 9 months ago
- This is a repository to practice multi-thread programming in C++☆33Feb 21, 2024Updated 2 years ago
- Co-Reinforcement Learning for Unified Multimodal Understanding and Generation☆48Jul 22, 2025Updated last year
- 分享AI Infra知识&代码练习：PyTorch、vLLM/SGLang、slime/vime框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等☆4,187Sep 20, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 轻量级大语言模型MiniMind的源码解读，包含tokenizer、RoPE、MoE、KV Cache、pretraining、SFT、LoRA、DPO等完整流程☆1,220Jun 16, 2025Updated last year
- mini project for nanorllm☆63Oct 3, 2026Updated 2 weeks ago
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆54May 12, 2026Updated 5 months ago
- 使用 cutlass 实现 flash-attention 精简版，具有教学意义☆59Aug 12, 2024Updated 2 years ago
- Flash Attention from Scratch on CUDA Ampere☆201Sep 1, 2025Updated last year
- Retriever-0.1B☆94Jun 6, 2024Updated 2 years ago
- ☆87Jun 28, 2026Updated 3 months ago