This project aims to replicate mainstream open-source model architectures with limited computational resources, implementing mini models with 100-200M parameters.
☆292Aug 24, 2026Updated last month
Alternatives and similar repositories for Mini-LLM
Users that are interested in Mini-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.☆4,457Sep 3, 2026Updated 3 weeks ago
- ☆15May 10, 2026Updated 4 months ago
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,182May 17, 2026Updated 4 months ago
- 👀 Train a 65M-parameter VLM from scratch in just 2h!☆8,692Updated this week
- 🧠 Train a 64M-parameter LLM from scratch in just 2h!☆62,739Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An LLM training framework built from the ground up, featuring a custom BumbleBee architecture and end-to-end support for multiple open-so…☆102Aug 24, 2026Updated last month
- 手撕transformer并完成一个简单的机器翻译。☆23Feb 19, 2025Updated last year
- 从零构建大模型：从预训练到RLHF的完整实践☆2,699Aug 21, 2026Updated last month
- Nano vLLM☆15,636Apr 26, 2026Updated 5 months ago
- [CVPR 2026 Highlight] Official implementation of Log-linear Sparse Attention (LLSA).☆92May 1, 2026Updated 4 months ago
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated last year
- The AI-Native SDLC Playbook — Anthropic Claude Academy course as EPUB ebook☆88Sep 3, 2026Updated 3 weeks ago
- ☆21Apr 21, 2026Updated 5 months ago
- 🎓从0开始训练一个大模型Minimind项目的超详细解析，包括但不限于用到的架构，算法，以及大模型面试经验☆1,772May 25, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 复现大模型相关算法及一些学习记录☆3,540Jul 2, 2026Updated 2 months ago
- CAD - Memory Efficient Convolutional Adapter for Segment Anything☆12Oct 4, 2024Updated last year
- My implementation of Stanford CS336 assignments.☆245Mar 15, 2026Updated 6 months ago
- slime is an LLM post-training framework for RL Scaling.☆8,547Updated this week
- ☆48Nov 1, 2025Updated 10 months ago
- Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation☆1,049Aug 29, 2026Updated 3 weeks ago
- Agent-R1: Training Powerful LLM Agents with End-to-End Reinforcement Learning☆1,677Sep 21, 2026Updated last week
- 这是一个从头训练大语言模型的项目，包括预训练、微调和直接偏好优化，模型拥有1B参数，支持中英文。☆875Feb 18, 2025Updated last year
- This is the public repository of AAAI 2024 paper "Is a Large Language Model a Good Annotator for Event Extraction"☆10Feb 16, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A minimal PyTorch re-implementation of Qwen 3.8☆450Aug 30, 2026Updated 3 weeks ago
- ☆151Jan 18, 2026Updated 8 months ago
- ☆56Nov 22, 2025Updated 10 months ago
- 一份面向实践者的 verl 框架使用教程。verl 是字节跳动开源的大语言模型强化学习训练框架，支持 PPO、GRPO 等多种算法，以及分布式训练、AgentRL 等场景。☆143Jul 2, 2026Updated 2 months ago
- A from-scratch Prefill/Decode disaggregation inference engine for LLMs☆160May 10, 2026Updated 4 months ago
- A practical bilingual guide to staying safe and prepared at conferences in Brazil / 巴西参会实用攻略与自救指南☆17Apr 22, 2026Updated 5 months ago
- A Pytorch implementation of WaveNet ASR (Automatic Speech Recognition)☆13Sep 22, 2021Updated 5 years ago
- This repository presents the original implementation of Pretraining Data Detection for Large Language Models: A Divergence-based Calibrat…☆23May 21, 2025Updated last year
- learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen☆4,731Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Agentic RL最详细入门☆366Aug 6, 2026Updated last month
- 《汇编语言一发入魂》配套代码☆15May 30, 2020Updated 6 years ago
- 从零复现 minimind👉minimind-v☆402Dec 24, 2025Updated 9 months ago
- This is a repository to practice multi-thread programming in C++☆33Feb 21, 2024Updated 2 years ago
- 轻量级大语言模型MiniMind的源码解读，包含tokenizer、RoPE、MoE、KV Cache、pretraining、SFT、LoRA、DPO等完整流程☆1,206Jun 16, 2025Updated last year
- mini project for nanorllm☆63Mar 31, 2026Updated 5 months ago
- Mini_RWKV_V7_LM Only 34.2M params (also have RWKV7s architecture [deep embedding]/[deep embedding attention) with Full Training code & da…☆95Jan 26, 2026Updated 8 months ago