轻量级大语言模型MiniMind的源码解读,包含tokenizer、RoPE、MoE、KV Cache、pretraining、SFT、LoRA、DPO等完整流程
☆1,091Jun 16, 2025Updated last year
Alternatives and similar repositories for MiniMind-in-Depth
Users that are interested in MiniMind-in-Depth are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🎓从0开始训练一个大模型Minimind项目的超详细解析,包括但不限于用到的架构,算法,以及大模型面试经验☆962May 25, 2026Updated last month
- 🚀 [从零构建 LLM] 极简大模型训练原理与实践指南。包含 Transformer, Pretraining, SFT 核心代码与对照实验。 | A minimal, principle-first guide to understanding and building…☆135Jun 4, 2026Updated last month
- 从零复现 minimind👉minimind-v☆354Dec 24, 2025Updated 6 months ago
- 👀「大模型」2小时从0训练65M参数的视觉多模态VLM!Train a 65M-parameter VLM from scratch in just 2h!☆8,235Jun 28, 2026Updated last week
- 🚀 轻量视频🎥 大模型🤖☆23Apr 27, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Nvidia Deepstream FFMPEG RTSP to HTTP Streaming☆15Sep 25, 2020Updated 5 years ago
- The official implementation of the paper "MLP Memory: A Retriever-Pretrained Memory for Large Language Models". (ICLR 2026)☆67Jun 11, 2026Updated 3 weeks ago
- 本项目对Deepseek-R1-Distill-Qwen-7B进行心理咨询CoT数据的LoRA微调,以进一步提升Deepseek-R1-Distill-Qwen-7B在心理咨询领域的慢思考能力。☆12Mar 11, 2025Updated last year
- I love reinforcement learning.☆12Jan 15, 2025Updated last year
- 主要记录大语言大模型(LLMs) 算法(应用)工程师相关的知识及面试题☆14,616Jun 14, 2026Updated 3 weeks ago
- EMNLP MAIN 2025 StepSearch: Igniting LLMs Search Ability via Step-Wise Proximal Policy Optimization☆72Sep 13, 2025Updated 9 months ago
- Official repository of STONE (KDD 2024)☆52Aug 3, 2025Updated 11 months ago
- 北航《并行程序设计》Lab合集(竞速Rank1)☆31Feb 23, 2023Updated 3 years ago
- BUPT Joint Programme with QMUL☆21Dec 21, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程☆31,095Jun 17, 2026Updated 2 weeks ago
- LinkerHand Dexterous Hands URDF Model Files Repository.☆51Jun 5, 2026Updated last month
- 📚 从零开始构建大模型☆31,783May 6, 2026Updated last month
- The simplest Local Knowledge Base example based on Langchain and Chat-GLM☆13Jun 9, 2023Updated 3 years ago
- H&M商品推荐比赛(rank: 116/2952 )方案☆15Jun 16, 2022Updated 4 years ago
- 开源许可证助手☆16Jun 20, 2025Updated last year
- 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)☆24,649Updated this week
- 操作系统第三次课程项目,一个简单的文件系统☆12Jun 24, 2021Updated 5 years ago
- AI 学习之旅☆110Jul 24, 2025Updated 11 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [ACM MM 2025] Mobile U-ViT: Revisiting large kernel and U-shaped ViT for efficient medical image segmentation☆63Oct 29, 2025Updated 8 months ago
- 清华大学人工智能导论(龙明盛老师)课程课件,作业以及试题☆19Jun 26, 2023Updated 3 years ago
- ☆12Aug 25, 2023Updated 2 years ago
- The supplementary material for the paper "Fine-tuning Large Language Models to Improve Accuracy and Comprehensibility of Automated Code R…☆16Aug 12, 2024Updated last year
- Official implementation of BandPO: Bridging Trust Regions and Ratio Clipping via Probability-Aware Bounds for LLM Reinforcement Learning.…☆49Apr 8, 2026Updated 2 months ago
- 《大模型白盒子构建指南》:一个全手搓的Tiny-Universe☆4,934Feb 12, 2026Updated 4 months ago
- ☆18Sep 22, 2023Updated 2 years ago
- 简单易理解的代码,用于在qwen上使用grpo加强数学能力☆58May 14, 2025Updated last year
- RePOSE: 3D Human Pose Estimation via Spatio-Temporal Depth Relational Consistency☆19Oct 2, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆11Jun 6, 2023Updated 3 years ago
- 📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程☆63,860Jun 24, 2026Updated last week
- [ICLR 2025] Code for the PopulationTransformer☆18Oct 16, 2025Updated 8 months ago
- Foreign exchange rates forecasting using EMD with LSTM☆15Apr 23, 2019Updated 7 years ago
- ☆23Dec 12, 2025Updated 6 months ago
- Implementation of GALS (GNSS-Augmented LiDAR SLAM)☆15Jul 5, 2022Updated 4 years ago
- ☆55Nov 22, 2025Updated 7 months ago