WKQ9411 / Mini-LLMLinks
This project aims to replicate mainstream open-source model architectures with limited computational resources, implementing mini models with 100-200M parameters.
☆134Updated last week
Alternatives and similar repositories for Mini-LLM
Users that are interested in Mini-LLM are comparing it to the libraries listed below
Sorting:
- Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation☆422Updated this week
- A repository sharing the literatures about large language models☆106Updated last month
- pytorch distribute tutorials☆170Updated 7 months ago
- My implementation of Stanford CS336 assignments.☆227Updated 6 months ago
- llm & rl☆271Updated 3 months ago
- modern AI for beginners☆197Updated 5 months ago
- 注释的nano_vllm仓库,并且完成了MiniCPM4的适配以及注册新模型的功能☆158Updated 5 months ago
- 分享AI Infra知识&代码练习:PyTorch/vLLM/SGLang框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等☆350Updated this week
- Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing☆68Updated last year
- ☆154Updated 2 months ago
- 大模型/LLM推理和部署理论与实践☆374Updated 6 months ago
- LLM大模型(重点)以及搜广推等 AI 算法中手写的面试题,(非 LeetCode),比如 Self-Attention, AUC等,一般比 LeetCode 更考察一个人的综合能力,又更贴近业务和基础知识一点☆479Updated last year
- 🏆🏆 「大模型」All in one & All from scratch. 🌍🌍 收集、清洗数据,训练Tokenizer,预训练、SFT、GRPO!☆52Updated 5 months ago
- 🔥 How to efficiently and effectively compress the CoTs or directly generate concise CoTs during inference while maintaining the reasonin…☆65Updated 8 months ago
- UltraScale Playbook 中文版☆131Updated 10 months ago
- 模型压缩的小白入门教程,PDF下载地址 https://github.com/datawhalechina/awesome-compression/releases☆356Updated 2 months ago
- 青稞Talk☆190Updated 2 weeks ago
- ☆152Updated 7 months ago
- ☆413Updated last year
- LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.☆859Updated 2 months ago
- 《EasyOffer》(<大模型面经合集>)是针对LLM宝宝们量身打造的大模型暑期实习Offer指南,主要记录大模型暑期实习和秋招准备的一些常见大厂手撕代码、大厂面经经验、常见大厂思考题等;小白一个,正在学习ing......有问题各位大佬随时指正,希望大家都能拿到心仪Of…☆659Updated 10 months ago
- Awesome LLM pre-training resources, including data, frameworks, and methods.☆323Updated 9 months ago
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆49Updated 5 months ago
- Awesome List for Agentic RL☆787Updated 2 months ago
- 看图学大模型☆316Updated last year
- ☆380Updated 9 months ago
- LLM Tokenizer with BPE algorithm☆47Updated last year
- A comprehensive guide for beginners in the field of data management and artificial intelligence.☆556Updated 10 months ago
- ☆28Updated 2 years ago
- 这是一个高效,快捷的arXiv论文爬虫,它可以将指定时间范围,指定主题,包含指定关键词的论文信息爬取到本地,并且将其中的标题和摘要翻译成中文。☆172Updated last year