wingAGI / clean-llmLinks
🏆🏆 「大模型」All in one & All from scratch. 🌍🌍 收集、清洗数据,训练Tokenizer,预训练、SFT、GRPO!
☆39Updated 2 months ago
Alternatives and similar repositories for clean-llm
Users that are interested in clean-llm are comparing it to the libraries listed below
Sorting:
- My implementation of Stanford CS336 assignments.☆172Updated 3 months ago
- 记录我在cs336学习时的笔记和作业☆98Updated last month
- modern AI for beginners☆168Updated last month
- ☆72Updated 3 months ago
- pytorch distribute tutorials☆153Updated 4 months ago
- 本仓库是关于大模型面试中常见面试试题和面试经验的整理。这里收集了各类与大模型相关的面试题目,并提供详细的解答和分析。本仓库由上海交大交影社区维护☆105Updated last year
- LLM大模型(重点)以及搜广推等 AI 算法中手写的面试题,(非 LeetCode),比如 Self-Attention, AUC等,一般比 LeetCode 更考察一个人的综合能力,又更贴近业务和基础知识一点☆402Updated 9 months ago
- ☆391Updated 8 months ago
- 《EasyOffer》(<大模型面经合集>)是针对LLM宝宝们量身打造的大模型暑期实习Offer指南,主要记录大模型暑期实习和秋招准备的一些常见大厂手撕代码、大厂面经经验、常见大厂思考题等;小白一个,正在学习ing......有问题各位大佬随时指正,希望大家都能拿到心仪Of…☆518Updated 6 months ago
- 个人构建MoE大模型:从预训练到DPO的完整实践☆1,627Updated last week
- A comprehensive guide for beginners in the field of data management and artificial intelligence.☆460Updated 6 months ago
- ☆221Updated last year
- Qwen2.5 0.5B GRPO☆69Updated 8 months ago
- Assignment 1 for Stanford CS336 - Language Modeling From Scratch☆69Updated 3 months ago
- llm & rl☆230Updated last month
- ☆85Updated last week
- ☆309Updated 5 months ago
- For People! For Freedom!☆132Updated 2 months ago
- 🔥 How to efficiently and effectively compress the CoTs or directly generate concise CoTs during inference while maintaining the reasonin…☆63Updated 5 months ago
- [TKDE'25] The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".☆435Updated 3 months ago
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆47Updated 2 months ago
- MindSpore online courses: Step into LLM☆477Updated 2 months ago
- 模型压缩的小白入门教程,PDF下载地址 https://github.com/datawhalechina/awesome-compression/releases☆331Updated 4 months ago
- ☆1,601Updated 2 weeks ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆247Updated last year
- A repository sharing the literatures about large language models☆103Updated 3 months ago
- 此项目是我个人对MIT 6.5940 课程作业的答案,学习笔记和心得。☆14Updated last year
- An awesome resume template.☆181Updated 8 months ago
- ☆11Updated last year
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆885Updated last week