nlp-greyfoss / metagradLinks
一个用于学习的仿Pytorch纯Python实现的自动求导工具。
☆51Updated last year
Alternatives and similar repositories for metagrad
Users that are interested in metagrad are comparing it to the libraries listed below
Sorting:
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆153Updated 7 months ago
- Inference code for LLaMA models☆121Updated last year
- ☆71Updated last week
- personal chatgpt☆372Updated 5 months ago
- DeepSpeed Tutorial☆97Updated 9 months ago
- 怎么训练一个LLM分词器☆149Updated last year
- Train your grpo with zero dataset and low resources, 8bit/4bit/lora/qlora supported, multi-gpu supported ...☆71Updated last month
- ☆34Updated 5 months ago
- ☆52Updated last year
- pytorch分布式训练☆66Updated last year
- ☆78Updated 8 months ago
- 使用单个24G显卡,从0开始训练LLM☆54Updated last week
- 用Numpy复现可训练的LLaMa3☆34Updated 11 months ago
- pytorch distribute tutorials☆136Updated last week
- 对llama3进行全参微调、lora微调以及qlora微调。☆198Updated 8 months ago
- 飞桨护航计划集训营☆18Updated 2 weeks ago
- 大语言模型应用:RAG、NL2SQL、聊天机器人、预训练、MOE混合专家模型、微调训练、强化学习、天池数据竞赛☆62Updated 3 months ago
- From Llama to Deepseek, grpo/mtp implemented. With pt/sft/lora/qlora included☆27Updated last month
- ChatGLM-6B添加了RLHF的实现,以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成,以及指定context推荐的RLHF的实现☆85Updated last year
- llama,chatglm 等模型的微调☆89Updated 10 months ago
- ☆108Updated 6 months ago
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆62Updated 3 months ago
- seq2seq_translation☆26Updated 3 years ago
- 一些 LLM 方面的从零复现笔记☆200Updated last month
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆326Updated 10 months ago
- ☆110Updated 11 months ago
- ☆43Updated 9 months ago
- 模型压缩的小白入门教程☆283Updated 6 months ago
- RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.☆62Updated 3 months ago
- 通义千问的DPO训练☆48Updated 8 months ago