Alternatives and similar repositories for metagrad

Users that are interested in metagrad are comparing it to the libraries listed below

• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆153Updated 7 months ago
• sunkx109 / llama
  Inference code for LLaMA models
  ☆121Updated last year
• chunhuizhang / bert_t5_gpt
  ☆71Updated last week
• chunhuizhang / personal_chatgpt
  personal chatgpt
  ☆372Updated 5 months ago
• OvJat / DeepSpeedTutorial
  DeepSpeed Tutorial
  ☆97Updated 9 months ago
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆149Updated last year
• XU-YIJIE / grpo-flat
  Train your grpo with zero dataset and low resources, 8bit/4bit/lora/qlora supported, multi-gpu supported ...
  ☆71Updated last month
• mindspore-lab / mindrlhf
  ☆34Updated 5 months ago
• cauyxy / bilivideos
  ☆52Updated last year
• taishan1994 / pytorch-distributed-NLP
  pytorch分布式训练
  ☆66Updated last year
• RethinkFun / trian_ppo
  ☆78Updated 8 months ago
• akaihaoshuai / baby-llama2-chinese_cybertron
  使用单个24G显卡，从0开始训练LLM
  ☆54Updated last week
• 2ertwo / LLaMa3-Numpy-trainable
  用Numpy复现可训练的LLaMa3
  ☆34Updated 11 months ago
• chunhuizhang / pytorch_distribute_tutorials
  pytorch distribute tutorials
  ☆136Updated last week
• taishan1994 / Llama3.1-Finetuning
  对llama3进行全参微调、lora微调以及qlora微调。
  ☆198Updated 8 months ago
• PFCCLab / Camp
  飞桨护航计划集训营
  ☆18Updated 2 weeks ago
• cwxndl / LLM
  大语言模型应用：RAG、NL2SQL、聊天机器人、预训练、MOE混合专家模型、微调训练、强化学习、天池数据竞赛
  ☆62Updated 3 months ago
• XU-YIJIE / hobo-llm-from-scratch
  From Llama to Deepseek, grpo/mtp implemented. With pt/sft/lora/qlora included
  ☆27Updated last month
• Pillars-Creation / ChatGLM-RLHF-LoRA-RM-PPO
  ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现
  ☆85Updated last year
• jiangxinyang227 / LLM-tuning
  llama，chatglm 等模型的微调
  ☆89Updated 10 months ago
• hengjiUSTC / learn-llm
  ☆108Updated 6 months ago
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆62Updated 3 months ago
• shouxieai / seq2seq_translation
  seq2seq_translation
  ☆26Updated 3 years ago
• Mxoder / LLM-from-scratch
  一些 LLM 方面的从零复现笔记
  ☆200Updated last month
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆326Updated 10 months ago
• yuanzhoulvpi2017 / SentenceEmbedding
  ☆110Updated 11 months ago
• lansinuote / Simple_LLM_PPO
  ☆43Updated 9 months ago
• datawhalechina / awesome-compression
  模型压缩的小白入门教程
  ☆283Updated 6 months ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆62Updated 3 months ago
• owenliang / qwen-dpo
  通义千问的DPO训练
  ☆48Updated 8 months ago