Alternatives and similar repositories for DeepSeek-MoE:

Users that are interested in DeepSeek-MoE are comparing it to the libraries listed below

• deepseek-ai / ESFT
  Expert Specialized Fine-Tuning
  ☆594Updated 6 months ago
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆974Updated 3 weeks ago
• Open-Reasoner-Zero / Open-Reasoner-Zero
  Official Repo for Open-Reasoner-Zero
  ☆1,667Updated 2 weeks ago
• MoonshotAI / MoBA
  MoBA: Mixture of Block Attention for Long-Context LLMs
  ☆1,687Updated 2 weeks ago
• hiyouga / EasyR1
  EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
  ☆1,681Updated this week
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆799Updated 3 months ago
• deepseek-ai / DeepSeek-V2
  DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
  ☆4,844Updated 6 months ago
• zhentingqi / rStar
  ☆910Updated 2 months ago
• agentica-project / deepscaler
  Democratizing Reinforcement Learning for LLMs
  ☆2,113Updated last month
• GAIR-NLP / O1-Journey
  O1 Replication Journey
  ☆1,977Updated 2 months ago
• AIDC-AI / Marco-o1
  An Open Large Reasoning Model for Real-World Solutions
  ☆1,475Updated 3 weeks ago
• deepseek-ai / DeepSeek-Math
  DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
  ☆2,566Updated 11 months ago
• RAGEN-AI / RAGEN
  RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.
  ☆1,210Updated this week
• BytedTsinghua-SIA / DAPO
  An Open-source RL System from ByteDance Seed and Tsinghua AIR
  ☆767Updated this week
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆690Updated last week
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆851Updated last month
• hkust-nlp / simpleRL-reason
  This is a replicate of DeepSeek-R1-Zero and DeepSeek-R1 training on small models with limited data
  ☆3,223Updated this week
• deepseek-ai / DualPipe
  A bidirectional pipeline parallelism algorithm for computation-communication overlap in V3/R1 training.
  ☆2,656Updated 2 weeks ago
• openreasoner / openr
  OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models
  ☆1,732Updated 2 months ago
• deepseek-ai / DeepSeek-VL
  DeepSeek-VL: Towards Real-World Vision-Language Understanding
  ☆3,712Updated 11 months ago
• deepseek-ai / profile-data
  Analyze computation-communication overlap in V3/R1.
  ☆957Updated this week
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,481Updated last year
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆936Updated 3 months ago
• PRIME-RL / PRIME
  Scalable RL solution for advanced reasoning of language models
  ☆1,419Updated last week
• deepseek-ai / EPLB
  Expert Parallelism Load Balancer
  ☆1,099Updated this week
• deepseek-ai / DeepSeek-Prover-V1.5
  ☆481Updated 7 months ago
• deepseek-ai / awesome-deepseek-coder
  A curated list of open-source projects related to DeepSeek Coder
  ☆652Updated 11 months ago
• volcengine / verl
  verl: Volcano Engine Reinforcement Learning for LLMs
  ☆5,399Updated this week
• Unakar / Logic-RL
  Reproduce R1 Zero on Logic Puzzle
  ☆2,208Updated this week
• microsoft / MInference
  [NeurIPS'24 Spotlight, ICLR'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which r…
  ☆944Updated last month