Alternatives and similar repositories for Skywork-MoE

Users that are interested in Skywork-MoE are comparing it to the libraries listed below

• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆121Updated 8 months ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆204Updated 2 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆126Updated last year
• SkyworkAI / skywork-o1-prm-inference
  ☆68Updated last year
• yyht / openrlhf_async_pipline
  ☆87Updated 5 months ago
• Glaciohound / LM-Infinite
  Implementation of NAACL 2024 Outstanding Paper "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆152Updated 10 months ago
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆195Updated last year
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated last year
• OpenSparseLLMs / Linear-MoE
  ☆129Updated 8 months ago
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆193Updated 10 months ago
• LLM360 / MegaMath
  [COLM 2025] An Open Math Pre-trainng Dataset with 370B Tokens.
  ☆109Updated 10 months ago
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆111Updated last year
• GAIR-NLP / ProX
  [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
  ☆265Updated 7 months ago
• TemporaryLoRA / Temp-LoRA
  ☆126Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated 2 years ago
• xichen-fy / Fira
  Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
  ☆119Updated last year
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆55Updated last year
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆113Updated 10 months ago
• THUDM / LongAlign
  [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs
  ☆260Updated last year
• pangu-tech / pangu-ultra
  ☆74Updated 8 months ago
• OpenBMB / Eurus
  ☆320Updated last year
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆73Updated last year
• inclusionAI / Ling-V2
  Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.
  ☆253Updated 4 months ago
• Tencent / llm.hunyuan.T1
  ☆82Updated 10 months ago
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆223Updated 6 months ago
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆138Updated 2 years ago
• MiroMindAI / MiroMind-M1
  MiroMind-M1 is a fully open-source series of reasoning language models built on Qwen-2.5, focused on advancing mathematical reasoning.
  ☆253Updated 5 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆251Updated last year
• SalesforceAIResearch / GemFilter
  ☆84Updated 2 months ago
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)
  ☆147Updated last year