Alternatives and similar repositories for Moonlight

Users that are interested in Moonlight are comparing it to the libraries listed below

• fla-org / native-sparse-attention
  🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
  ☆720Updated 3 months ago
• MoonshotAI / MoBA
  MoBA: Mixture of Block Attention for Long-Context LLMs
  ☆1,817Updated 3 months ago
• ByteDance-Seed / Seed-Thinking-v1.5
  ☆796Updated last month
• HKUNLP / Dream
  Dream 7B, a large diffusion language model
  ☆816Updated 3 weeks ago
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆798Updated 3 months ago
• KellerJordan / Muon
  Muon is an optimizer for hidden layers in neural networks
  ☆988Updated this week
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆1,023Updated last week
• QwenLM / ParScale
  Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling
  ☆410Updated last month
• PRIME-RL / PRIME
  Scalable RL solution for advanced reasoning of language models
  ☆1,650Updated 3 months ago
• microsoft / MInference
  [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…
  ☆1,067Updated 2 weeks ago
• MoonshotAI / Kimi-VL
  Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities
  ☆956Updated 3 weeks ago
• Open-Reasoner-Zero / Open-Reasoner-Zero
  Official Repo for Open-Reasoner-Zero
  ☆1,985Updated last month
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆805Updated 7 months ago
• BytedTsinghua-SIA / DAPO
  An Open-source RL System from ByteDance Seed and Tsinghua AIR
  ☆1,421Updated 2 months ago
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆800Updated last week
• SkyworkAI / Skywork-OR1
  Unleashing the Power of Reinforcement Learning for Math and Code Reasoners
  ☆645Updated last month
• lucidrains / native-sparse-attention-pytorch
  Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
  ☆667Updated last month
• seal-rg / recurrent-pretraining
  Pretraining code for a large-scale depth-recurrent language model
  ☆793Updated last month
• mlc-ai / xgrammar
  Fast, Flexible and Portable Structured Generation
  ☆1,052Updated last week
• GAIR-NLP / LIMO
  [COLM 2025] LIMO: Less is More for Reasoning
  ☆977Updated this week
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆735Updated 9 months ago
• SafeAILab / EAGLE
  Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.
  ☆1,384Updated this week
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,101Updated last month
• AIDC-AI / Marco-o1
  An Open Large Reasoning Model for Real-World Solutions
  ☆1,504Updated last month
• apple / ml-cross-entropy
  ☆485Updated this week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,012Updated this week
• deepseek-ai / DeepSeek-MoE
  DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
  ☆1,747Updated last year
• Gen-Verse / MMaDA
  MMaDA - Open-Sourced Multimodal Large Diffusion Language Models
  ☆1,176Updated last month
• Qihoo360 / Light-R1
  ☆728Updated last month
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆341Updated 7 months ago