Alternatives and similar repositories for VeOmni

Users that are interested in VeOmni are comparing it to the libraries listed below

• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆621Updated 3 weeks ago
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆961Updated 4 months ago
• alibaba / ROLL
  An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
  ☆2,619Updated this week
• NVlabs / Fast-dLLM
  Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"
  ☆773Updated last month
• alibaba / Pai-Megatron-Patch
  The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
  ☆1,507Updated last month
• fla-org / native-sparse-attention
  🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
  ☆952Updated 9 months ago
• stepfun-ai / Step3
  ☆443Updated 5 months ago
• SandAI-org / MagiAttention
  A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
  ☆607Updated this week
• ByteDance-Seed / Seed-Thinking-v1.5
  ☆816Updated 7 months ago
• THUDM / slime
  slime is an LLM post-training framework for RL Scaling.
  ☆3,224Updated last week
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆1,397Updated 5 months ago
• MoonshotAI / Kimi-VL
  Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities
  ☆1,136Updated 6 months ago
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆330Updated 8 months ago
• flagos-ai / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆463Updated this week
• Open-Reasoner-Zero / Open-Reasoner-Zero
  Official Repo for Open-Reasoner-Zero
  ☆2,087Updated 7 months ago
• yongliang-wu / DFT
  [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.
  ☆523Updated last week
• inclusionAI / AReaL
  Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.
  ☆3,381Updated this week
• sgl-project / SpecForge
  Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
  ☆626Updated this week
• deepseek-ai / Engram
  Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models
  ☆1,612Updated this week
• step-law / steplaw
  ☆208Updated 2 months ago
• BytedTsinghua-SIA / DAPO
  An Open-source RL System from ByteDance Seed and Tsinghua AIR
  ☆1,702Updated 8 months ago
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆258Updated last month
• volcengine / veScale
  Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs
  ☆917Updated last month
• feifeibear / LLMSpeculativeSampling
  Fast inference from large lauguage models via speculative decoding
  ☆878Updated last year
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆417Updated 4 months ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆664Updated 2 years ago
• NVlabs / Long-RL
  Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)
  ☆684Updated 3 months ago
• bytedance / flux
  A fast communication-overlapping library for tensor/expert parallelism on GPUs.
  ☆1,218Updated 4 months ago
• hemingkx / SpeculativeDecodingPapers
  📰 Must-read papers and blogs on Speculative Decoding ⚡️
  ☆1,071Updated 3 weeks ago
• EvolvingLMMs-Lab / open-r1-multimodal
  A fork to add multimodal model training to open-r1
  ☆1,435Updated 11 months ago