Alternatives and similar repositories for VeOmni

Users that are interested in VeOmni are comparing it to the libraries listed below

• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆215Updated 2 months ago
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆510Updated last week
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆299Updated last month
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆203Updated 2 weeks ago
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆219Updated 3 months ago
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆774Updated 2 weeks ago
• SandAI-org / MagiAttention
  A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
  ☆372Updated last week
• step-law / steplaw
  ☆188Updated last month
• mit-han-lab / x-attention
  XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆158Updated 3 weeks ago
• fla-org / flame
  🔥 A minimal training framework for scaling FLA models
  ☆146Updated 3 weeks ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆291Updated 6 months ago
• XunhaoLai / native-sparse-attention-triton
  Efficient triton implementation of Native Sparse Attention.
  ☆155Updated last week
• NVIDIA / NeMo-RL
  Scalable toolkit for efficient model reinforcement
  ☆385Updated this week
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆166Updated last week
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆208Updated 9 months ago
• alexzhang13 / flashattention2-custom-mask
  Triton implementation of FlashAttention2 that adds Custom Masks.
  ☆117Updated 9 months ago
• mit-han-lab / duo-attention
  [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  ☆463Updated 3 months ago
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆107Updated 2 weeks ago
• FasterDecoding / SnapKV
  ☆248Updated last year
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆179Updated 2 months ago
• fla-org / native-sparse-attention
  🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
  ☆686Updated 2 months ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆396Updated 3 weeks ago
• QwenLM / ParScale
  Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling
  ☆367Updated 2 weeks ago
• TencentARC / mllm-npu
  mllm-npu: training multimodal large language models on Ascend NPUs
  ☆90Updated 9 months ago
• MiniMax-AI / One-RL-to-See-Them-All
  The official repo of One RL to See Them All: Visual Triple Unified Reinforcement Learning
  ☆230Updated this week
• OpenSparseLLMs / MoM
  ☆83Updated last month
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆125Updated 5 months ago
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆94Updated 2 months ago
• alibaba / ROLL
  ☆404Updated this week
• FMInference / H2O
  [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
  ☆448Updated 10 months ago