ByteDance-Seed / VeOmniLinks
VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
β1,451Updated this week
Alternatives and similar repositories for VeOmni
Users that are interested in VeOmni are comparing it to the libraries listed below
Sorting:
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inferenceβ614Updated last week
- π³ Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"β944Updated 9 months ago
- An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Modelsβ2,516Updated this week
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"β748Updated 3 weeks ago
- Ring attention implementation with flash attentionβ949Updated 3 months ago
- β440Updated 4 months ago
- A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Trainingβ590Updated this week
- β818Updated 6 months ago
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.β1,489Updated last week
- slime is an LLM post-training framework for RL Scaling.β2,911Updated this week
- Muon is Scalable for LLM Trainingβ1,387Updated 4 months ago
- Super-Efficient RLHF Training of LLMs with Parameter Reallocationβ328Updated 8 months ago
- [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.β513Updated last month
- Official Repo for Open-Reasoner-Zeroβ2,084Updated 6 months ago
- FlagScale is a large model toolkit based on open-sourced projects.β426Updated this week
- An Open-source RL System from ByteDance Seed and Tsinghua AIRβ1,684Updated 7 months ago
- Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilitiesβ1,132Updated 5 months ago
- Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.β3,259Updated this week
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.β557Updated last week
- β208Updated last month
- A fork to add multimodal model training to open-r1β1,433Updated 10 months ago
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.β834Updated 7 months ago
- Fast inference from large lauguage models via speculative decodingβ868Updated last year
- Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)β680Updated 3 months ago
- Explore the Multimodal βAha Momentβ on 2B Modelβ620Updated 9 months ago
- πA curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.πβ478Updated 3 weeks ago
- [ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.β852Updated last week
- β1,039Updated last month
- TransMLA: Multi-Head Latent Attention Is All You Need (NeurIPS 2025 Spotlight)β419Updated 3 months ago
- ByteCheckpoint: An Unified Checkpointing Library for LFMsβ256Updated 2 weeks ago