ByteDance-Seed / VeOmniLinks
VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
☆1,178Updated this week
Alternatives and similar repositories for VeOmni
Users that are interested in VeOmni are comparing it to the libraries listed below
Sorting:
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference☆571Updated 2 weeks ago
- ☆427Updated last month
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆877Updated 6 months ago
- Ring attention implementation with flash attention☆885Updated 3 weeks ago
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆482Updated 3 weeks ago
- A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training☆523Updated last week
- ☆816Updated 3 months ago
- Muon is Scalable for LLM Training☆1,318Updated 2 months ago
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆319Updated 5 months ago
- An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models☆1,980Updated this week
- ☆202Updated 5 months ago
- slime is an LLM post-training framework for RL Scaling.☆2,023Updated this week
- [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.☆460Updated last week
- Fast inference from large lauguage models via speculative decoding☆829Updated last year
- SpargeAttention: A training-free sparse attention that can accelerate any model inference.☆729Updated last week
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,361Updated this week
- Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities☆1,063Updated 2 months ago
- FlagScale is a large model toolkit based on open-sourced projects.☆357Updated last week
- Official Repo for Open-Reasoner-Zero☆2,045Updated 4 months ago
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆412Updated this week
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆822Updated 4 months ago
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆248Updated 2 months ago
- Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)☆625Updated last week
- 📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉☆408Updated last month
- 青稞Talk☆148Updated 2 weeks ago
- ☆844Updated last month
- A fork to add multimodal model training to open-r1☆1,402Updated 7 months ago
- [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads☆491Updated 7 months ago
- Explore the Multimodal “Aha Moment” on 2B Model☆609Updated 6 months ago
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆1,560Updated 4 months ago