ByteDance-Seed / VeOmniLinks
VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
☆1,601Updated this week
Alternatives and similar repositories for VeOmni
Users that are interested in VeOmni are comparing it to the libraries listed below
Sorting:
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference☆637Updated 2 weeks ago
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆816Updated last week
- An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models☆2,747Updated this week
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆964Updated 10 months ago
- ☆814Updated 7 months ago
- Ring attention implementation with flash attention☆973Updated 4 months ago
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,524Updated last month
- ☆449Updated 5 months ago
- slime is an LLM post-training framework for RL Scaling.☆3,571Updated last week
- Muon is Scalable for LLM Training☆1,421Updated 6 months ago
- A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training☆626Updated this week
- Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities☆1,151Updated 6 months ago
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆1,715Updated 8 months ago
- Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.☆3,470Updated this week
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆331Updated 9 months ago
- Official Repo for Open-Reasoner-Zero☆2,086Updated 8 months ago
- ☆209Updated 3 months ago
- [ICLR 2026] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.☆532Updated last month
- FlagScale is a large model toolkit based on open-sourced projects.☆471Updated this week
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆676Updated this week
- A fork to add multimodal model training to open-r1☆1,443Updated 11 months ago
- Fast inference from large lauguage models via speculative decoding☆884Updated last year
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆839Updated 8 months ago
- Training library for Megatron-based models with bidirectional Hugging Face conversion capability☆400Updated this week
- Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)☆690Updated 4 months ago
- ☆1,112Updated 2 months ago
- 📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉☆511Updated 2 weeks ago
- MoBA: Mixture of Block Attention for Long-Context LLMs☆2,038Updated 10 months ago
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,180Updated 4 months ago
- 青稞Talk☆190Updated 2 weeks ago