ByteDance-Seed / VeOmniLinks
VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework
☆1,050Updated 2 weeks ago
Alternatives and similar repositories for VeOmni
Users that are interested in VeOmni are comparing it to the libraries listed below
Sorting:
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference☆557Updated last month
- ☆422Updated last month
- Ring attention implementation with flash attention☆864Updated last month
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆847Updated 5 months ago
- A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training☆502Updated last week
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆436Updated last week
- ☆814Updated 3 months ago
- [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.☆435Updated 3 weeks ago
- An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models☆1,888Updated 2 weeks ago
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆313Updated 4 months ago
- Muon is Scalable for LLM Training☆1,302Updated last month
- ☆198Updated 5 months ago
- slime is a LLM post-training framework for RL Scaling.☆1,747Updated this week
- FlagScale is a large model toolkit based on open-sourced projects.☆352Updated this week
- 青稞Talk☆141Updated this week
- Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities☆1,058Updated 2 months ago
- Long-RL: Scaling RL to Long Sequences☆605Updated last week
- ☆804Updated last week
- SpargeAttention: A training-free sparse attention that can accelerate any model inference.☆709Updated last month
- ☆615Updated last week
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆243Updated 2 months ago
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,341Updated this week
- [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads☆490Updated 7 months ago
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆818Updated 4 months ago
- 📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉☆394Updated 3 weeks ago
- Official Repo for Open-Reasoner-Zero☆2,033Updated 3 months ago
- Fast inference from large lauguage models via speculative decoding☆815Updated last year
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆447Updated 7 months ago
- The official repo of One RL to See Them All: Visual Triple Unified Reinforcement Learning☆312Updated 3 months ago
- A sparse attention kernel supporting mix sparse patterns☆294Updated 7 months ago