Ola-Omni / OlaLinks
Ola: Pushing the Frontiers of Omni-Modal Language Model
☆341Updated last week
Alternatives and similar repositories for Ola
Users that are interested in Ola are comparing it to the libraries listed below
Sorting:
- Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆286Updated 5 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,063Updated 8 months ago
- Matrix-Game: Interactive World Foundation Model☆730Updated this week
- ✨✨VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model☆588Updated 3 weeks ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆312Updated 3 months ago
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆913Updated 3 months ago
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆592Updated 2 months ago
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆288Updated last month
- [ICML 2025 Oral] An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆154Updated last week
- a family of versatile and state-of-the-art video tokenizers.☆397Updated 2 months ago
- ☆233Updated 6 months ago
- [ICML 2025] PyTorch Implementation of "OmniAudio: Generating Spatial Audio from 360-Degree Video"☆297Updated last month
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆727Updated last month
- Official Repository of OmniCaptioner☆146Updated 2 months ago
- Video generation from text&image, 1st-gen☆925Updated last month
- [CVPR 2025] The First Investigation of CoT Reasoning (RL, TTS, Reflection) in Image Generation☆724Updated last month
- [CVPR 2025] The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆220Updated this week
- Code for paper "Towards Understanding Camera Motions in Any Video"☆193Updated 3 weeks ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆568Updated last year
- The first Large Audio Language Model that enables native in-depth thinking, which is trained on large-scale audio Chain-of-Thought data.☆225Updated last month
- Official implementation for "RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers" (ICML 2025)☆679Updated last month
- Video-Inpaint-Anything: This is the inference code for our paper CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, C…☆295Updated 8 months ago
- SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆476Updated last month
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,192Updated 2 months ago
- [CVPR 2025] A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generation☆249Updated 3 months ago
- [ICML 2025] Official repository for paper "Scaling Video-Language Models to 10K Frames via Hierarchical Differential Distillation"☆152Updated last month
- Efficient DiT architecture for text2any tasks, ICLR2025☆449Updated last month
- Skywork-R1V2:Multimodal Hybrid Reinforcement Learning for Reasoning☆2,626Updated last week
- Evaluation of Text-to-Video Generation Models: A Dynamics Perspective[NeurIPS 2024].☆274Updated 6 months ago
- [CVPR'25]Tora: Trajectory-oriented Diffusion Transformer for Video Generation☆1,164Updated 2 weeks ago