Ola-Omni / OlaLinks
Ola: Pushing the Frontiers of Omni-Modal Language Model
☆347Updated last month
Alternatives and similar repositories for Ola
Users that are interested in Ola are comparing it to the libraries listed below
Sorting:
- Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆286Updated 6 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,067Updated 9 months ago
- [ICML 2025 Oral] An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆170Updated last week
- ✨✨VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model☆614Updated last month
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆290Updated 2 months ago
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆600Updated 3 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆312Updated last week
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆916Updated 3 months ago
- a family of versatile and state-of-the-art video tokenizers.☆403Updated 3 months ago
- Matrix-Game: Interactive World Foundation Model☆811Updated last week
- [CVPR 2025] The First Investigation of CoT Reasoning (RL, TTS, Reflection) in Image Generation☆763Updated last month
- PyTorch implementation of [ThinkSound], a unified framework for generating audio from any modality, guided by Chain-of-Thought (CoT) reas…☆515Updated this week
- Official Repository of OmniCaptioner☆152Updated 2 months ago
- ☆126Updated 3 weeks ago
- ☆404Updated 4 months ago
- ☆234Updated 7 months ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆740Updated 2 months ago
- [CVPR 2025] The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆235Updated 3 weeks ago
- [ICML 2025] PyTorch Implementation of "OmniAudio: Generating Spatial Audio from 360-Degree Video"☆311Updated 2 weeks ago
- GPT-ImgEval: Evaluating GPT-4o’s state-of-the-art image generation capabilities☆283Updated 2 months ago
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆462Updated last year
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆396Updated last month
- Video generation from text&image, 1st-gen☆925Updated 2 months ago
- [ICCV 2025] SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆490Updated this week
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆572Updated last year
- 🔥 Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos☆1,167Updated last week
- Code for paper "Towards Understanding Camera Motions in Any Video"☆200Updated last month
- Video-Inpaint-Anything: This is the inference code for our paper CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, C…☆298Updated 9 months ago
- Official repository of T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT☆350Updated 3 weeks ago
- [CVPR'25]Tora: Trajectory-oriented Diffusion Transformer for Video Generation☆1,172Updated this week