dvlab-research / LyraLinks
[ICCV 2025] Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"
☆297Updated 9 months ago
Alternatives and similar repositories for Lyra
Users that are interested in Lyra are comparing it to the libraries listed below
Sorting:
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆300Updated 5 months ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆370Updated 4 months ago
- Mini-Omni-Reasoner: a real-time speech reasoning framework that interleaves silent reasoning tokens with spoken response tokens (“thinkin…☆158Updated last month
- ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆265Updated 5 months ago
- [ICML 2025] Official repository for paper "Scaling Video-Language Models to 10K Frames via Hierarchical Differential Distillation"☆177Updated 3 weeks ago
- [ICML 2025 Oral] An official implementation of VideoRoPE & VideoRoPE++☆199Updated 2 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆117Updated last year
- ☆241Updated 10 months ago
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆314Updated last year
- a family of versatile and state-of-the-art video tokenizers.☆414Updated last month
- [Arxiv] Discrete Diffusion in Large Language and Multimodal Models: A Survey☆309Updated 2 weeks ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆158Updated 9 months ago
- ☆140Updated 3 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆327Updated 3 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆180Updated 11 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆258Updated last year
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆394Updated 4 months ago
- The first Large Audio Language Model that enables native in-depth thinking, which is trained on large-scale audio Chain-of-Thought data.☆262Updated 5 months ago
- [NeurIPS 2025] Efficient Reasoning Vision Language Models☆405Updated last month
- SDAR (Synergy of Diffusion and AutoRegression), a large diffusion language model（1.7B, 4B, 8B, 30B）☆239Updated this week
- (ICCV 2025) Enhance CLIP and MLLM's fine-grained visual representations with generative models.☆73Updated 3 months ago
- Official implementation of "JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronization"☆282Updated last week
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆620Updated 6 months ago
- GPT-ImgEval: Evaluating GPT-4o’s state-of-the-art image generation capabilities☆301Updated 5 months ago
- (NeurIPS 2024) Official PyTorch implementation of LOVA3☆90Updated 6 months ago
- Official repository of "Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Models"☆136Updated last month
- Lumina-DiMOO - An Open-Sourced Multi-Modal Large Diffusion Language Model☆839Updated this week
- AudioTrust: Benchmarking the Multi-faceted Trustworthiness of Audio Large Language Models☆207Updated 2 weeks ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025☆269Updated 4 months ago
- Official implementation of X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models☆158Updated 10 months ago