dvlab-research / LyraLinks
Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"
☆287Updated 6 months ago
Alternatives and similar repositories for Lyra
Users that are interested in Lyra are comparing it to the libraries listed below
Sorting:
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆290Updated 2 months ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆350Updated last month
- ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆183Updated 2 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆176Updated 8 months ago
- [ICML 2025] Official repository for paper "Scaling Video-Language Models to 10K Frames via Hierarchical Differential Distillation"☆159Updated 2 months ago
- [ICML 2025 Oral] An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆174Updated 2 weeks ago
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆302Updated last year
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆114Updated last year
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆157Updated 6 months ago
- ☆127Updated last month
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆396Updated last month
- (ICCV 2025) Enhance CLIP and MLLM's fine-grained visual representations with generative models.☆66Updated 3 weeks ago
- R1-like Computer-use Agent☆78Updated 3 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆314Updated 2 weeks ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆261Updated last year
- Official implementation of X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models☆155Updated 7 months ago
- ☆234Updated 7 months ago
- AudioTrust: Benchmarking the Multi-faceted Trustworthiness of Audio Large Language Models☆197Updated last month
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆574Updated last year
- (NeurIPS 2024) Official PyTorch implementation of LOVA3☆89Updated 3 months ago
- [Arxiv] Discrete Diffusion in Large Language and Multimodal Models: A Survey☆172Updated last week
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025☆259Updated last month
- The first Large Audio Language Model that enables native in-depth thinking, which is trained on large-scale audio Chain-of-Thought data.☆234Updated 2 months ago
- An open-source implementation for training LLaVA-NeXT.☆408Updated 8 months ago
- 🚀 [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'2…☆84Updated 3 weeks ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆112Updated 3 months ago
- [ICML 2025] PyTorch Implementation of "OmniAudio: Generating Spatial Audio from 360-Degree Video"☆313Updated 3 weeks ago
- Official Repository of OmniCaptioner☆153Updated 2 months ago
- a family of versatile and state-of-the-art video tokenizers.☆403Updated 3 months ago
- [ECCV 2022] & [IJCV 2024] Official implementation of the paper: Audio-Visual Segmentation (with Semantics)☆399Updated 8 months ago