dvlab-research / LyraLinks
Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"
☆286Updated 4 months ago
Alternatives and similar repositories for Lyra
Users that are interested in Lyra are comparing it to the libraries listed below
Sorting:
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆285Updated 3 weeks ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆338Updated this week
- [ICML 2025 Spotlight] An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆146Updated last month
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆295Updated 10 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆308Updated 3 months ago
- A post-training method to enhance CLIP's fine-grained visual representations with generative models.☆51Updated 2 months ago
- [ICML 2025] Official repository for paper "Scaling Video-Language Models to 10K Frames via Hierarchical Differential Distillation"☆146Updated 3 weeks ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025☆249Updated last week
- R1-like Computer-use Agent☆74Updated 2 months ago
- The first Large Audio Language Model that enables native in-depth thinking, which is trained on large-scale audio Chain-of-Thought data.☆224Updated 3 weeks ago
- ☆230Updated 6 months ago
- a family of versatile and state-of-the-art video tokenizers.☆393Updated 2 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆175Updated 7 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆565Updated last year
- Official Repository of OmniCaptioner☆144Updated last month
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,056Updated 7 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆113Updated last year
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆395Updated this week
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆259Updated last year
- An open-source implementation for training LLaVA-NeXT.☆397Updated 7 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆110Updated 2 months ago
- [ICLR 2025] Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆142Updated 6 months ago
- A collection of multimodal reasoning papers, codes, datasets, benchmarks and resources.☆223Updated this week
- Evaluation of Text-to-Video Generation Models: A Dynamics Perspective[NeurIPS 2024].☆272Updated 6 months ago
- GPT-ImgEval: Evaluating GPT-4o’s state-of-the-art image generation capabilities☆271Updated last month
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆588Updated 2 months ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆155Updated 5 months ago
- (NeurIPS 2024) Official PyTorch implementation of LOVA3☆87Updated 2 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆163Updated last month
- Official implementation of X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models☆154Updated 6 months ago