dvlab-research / Lyra
Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition
☆271Updated 3 weeks ago
Alternatives and similar repositories for Lyra:
Users that are interested in Lyra are comparing it to the libraries listed below
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆272Updated 6 months ago
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆385Updated 5 months ago
- a family of versatile and state-of-the-art video tokenizers.☆322Updated 2 weeks ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆531Updated 7 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆104Updated 3 months ago
- MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆279Updated last month
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆233Updated last month
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆165Updated 2 months ago
- Official implementation of X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models☆150Updated last month
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆108Updated 9 months ago
- The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆138Updated this week
- [ICLR 2025] BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities☆137Updated this week
- An open-source implementation for training LLaVA-NeXT.☆375Updated 3 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,032Updated 3 months ago
- This is the official reproduction of Qihoo-T2X.☆271Updated 3 months ago
- ☆215Updated last month
- Evaluation of Text-to-Video Generation Models: A Dynamics Perspective[NeurIPS 2024].☆259Updated last month
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆251Updated 9 months ago
- (NeurIPS 2024) Learning to Visual Question Answering, Asking and Assessment☆68Updated 2 months ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆151Updated last month
- Video-Inpaint-Anything: This is the inference code for our paper CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, C…☆261Updated 4 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆89Updated 10 months ago
- [ICLR 2025] Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆117Updated last month
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆151Updated 4 months ago
- Align Anything: Training All-modality Model with Feedback☆938Updated this week
- ☆281Updated this week
- SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation☆106Updated 3 months ago
- Code for paper "GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators"☆193Updated 6 months ago
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache☆40Updated 6 months ago