VITA-MLLM / VITA-Audio
✨✨VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model
☆75Updated this week
Alternatives and similar repositories for VITA-Audio:
Users that are interested in VITA-Audio are comparing it to the libraries listed below
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆37Updated 3 weeks ago
- Sparrow: Data-Efficient Video-LLM with Text-to-Image Augmentation☆28Updated last month
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆275Updated last month
- Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆283Updated 4 months ago
- The Next Step Forward in Multimodal LLM Alignment☆149Updated last week
- ☆66Updated last month
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.☆11Updated last month
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…☆44Updated last week
- [ICML 2025 Spotlight]An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆139Updated 2 weeks ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆334Updated 2 months ago
- The first Large Audio Language Model that enables native in-depth thinking, which is trained on large-scale audio Chain-of-Thought data.☆215Updated last month
- The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate".☆98Updated 5 months ago
- The official Soundwave repository☆200Updated last month
- A project for tri-modal LLM benchmarking and instruction tuning.☆34Updated last month
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆96Updated 5 months ago
- Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)☆32Updated last month
- ☆150Updated 3 months ago
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆91Updated 3 weeks ago
- LMM solved catastrophic forgetting, AAAI2025☆41Updated 3 weeks ago
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆27Updated 2 months ago
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆23Updated 2 weeks ago
- A collection of omni-mllm☆26Updated last week
- llama-omni训练代码复现☆61Updated 3 months ago
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆267Updated 3 months ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆95Updated 6 months ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated 9 months ago
- ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆63Updated this week
- Official implementation of paper AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding☆51Updated 2 weeks ago
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆24Updated 4 months ago
- MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models☆34Updated last month