dynamic-superb / multimodal-llamaLinks
The official implementation of ImageBind-LLM and Whisper-LLM from the paper "Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech".
☆21Updated last year
Alternatives and similar repositories for multimodal-llama
Users that are interested in multimodal-llama are comparing it to the libraries listed below
Sorting:
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆102Updated 5 months ago
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆40Updated 2 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆218Updated 2 weeks ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆45Updated last year
- ☆80Updated last week
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆36Updated 10 months ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆127Updated 6 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated 4 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆49Updated 11 months ago
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆18Updated last year
- small audio language model for reasoning☆64Updated last month
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆145Updated last year
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆69Updated 5 months ago
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆52Updated 7 months ago
- The open source code for LLM-Codec☆134Updated 9 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆53Updated 4 months ago
- Implementation of Google's USM speech model in Pytorch☆31Updated 2 months ago
- Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆21Updated this week
- Official release of StyleTalk dataset.☆64Updated 11 months ago
- ☆71Updated last year
- Audio-FLAN☆156Updated 3 months ago
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆118Updated last week
- ☆39Updated 8 months ago
- ☆113Updated last month
- Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆118Updated 2 weeks ago
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆35Updated 8 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆144Updated last month
- LibriSpeech-Long is a benchmark dataset for long-form speech generation and processing. Released as part of "Long-Form Speech Generation …☆67Updated 5 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆71Updated 7 months ago
- The repoduction codes for Qwen-Audio Fine-tuning☆39Updated 9 months ago