Sreyan88 / GAMA
Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
☆102Updated last month
Alternatives and similar repositories for GAMA:
Users that are interested in GAMA are comparing it to the libraries listed below
- AudioBench: A Universal Benchmark for Audio Large Language Models☆116Updated last week
- Versatile Evaluation of Speech and Audio☆153Updated 3 weeks ago
- Audio Captioning datasets for PyTorch.☆113Updated 2 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆166Updated 6 months ago
- AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆144Updated 3 weeks ago
- Reference-aware automatic speech evaluation toolkit☆140Updated last month
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆105Updated last week
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆112Updated last month
- Official Implementation of EnCLAP (ICASSP 2024)☆90Updated 7 months ago
- This is a list of speech tasks and datasets, which can provide training data for Generative AI, AIGC, AI model training, intelligent spee…☆73Updated 7 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆72Updated last month
- ☆37Updated this week
- The open source code for LLM-Codec☆123Updated 5 months ago
- UTokyo-SaruLab MOS Prediction System☆129Updated last month
- PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.☆223Updated 3 months ago
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆70Updated 4 months ago
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆123Updated 4 months ago
- Unofficial SoundStream implementation of Pytorch with training code and 16kHz pretrained checkpoint☆62Updated last year
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆140Updated last year
- Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.☆109Updated last year
- Implementation of SoundStorm built upon SpeechTokenizer.☆108Updated last year
- FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3☆184Updated 9 months ago
- Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"☆48Updated 2 weeks ago
- ☆63Updated 4 months ago
- This repository contains the training, inference, evaluation code for SpeechLLM models and details about the model releases on huggingfac…☆79Updated 7 months ago
- Ultra-low bitrate neural audio codec (0.31~1.40 kbps) with a better semantic in the latent space.☆185Updated 5 months ago
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆126Updated 7 months ago
- ARCH: Audio Representations benCHmark☆39Updated 5 months ago
- Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'☆92Updated 6 months ago
- ☆43Updated 7 months ago