Sreyan88 / GAMA
Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
☆123Updated 4 months ago
Alternatives and similar repositories for GAMA:
Users that are interested in GAMA are comparing it to the libraries listed below
- AudioBench: A Universal Benchmark for Audio Large Language Models☆200Updated 3 weeks ago
- Audio Captioning datasets for PyTorch.☆115Updated last month
- Official Implementation of EnCLAP (ICASSP 2024)☆91Updated 10 months ago
- Audio-FLAN☆141Updated last month
- Reference-aware automatic speech evaluation toolkit☆153Updated 4 months ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆126Updated 4 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆175Updated 9 months ago
- Audio Codec Speech processing Universal PERformance Benchmark☆251Updated last week
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆156Updated 7 months ago
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆118Updated last month
- AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆201Updated this week
- Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'☆95Updated 9 months ago
- ☆62Updated last month
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆38Updated 2 weeks ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆92Updated 4 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆136Updated this week
- The open source code for LLM-Codec☆133Updated 8 months ago
- Versatile Evaluation of Speech and Audio☆185Updated this week
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆142Updated last year
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆129Updated 10 months ago
- UTokyo-SaruLab MOS Prediction System☆173Updated 3 weeks ago
- VoiceLDM: Text-to-Speech with Environmental Context☆174Updated 8 months ago
- FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3☆196Updated last year
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆62Updated this week
- ☆55Updated 2 years ago
- An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.☆140Updated last month
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆150Updated 2 months ago
- Audiogen Codec☆135Updated 9 months ago
- Implementation of SoundStorm built upon SpeechTokenizer.☆110Updated last year
- [SLT'24] The official implementation of SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model☆118Updated 6 months ago