Sreyan88 / GAMALinks
Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
☆148Updated last year
Alternatives and similar repositories for GAMA
Users that are interested in GAMA are comparing it to the libraries listed below
Sorting:
- AudioBench: A Universal Benchmark for Audio Large Language Models☆286Updated 6 months ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆192Updated last year
- ☆121Updated 3 months ago
- Audio Captioning datasets for PyTorch.☆125Updated 5 months ago
- small audio language model for reasoning☆81Updated 2 weeks ago
- Audio-FLAN☆160Updated 2 months ago
- The open source code for LLM-Codec☆143Updated last year
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆147Updated 8 months ago
- Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'☆99Updated last year
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Survey".☆196Updated this week
- Official Implementation of EnCLAP (ICASSP 2024)☆94Updated last year
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆184Updated last week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆124Updated last year
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆189Updated last year
- AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆274Updated 2 months ago
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆149Updated 6 months ago
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆49Updated 8 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆151Updated 2 years ago
- Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.☆64Updated 5 months ago
- Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.☆126Updated 2 years ago
- This is a list of speech tasks and datasets, which can provide training data for Generative AI, AIGC, AI model training, intelligent spee…☆81Updated last year
- ☆111Updated 3 months ago
- Ultra-low bitrate neural audio codec (0.31~1.40 kbps) with a better semantic in the latent space.☆233Updated 9 months ago
- A low-bitrate single-codebook 16 / 24 kHz speech codec based on focal modulation☆133Updated 3 weeks ago
- Reference-aware automatic speech evaluation toolkit☆172Updated last year
- An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.☆194Updated 5 months ago
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆48Updated last year
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆129Updated last year
- A Benchmark for Evaluating Turn-Taking and Overlap Handling in Full-Duplex Spoken Dialogue Models☆110Updated 2 months ago
- The TTSDS benchmark evaluates synthetic speech quality by considering prosody, speaker identity, and intelligibility, comparing these fac…☆71Updated 2 months ago