Towards Fine-grained Audio Captioning with Multimodal Contextual Cues
☆88Jan 4, 2026Updated 7 months ago
Alternatives and similar repositories for FusionAudio
Users that are interested in FusionAudio are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆33Dec 23, 2025Updated 7 months ago
- ☆12Mar 11, 2025Updated last year
- Agentifying Patient Dynamics within LLMs through Interacting with Clinical World Model☆31May 15, 2026Updated 2 months ago
- Audio-FLAN☆161Sep 23, 2025Updated 10 months ago
- MedGen: Unlocking Medical Video Generation by Scaling Granularly-annotated Medical Videos.☆33Apr 18, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICLR'25] ApolloMoE: Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts☆53Nov 20, 2024Updated last year
- ☆56Jul 13, 2025Updated last year
- MUSDB25 - A Fully Multitrack Dataset for Music Source Separation☆13Mar 29, 2025Updated last year
- [INTERSPEECH 2025 Oral]Official code for "Accelerating Diffusion-based Text-to-Speech Model Training with Dual Modality Alignment"☆67Jun 16, 2025Updated last year
- [ACL 2026 Main] FineLAP: Taming Heterogeneous Supervision for Fine-grained Language-Audio Pre-training☆36Apr 20, 2026Updated 3 months ago
- Multi-lingual AudioCaps☆14Nov 20, 2023Updated 2 years ago
- ☆37Jun 9, 2025Updated last year
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆68Dec 26, 2025Updated 7 months ago
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆127Mar 20, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆47Sep 19, 2025Updated 10 months ago
- ☆35Sep 6, 2025Updated 11 months ago
- [ACL 2025] Exploring Compositional Generalization of Multimodal LLMs for Medical Imaging☆40Jun 4, 2025Updated last year
- Collection of scripts from mHuBERT-147.☆35Nov 19, 2024Updated last year
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆208Dec 13, 2024Updated last year
- [INTERSPEECH 2026 Oral]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆122Jun 21, 2026Updated last month
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆56May 15, 2025Updated last year
- ☆101Jan 19, 2026Updated 6 months ago
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆49Jan 19, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Implementation of the paper "Variable Bitrate Residual Vector Quantization for Audio Coding"☆11Apr 10, 2025Updated last year
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆211Jan 6, 2025Updated last year
- ☆131Jul 23, 2026Updated 2 weeks ago
- ☆21Jun 4, 2026Updated 2 months ago
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆76Jul 20, 2026Updated 3 weeks ago
- [NAACL 2025] WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matching☆133Apr 8, 2026Updated 4 months ago
- Official Repository for "Music Source Restoration"☆31Jun 1, 2025Updated last year
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆216Feb 25, 2026Updated 5 months ago
- Automatic speech annotator processing speech with voice activaty detection, overlapping speech detection, speaker diarization and automat…☆33Jun 14, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- open-vocabulary sound event detection☆54Dec 17, 2025Updated 7 months ago
- The official Soundwave repository☆223Mar 16, 2025Updated last year
- LibriSpeech-Long is a benchmark dataset for long-form speech generation and processing. Released as part of "Long-Form Speech Generation …☆99Dec 28, 2024Updated last year
- A low-bitrate single-codebook 16 / 24 kHz speech codec based on focal modulation☆174Nov 30, 2025Updated 8 months ago
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆145Apr 7, 2026Updated 4 months ago
- [ACL 2026 Main] Training, inference, and testing of the SAC speech codec model.☆109Nov 1, 2025Updated 9 months ago
- Expressive Speech Retrieval using Natural Language Descriptions of Speaking Style☆15Aug 18, 2025Updated 11 months ago