zszheng147 / Spatial-ASTView external linksLinks
🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)
☆73Feb 13, 2025Updated last year
Alternatives and similar repositories for Spatial-AST
Users that are interested in Spatial-AST are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆195Dec 13, 2025Updated 2 months ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆59Jul 2, 2025Updated 7 months ago
- Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence☆19Jun 14, 2024Updated last year
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆69Jan 22, 2026Updated 3 weeks ago
- ☆32Nov 18, 2025Updated 2 months ago
- ARCH: Audio Representations benCHmark☆53Aug 26, 2024Updated last year
- Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos☆25Oct 1, 2024Updated last year
- A python implementation of “Self-Supervised Learning of Spatial Acoustic Representation with Cross-Channel Signal Reconstruction and Mult…☆39Oct 11, 2024Updated last year
- Real Acoustic Fields An Audio-Visual Room Acoustics Dataset and Benchmark☆60Aug 29, 2024Updated last year
- Data generator for creating synthetic audio mixtures suitable for DCASE Challenge 2022 Task 3☆44Apr 5, 2023Updated 2 years ago
- Baseline method for sound event localization task of DCASE 2023 challenge☆60Mar 13, 2023Updated 2 years ago
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆256Jul 25, 2024Updated last year
- Visually-Aware Audio Captioning☆43Mar 3, 2023Updated 2 years ago
- ☆66Aug 7, 2025Updated 6 months ago
- ☆13Feb 1, 2026Updated last week
- [EMNLP 2025 Findings] A complete cross-modal RAG system for end-to-end speech-to-speech large models, including ASR-based Retrieval and E…☆27Jul 11, 2025Updated 7 months ago
- AudioLDM training, finetuning, evaluation and inference.☆14Mar 27, 2024Updated last year
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)☆41Sep 10, 2025Updated 5 months ago
- [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer☆221Nov 30, 2025Updated 2 months ago
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆154May 30, 2025Updated 8 months ago
- Python implementation of the paper "Fusion of Audio and Visual Embeddings for Sound Event Localization and Detection"☆27Apr 26, 2024Updated last year
- We propose a novel approach for reconstructing human expressiveness in piano performance with a multi-layer bi-directional Transformer. (…☆20May 16, 2024Updated last year
- Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".☆308Aug 4, 2025Updated 6 months ago
- Speech samples and code of BEdit-TTS☆34Oct 8, 2023Updated 2 years ago
- ☆35Nov 14, 2024Updated last year
- AD-YOLO: You Look Only Once in Training Multiple Sound Event Localization and Detection, IEEE ICASSP 2023☆33Dec 21, 2025Updated last month
- A Framework for Speech, Language, Audio, Music Processing with Large Language Model☆966Jan 15, 2026Updated 3 weeks ago
- Xmart青年论坛仓库，存放历史学生论坛和前沿讲座的视频回放和讲义，获取最新Xmart预告欢迎关注公众号【XLANCE Lab】☆50Dec 20, 2025Updated last month
- ☆39Jan 17, 2026Updated 3 weeks ago
- ☆131Jan 30, 2026Updated 2 weeks ago
- Audio propagation engine - Meta Reality Labs Research.☆23Nov 1, 2022Updated 3 years ago
- MFF-EINV2: Multi-scale Feature Fusion across Spectral-Spatial-Temporal Domains for Sound Event Localization and Detection☆21Jul 17, 2024Updated last year
- This repo includes the official implementations of "Fine-tune the pretrained ATST model for sound event detection".☆158Aug 24, 2025Updated 5 months ago
- ☆45Dec 13, 2025Updated 2 months ago
- A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple task…☆438Sep 29, 2023Updated 2 years ago
- Baseline method for sound event localization task of DCASE 2022 challenge☆60Jun 21, 2022Updated 3 years ago
- Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.☆68Jul 19, 2025Updated 6 months ago
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆54May 15, 2025Updated 8 months ago
- ☆19Mar 6, 2025Updated 11 months ago