🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)
☆93Feb 13, 2025Updated last year
Alternatives and similar repositories for Spatial-AST
Users that are interested in Spatial-AST are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆44Oct 8, 2026Updated 3 weeks ago
- MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations☆43Aug 29, 2026Updated 2 months ago
- ☆16May 25, 2026Updated 5 months ago
- ☆65Oct 19, 2025Updated last year
- Code for the paper "DSpAST: Disentangled Representations for Spatial Audio Reasoning with Large Language Models"☆18Oct 23, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICLR 2026] An official implementation of "STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence"☆47Apr 19, 2026Updated 6 months ago
- ☆18Feb 1, 2026Updated 9 months ago
- Repository for SAVVY(Spatial Awareness via Audio-Visual LLMs through Seeing and Hearing) Benchmark and SAVVY model☆29May 30, 2026Updated 5 months ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆69Jul 2, 2025Updated last year
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)☆49Sep 10, 2025Updated last year
- Baseline method for sound event localization task of DCASE 2023 challenge☆73Mar 13, 2023Updated 3 years ago
- A python implementation of “Self-Supervised Learning of Spatial Acoustic Representation with Cross-Channel Signal Reconstruction and Mult…☆41Oct 11, 2024Updated 2 years ago
- ☆15Aug 13, 2023Updated 3 years ago
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆223Feb 25, 2026Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICLR 2025] Enhancing Self-Supervised Models with Audio Mixtures for Polyphonic Soundscapes☆82Oct 8, 2025Updated last year
- Audio propagation engine - Meta Reality Labs Research.☆24Nov 1, 2022Updated 4 years ago
- A Framework for Speech, Language, Audio, Music Processing with Large Language Model☆1,067Jan 15, 2026Updated 9 months ago
- ☆144Jan 24, 2026Updated 9 months ago
- Implementation of the paper "Binaural Sound Source Distance Estimation and Localization for a Moving Listener"☆23Mar 2, 2025Updated last year
- [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer☆247Nov 30, 2025Updated 11 months ago
- [TASLP] Open-Vocabulary Sound Event Localization and Detection with Joint Learning of CLAP Embedding and Activity-Coupled Cartesian DOA V…☆14Mar 25, 2026Updated 7 months ago
- [EMNLP 2025 Findings] A complete cross-modal RAG system for end-to-end speech-to-speech large models, including ASR-based Retrieval and E…☆32Jul 11, 2025Updated last year
- A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple task…☆475Sep 29, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- PSELDNets: Pre-trained Neural Networks on Large-scale Synthetic Datasets for Sound Event Localization and Detection☆50Updated this week
- Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence☆22Jun 14, 2024Updated 2 years ago
- Spherical Harmonics ROOM, an open-source Python library for room acoustics simulation using Ambisonics, https://arxiv.org/abs/2603.27342,…☆27Sep 29, 2026Updated last month
- Data generator for sound event localization and detection clips, including 4-ch microphone-array-format signals and first-order-ambisonic…☆22Nov 13, 2024Updated last year
- Baseline method for audio-visual sound event localization and detection task of DCASE 2023 challenge☆69Mar 19, 2025Updated last year
- A Python Library for Binaural Mixing and Data Generation☆55Jan 23, 2026Updated 9 months ago
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆79Jul 20, 2026Updated 3 months ago
- Official implementation of "NaVLA$^2$: A Vision-Language-Audio-Action Model for Multimodal Instruction Navigation"☆13Mar 14, 2026Updated 7 months ago
- Python implementation of the paper "Fusion of Audio and Visual Embeddings for Sound Event Localization and Detection"☆32Apr 26, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆79Aug 7, 2025Updated last year
- AudioLDM training, finetuning, evaluation and inference.☆14Mar 27, 2024Updated 2 years ago
- [ICML 2026] JAEGER: Joint 3D Audio-Visual Grounding and Reasoning in Simulated Physical Environments☆20Jun 9, 2026Updated 4 months ago
- [ICASSP 2024] Max-AST: Combining Convolution, Local and Global Self-Attentions for Audio Event Classification☆13Mar 10, 2025Updated last year
- ☆38Nov 14, 2024Updated last year
- HARP: A Large-Scale Higher-Order Ambisonic Room Impulse Response Dataset☆35Jun 3, 2025Updated last year
- A large synthetic dataset of spatial audio with multiple labels☆130Sep 11, 2026Updated last month