Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"
☆28Feb 22, 2022Updated 4 years ago
Alternatives and similar repositories for ResDAVEnet-VQ
Users that are interested in ResDAVEnet-VQ are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Transformer-based visually grounded speech models☆19Sep 22, 2022Updated 4 years ago
- Deep Audio-Visual Embedding network (DAVEnet) implementation in PyTorch☆66Aug 31, 2018Updated 8 years ago
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆54Mar 30, 2022Updated 4 years ago
- Unsupervised phone and word segmentation using dynamic programming on self-supervised VQ features.☆40May 5, 2026Updated 5 months ago
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆27Dec 4, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Vector Quantized Autoregressive Predictive Coding (VQ-APC)☆38Nov 11, 2020Updated 5 years ago
- Code for "Phoneme Segmentation Using Self-Supervised Speech Models", Strgar & Harwath, Proceedings of the IEEE Spoken Language Technology…☆55Nov 4, 2022Updated 3 years ago
- Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence☆22Jun 14, 2024Updated 2 years ago
- Self-Supervised Contrastive Learning for Unsupervised Phoneme Segmentation (INTERSPEECH 2020)☆147Aug 5, 2022Updated 4 years ago
- ☆15May 8, 2021Updated 5 years ago
- An implementation of the Contrast Predictive Coding (CPC) method to train audio features in an unsupervised fashion.☆10Feb 22, 2022Updated 4 years ago
- Code for the C2KD paper (ICASSP 2023)☆20May 15, 2023Updated 3 years ago
- Source code for INTERSPEECH2020☆12Aug 7, 2020Updated 6 years ago
- [NeurIPS 2025] ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models☆25Apr 20, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Non-Autoregressive Predictive Coding☆51Nov 3, 2020Updated 6 years ago
- Concreteness☆20Nov 22, 2022Updated 3 years ago
- The official implementation of OpenSR (ACL2023 Oral)☆17Nov 29, 2023Updated 2 years ago
- ☆37Jun 30, 2022Updated 4 years ago
- ☆12Aug 25, 2023Updated 3 years ago
- X (weighted / probabilistic) Context-Free Grammars☆25Jan 30, 2024Updated 2 years ago
- Official implementation of USR (NeurIPS 2024)☆41Dec 21, 2024Updated last year
- Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)☆20Mar 17, 2025Updated last year
- Code for "Does syntax need to grow on trees? Sources of inductive bias in sequence to sequence networks"☆23Jan 14, 2020Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Audio-visual diarization pipeline used for creating VoxConverse dataset☆22Jun 6, 2025Updated last year
- ☆37May 8, 2021Updated 5 years ago
- Fast and Modularized CFG-focused Models☆23Nov 8, 2023Updated 2 years ago
- Semi-supervised Learning for Multi-speaker Text-to-speech Synthesis Using Discrete Speech Representation☆39Jul 16, 2020Updated 6 years ago
- R1V, trained with AI feedback, answers open-ended visual questions.☆14Apr 12, 2025Updated last year
- Autoregressive Predictive Coding: An unsupervised autoregressive model for speech representation learning☆191Jan 29, 2020Updated 6 years ago
- Official PyTorch implementation of the paper: "Deep Audio Waveform Prior" (Interspeech 2022) https://arxiv.org/abs/2207.10441☆12Oct 25, 2022Updated 4 years ago
- CAFA - a Controllable Automatic Foley Artist☆14Jul 27, 2025Updated last year
- multilingual speech aligner☆80Nov 19, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆59Apr 20, 2023Updated 3 years ago
- ☆25Feb 20, 2024Updated 2 years ago
- WildVSR☆22Dec 13, 2023Updated 2 years ago
- Wavenet Autoencoder for Unsupervised speech representation learning (after Chorowski, Jan 2019)☆176Sep 16, 2020Updated 6 years ago
- MetaC provides a read-eval-print loop (a REPL) and notebook interactive development environment (a NIDE) for C programming. MetaC also …☆12Sep 27, 2026Updated last month
- ☆19Sep 10, 2025Updated last year
- ☆12Nov 18, 2020Updated 5 years ago