Interspeech Tutorial - Resource Efficient and Cross-Modal Learning Toward Foundation Modeling
☆15Oct 9, 2023Updated 3 years ago
Alternatives and similar repositories for Interspeech23-Tutorial-Para-Efficient-Cross-Modal-Tutorial
Users that are interested in Interspeech23-Tutorial-Para-Efficient-Cross-Modal-Tutorial are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Sep 27, 2026Updated last month
- Code for T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5☆19Nov 29, 2022Updated 3 years ago
- ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancement☆14Dec 19, 2022Updated 3 years ago
- ☆24Mar 30, 2024Updated 2 years ago
- ☆12Mar 11, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Policy gradient reinforcement learning beyond the mean, e.g., Pass@k, Max@k, TopM@K, CVaR, VaR, Quantiles, Trimmed Means or other functio…☆15Jun 5, 2026Updated 5 months ago
- Code repo for our paper of "Audio-Visual Representation Learning via Knowledge Distillation from Speech Foundation Models"☆12Feb 14, 2025Updated last year
- Source code and speech samples for the DSU-AVO paper accepted to INTERSPEECH 2023☆12May 13, 2024Updated 2 years ago
- ☆10Dec 13, 2025Updated 11 months ago
- Apollo training data preprocessing scripts☆16Mar 9, 2025Updated last year
- Repository for phoneme analysis on word-level Kaldi/ESPNet ASR transcripts☆11Apr 11, 2021Updated 5 years ago
- Audio-Visual Speech Recognition☆24Jul 7, 2025Updated last year
- ☆35Nov 24, 2024Updated last year
- A collection of tools and guides for preparing popular lipreading and audio-visual speech recognition datasets into a unified, standardiz…☆13Oct 28, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This repo contains the official PyTorch implementation of "Analyzing Discrete Self Supervised Speech Representation For Spoken Language M…☆21Jan 3, 2023Updated 3 years ago
- A pitch detection model trained to be robust against noise and reverberation environments.☆27Jan 21, 2025Updated last year
- 비임 가즈으아☆11Aug 16, 2018Updated 8 years ago
- Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…☆36Jun 20, 2023Updated 3 years ago
- BEAVER: A Training-Free Hierarchical Prompt Compression Method via Structure-Aware Page Selection☆19Mar 30, 2026Updated 7 months ago
- Pytorch implementation for “V2C: Visual Voice Cloning”☆35Jan 28, 2023Updated 3 years ago
- A toolkit for researchers in the multimodal sound separation.☆16Oct 20, 2023Updated 3 years ago
- ☆16Feb 19, 2026Updated 9 months ago
- Implementation of "Improving Whispered Speech Recognition Performance using Pseudo-whispered based Data Augmentation"☆16Sep 11, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆18Nov 22, 2024Updated last year
- Official source code for the paper "Tailored Design of Audio-Visual Speech Recognition Models using Branchformers"☆15Feb 24, 2025Updated last year
- WavBench: Benchmarking Reasoning, Colloquialism, and Paralinguistics for End-to-End Spoken Dialogue Models☆38Feb 13, 2026Updated 9 months ago
- [CVPR 2024] Official Repository for MCPNet: An Interpretable Classifier via Multi-Level Concept Prototypes☆21Jul 8, 2024Updated 2 years ago
- ☆30Jul 12, 2024Updated 2 years ago
- ☆25Mar 12, 2022Updated 4 years ago
- (SLT 2024) Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech Recognition☆13Oct 22, 2024Updated 2 years ago
- Torch implementation of Whisper-guided DDPM based Voice Conversion☆49Mar 7, 2023Updated 3 years ago
- Speech formant tracking code in Python☆15Oct 10, 2013Updated 13 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- (ICLR 2025) Multi-Task Corrupted Prediction for Learning Robust Audio-Visual Speech Representation☆16Apr 29, 2025Updated last year
- Evaluation script for VoxMovies dataset in PyTorch☆23Jan 12, 2024Updated 2 years ago
- ☆64May 23, 2022Updated 4 years ago
- Pytorch implementation of LearnableUpsamplingLayer (NaturalSpeech, Tan et al., 2022)☆57Mar 12, 2024Updated 2 years ago
- Towards a general language-audio model for computational paralinguistic tasks☆31Dec 14, 2024Updated last year
- ☆12Dec 8, 2022Updated 3 years ago
- Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)☆20Mar 17, 2025Updated last year
Are these results useful?