umbertocappellazzo / Llama-AVSR
[ICASSP 2025] Official Pytorch implementation of "Large Language Models are Strong Audio-Visual Speech Recognition Learners".
☆14Updated 2 weeks ago
Alternatives and similar repositories for Llama-AVSR:
Users that are interested in Llama-AVSR are comparing it to the libraries listed below
- Speech-MASSIVE is a multilingual Spoken Language Understanding (SLU) dataset comprising the speech counterpart for a portion of the MASSI…☆21Updated 7 months ago
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆26Updated last year
- Collection of scripts from mHuBERT-147.☆24Updated 4 months ago
- Transformer-based visually grounded speech models☆19Updated 2 years ago
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆39Updated 6 months ago
- DUSTED: Spoken-Term Discovery using Discrete Speech Units☆15Updated 5 months ago
- TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages☆14Updated 10 months ago
- ☆36Updated 6 months ago
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆51Updated 3 weeks ago
- This repo contains the official PyTorch implementation of "Analyzing Discrete Self Supervised Speech Representation For Spoken Language M…☆17Updated 2 years ago
- Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)☆16Updated last week
- DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning☆48Updated last year
- ☆19Updated last year
- 56 language, 1 model Multilingual ASR☆25Updated 3 years ago
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated last year
- Unsupervised phone and word segmentation using dynamic programming on self-supervised VQ features.☆36Updated last year
- SERAB: a multi-lingual benchmark for speech emotion recognition☆28Updated 2 years ago
- [IJCAI'23] Learning to Speak from Text for Low-Resource TTS☆63Updated last year
- ☆14Updated 8 months ago
- A toolkit to calculate speech audio quality. Not affiliated with the original authors☆50Updated 7 months ago
- ☆21Updated 7 months ago
- Aty-TTS: Improving fairness for spoken language understanding in atypical speech with Text-to-Speech☆10Updated last year
- ☆36Updated 2 years ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆49Updated last year
- MSP-Podcast Challenge Baseline Code☆20Updated 9 months ago
- INTERSPEECH 23 - Refunction Whisper to recognize new tasks with adapters!☆37Updated last year
- (Hybrid) BYOL-S feature extractor using serab-byols package in pytorch.☆27Updated 11 months ago
- ☆16Updated last year
- multilingual speech aligner☆72Updated last year
- Code for ICASSP 2024 Paper: RECAP: Retrieval-Augmented Audio Captioning☆12Updated 9 months ago