umbertocappellazzo / Llama-AVSR
[ICASSP 2025] Official Pytorch implementation of "Large Language Models are Strong Audio-Visual Speech Recognition Learners".
☆18Updated 2 months ago
Alternatives and similar repositories for Llama-AVSR
Users that are interested in Llama-AVSR are comparing it to the libraries listed below
Sorting:
- (SLT 2024) Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech Recognition☆11Updated 6 months ago
- MSP-Podcast Challenge Baseline Code☆22Updated 11 months ago
- Speech-MASSIVE is a multilingual Spoken Language Understanding (SLU) dataset comprising the speech counterpart for a portion of the MASSI…☆22Updated 8 months ago
- Transformer-based visually grounded speech models☆19Updated 2 years ago
- TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages☆15Updated 11 months ago
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆39Updated 8 months ago
- Audio-visual diarization pipeline used for creating VoxConverse dataset☆21Updated 2 months ago
- Official PyTorch implementation for "Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech …☆24Updated last week
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆26Updated last year
- ☆19Updated last year
- Aty-TTS: Improving fairness for spoken language understanding in atypical speech with Text-to-Speech☆10Updated last year
- ☆43Updated 2 years ago
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆40Updated last month
- Repository having the code and models from the paper: data2vec-aqc: Search for the right Teaching Assistant in the Teacher-Student traini…☆11Updated last year
- Source code and speech samples for the DSU-AVO paper accepted to INTERSPEECH 2023☆12Updated last year
- A benchmark to evaluate full-duplex spoken dialogue models on pause handling, backchanneling, turn-taking, and user interruptions.☆29Updated this week
- NOTSOFAR-1 Challenge: Distant Diarization and ASR☆53Updated 3 months ago
- ☆21Updated 8 months ago
- INTERSPEECH 23 - Refunction Whisper to recognize new tasks with adapters!☆36Updated last year
- Once more Diarization: Improving meeting transcription systems through segment-level speaker reassignment☆12Updated 3 months ago
- This repo contains the official PyTorch implementation of "Analyzing Discrete Self Supervised Speech Representation For Spoken Language M…☆18Updated 2 years ago
- Balanced Error Rate for Speaker Diarization☆32Updated 2 years ago
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆53Updated 3 weeks ago
- ☆38Updated 7 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆35Updated last year
- DUSTED: Spoken-Term Discovery using Discrete Speech Units☆17Updated 7 months ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆52Updated last year
- ☆12Updated 11 months ago
- ☆14Updated 2 years ago