Alternatives and similar repositories for Llama-AVSR

Users that are interested in Llama-AVSR are comparing it to the libraries listed below

• sungnyun / avsr-temporal-dynamics
  (SLT 2024) Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech Recognition
  ☆12Updated 8 months ago
• msplabresearch / MSP-Podcast_Challenge
  MSP-Podcast Challenge Baseline Code
  ☆24Updated last year
• JeongHun0716 / zero-avsr
  Official PyTorch implementation for "Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech …
  ☆27Updated last month
• cuhealthybrains / MT-LLM
  The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"
  ☆42Updated 2 months ago
• ga642381 / SpeechPrompt-v2
  《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm
  ☆81Updated last year
• BenoitWang / Speech_Emotion_Diarization
  ☆66Updated 9 months ago
• mispchallenge / misp2022_baseline
  ☆30Updated 2 years ago
• choijeongsoo / utut
  [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
  ☆30Updated 9 months ago
• sinhat98 / adapter-wavlm
  ☆43Updated 2 years ago
• ms-dot-k / TMT
  TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages
  ☆16Updated last year
• jasonppy / FaST-VGS-Family
  Transformer-based visually grounded speech models
  ☆19Updated 2 years ago
• sungnyun / ARMHuBERT
  (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT
  ☆40Updated 10 months ago
• WangHelin1997 / SpecAugment-plus
  A Pytorch implementation of the paper : SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classification
  ☆34Updated 4 years ago
• tiantiaf0627 / vox-profile-release
  Vox-Profile Benchmark
  ☆30Updated 2 weeks ago
• VoxBlink / ScriptsForVoxBlink
  A repo containing download guidance and corresponding scripts of the VoxBlink dataset.
  ☆26Updated last year
• EMOsuperb / EMO-SUPERB-submission
  EMO-SUPERB submission
  ☆44Updated 9 months ago
• jasonppy / word-discovery
  Word Discovery in Visually Grounded, Self-Supervised Speech Models
  ☆26Updated last year
• haoheliu / diffres-python
  Learning differentiable temporal resolution on time-series data.
  ☆36Updated 2 years ago
• Srijith-rkr / KAUST-Whisper-Adapter
  INTERSPEECH 23 - Refunction Whisper to recognize new tasks with adapters!
  ☆36Updated last year
• leibniz-future-lab / SelfDistill-SER
  ☆19Updated 2 years ago
• microsoft / NOTSOFAR1-Challenge
  NOTSOFAR-1 Challenge: Distant Diarization and ASR
  ☆54Updated 4 months ago
• JaesungHuh / av-diarization
  Audio-visual diarization pipeline used for creating VoxConverse dataset
  ☆21Updated 3 weeks ago
• mutiann / speech_rankings
  A CSRankings-like index for speech researchers
  ☆34Updated 8 months ago
• IDRnD / VoxTube
  The VoxTube dataset official repository
  ☆69Updated last year
• ftshijt / speech_evaluation
  A toolkit dedicate for speech evaluation.
  ☆20Updated 9 months ago
• mispchallenge / MISP-ICME-AVSR
  ☆17Updated last year
• Speech-Arena / speech_df_arena
  ☆18Updated 2 months ago
• ga642381 / Speech-Prompts-Adapters
  This Repository surveys the paper focusing on Prompting and Adapters for Speech Processing.
  ☆110Updated last year
• mkunes / w2v2_audioFrameClassification
  wav2vec2 audio classification for prosodic boundary detection and other tasks
  ☆42Updated last year
• KeiKinn / ParaCLAP
  Towards a general language-audio model for computational paralinguistic tasks
  ☆13Updated 6 months ago