wanglin-lw / ST-Caps

Related projects: ⓘ

• NYElegance / SimulLR
  PyTorch Implementation of SimulLR
  ☆11Updated 2 years ago
• Levent9 / Zero-shot-FaceVC
  ☆14Updated 6 months ago
• the-anonymous-bs / av-SALMONN
  av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models
  ☆14Updated 4 months ago
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆20Updated 2 weeks ago
• thuhcsi / SECap
  ☆130Updated 2 months ago
• Exgc / AVMuST-TED
  ☆22Updated 5 months ago
• GalaxyCong / HPMDubbing
  [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.
  ☆99Updated 3 months ago
• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆21Updated last month
• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆99Updated 5 months ago
• marmot-xy / CMBS
  cross modal background suppression for audio-visual event localization
  ☆34Updated 2 years ago
• zeroQiaoba / MERTools
  Toolkits for Multimodal Emotion Recognition
  ☆150Updated 3 months ago
• liyidi / soundnet_localize_sound_source
  soundnet and localize sound source
  ☆12Updated 3 years ago
• GeWu-Lab / awesome-audiovisual-learning
  A curated list of audio-visual learning methods and datasets.
  ☆220Updated last week
• HappyColor / SpeechFormer
  Official implement of SpeechFormer written in Python (PyTorch).
  ☆72Updated last year
• Franklin905 / VALOR
  Research code for NeurIPS 2023 paper "Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser"
  ☆15Updated 11 months ago
• Sreyan88 / MMER
  Code for the InterSpeech 2023 paper: MMER: Multimodal Multi-task learning for Speech Emotion Recognition
  ☆62Updated 6 months ago
• mpc001 / auto_avsr
  Auto-AVSR: Lip-Reading Sentences Project
  ☆164Updated 5 months ago
• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆28Updated last year
• samsad35 / VQ-MAE-S-code
  A Vector Quantized Masked AutoEncoder for speech emotion recognition
  ☆15Updated 6 months ago
• xieyuankun / Codecfake
  This is the official repo of our work titled "The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio".
  ☆29Updated 4 months ago
• zexupan / USEV
  ☆13Updated 2 months ago
• HappyColor / DST
  Deformable Speech Transformer (DST)
  ☆26Updated last month
• Vincent-ZHQ / CA-MSER
  Code for Speech Emotion Recognition with Co-Attention based Multi-level Acoustic Information
  ☆121Updated 9 months ago
• ASolitaryMan / HFLEA
  FRAME-LEVEL EMOTIONAL STATE ALIGNMENT METHOD FOR SPEECH EMOTION RECOGNITION
  ☆13Updated 10 months ago
• ubc-vision / TriBERT
  Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation" in NeurIPS…
  ☆13Updated 2 years ago
• my-yy / vfal_papers
  Voice Face Association Learning Paper List
  ☆12Updated last year
• liuxubo717 / sound_generation
  Code and generated sounds for "Conditional Sound Generation Using Neural Discrete Time-Frequency Representation Learning", MLSP 2021
  ☆68Updated 3 years ago
• XinhaoMei / WavCaps
  This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.
  ☆194Updated last month
• talkingnow / HM-Conformer
  ☆21Updated 8 months ago
• media-sec-lab / Audio-Deepfake-Detection
  Research progress on speech deepfake detection: Relevant datasets aggregated from the review literature and publicly available codes
  ☆84Updated last year