JaesungHuh / VoxMovies

Related projects ⓘ

Alternatives and complementary repositories for VoxMovies

• JinhuaLiang / lam4fsl
  An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"
  ☆28Updated last year
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆54Updated last year
• facebookresearch / visual-acoustic-matching
  Repo for Visual Acoustic Matching, CVPR 2022
  ☆65Updated last year
• uark-cviu / Right2Talk
  [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach
  ☆20Updated 3 years ago
• wnhsu / ResDAVEnet-VQ
  Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"
  ☆26Updated 2 years ago
• WangHelin1997 / MaskSpec
  The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training
  ☆39Updated last year
• akoepke / audio-retrieval-benchmark
  Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".
  ☆47Updated 2 years ago
• AlanBaade / MAE-AST-Public
  Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer
  ☆83Updated 2 years ago
• karreny / telling-left-from-right
  Project website for "Telling left from right: Learning spatial correspondence between sight and sound"
  ☆20Updated 2 years ago
• facebookresearch / learning-audio-visual-dereverberation
  Code for paper Learning Audio-Visual Dereverberation
  ☆26Updated 2 years ago
• chorowski-lab / hCPC
  Implementation of multi-level Contrastive Predictive Coding (CPC) methods
  ☆20Updated last year
• showlab / AVA-AVD
  ☆14Updated last year
• sony / CLIPSep
  ☆35Updated last year
• JeongHun0716 / e-mvsr
  Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)
  ☆14Updated last month
• jasonppy / word-discovery
  Word Discovery in Visually Grounded, Self-Supervised Speech Models
  ☆25Updated 11 months ago
• sangho-vision / acav100m
  ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.
  ☆54Updated 3 years ago
• wsntxxn / TextToAudioGrounding
  The dataset and baseline code for Text-to-Audio Grounding (TAG)
  ☆37Updated 3 months ago
• audio-captioning / clotho-dataset
  Python code for handling the Clotho dataset.
  ☆77Updated 3 years ago
• Sosdatasets / SoS_Dataset
  ☆11Updated 4 months ago
• JuanFMontesinos / Solos
  Solos: A Dataset for Audio-Visual Music Analysis
  ☆21Updated last year
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆50Updated 2 years ago
• kaistmm / VoxMM
  ☆14Updated 7 months ago
• Hertin / WavPrompt
  ☆36Updated 2 years ago
• JaesungHuh / VoxSRC2022
  VoxSRC2022 workshop development kit
  ☆17Updated 2 years ago
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆30Updated last year
• atosystem / SpeechCLIP
  SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022
  ☆109Updated last year
• jasonppy / FaST-VGS-Family
  Transformer-based visually grounded speech models
  ☆19Updated 2 years ago
• sungnyun / ARMHuBERT
  (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT
  ☆38Updated 2 months ago
• rhoposit / icassp2021
  ☆15Updated 3 years ago
• stoneMo / SLAVC
  Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)
  ☆16Updated last year