Alternatives and similar repositories for VoxMovies

Users that are interested in VoxMovies are comparing it to the libraries listed below

• uark-cviu / Right2Talk
  [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach
  ☆20Updated 4 years ago
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆57Updated 2 years ago
• sangho-vision / acav100m
  ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.
  ☆62Updated 4 years ago
• JaesungHuh / av-diarization
  Audio-visual diarization pipeline used for creating VoxConverse dataset
  ☆21Updated 6 months ago
• audio-captioning / clotho-dataset
  Python code for handling the Clotho dataset.
  ☆85Updated 5 years ago
• wnhsu / ResDAVEnet-VQ
  Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"
  ☆27Updated 3 years ago
• karreny / telling-left-from-right
  Project website for "Telling left from right: Learning spatial correspondence between sight and sound"
  ☆24Updated 3 years ago
• epic-kitchens / epic-sounds-annotations
  Splits for epic-sounds dataset
  ☆83Updated 4 months ago
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆53Updated last year
• facebookresearch / visual-acoustic-matching
  Repo for Visual Acoustic Matching, CVPR 2022
  ☆70Updated 2 years ago
• atosystem / SpeechCLIP
  SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022
  ☆117Updated 3 years ago
• akoepke / audio-retrieval-benchmark
  Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".
  ☆54Updated 5 months ago
• midas-research / speechmix
  ☆12Updated 5 years ago
• EGO4D / audio-visual
  ☆67Updated 3 years ago
• amazon-science / iwslt-autodub-task
  ☆20Updated last year
• rishikksh20 / AudioMAE-pytorch
  Unofficial PyTorch implementation of Masked Autoencoders that Listen
  ☆70Updated 3 years ago
• clovaai / lookwhostalking
  Look Who’s Talking: Active Speaker Detection in the Wild
  ☆75Updated 2 years ago
• GasserElbanna / serab-byols
  (Hybrid) BYOL-S feature extractor using serab-byols package in pytorch.
  ☆27Updated last year
• etzinis / biased_separation
  Code for the paper: Unified Gradient Reweighting for Model Biasing with Applications to Source Separation
  ☆14Updated 5 years ago
• chorowski-lab / hCPC
  Implementation of multi-level Contrastive Predictive Coding (CPC) methods
  ☆19Updated 2 years ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆57Updated 3 years ago
• ExplainableML / ZerAuCap
  [NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords
  ☆18Updated last year
• CVxTz / COLA_pytorch
  COLA contrastive pre-training method implemented in PyTorch
  ☆43Updated 4 years ago
• AlanBaade / MAE-AST-Public
  Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer
  ☆89Updated 3 years ago
• shincling / discreteSeparation
  The demo for "Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem".
  ☆12Updated 4 years ago
• rhoposit / multilingual_VQVAE
  ☆37Updated 4 years ago
• rhoposit / icassp2021
  ☆15Updated 4 years ago
• sungnyun / ARMHuBERT
  (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT
  ☆39Updated last year
• ekazakos / auditory-slow-fast
  Implementation of "Slow-Fast Auditory Streams for Audio Recognition, ICASSP, 2021" in PyTorch
  ☆74Updated 4 years ago
• jasonppy / FaST-VGS-Family
  Transformer-based visually grounded speech models
  ☆19Updated 3 years ago