Alternatives and similar repositories for SpeechCLIP

Users that are interested in SpeechCLIP are comparing it to the libraries listed below

• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆55Updated 2 years ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆85Updated last year
• kyegomez / AudioFlamingo
  Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…
  ☆40Updated 7 months ago
• asappresearch / wav2seq
  Official code for Wav2Seq
  ☆96Updated 3 years ago
• jaeyeonkim99 / EnCLAP
  Official Implementation of EnCLAP (ICASSP 2024)
  ☆92Updated last year
• microsoft / WavText5K
  Web-crawl for "Audio Retrieval with WavText5K and CLAP Training"
  ☆50Updated 2 years ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆56Updated 3 years ago
• fengpeng-yue / speech-to-speech-translation
  ☆25Updated 2 years ago
• RF5 / simple-asgan
  Training code and trained checkpoints for ASGAN.
  ☆62Updated last year
• audio-captioning / clotho-dataset
  Python code for handling the Clotho dataset.
  ☆83Updated 4 years ago
• rishikksh20 / AudioMAE-pytorch
  Unofficial PyTorch implementation of Masked Autoencoders that Listen
  ☆69Updated 3 years ago
• rishikksh20 / Zero-Shot-TTS
  Unofficial Implementation of Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration
  ☆34Updated 3 years ago
• facebookresearch / facestar
  Facestar dataset. High quality audio-visual recordings of human conversational speech.
  ☆109Updated 3 years ago
• MingjieChen / DYGANVC
  demo page https://MingjieChen.github.io/dygan-vc
  ☆67Updated 3 years ago
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆56Updated last year
• DanielLin94144 / StyleTalk
  Official release of StyleTalk dataset.
  ☆69Updated last year
• Observeai-Research / Phoneme-BERT
  ☆34Updated 4 years ago
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• kyegomez / USM
  Implementation of Google's USM speech model in Pytorch
  ☆30Updated last week
• JaesungHuh / VoxMovies
  Evaluation script for VoxMovies dataset in PyTorch
  ☆23Updated last year
• RF5 / transfusion-asr
  Transcribing Speech with Multinomial Diffusion, training code and models.
  ☆78Updated last year
• mechanicalsea / lighthubert
  LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT
  ☆74Updated 2 years ago
• ga642381 / SpeechGen
  《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》
  ☆75Updated 2 years ago
• ictnlp / DASpeech
  Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".
  ☆63Updated last year
• utter-project / mHuBERT-147-scripts
  Collection of scripts from mHuBERT-147.
  ☆29Updated 9 months ago
• nervjack2 / MelHuBERT
  Official implementation of MelHuBERT
  ☆66Updated 10 months ago
• suzuki256 / dog-dataset
  ☆43Updated 3 years ago
• vectominist / MiniASR
  A mini, simple, and fast end-to-end automatic speech recognition toolkit.
  ☆54Updated 2 years ago
• WangHelin1997 / MaskSpec
  The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training
  ☆42Updated 8 months ago
• glory20h / VoiceLDM
  VoiceLDM: Text-to-Speech with Environmental Context
  ☆182Updated last year