Alternatives and similar repositories for SpeechCLIP

Users that are interested in SpeechCLIP are comparing it to the libraries listed below

• microsoft / WavText5K
  Web-crawl for "Audio Retrieval with WavText5K and CLAP Training"
  ☆49Updated 2 years ago
• kyegomez / AudioFlamingo
  Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…
  ☆41Updated 3 months ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆81Updated 10 months ago
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆51Updated last year
• facebookresearch / facestar
  Facestar dataset. High quality audio-visual recordings of human conversational speech.
  ☆106Updated 3 years ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆53Updated 3 years ago
• asappresearch / wav2seq
  Official code for Wav2Seq
  ☆96Updated 2 years ago
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆55Updated 2 years ago
• mechanicalsea / lighthubert
  LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT
  ☆73Updated 2 years ago
• fengpeng-yue / speech-to-speech-translation
  ☆25Updated 2 years ago
• DanielLin94144 / StyleTalk
  Official release of StyleTalk dataset.
  ☆62Updated 10 months ago
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• JinhuaLiang / lam4fsl
  An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"
  ☆31Updated last year
• SRA2 / SPELL
  Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection (ECCV 2022)
  ☆65Updated last year
• jaeyeonkim99 / EnCLAP
  Official Implementation of EnCLAP (ICASSP 2024)
  ☆91Updated 11 months ago
• lucasnewman / best-rq-pytorch
  Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.
  ☆117Updated last year
• 0nutation / USLM
  Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)
  ☆144Updated last year
• RF5 / transfusion-asr
  Transcribing Speech with Multinomial Diffusion, training code and models.
  ☆76Updated last year
• vectominist / spin
  Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…
  ☆52Updated last year
• audio-captioning / clotho-dataset
  Python code for handling the Clotho dataset.
  ☆82Updated 4 years ago
• RF5 / simple-asgan
  Training code and trained checkpoints for ASGAN.
  ☆62Updated last year
• rishikksh20 / Zero-Shot-TTS
  Unofficial Implementation of Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration
  ☆34Updated 3 years ago
• HarunoriKawano / BEST-RQ
  Implementation of the paper "Self-supervised Learning with Random-projection Quantizer for Speech Recognition" in Pytorch.
  ☆75Updated last year
• youngsheen / GPST
  [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer
  ☆52Updated 6 months ago
• hhguo / MSMC-TTS
  Official Implement of Multi-Stage Multi-Codebook (MSMC) TTS
  ☆163Updated last year
• snap-research / GenAU
  ☆30Updated last month
• BenoitWang / Speech_Emotion_Diarization
  ☆65Updated 8 months ago
• rishikksh20 / AudioMAE-pytorch
  Unofficial PyTorch implementation of Masked Autoencoders that Listen
  ☆66Updated 2 years ago
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆39Updated last year
• soham97 / mellow
  small audio language model for reasoning
  ☆62Updated 3 weeks ago