Alternatives and similar repositories for SpeechCLIP:

Users that are interested in SpeechCLIP are comparing it to the libraries listed below

• microsoft / WavText5K
  Web-crawl for "Audio Retrieval with WavText5K and CLAP Training"
  ☆49Updated 2 years ago
• jaeyeonkim99 / EnCLAP
  Official Implementation of EnCLAP (ICASSP 2024)
  ☆91Updated 9 months ago
• kyegomez / AudioFlamingo
  Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…
  ☆40Updated last month
• mechanicalsea / lighthubert
  LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT
  ☆70Updated 2 years ago
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆51Updated 11 months ago
• DanielLin94144 / StyleTalk
  Official release of StyleTalk dataset.
  ☆62Updated 8 months ago
• RF5 / simple-asgan
  Training code and trained checkpoints for ASGAN.
  ☆62Updated last year
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆53Updated 3 years ago
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆54Updated last year
• asappresearch / wav2seq
  Official code for Wav2Seq
  ☆96Updated 2 years ago
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• vectominist / spin
  Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…
  ☆49Updated last year
• soham97 / mellow
  small audio language model for reasoning
  ☆49Updated last week
• audio-captioning / clotho-dataset
  Python code for handling the Clotho dataset.
  ☆81Updated 4 years ago
• kyegomez / USM
  Implementation of Google's USM speech model in Pytorch
  ☆30Updated last month
• fengpeng-yue / speech-to-speech-translation
  ☆25Updated 2 years ago
• lucasnewman / best-rq-pytorch
  Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.
  ☆112Updated last year
• HarunoriKawano / BEST-RQ
  Implementation of the paper "Self-supervised Learning with Random-projection Quantizer for Speech Recognition" in Pytorch.
  ☆71Updated last year
• rishikksh20 / AudioMAE-pytorch
  Unofficial PyTorch implementation of Masked Autoencoders that Listen
  ☆66Updated 2 years ago
• ga642381 / SpeechGen
  《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》
  ☆74Updated last year
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆80Updated 9 months ago
• RF5 / transfusion-asr
  Transcribing Speech with Multinomial Diffusion, training code and models.
  ☆76Updated last year
• BenoitWang / Speech_Emotion_Diarization
  ☆64Updated 6 months ago
• MingjieChen / DYGANVC
  demo page https://MingjieChen.github.io/dygan-vc
  ☆67Updated 2 years ago
• mct10 / RepCodec
  Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization
  ☆169Updated 8 months ago
• facebookresearch / facestar
  Facestar dataset. High quality audio-visual recordings of human conversational speech.
  ☆106Updated 2 years ago
• zcxu-eric / AVA-AVD
  ☆46Updated 2 years ago
• imxtx / awesome-controllabe-speech-synthesis
  This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".
  ☆127Updated 2 months ago
• 0nutation / USLM
  Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)
  ☆138Updated last year
• mct10 / CoBERT
  Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning
  ☆46Updated last year