Alternatives and similar repositories for whisper-finetuning

Users that are interested in whisper-finetuning are comparing it to the libraries listed below

• jasonppy / PromptingWhisper
  Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation
  ☆151Updated last year
• huggingface / diarizers
  ☆311Updated last year
• cvqluu / simple_diarizer
  Simplified diarization pipeline using some pretrained models - audio file to diarized segments in a few lines of code
  ☆151Updated last year
• huggingface / open_asr_leaderboard
  ☆148Updated this week
• ylacombe / finetune-hf-vits
  Finetune VITS and MMS using HuggingFace's tools
  ☆170Updated last year
• huggingface / speechbox
  ☆358Updated last year
• vasistalodagala / whisper-finetune
  Fine-tune and evaluate Whisper models for Automatic Speech Recognition (ASR) on custom datasets or datasets from huggingface.
  ☆347Updated 2 years ago
• ccoreilly / wav2vec2-service
  ☆39Updated 3 years ago
• mogwai / nanodrz
  Speaker Diarization with Transformers
  ☆69Updated 4 months ago
• neonbjb / tts-scores
  Scripts for computing the Intelligibility and CLVP scores for evaluating TTS models
  ☆163Updated last year
• Edresson / Wav2Vec-Wrapper
  An easy way to fine-tune Wav2Vec 2.0 for low-resource languages.
  ☆81Updated 2 years ago
• jonatasgrosman / wav2vec2-sprint
  ☆201Updated 3 years ago
• efeslab / LiteASR
  [EMNLP Main '25] LiteASR: Efficient Automatic Speech Recognition with Low-Rank Approximation
  ☆132Updated 5 months ago
• PolyAI-LDN / pheme
  ☆262Updated last year
• NeuralVox / OpenPhonemizer
  An espeak-compatible, permissively-licensed IPA phonemizer (G2P) based on DeepPhonemizer. Usable as a drop-in replacement for espeak's GP…
  ☆102Updated last year
• miguelvalente / whisperer
  Go from raw audio files to a text-audio dataset automatically with OpenAI's Whisper.
  ☆137Updated 2 years ago
• tuanh123789 / Train_Hifigan_XTTS
  This is an implementation for train hifigan part of XTTSv2 model using Coqui/TTS.
  ☆85Updated 11 months ago
• Srijith-rkr / Whispering-LLaMA
  EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction
  ☆264Updated last year
• roatienza / efficientspeech
  PyTorch code implementation of EfficientSpeech - to be presented at ICASSP2023.
  ☆177Updated last year
• huggingface / dataspeech
  ☆378Updated last year
• revdotcom / speech-datasets
  Various speech datasets made available to the public
  ☆131Updated 10 months ago
• roudimit / whisper-flamingo
  Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation
  ☆191Updated 3 months ago
• jumon / zac
  Zero-shot Audio Classification using Whisper
  ☆78Updated 2 years ago
• apple / pytorch-speech-features
  ☆85Updated last year
• NVIDIA / RAD-MMM
  A TTS model that makes a speaker speak new languages
  ☆76Updated last year
• HHousen / speaker-change-detection
  Speaker change detection using SincNet and an LSTM/Transformer
  ☆55Updated 5 months ago
• Open-Speech-EkStep / ULCA-asr-dataset-corpus
  ☆48Updated 2 years ago
• fengredrum / finetune-whisper-lora
  Fine-Tune Whisper with Transformers and PEFT
  ☆57Updated last year
• sanchit-gandhi / seq2seq-speech
  Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax.
  ☆37Updated 2 years ago
• ducanhdt / openai_whisper_finetuning
  ☆49Updated 2 years ago