Alternatives and similar repositories for whisper-finetuning

Users that are interested in whisper-finetuning are comparing it to the libraries listed below

• jasonppy / PromptingWhisper
  Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation
  ☆148Updated last year
• huggingface / open_asr_leaderboard
  ☆123Updated this week
• huggingface / diarizers
  ☆307Updated last year
• NeuralVox / OpenPhonemizer
  An espeak-compatible, permissively-licensed IPA phonemizer (G2P) based on DeepPhonemizer. Usable as a drop-in replacement for espeak's GP…
  ☆102Updated 10 months ago
• miguelvalente / whisperer
  Go from raw audio files to a text-audio dataset automatically with OpenAI's Whisper.
  ☆137Updated 2 years ago
• cvqluu / simple_diarizer
  Simplified diarization pipeline using some pretrained models - audio file to diarized segments in a few lines of code
  ☆150Updated last year
• mogwai / nanodrz
  Speaker Diarization with Transformers
  ☆69Updated 2 months ago
• ylacombe / finetune-hf-vits
  Finetune VITS and MMS using HuggingFace's tools
  ☆162Updated last year
• efeslab / LiteASR
  [EMNLP Main '25] LiteASR: Efficient Automatic Speech Recognition with Low-Rank Approximation
  ☆122Updated 3 months ago
• vasistalodagala / whisper-finetune
  Fine-tune and evaluate Whisper models for Automatic Speech Recognition (ASR) on custom datasets or datasets from huggingface.
  ☆331Updated 2 years ago
• PolyAI-LDN / pheme
  ☆262Updated last year
• huggingface / speechbox
  ☆359Updated last year
• knoriy / CLARA
  ☆62Updated last year
• roudimit / whisper-flamingo
  Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation
  ☆176Updated last month
• huggingface / dataspeech
  ☆377Updated 11 months ago
• roatienza / efficientspeech
  PyTorch code implementation of EfficientSpeech - to be presented at ICASSP2023.
  ☆176Updated last year
• EndlessReform / smoltts
  Open TTS models, built for streaming on the edge
  ☆43Updated 5 months ago
• apple / pytorch-speech-features
  ☆85Updated last year
• neonbjb / tts-scores
  Scripts for computing the Intelligibility and CLVP scores for evaluating TTS models
  ☆162Updated last year
• HKAB / whisper-finetune-vietnamese
  Whisper finetuned on VinBigdata-VLSP2020-100h + KenLM
  ☆38Updated last year
• Srijith-rkr / Whispering-LLaMA
  EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction
  ☆262Updated last year
• clement-pages / gryannote
  Provide Gradio custom components to make the diarization-based audio labeling process easier and faster.
  ☆67Updated last month
• Edresson / Wav2Vec-Wrapper
  An easy way to fine-tune Wav2Vec 2.0 for low-resource languages.
  ☆82Updated 2 years ago
• jumon / zac
  Zero-shot Audio Classification using Whisper
  ☆79Updated 2 years ago
• NVIDIA / RAD-MMM
  A TTS model that makes a speaker speak new languages
  ☆76Updated last year
• mtkresearch / clairaudience
  Zero-shot Domain-sensitive Speech Recognition with Prompt-conditioning Fine-tuning (ASRU2023)
  ☆27Updated last year
• revdotcom / speech-datasets
  Various speech datasets made available to the public
  ☆128Updated 8 months ago
• krylm / whisper-event-tuning
  Final training script from HuggingFace Whisper Fine tuning event - to get best results on finetuned model.
  ☆12Updated 2 years ago
• ccoreilly / wav2vec2-service
  ☆38Updated 3 years ago
• alibabasglab / MossFormer2
  This is the audio sample repository for speech separation model "MossFormer2".
  ☆141Updated 9 months ago