Alternatives and similar repositories for whisper-finetuning

Users that are interested in whisper-finetuning are comparing it to the libraries listed below

• ylacombe / finetune-hf-vits
  Finetune VITS and MMS using HuggingFace's tools
  ☆163Updated last year
• jasonppy / PromptingWhisper
  Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation
  ☆150Updated last year
• huggingface / diarizers
  ☆308Updated last year
• huggingface / speechbox
  ☆359Updated last year
• cvqluu / simple_diarizer
  Simplified diarization pipeline using some pretrained models - audio file to diarized segments in a few lines of code
  ☆148Updated last year
• mogwai / nanodrz
  Speaker Diarization with Transformers
  ☆69Updated 3 months ago
• huggingface / open_asr_leaderboard
  ☆127Updated 3 weeks ago
• huggingface / dataspeech
  ☆377Updated last year
• vasistalodagala / whisper-finetune
  Fine-tune and evaluate Whisper models for Automatic Speech Recognition (ASR) on custom datasets or datasets from huggingface.
  ☆338Updated 2 years ago
• miguelvalente / whisperer
  Go from raw audio files to a text-audio dataset automatically with OpenAI's Whisper.
  ☆137Updated 2 years ago
• ccoreilly / wav2vec2-service
  ☆38Updated 3 years ago
• Srijith-rkr / Whispering-LLaMA
  EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction
  ☆263Updated last year
• NeuralVox / OpenPhonemizer
  An espeak-compatible, permissively-licensed IPA phonemizer (G2P) based on DeepPhonemizer. Usable as a drop-in replacement for espeak's GP…
  ☆103Updated 11 months ago
• PolyAI-LDN / pheme
  ☆262Updated last year
• efeslab / LiteASR
  [EMNLP Main '25] LiteASR: Efficient Automatic Speech Recognition with Low-Rank Approximation
  ☆127Updated 4 months ago
• HKAB / whisper-finetune-vietnamese
  Whisper finetuned on VinBigdata-VLSP2020-100h + KenLM
  ☆38Updated last year
• roatienza / efficientspeech
  PyTorch code implementation of EfficientSpeech - to be presented at ICASSP2023.
  ☆178Updated last year
• neonbjb / tts-scores
  Scripts for computing the Intelligibility and CLVP scores for evaluating TTS models
  ☆163Updated last year
• Open-Speech-EkStep / ULCA-asr-dataset-corpus
  ☆47Updated 2 years ago
• FrenchKrab / IS2023-powerset-diarization
  Official repository for the "Powerset multi-class cross entropy loss for neural speaker diarization" paper published in Interspeech 2023.
  ☆86Updated last year
• revdotcom / speech-datasets
  Various speech datasets made available to the public
  ☆131Updated 9 months ago
• sanchit-gandhi / whisper-flash-attention
  ☆19Updated 2 years ago
• clement-pages / gryannote
  Provide Gradio custom components to make the diarization-based audio labeling process easier and faster.
  ☆68Updated last week
• roudimit / whisper-flamingo
  Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation
  ☆181Updated last month
• ducanhdt / openai_whisper_finetuning
  ☆49Updated 2 years ago
• jumon / zac
  Zero-shot Audio Classification using Whisper
  ☆79Updated 2 years ago
• Vaibhavs10 / fast-whisper-finetuning
  ☆539Updated last year
• HHousen / speaker-change-detection
  Speaker change detection using SincNet and an LSTM/Transformer
  ☆53Updated 3 months ago
• tuanh123789 / Train_Hifigan_XTTS
  This is an implementation for train hifigan part of XTTSv2 model using Coqui/TTS.
  ☆84Updated 10 months ago
• EndlessReform / smoltts
  Open TTS models, built for streaming on the edge
  ☆42Updated 6 months ago