AGENDD / RWKV-SpeechChatLinks
RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained weights can be applied to perform a range of audio tasks, including automatic speech recognition (ASR), speech translation, speech question answering (QA), and more.
☆28Updated 11 months ago
Alternatives and similar repositories for RWKV-SpeechChat
Users that are interested in RWKV-SpeechChat are comparing it to the libraries listed below
Sorting:
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆54Updated 11 months ago
- Official implementation of the TTS model Lina-Speech☆175Updated 11 months ago
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆91Updated 2 months ago
- ☆102Updated 2 months ago
- Audio tokenization, in the fastest way possible!☆53Updated last year
- Official code for"DiaMoE-TTS: A Unified IPA-based Dialect TTS Framework with Mixture-of-Experts and Parameter-Efficient Zero-Shot Adaptat…☆200Updated 2 weeks ago
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆129Updated 4 months ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆16Updated last year
- StyleTTS 2 Optimized Training Fork☆34Updated 10 months ago
- Googleの音声復元モデルMiipher-2の再現実装の学習および推論コード。学習済みモデルも公開しています。☆30Updated 4 months ago
- ☆58Updated last year
- Open TTS models, built for streaming on the edge☆44Updated 9 months ago
- A collection of all our phonemeizers for dataset construction and inference☆27Updated 9 months ago
- Official Code for ParrotTTS☆58Updated last year
- This is a fork of the original fairseq repository (version 0.12.2) with added classes for training mHuBERT-147.☆19Updated last year
- Official implementation of paper: Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis☆47Updated 2 months ago
- LongCat Audio Tokenizer and Detokenizer☆261Updated 2 weeks ago
- ☆41Updated 5 months ago
- ☆23Updated last year
- ☆48Updated 5 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆106Updated 6 months ago
- An unofficial PyTorch implementation of VALL-E☆88Updated 4 months ago
- Code associated with the paper: CTC-DRO: Robust Optimization for Reducing Language Disparities in Speech Recognition.☆15Updated 7 months ago
- Code for the blog "Neural audio codecs: how to get audio into LLMs"☆138Updated last month
- PyTorch implementation of Miipher-2 [2025] which is a speech restoration model by Google DeepMind☆61Updated 2 months ago
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆77Updated last year
- Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"☆138Updated 6 months ago
- ☆26Updated last year
- My vocoder experiments☆31Updated 4 months ago
- A TTS Trained on Universal Audio.☆41Updated 6 months ago