AGENDD / RWKV-SpeechChatLinks
RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained weights can be applied to perform a range of audio tasks, including automatic speech recognition (ASR), speech translation, speech question answering (QA), and more.
☆27Updated 9 months ago
Alternatives and similar repositories for RWKV-SpeechChat
Users that are interested in RWKV-SpeechChat are comparing it to the libraries listed below
Sorting:
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆50Updated 9 months ago
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆87Updated last week
- LongCat Audio Tokenizer and Detokenizer☆112Updated this week
- Official implementation of the TTS model Lina-Speech☆170Updated 9 months ago
- ☆100Updated 2 weeks ago
- PyTorch implementation of Miipher-2 [2025] which is a speech restoration model by Google DeepMind☆52Updated 3 weeks ago
- Code associated with the paper: CTC-DRO: Robust Optimization for Reducing Language Disparities in Speech Recognition.☆15Updated 5 months ago
- Official implementation of paper: Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis☆43Updated last month
- Audio tokenization, in the fastest way possible!☆53Updated last year
- ☆39Updated 3 months ago
- ☆27Updated last month
- ☆50Updated 6 months ago
- Open TTS models, built for streaming on the edge☆43Updated 7 months ago
- ☆43Updated 3 months ago
- DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factors☆33Updated 8 months ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆16Updated last year
- ☆26Updated last year
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆127Updated 2 months ago
- Official Code for ParrotTTS☆56Updated last year
- Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"☆118Updated 4 months ago
- GPT-style network for phonemization with durations of text☆67Updated last year
- A collection of all our phonemeizers for dataset construction and inference☆26Updated 7 months ago
- ☆41Updated 8 months ago
- ☆23Updated last year
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆164Updated last week
- Official code for"DiaMoE-TTS: A Unified IPA-based Dialect TTS Framework with Mixture-of-Experts and Parameter-Efficient Zero-Shot Adaptat…☆50Updated this week
- My vocoder experiments☆31Updated 2 months ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆26Updated 10 months ago
- Training code and dataset cleasing with Sidon☆36Updated last week
- ☆43Updated last year