AGENDD / RWKV-SpeechChatLinks
RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained weights can be applied to perform a range of audio tasks, including automatic speech recognition (ASR), speech translation, speech question answering (QA), and more.
☆28Updated last year
Alternatives and similar repositories for RWKV-SpeechChat
Users that are interested in RWKV-SpeechChat are comparing it to the libraries listed below
Sorting:
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆54Updated last year
- Official implementation of the TTS model Lina-Speech☆175Updated last year
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆92Updated 3 months ago
- ☆105Updated 3 months ago
- Audio tokenization, in the fastest way possible!☆53Updated last year
- Open TTS models, built for streaming on the edge☆44Updated 9 months ago
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆131Updated 5 months ago
- An unofficial PyTorch implementation of VALL-E☆88Updated 5 months ago
- ☆41Updated 11 months ago
- Official Code for ParrotTTS☆58Updated last year
- GPT-style network for phonemization with durations of text☆68Updated last year
- The YouTube Text-To-Speech dataset is comprised of waveform audio extracted from YouTube videos alongside their English transcriptions☆52Updated 4 years ago
- PyTorch implementation of Miipher-2 [2025] which is a speech restoration model by Google DeepMind☆62Updated 3 months ago
- A collection of all our phonemeizers for dataset construction and inference☆27Updated 10 months ago
- ☆58Updated last year
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆196Updated 3 months ago
- A package for NeuCodec: a 50hz, 0.8kbps, 24kHz audio codec.☆138Updated 3 months ago
- GPT for FACodec☆13Updated last year
- ☆23Updated last year
- A TTS Trained on Universal Audio.☆41Updated 7 months ago
- Code associated with the paper: CTC-DRO: Robust Optimization for Reducing Language Disparities in Speech Recognition.☆15Updated 7 months ago
- Official code for"DiaMoE-TTS: A Unified IPA-based Dialect TTS Framework with Mixture-of-Experts and Parameter-Efficient Zero-Shot Adaptat…☆210Updated last month
- Official implementation of paper: Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis☆48Updated 3 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆106Updated 7 months ago
- LongCat Audio Tokenizer and Detokenizer☆265Updated 3 weeks ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆16Updated last year
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆26Updated last year
- Text-audio foundation model from Boson AI☆116Updated 4 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆67Updated last year
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆76Updated last year