AGENDD / RWKV-SpeechChat
RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained weights can be applied to perform a range of audio tasks, including automatic speech recognition (ASR), speech translation, speech question answering (QA), and more.
☆27Updated 4 months ago
Alternatives and similar repositories for RWKV-SpeechChat
Users that are interested in RWKV-SpeechChat are comparing it to the libraries listed below
Sorting:
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆50Updated 4 months ago
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆74Updated last week
- Official implementation of the TTS model Lina-Speech☆165Updated 4 months ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆25Updated 5 months ago
- Open TTS models, built for streaming on the edge☆41Updated 2 months ago
- A large-scale RWKV v6, v7(World, ARWKV, PRWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy o…☆35Updated 2 weeks ago
- ☆18Updated last year
- E2E TTS using Conditional Flow Matching (Experimental*)☆69Updated last year
- ☆40Updated 3 months ago
- GPT for FACodec☆13Updated last year
- （WIP）long form speech generatoins☆31Updated last month
- TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching☆56Updated 3 weeks ago
- Official repository of the IEEE SLT 2024 paper "Self-Supervised Syllable Discovery Based on Speaker-Disentangled HuBERT"☆38Updated last month
- My vocoder experiments☆29Updated 7 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆58Updated 3 weeks ago
- This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models☆33Updated 7 months ago
- 4G GPU & 10 Minutes for train☆12Updated last year
- ☆20Updated 7 months ago
- Audio tokenization, in the fastest way possible!☆52Updated 8 months ago
- ☆50Updated last month
- ☆13Updated 8 months ago
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆48Updated last year
- Official repository of Wavehax vocoder☆46Updated 5 months ago
- Self-supervised Generative LM-based Voice Conversion☆36Updated 3 weeks ago
- Text-To-Speech for NotebookLM☆29Updated 4 months ago
- Inference code for Audiodec-Valle-Wenetspeech4TTS☆49Updated 10 months ago
- ☆25Updated last year
- ☆68Updated 8 months ago
- ☆13Updated last year
- PyTorch Implementation of ViT-TTS (EMNLP'23)☆10Updated last year