AGENDD / RWKV-SpeechChat
RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained weights can be applied to perform a range of audio tasks, including automatic speech recognition (ASR), speech translation, speech question answering (QA), and more.
☆27Updated 3 months ago
Alternatives and similar repositories for RWKV-SpeechChat:
Users that are interested in RWKV-SpeechChat are comparing it to the libraries listed below
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆49Updated 4 months ago
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆68Updated last month
- Official implementation of the TTS model Lina-Speech☆163Updated 3 months ago
- Audio tokenization, in the fastest way possible!☆51Updated 7 months ago
- ☆50Updated 3 weeks ago
- GPT for FACodec☆13Updated last year
- My vocoder experiments☆28Updated 6 months ago
- a Frontier Japanese Speech Generation net☆31Updated last month
- ☆24Updated 3 months ago
- ☆20Updated 6 months ago
- （WIP）long form speech generatoins☆31Updated 3 weeks ago
- Open TTS models, built for streaming on the edge☆39Updated last month
- ☆18Updated 11 months ago
- GPT-style network for phonemization with durations of text☆64Updated last year
- A low-bitrate single-codebook 16 kHz speech codec based on focal modulation☆85Updated 2 months ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆25Updated 4 months ago
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆50Updated 5 months ago
- A collection of all our phonemeizers for dataset construction and inference☆22Updated 2 months ago
- ☆40Updated 2 months ago
- ☆13Updated 7 months ago
- Just another FastSpeech 2 but cleaner code :)☆26Updated 9 months ago
- An unofficial PyTorch implementation of VALL-E☆87Updated this week
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆34Updated 2 months ago
- Text-To-Speech for NotebookLM☆29Updated 4 months ago
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆48Updated last year
- This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models☆33Updated 6 months ago
- 4G GPU & 10 Minutes for train☆12Updated last year
- ☆68Updated 7 months ago
- StyleTTS 2 Optimized Training Fork☆27Updated 2 months ago
- Unofficial Pytorch implementation of SNAC: Speaker-normalized affine coupling layer in flow-based architecture for zero-shot multi-speake…☆57Updated last year