AGENDD / RWKV-SpeechChatLinks
RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained weights can be applied to perform a range of audio tasks, including automatic speech recognition (ASR), speech translation, speech question answering (QA), and more.
☆27Updated 5 months ago
Alternatives and similar repositories for RWKV-SpeechChat
Users that are interested in RWKV-SpeechChat are comparing it to the libraries listed below
Sorting:
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆51Updated 6 months ago
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆76Updated this week
- Llasa Speed Up☆35Updated 3 weeks ago
- Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"☆82Updated 2 weeks ago
- A collection of all our phonemeizers for dataset construction and inference☆23Updated 4 months ago
- ☆24Updated 5 months ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆14Updated 9 months ago
- A TTS Trained on Universal Audio.☆33Updated 2 weeks ago
- (WIP)long form speech generatoins☆31Updated 2 months ago
- ☆50Updated 2 months ago
- My vocoder experiments☆29Updated 8 months ago
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆35Updated 4 months ago
- ☆18Updated last year
- Code associated with the paper: CTC-DRO: Robust Optimization for Reducing Language Disparities in Speech Recognition.☆15Updated last month
- StyleTTS 2 Optimized Training Fork☆31Updated 4 months ago
- DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factors☆26Updated 4 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆92Updated last month
- ☆40Updated 4 months ago
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆48Updated last year
- GPT for FACodec☆13Updated last year
- This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models☆34Updated 8 months ago
- ☆25Updated last year
- Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆44Updated 2 weeks ago
- Text-To-Speech for NotebookLM☆32Updated 6 months ago
- Official implementation of the TTS model Lina-Speech☆165Updated 5 months ago
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆84Updated last month
- ☆13Updated 9 months ago
- ☆21Updated 8 months ago
- ☆74Updated 2 weeks ago
- Official repository of the IEEE SLT 2024 paper "Self-Supervised Syllable Discovery Based on Speaker-Disentangled HuBERT"☆38Updated this week