AGENDD / RWKV-ASRLinks
This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the idea of SLAM_ASR and used the RWKV language model as the LLM, and instead of directly writing a prompt template we directly finetuned the initial state of the RWKV model.
☆54Updated last year
Alternatives and similar repositories for RWKV-ASR
Users that are interested in RWKV-ASR are comparing it to the libraries listed below
Sorting:
- Official implementation of the TTS model Lina-Speech☆176Updated last year
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆94Updated 4 months ago
- RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained …☆28Updated last year
- ☆106Updated 4 months ago
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆76Updated last year
- LEMAS‑TTS is a multilingual zero‑shot text‑to‑speech system, supporting 10 languages: Chinese English Spanish Russian French German Ital…☆89Updated 3 weeks ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆110Updated 8 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆25Updated last year
- flow mirror models from JZX AI Labs☆43Updated last year
- An unofficial PyTorch implementation of VALL-E☆88Updated 6 months ago
- ☆23Updated last year
- ☆43Updated 5 months ago
- [AutoArk] GPA (General Purpose Audio) can do ASR, TTS and voice conversion with one tiny 300M model!☆84Updated last week
- An espeak-compatible, permissively-licensed IPA phonemizer (G2P) based on DeepPhonemizer. Usable as a drop-in replacement for espeak's GP…☆106Updated last year
- Official code for"DiaMoE-TTS: A Unified IPA-based Dialect TTS Framework with Mixture-of-Experts and Parameter-Efficient Zero-Shot Adaptat…☆225Updated 2 months ago
- CTC decoder with hotwords for ASR.☆34Updated 9 months ago
- Just another FastSpeech 2 but cleaner code :)☆29Updated last year
- (WIP)long form speech generatoins☆31Updated 10 months ago
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆132Updated 4 months ago
- Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"☆147Updated 8 months ago
- Official Code for ParrotTTS☆58Updated last year
- ☆23Updated last year
- poorman's ar-dit tts☆45Updated last month
- All generative model in one for better TTS model☆74Updated last year
- ☆97Updated 3 months ago
- ☆19Updated last year
- Causal streaming adaptation of OpenAI Whisper for real-time transcription on small audio chunks.☆62Updated 4 months ago
- ☆54Updated this week
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆189Updated 2 months ago
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆197Updated 2 weeks ago