AGENDD / RWKV-ASRLinks
This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the idea of SLAM_ASR and used the RWKV language model as the LLM, and instead of directly writing a prompt template we directly finetuned the initial state of the RWKV model.
☆52Updated 6 months ago
Alternatives and similar repositories for RWKV-ASR
Users that are interested in RWKV-ASR are comparing it to the libraries listed below
Sorting:
- Official implementation of the TTS model Lina-Speech☆166Updated 6 months ago
- RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained …☆27Updated 6 months ago
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆78Updated last week
- Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"☆100Updated last month
- Official Code for ParrotTTS☆52Updated 9 months ago
- flow mirror models from JZX AI Labs☆44Updated 9 months ago
- An unofficial PyTorch implementation of VALL-E☆87Updated last month
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆92Updated last month
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆70Updated 3 weeks ago
- An espeak-compatible, permissively-licensed IPA phonemizer (G2P) based on DeepPhonemizer. Usable as a drop-in replacement for espeak's GP…☆100Updated 9 months ago
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆72Updated 8 months ago
- Implementation of Google's USM speech model in Pytorch☆31Updated 3 months ago
- Audio tokenization, in the fastest way possible!☆52Updated 10 months ago
- ☆28Updated 5 months ago
- Llasa Speed Up☆35Updated last month
- Official release of StyleTalk dataset.☆67Updated last year
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆55Updated 8 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated last year
- （WIP）long form speech generatoins☆31Updated 3 months ago
- ☆26Updated last week
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆120Updated last week
- Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆50Updated this week
- ☆57Updated last year
- A native-PyTorch library for large scale M-LLM (text/audio) training with tp/cp/dp/pp.☆100Updated last week
- Inference code for Audiodec-Valle-Wenetspeech4TTS☆50Updated last year
- ☆38Updated last month
- An LLM base TTS engine☆81Updated 6 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆59Updated 8 months ago
- Open TTS models, built for streaming on the edge☆43Updated 4 months ago
- ☆50Updated 3 months ago