sanowl / LSLM-Listening-while-Speaking-Language-Model
LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances human-computer interaction through real-time spoken dialogue capabilities.
☆41Updated last month
Related projects ⓘ
Alternatives and complementary repositories for LSLM-Listening-while-Speaking-Language-Model
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆33Updated last week
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆23Updated 4 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆36Updated 5 months ago
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆90Updated 2 weeks ago
- SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer.☆62Updated last week
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆136Updated last year
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆31Updated 2 weeks ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆40Updated last week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆50Updated 2 months ago
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆65Updated 7 months ago
- This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models☆29Updated 3 weeks ago
- E2E TTS using Conditional Flow Matching (Experimental*)☆66Updated last year
- GPT-style network for phonemization with durations of text☆62Updated 7 months ago
- lina-speech : linear attention based text-to-speech☆134Updated this week
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆60Updated 2 weeks ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆38Updated last week
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- All generative model in one for better TTS model☆66Updated 2 months ago
- ☆34Updated 6 months ago
- ☆57Updated 2 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆46Updated last month
- ☆76Updated 2 months ago
- [WIP] Unofficial Implementation of Microsoft's PromptTTS2☆51Updated last year
- Inference code for Audiodec-Valle-Wenetspeech4TTS☆46Updated 3 months ago
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆28Updated 3 months ago
- ☆62Updated 9 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆119Updated 3 weeks ago
- ☆59Updated last year
- DEX-TTS: Diffusion-based EXpressive TTS with Style Modeling on Time Variability☆89Updated last week
- Unofficial Pytorch implementation of SNAC: Speaker-normalized affine coupling layer in flow-based architecture for zero-shot multi-speake…☆56Updated last year