sanowl / LSLM-Listening-while-Speaking-Language-Model
LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances human-computer interaction through real-time spoken dialogue capabilities.
☆62Updated last month
Alternatives and similar repositories for LSLM-Listening-while-Speaking-Language-Model:
Users that are interested in LSLM-Listening-while-Speaking-Language-Model are comparing it to the libraries listed below
- Official release of StyleTalk dataset.☆60Updated 7 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆101Updated this week
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆42Updated 7 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆60Updated 2 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆72Updated last month
- ☆12Updated 10 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆82Updated 3 weeks ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆126Updated 3 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆116Updated last week
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆63Updated 3 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆140Updated last year
- This repository contains the training, inference, evaluation code for SpeechLLM models and details about the model releases on huggingfac…☆79Updated 7 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated 6 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆43Updated 2 months ago
- ☆37Updated this week
- The open source code for LLM-Codec☆123Updated 5 months ago
- Official Code for ParrotTTS☆46Updated 3 months ago
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆39Updated last month
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆16Updated 10 months ago
- ☆33Updated 5 months ago
- Official implementation of the TTS model Lina-Speech☆150Updated 3 weeks ago
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆151Updated 2 months ago
- Codec for paper: LLaSA: Scaling Train-time and Test-time Compute for LLaMA-based Speech Synthesis☆126Updated 2 weeks ago
- GPT-style network for phonemization with durations of text☆64Updated 10 months ago
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆100Updated 2 months ago
- An espeak-compatible, permissively-licensed IPA phonemizer (G2P) based on DeepPhonemizer. Usable as a drop-in replacement for espeak's GP…☆90Updated 3 months ago
- trying to reproduce suno v3☆27Updated this week
- ☆21Updated 3 weeks ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆61Updated 2 months ago