Haoqiu-Yan / PerceptiveAgent
Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))
☆33Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for PerceptiveAgent
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆39Updated 5 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆37Updated 3 weeks ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆53Updated last month
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆57Updated 3 weeks ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆83Updated last month
- ☆34Updated 7 months ago
- The open source code for LLM-Codec☆114Updated 3 months ago
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆71Updated 7 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆32Updated last month
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆43Updated 2 weeks ago
- ☆21Updated last month
- All generative model in one for better TTS model☆66Updated 2 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 4 months ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆26Updated last year
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆37Updated last year
- Project page for "Improving Few-shot Learning for Talking Face System with TTS Data Augmentation" for ICASSP2023☆83Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆42Updated 3 weeks ago
- ☆48Updated last year
- The project page repo for Neural Dubber.☆29Updated last year
- ☆83Updated 2 months ago
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆51Updated 5 months ago
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆58Updated 7 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆23Updated 4 months ago
- FlashSpeech: Efficient Zero-Shot Speech Synthesis☆97Updated 2 months ago
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS 2024)☆13Updated 2 weeks ago
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆60Updated last month
- The official implementation of EmoSphere++☆41Updated 2 weeks ago
- Implementation of DCComix TTS: An End-to-End Expressive TTS with Discrete Code Collaborated with Mixer☆76Updated last year