kehanlu / DeSTA2Links
Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"
☆113Updated 2 months ago
Alternatives and similar repositories for DeSTA2
Users that are interested in DeSTA2 are comparing it to the libraries listed below
Sorting:
- Code for DeSTA2.5-Audio☆115Updated 2 months ago
- The official repository of Dynamic-SUPERB.☆191Updated 3 months ago
- A Benchmark for Evaluating Turn-Taking and Overlap Handling in Full-Duplex Spoken Dialogue Models☆84Updated 2 weeks ago
- This Repository surveys the paper focusing on Prompting and Adapters for Speech Processing.☆112Updated 2 years ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆166Updated this week
- Layer-wise analysis of self-supervised pre-trained speech representations☆117Updated 11 months ago
- **Interspeech 2022** 《SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks》Speec…☆102Updated 6 months ago
- The open source code for LLM-Codec☆140Updated last year
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆139Updated 6 months ago
- A Massive Contextual Speech Recognition Benchmark.☆90Updated 2 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆149Updated 2 years ago
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆73Updated 5 months ago
- Audio-FLAN☆158Updated 2 weeks ago
- Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.☆210Updated last year
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆187Updated last year
- EMO-SUPERB submission☆46Updated last year
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆167Updated 5 months ago
- wav2vec2 audio classification for prosodic boundary detection and other tasks☆42Updated 2 years ago
- ☆43Updated 2 years ago
- An evolving, large-scale and multi-domain ASR corpus for low-resource languages with automated crawling, transcription and refinement☆173Updated last month
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆82Updated last year
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆95Updated 10 months ago
- A method that directly addresses the modality gap by aligning speech token with the corresponding text transcription during the tokenizat…☆92Updated last month
- This is a list of speech tasks and datasets, which can provide training data for Generative AI, AIGC, AI model training, intelligent spee…☆80Updated last year
- Audio Codec Speech processing Universal PERformance Benchmark☆273Updated 3 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆51Updated last year
- [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation☆31Updated last year
- Implementation of the paper "Self-supervised Learning with Random-projection Quantizer for Speech Recognition" in Pytorch.☆87Updated 2 years ago
- The TTSDS benchmark evaluates synthetic speech quality by considering prosody, speaker identity, and intelligibility, comparing these fac…☆64Updated last week
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆45Updated 6 months ago