kehanlu / DeSTA2Links
Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"
☆94Updated 4 months ago
Alternatives and similar repositories for DeSTA2
Users that are interested in DeSTA2 are comparing it to the libraries listed below
Sorting:
- The official repository of Dynamic-SUPERB.☆183Updated this week
- A method that directly addresses the modality gap by aligning speech token with the corresponding text transcription during the tokenizat…☆80Updated this week
- This Repository surveys the paper focusing on Prompting and Adapters for Speech Processing.☆110Updated last year
- **Interspeech 2022** 《SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks》Speec…☆100Updated 2 months ago
- Collection of works for evaluating (and analyzing) large audio-language models (LALMs)☆28Updated last week
- Official release of StyleTalk dataset.☆67Updated 11 months ago
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆77Updated last month
- Audio-FLAN☆157Updated 3 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆146Updated last week
- Pre-trained Wav2vec2.0 for Mandarin☆40Updated 2 years ago
- A benchmark to evaluate full-duplex spoken dialogue models on pause handling, backchanneling, turn-taking, and user interruptions.☆42Updated 2 weeks ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆50Updated last year
- ☆84Updated 3 weeks ago
- Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆139Updated 3 weeks ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆179Updated 11 months ago
- The open source code for LLM-Codec☆135Updated 10 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆82Updated 7 months ago
- An evolving, large-scale and multi-domain ASR corpus for low-resource languages with automated crawling, transcription and refinement☆159Updated last month
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆125Updated 3 months ago
- An automatic prosodic boundary annotation tool for Text-to-Speech Synthesis (TTS).☆48Updated last year
- Zero-shot Domain-sensitive Speech Recognition with Prompt-conditioning Fine-tuning (ASRU2023)☆27Updated last year
- ☆31Updated 3 months ago
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆40Updated last month
- ☆71Updated last year
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆154Updated 2 months ago
- ☆80Updated last month
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆73Updated 2 years ago
- Github repository for ACL 2025 paper: Recent Advances in Speech Language Models: A Survey.☆49Updated last week
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆145Updated last year
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆55Updated 2 months ago