kehanlu / DeSTA2
Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"
☆50Updated last month
Alternatives and similar repositories for DeSTA2:
Users that are interested in DeSTA2 are comparing it to the libraries listed below
- **Interspeech 2022** 《SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks》Speec…☆98Updated last year
- Official release of StyleTalk dataset.☆61Updated 7 months ago
- The open source code for LLM-Codec☆126Updated 6 months ago
- An automatic prosodic boundary annotation tool for Text-to-Speech Synthesis (TTS).☆48Updated 8 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- ☆43Updated 3 weeks ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆49Updated last year
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆78Updated 2 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆50Updated 4 months ago
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆85Updated 3 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆124Updated this week
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆168Updated 7 months ago
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated last year
- UTokyo-SaruLab MOS Prediction System☆147Updated 2 months ago
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆42Updated 4 months ago
- This is a list of speech tasks and datasets, which can provide training data for Generative AI, AIGC, AI model training, intelligent spee…☆75Updated 8 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆128Updated 4 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Official implementation of MelHuBERT☆64Updated 3 months ago
- This Repository surveys the paper focusing on Prompting and Adapters for Speech Processing.☆107Updated last year
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆16Updated 11 months ago
- The open source code for SimpleSpeech series☆127Updated 4 months ago
- ☆22Updated 4 years ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆119Updated last month
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆73Updated 4 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆42Updated 8 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆47Updated 3 months ago
- ☆12Updated 11 months ago
- ConMamba for Automatic Speech Recognition☆57Updated 6 months ago