cwang621 / blsp
BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing
☆51Updated last year
Alternatives and similar repositories for blsp:
Users that are interested in blsp are comparing it to the libraries listed below
- [INTERSPEECH 2023] Knowledge Transfer from Pre-trained Language Models to Cif-based Recognizers via Hierarchical Distillation☆38Updated last year
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆89Updated 4 months ago
- A repository used to organize content related to Large Speech(Audio) Model, including paper, data, applications, tools and so on.☆16Updated 3 months ago
- The open source code for LLM-Codec☆132Updated 8 months ago
- [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels☆35Updated last year
- ☆28Updated 2 years ago
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- [ICASSP 2022] Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection☆25Updated last year
- ☆22Updated 6 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆49Updated 9 months ago
- ☆58Updated 3 weeks ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆43Updated 10 months ago
- Official release of StyleTalk dataset.☆62Updated 9 months ago
- [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation☆29Updated 7 months ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆29Updated last year
- ☆38Updated 8 months ago
- End-to-end Speech Translation with Stacked Acoustic-and-Textual Encoding☆26Updated 3 years ago
- code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)☆64Updated 2 years ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆57Updated 5 months ago
- End-to-end Speech Translation☆36Updated 4 years ago
- Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech und…☆43Updated 2 years ago
- Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".☆17Updated last year
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated 8 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆174Updated 9 months ago
- Audio-FLAN☆142Updated last month
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆42Updated 3 months ago
- **Interspeech 2022** 《SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks》Speec…☆99Updated last week
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆34Updated last year
- [ICASSP 2020] CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition (A PyTorch implementation of Continuous Integrate-and-…☆70Updated 3 months ago