openaudiolab / LLaST
LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models
☆23Updated 6 months ago
Alternatives and similar repositories for LLaST:
Users that are interested in LLaST are comparing it to the libraries listed below
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆27Updated last year
- ☆34Updated 10 months ago
- ☆27Updated 7 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆47Updated 3 months ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆25Updated 2 months ago
- Temporary anonymous version☆22Updated 10 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆42Updated 4 months ago
- ☆36Updated 2 years ago
- Official release of StyleTalk dataset.☆61Updated 7 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆53Updated 3 months ago
- A spoken version of the textual story cloze benchmark☆14Updated last year
- ☆31Updated last year
- ☆41Updated 2 weeks ago
- Collection of scripts from mHuBERT-147.☆24Updated 2 months ago
- ☆18Updated 9 months ago
- An unofficial PyTorch implementation of Mix-Phoneme-Bert☆39Updated last year
- Aty-TTS: Improving fairness for spoken language understanding in atypical speech with Text-to-Speech☆10Updated last year
- ☆25Updated 2 years ago
- FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis (Accepted by ISCSLP'2024)☆22Updated 11 months ago
- Audio Generation model working with GPT-2 and VQVAE compressed representation of MelSpectrograms☆18Updated last year
- （WIP）long form speech generatoins☆30Updated 2 months ago
- ☆36Updated 4 months ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆15Updated 2 months ago
- multilingual speech aligner☆72Updated last year
- CML-TTS: A Multilingual Dataset for Speech Synthesis☆29Updated 6 months ago
- 60k hours of phoneme-aligned audio from audio books☆18Updated 6 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated 7 months ago
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆16Updated 11 months ago