openaudiolab / LLaST
LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models
☆25Updated 7 months ago
Alternatives and similar repositories for LLaST:
Users that are interested in LLaST are comparing it to the libraries listed below
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Official release of StyleTalk dataset.☆62Updated 8 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- ☆36Updated 2 years ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆28Updated last year
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆50Updated 2 weeks ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆25Updated 3 months ago
- ☆28Updated 8 months ago
- Collection of scripts from mHuBERT-147.☆24Updated 4 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated 8 months ago
- ☆18Updated 10 months ago
- ☆31Updated last year
- An unofficial PyTorch implementation of Mix-Phoneme-Bert☆39Updated last year
- Code for InterSpeech 2024 Paper: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition☆16Updated 8 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆52Updated this week
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆51Updated 4 months ago
- A spoken version of the textual story cloze benchmark☆15Updated last year
- multilingual speech aligner☆72Updated last year
- Multi-Task Speech classification of accent and gender of an english speaker on Mozilla's common voice dataset☆26Updated 6 months ago
- Streaming Vocos☆21Updated 2 months ago
- ☆25Updated 2 years ago
- Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".☆13Updated last year
- Prosodic Speech Segmentation with Transformers☆25Updated last year
- ☆35Updated 11 months ago
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆53Updated 4 months ago
- (WIP)long form speech generatoins☆30Updated 3 months ago
- PyTorch Implementation of ViT-TTS (EMNLP'23)☆10Updated last year
- [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels☆34Updated last year
- ☆36Updated 6 months ago