openaudiolab / LLaST
LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models
☆25Updated 8 months ago
Alternatives and similar repositories for LLaST:
Users that are interested in LLaST are comparing it to the libraries listed below
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆35Updated last year
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆54Updated last week
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated 10 months ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆25Updated 4 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- multilingual speech aligner☆74Updated last year
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆29Updated last year
- Speaker-aware CTC (SACTC) for multi-talker overlapped speech recognition.☆16Updated last month
- ☆36Updated 2 years ago
- Prosodic Speech Segmentation with Transformers☆25Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆58Updated 6 months ago
- Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".☆13Updated last year
- Temporary anonymous version☆22Updated last year
- Official Code for SyllableLM: Learning Coarse Semantic Units for Speech Language Models☆52Updated last week
- An unofficial PyTorch implementation of Mix-Phoneme-Bert☆39Updated last year
- Collection of scripts from mHuBERT-147.☆24Updated 5 months ago
- Official release of StyleTalk dataset.☆62Updated 10 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆52Updated 6 months ago
- ☆30Updated 10 months ago
- The project for speech translation☆11Updated last year
- ☆18Updated last year
- Aty-TTS: Improving fairness for spoken language understanding in atypical speech with Text-to-Speech☆10Updated last year
- ☆38Updated 7 months ago
- [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels☆35Updated last year
- SpeechGLUE is a speech version of the GLUE benchmark, driven by text-to-speech.☆13Updated last year
- A spoken version of the textual story cloze benchmark☆16Updated last year
- ☆18Updated 7 months ago
- FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis (Accepted by ISCSLP'2024)☆24Updated last year
- (WIP)long form speech generatoins☆31Updated last month
- ☆31Updated last year