openaudiolab / LLaSTLinks
LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models
☆25Updated 11 months ago
Alternatives and similar repositories for LLaST
Users that are interested in LLaST are comparing it to the libraries listed below
Sorting:
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆37Updated last year
- Official release of StyleTalk dataset.☆67Updated last year
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆47Updated last year
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆28Updated 2 years ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆25Updated 7 months ago
- Official implementation of MelHuBERT☆66Updated 9 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆60Updated 9 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated last year
- Collection of scripts from mHuBERT-147.☆29Updated 8 months ago
- Speaker-aware CTC (SACTC) for multi-talker overlapped speech recognition.☆20Updated 2 months ago
- ☆37Updated 3 years ago
- ☆21Updated last year
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated 2 years ago
- ☆33Updated last year
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆40Updated 11 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated 6 months ago
- A spoken version of the textual story cloze benchmark☆18Updated 2 years ago
- This repo contains the official PyTorch implementation of "Analyzing Discrete Self Supervised Speech Representation For Spoken Language M…☆19Updated 2 years ago
- multilingual speech aligner☆75Updated last year
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆50Updated 2 months ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Updated 8 months ago
- Code for InterSpeech 2024 Paper: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition☆17Updated last year
- [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels☆39Updated last year
- A Benchmark Corpus for Low-Resource Cantonese Punctuation Restoration from Speech Transcripts☆14Updated 8 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆66Updated 2 weeks ago
- Transformer-based visually grounded speech models☆19Updated 2 years ago
- ☆11Updated last year
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆96Updated 2 months ago
- Towards Comprehensive Benchmark for End-to-End Spoken Dialogue Models☆32Updated 4 months ago
- ☆19Updated 10 months ago