ictnlp / CRESS
Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".
☆17Updated last year
Alternatives and similar repositories for CRESS:
Users that are interested in CRESS are comparing it to the libraries listed below
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆49Updated 10 months ago
- ☆28Updated 2 years ago
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated last year
- Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"☆18Updated 3 months ago
- The project for speech translation☆11Updated last year
- Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".☆13Updated last year
- [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels☆32Updated 10 months ago
- code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)☆63Updated 2 years ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆27Updated last year
- Source code for our EMNLP 2022 paper "Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Transla…☆7Updated 2 years ago
- End-to-End Speech Processing Toolkit☆11Updated last week
- [ICASSP 2022] Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection☆25Updated last year
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆63Updated 3 months ago
- End-to-end Speech Translation with Stacked Acoustic-and-Textual Encoding☆25Updated 3 years ago
- End-to-end Speech Translation☆36Updated 3 years ago
- ☆34Updated 2 years ago
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Updated 2 years ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆23Updated 5 months ago
- [INTERSPEECH 2023] Knowledge Transfer from Pre-trained Language Models to Cif-based Recognizers via Hierarchical Distillation☆37Updated last year
- Optimized loss based on cross-entropy (CE), like MWER (minimum WER) Loss with beam search and negative sampling strategy, Smoothed Max Po…☆20Updated 3 months ago
- llama-omni训练代码复现☆41Updated last week
- DST is a Decoder-only simultaneous machine translation model, which can conduct policy decision and translation concurrently☆7Updated 7 months ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆19Updated last month
- [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation☆27Updated 4 months ago
- open-source Mandarian biased word dataset☆11Updated last year
- ☆15Updated 6 months ago
- [ICASSP 2020] CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition (A PyTorch implementation of Continuous Integrate-and-…☆68Updated 3 weeks ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- ☆12Updated 8 months ago
- Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech und…☆43Updated last year