ReneeYe / ConST
code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)
☆63Updated 2 years ago
Alternatives and similar repositories for ConST:
Users that are interested in ConST are comparing it to the libraries listed below
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated last year
- ☆28Updated 2 years ago
- End-to-end Speech Translation with Stacked Acoustic-and-Textual Encoding☆26Updated 3 years ago
- A PyTorch implementation of paper "Learning Shared Semantic Space for Speech-to-Text Translation", ACL (Findings) 2021☆47Updated 3 years ago
- End-to-end Speech Translation☆36Updated 3 years ago
- ☆33Updated 6 months ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆19Updated 2 months ago
- This is an implementation of paper "End-to-end Speech Translation via Cross-modal Progressive Training" (Interspeech2021)☆20Updated 2 years ago
- Token-Level Supervised Contrastive Learning for Punctuation Restoration☆29Updated 3 years ago
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆49Updated 11 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Updated 2 years ago
- ☆34Updated 2 years ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆27Updated last year
- Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech und…☆43Updated last year
- Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"☆18Updated 3 months ago
- ☆24Updated 4 years ago
- ☆48Updated 3 years ago
- ☆19Updated 5 months ago
- [ICASSP 2022] Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection☆25Updated last year
- Official implementation of AAAI'2022 paper "Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement"☆18Updated 3 years ago
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- End-to-End Speech Processing Toolkit☆12Updated last month
- Meta-learning model agnostic (MAML) implementation for cross-accented ASR☆44Updated last year
- **Interspeech 2022** 《SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks》Speec…☆98Updated last year
- Making Espnet easier to use☆54Updated 3 years ago
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆42Updated last month
- Code for ACL 2022 main conference paper "Modeling Dual Read/Write Paths for Simultaneous Machine Translation"☆12Updated 2 years ago
- Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".☆17Updated last year
- Systems submitted to IWSLT 2021 by the MT-UPC group.☆14Updated last year