ReneeYe / ConST
code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)
☆62Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for ConST
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated last year
- End-to-end Speech Translation with Stacked Acoustic-and-Textual Encoding☆24Updated 3 years ago
- End-to-end Speech Translation☆36Updated 3 years ago
- ☆28Updated 2 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆19Updated 3 months ago
- A PyTorch implementation of paper "Learning Shared Semantic Space for Speech-to-Text Translation", ACL (Findings) 2021☆46Updated 2 years ago
- This is an implementation of paper "End-to-end Speech Translation via Cross-modal Progressive Training" (Interspeech2021)☆19Updated 2 years ago
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Updated 2 years ago
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆45Updated 8 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- Official implementation of AAAI'2022 paper "Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement"☆18Updated 2 years ago
- Token-Level Supervised Contrastive Learning for Punctuation Restoration☆29Updated 3 years ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆26Updated last year
- Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".☆16Updated last year
- [ICASSP 2022] Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection☆25Updated last year
- End-to-End Speech Processing Toolkit☆11Updated this week
- ☆45Updated 3 years ago
- Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech und…☆43Updated last year
- ☆34Updated 2 years ago
- ASCEND Chinese-English code-switching dataset☆22Updated 2 years ago
- [ICASSP 2020] CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition (A PyTorch implementation of Continuous Integrate-and-…☆67Updated last year
- **Interspeech 2022** 《SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks》Speec…☆97Updated last year
- Systems submitted to IWSLT 2021 by the MT-UPC group.☆14Updated last year
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- [ICASSP 2022] AISHELL-NER: Named Entity Recognition from Chinese Speech☆22Updated 2 years ago
- The project for speech translation☆11Updated last year
- ☆18Updated 2 months ago
- Code repository for the Cantonese In-car Audio-Visual Speech Recognition (CI-AVSR) dataset.☆37Updated 4 months ago
- ☆20Updated 3 months ago