ictnlp / CMOTLinks
Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"
☆18Updated last year
Alternatives and similar repositories for CMOT
Users that are interested in CMOT are comparing it to the libraries listed below
Sorting:
- code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)☆64Updated 3 years ago
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated 2 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆19Updated 11 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated last year
- End-to-end Speech Translation☆35Updated 4 years ago
- ☆37Updated 2 years ago
- A PyTorch implementation of paper "Learning Shared Semantic Space for Speech-to-Text Translation", ACL (Findings) 2021☆48Updated 3 years ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆28Updated 2 years ago
- ☆27Updated 3 years ago
- Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".☆12Updated 2 years ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆48Updated 2 years ago
- ☆15Updated last year
- Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval…☆21Updated 2 years ago
- Official implementation of AAAI'2022 paper "Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement"☆17Updated 3 years ago
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Updated 3 years ago
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆46Updated 3 weeks ago
- Latex template for CUHK PhD Thesis☆11Updated 4 months ago
- End-to-End Speech Processing Toolkit☆15Updated 10 months ago
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆56Updated last year
- ☆24Updated 5 years ago
- ☆41Updated last year
- Multilingual speech translation☆41Updated 4 years ago
- Code for NeurIPS 2022 Spotlight paper " Non-Monotonic Latent Alignments for CTC-Based Non-Autoregressive Machine Translation"☆20Updated 3 years ago
- Token-Level Supervised Contrastive Learning for Punctuation Restoration☆29Updated 4 years ago
- This is an implementation of paper "End-to-end Speech Translation via Cross-modal Progressive Training" (Interspeech2021)☆19Updated 3 years ago
- Implementation of Imputer: Sequence Modelling via Imputation and Dynamic Programming in PyTorch☆58Updated 5 years ago
- Code for EMNLP 2022 main conference paper "Low-resource Neural Machine Translation with Cross-modal Alignment".☆14Updated 2 years ago
- Official release of StyleTalk dataset.☆70Updated last year
- ☆34Updated 4 years ago
- Revisiting End-to-End Speech-to-Text Translation From Scratch☆13Updated 2 years ago