ictnlp / CMOTLinks
Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"
☆18Updated last year
Alternatives and similar repositories for CMOT
Users that are interested in CMOT are comparing it to the libraries listed below
Sorting:
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated 2 years ago
- code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)☆64Updated 3 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆19Updated 10 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated last year
- ☆37Updated 2 years ago
- A PyTorch implementation of paper "Learning Shared Semantic Space for Speech-to-Text Translation", ACL (Findings) 2021☆48Updated 3 years ago
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆46Updated last week
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆28Updated 2 years ago
- Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".☆12Updated 2 years ago
- Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval…☆21Updated 2 years ago
- End-to-end Speech Translation☆35Updated 4 years ago
- ☆27Updated 3 years ago
- ☆41Updated last year
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Updated 3 years ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆48Updated last year
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆55Updated last year
- End-to-End Speech Processing Toolkit☆15Updated 9 months ago
- ☆12Updated 2 years ago
- This is an implementation of paper "End-to-end Speech Translation via Cross-modal Progressive Training" (Interspeech2021)☆19Updated 3 years ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆37Updated 2 years ago
- Token-Level Supervised Contrastive Learning for Punctuation Restoration☆29Updated 4 years ago
- Official implementation of AAAI'2022 paper "Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement"☆17Updated 3 years ago
- Implementation of Imputer: Sequence Modelling via Imputation and Dynamic Programming in PyTorch☆58Updated 5 years ago
- Latex template for CUHK PhD Thesis☆11Updated 4 months ago
- Official release of StyleTalk dataset.☆70Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆49Updated last year
- ☆15Updated last year
- Multilingual speech translation☆41Updated 4 years ago
- Dataset☆20Updated 3 months ago
- Transformer-based visually grounded speech models☆19Updated 3 years ago