Alternatives and similar repositories for CMOT:

Users that are interested in CMOT are comparing it to the libraries listed below

• ictnlp / STEMM
  Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".
  ☆36Updated last year
• ReneeYe / ConST
  code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)
  ☆63Updated 2 years ago
• ictnlp / BT4ST
  Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".
  ☆13Updated last year
• ictnlp / CRESS
  Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".
  ☆17Updated last year
• dqqcasia / mosst
  ☆28Updated 2 years ago
• openaudiolab / LLaST
  LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models
  ☆23Updated 5 months ago
• dqqcasia / st
  End-to-end Speech Translation
  ☆36Updated 3 years ago
• ReneeYe / XSTNet
  This is an implementation of paper "End-to-end Speech Translation via Cross-modal Progressive Training" (Interspeech2021)
  ☆20Updated 2 years ago
• formiel / fairseq
  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
  ☆19Updated last month
• Glaciohound / Chimera-ST
  A PyTorch implementation of paper "Learning Shared Semantic Space for Speech-to-Text Translation", ACL (Findings) 2021
  ☆47Updated 2 years ago
• 0nutation / DUB
  Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)
  ☆27Updated last year
• mct10 / CoBERT
  Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning
  ☆46Updated last year
• ictnlp / LNMT-CA
  Code for EMNLP 2022 main conference paper "Low-resource Neural Machine Translation with Cross-modal Alignment".
  ☆14Updated last year
• ictnlp / GMA
  Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"
  ☆11Updated 2 years ago
• YosukeHiguchi / espnet
  End-to-End Speech Processing Toolkit
  ☆11Updated last week
• wsntxxn / TextToAudioGrounding
  The dataset and baseline code for Text-to-Audio Grounding (TAG)
  ☆41Updated 2 weeks ago
• nethermanpro / ComSL
  ☆11Updated last year
• Hypotheses-Paradise / UADF
  ☆12Updated 8 months ago
• xuchennlp / S2T
  The project for speech translation
  ☆11Updated last year
• ictnlp / PCFG-NAT
  Code for NeurIPS 2023 paper "Non-autoregressive Machine Translation with Probabilistic Context-free Grammar".
  ☆11Updated last year
• 0nutation / SLMTokBench
  SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"
  ☆33Updated last year
• duyichao / E2E-ST-TDA
  Official implementation of AAAI'2022 paper "Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement"
  ☆18Updated 3 years ago
• cwang621 / blsp
  BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing
  ☆49Updated 10 months ago
• thunlp / duplex-model
  ☆33Updated 5 months ago
• Sakshi113 / MMAU
  ☆37Updated this week
• NKU-HLT / KNN-CTC
  [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels
  ☆32Updated 10 months ago
• declare-lab / speech-adapters
  Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech und…
  ☆43Updated last year
• blmoistawinde / fense
  Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval…
  ☆20Updated last year
• xuchenneu / SATE
  End-to-end Speech Translation with Stacked Acoustic-and-Textual Encoding
  ☆25Updated 3 years ago
• YuanGongND / llm_speech_emotion_challenge
  ☆22Updated 7 months ago