Alternatives and similar repositories for CMOT

Users that are interested in CMOT are comparing it to the libraries listed below

• ictnlp / STEMM
  Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".
  ☆36Updated last year
• openaudiolab / LLaST
  LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models
  ☆25Updated 11 months ago
• 0nutation / DUB
  Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)
  ☆28Updated 2 years ago
• ReneeYe / ConST
  code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)
  ☆65Updated 3 years ago
• ZihanZhaoSJTU / LibriSQA
  ☆37Updated last year
• Glaciohound / Chimera-ST
  A PyTorch implementation of paper "Learning Shared Semantic Space for Speech-to-Text Translation", ACL (Findings) 2021
  ☆48Updated 3 years ago
• ictnlp / CRESS
  Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".
  ☆17Updated last year
• dqqcasia / mosst
  ☆27Updated 2 years ago
• mct10 / CoBERT
  Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning
  ☆47Updated last year
• wsntxxn / TextToAudioGrounding
  The dataset and baseline code for Text-to-Audio Grounding (TAG)
  ☆42Updated 2 weeks ago
• ictnlp / DASpeech
  Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".
  ☆63Updated 11 months ago
• Hypotheses-Paradise / UADF
  ☆14Updated last year
• ictnlp / BT4ST
  Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".
  ☆12Updated last year
• declare-lab / speech-adapters
  Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech und…
  ☆43Updated 2 years ago
• dqqcasia / st
  End-to-end Speech Translation
  ☆35Updated 4 years ago
• formiel / fairseq
  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
  ☆19Updated 6 months ago
• ictnlp / LSG
  The code for AAAI 2025 “Large Language Models Are Read/Write Policy-Makers for Simultaneous Generation”
  ☆13Updated 6 months ago
• GATECH-EIC / S3-Router
  [NeurIPS 2022] "Losses Can Be Blessings: Routing Self-Supervised Speech Representations Towards Efficient Multilingual and Multitask Spee…
  ☆16Updated last year
• Observeai-Research / Phoneme-BERT
  ☆34Updated 4 years ago
• DanielLin94144 / StyleTalk
  Official release of StyleTalk dataset.
  ☆67Updated last year
• 0nutation / SLMTokBench
  SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"
  ☆37Updated last year
• hlt-mt / FBK-fairseq
  Repository containing the open source code of works published at the FBK MT unit.
  ☆47Updated last week
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆54Updated 3 years ago
• hqsiswiliam / punctuation-restoration-scl
  Token-Level Supervised Contrastive Learning for Punctuation Restoration
  ☆29Updated 3 years ago
• cwang621 / blsp
  BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing
  ☆52Updated last year
• ReneeYe / XSTNet
  This is an implementation of paper "End-to-end Speech Translation via Cross-modal Progressive Training" (Interspeech2021)
  ☆20Updated 3 years ago
• Jiaxin-Ye / Emo-DNA
  [ACM MM 2023] Official PyTorch implementation of "Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion Reco…
  ☆11Updated last year
• W-Wu / DEER
  ☆11Updated last year
• JeongHun0716 / e-mvsr
  Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)
  ☆16Updated 4 months ago
• YosukeHiguchi / espnet
  End-to-End Speech Processing Toolkit
  ☆15Updated 5 months ago