Alternatives and similar repositories for MPD_EMVI

Users that are interested in MPD_EMVI are comparing it to the libraries listed below

• OmniMMI / OpenOmniNexus
  a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.
  ☆14Updated last month
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• blmoistawinde / fense
  Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval…
  ☆21Updated 2 years ago
• duyichao / E2E-ST-TDA
  Official implementation of AAAI'2022 paper "Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement"
  ☆18Updated 3 years ago
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆34Updated last month
• wsntxxn / TextToAudioGrounding
  The dataset and baseline code for Text-to-Audio Grounding (TAG)
  ☆42Updated 4 months ago
• ictnlp / STEMM
  Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".
  ☆36Updated last year
• ictnlp / GMA
  Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"
  ☆11Updated 3 years ago
• ictnlp / LNMT-CA
  Code for EMNLP 2022 main conference paper "Low-resource Neural Machine Translation with Cross-modal Alignment".
  ☆14Updated 2 years ago
• Aman-4-Real / See-or-Guess
  [ACM MM 2024] See or Guess: Counterfactually Regularized Image Captioning
  ☆14Updated 3 months ago
• SpeechEE / SpeechEE
  ☆11Updated 2 months ago
• Ceaglex / LoVA
  The code and weight for LoVA. LoVA is a novel model for Long-form Video-to-Audio generation. Based on the Diffusion Transformer (DiT) arc…
  ☆13Updated 2 months ago
• kkk-an / COFFTEA
  Code for Findings of EMNLP2023 paper "Coarse-to-Fine Dual Encoders are Better Frame Identification Learners"
  ☆12Updated last year
• BriansIDP / AudioVisualLLM
  ☆18Updated 11 months ago
• ReneeYe / ConST
  code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)
  ☆64Updated 2 years ago
• duyichao / MINETrans-IWSLT23
  Official implementation of our IWSLT 2023 paper "The MineTrans Systems for IWSLT 2023 Offline Speech Translation and Speech-to-Speech Tra…
  ☆15Updated last year
• Aman-4-Real / MMTG
  [ACM MM 2022]: Multi-Modal Experience Inspired AI Creation
  ☆20Updated 5 months ago
• yuezih / Movie101
  Narrative movie understanding benchmark
  ☆70Updated last year
• MC-EIU / MC-EIU
  ☆21Updated 2 weeks ago
• RainBowLuoCS / OpenOmni
  OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…
  ☆49Updated this week
• albertwy / GPT-4V-Evaluation
  Data for evaluating GPT-4V
  ☆11Updated last year
• nlpapereading / nlpapereading
  ☆59Updated 2 years ago
• thunlp / duplex-model
  ☆38Updated 9 months ago
• ictnlp / PLUVR
  Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".
  ☆21Updated last year
• pygongnlp / PT-M2
  [EMNLP 2022] Revisiting Grammatical Error Correction Evaluation and Beyond
  ☆19Updated 2 years ago
• xinghaow99 / DenoSent
  [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning
  ☆16Updated last year
• andreamad8 / ToDCL
  Continual Learning for Task-Oriented Dialogue Systems
  ☆29Updated 3 years ago
• WowCZ / LongMIT
  LongMIT: Essential Factors in Crafting Effective Long Context Multi-Hop Instruction Datasets
  ☆36Updated 7 months ago
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆74Updated last year
• lscpku / VITATECS
  ☆18Updated 10 months ago