Alternatives and similar repositories for valhalla-nmt

Users that are interested in valhalla-nmt are comparing it to the libraries listed below

• QAQ-v / MMT
  ☆15Updated 5 years ago
• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆259Updated 3 years ago
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆146Updated 3 years ago
• xplip / pixel
  Research code for pixel-based encoders of language (PIXEL)
  ☆346Updated 6 months ago
• zinengtang / TVLT
  PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
  ☆124Updated 2 years ago
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆374Updated 2 years ago
• libeineu / fairseq_mmt
  This code repository is for the accepted ACL2022 paper "On Vision Features in Multimodal Machine Translation". We provide the details and…
  ☆43Updated 3 years ago
• berniebear / Multi-HT100M
  ☆53Updated 4 years ago
• ictnlp / PLUVR
  Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".
  ☆21Updated 2 years ago
• victorsungo / MMDialog
  The official site of paper MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation
  ☆203Updated 2 years ago
• huiyegit / T2I_CL
  ☆45Updated 4 years ago
• dhansmair / flamingo-mini
  Implementation of the deepmind Flamingo vision-language model, based on Hugging Face language models and ready for training
  ☆169Updated 2 years ago
• YoadTew / zero-shot-image-to-text
  Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
  ☆278Updated 3 years ago
• j-min / CLIP-Caption-Reward
  PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)
  ☆246Updated 8 months ago
• j-min / DallEval
  DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models (ICCV 2023)
  ☆143Updated 8 months ago
• TheoCoombes / ClipCap
  Using pretrained encoder and language models to generate captions from multimedia inputs.
  ☆100Updated 2 years ago
• LividWo / Revisit-MMT
  ☆25Updated 4 years ago
• facebookresearch / DVDialogues
  Code for DVD A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialogue
  ☆14Updated 4 years ago
• m-bain / CondensedMovies
  Story-Based Retrieval with Contextual Embeddings. Largest freely available movie video dataset. [ACCV'20]
  ☆194Updated 3 years ago
• ImperialNLP / VTLM
  Cross-lingual Visual Pre-training for Multimodal Machine Translation
  ☆18Updated 4 years ago
• xingyaoww / gif-reply
  Official Github Repo for the Findings of EMNLP 2021 paper "An animated picture says at least a thousand words: Selecting Gif-based Replie…
  ☆32Updated 4 years ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆225Updated 3 years ago
• gchhablani / multilingual-image-captioning
  ☆44Updated 4 years ago
• HLTCHKUST / VG-GPLMs
  The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".
  ☆56Updated 4 years ago
• researchmm / generate-it
  A collection of models for image<->text generation in ACM MM 2021.
  ☆67Updated 4 years ago
• ShannonAI / OpenViDial
  Code, Models and Datasets for OpenViDial Dataset
  ☆132Updated 4 years ago
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆92Updated 2 years ago
• nttmdlab-nlp / SlideVQA
  SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images (AAAI2023)
  ☆104Updated 10 months ago
• pzzhang / VinVL
  project page for VinVL
  ☆359Updated 2 years ago
• nttmdlab-nlp / VisualMRC
  VisualMRC: Machine Reading Comprehension on Document Images (AAAI2021)
  ☆57Updated 10 months ago