Alternatives and similar repositories for valhalla-nmt

Users that are interested in valhalla-nmt are comparing it to the libraries listed below

• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆259Updated 3 years ago
• ictnlp / PLUVR
  Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".
  ☆21Updated last year
• QAQ-v / MMT
  ☆15Updated 4 years ago
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆143Updated 3 years ago
• berniebear / Multi-HT100M
  ☆53Updated 3 years ago
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆373Updated 2 years ago
• libeineu / fairseq_mmt
  This code repository is for the accepted ACL2022 paper "On Vision Features in Multimodal Machine Translation". We provide the details and…
  ☆43Updated 2 years ago
• xplip / pixel
  Research code for pixel-based encoders of language (PIXEL)
  ☆339Updated last month
• nttmdlab-nlp / VisualMRC
  VisualMRC: Machine Reading Comprehension on Document Images (AAAI2021)
  ☆56Updated 5 months ago
• m-bain / CondensedMovies
  Story-Based Retrieval with Contextual Embeddings. Largest freely available movie video dataset. [ACCV'20]
  ☆184Updated 2 years ago
• TheoCoombes / ClipCap
  Using pretrained encoder and language models to generate captions from multimedia inputs.
  ☆98Updated 2 years ago
• researchmm / generate-it
  A collection of models for image<->text generation in ACM MM 2021.
  ☆66Updated 3 years ago
• zinengtang / TVLT
  PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
  ☆126Updated 2 years ago
• ShannonAI / OpenViDial
  Code, Models and Datasets for OpenViDial Dataset
  ☆131Updated 3 years ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆224Updated 3 years ago
• jamespark3922 / visual-comet
  VisualCOMET: Reasoning about the Dynamic Context of a Still Image
  ☆87Updated 2 years ago
• victorsungo / MMDialog
  The official site of paper MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation
  ☆199Updated last year
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 4 years ago
• LividWo / Revisit-MMT
  ☆24Updated 4 years ago
• facebookresearch / DVDialogues
  Code for DVD A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialogue
  ☆14Updated 3 years ago
• pzzhang / VinVL
  project page for VinVL
  ☆357Updated 2 years ago
• j-min / CLIP-Caption-Reward
  PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)
  ☆245Updated 2 months ago
• j-min / DallEval
  DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models (ICCV 2023)
  ☆142Updated 2 months ago
• ImperialNLP / VTLM
  Cross-lingual Visual Pre-training for Multimodal Machine Translation
  ☆18Updated 3 years ago
• adymaharana / StoryViz
  ☆33Updated 3 years ago
• YoadTew / zero-shot-image-to-text
  Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
  ☆278Updated 2 years ago
• gchhablani / multilingual-image-captioning
  ☆44Updated 4 years ago
• adymaharana / VLCStoryGan
  Official code repository for the EMNLP 2021 paper
  ☆26Updated 3 years ago
• salesforce / VD-BERT
  ☆45Updated 2 months ago
• VegB / iNLG
  Implementation of "Visualize Before You Write: Imagination-Guided Open-Ended Text Generation".
  ☆17Updated 2 years ago