yxuansu / MAGIC

Related projects ⓘ

Alternatives and complementary repositories for MAGIC

• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆361Updated last year
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆185Updated 2 years ago
• YoadTew / zero-shot-image-to-text
  Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
  ☆269Updated 2 years ago
• victorsungo / MMDialog
  The official site of paper MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation
  ☆190Updated last year
• clip-vil / CLIP-ViL
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆400Updated 2 years ago
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆288Updated last year
• dhansmair / flamingo-mini
  Implementation of the deepmind Flamingo vision-language model, based on Hugging Face language models and ready for training
  ☆164Updated last year
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆185Updated 9 months ago
• jmhessel / clipscore
  CLIPScore EMNLP code
  ☆191Updated last year
• zdou0830 / METER
  METER: A Multimodal End-to-end TransformER Framework
  ☆361Updated last year
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆202Updated last year
• limanling / clip-event
  ☆100Updated 2 years ago
• researchmm / soho
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆206Updated 2 years ago
• google-research-datasets / conceptual-12m
  Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
  ☆364Updated last year
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆137Updated 2 years ago
• j-min / CLIP-Caption-Reward
  PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)
  ☆233Updated 2 years ago
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 2 years ago
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆478Updated last year
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆87Updated last year
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆223Updated 2 years ago
• microsoft / BridgeTower
  Open source code for AAAI 2023 Paper "BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning"
  ☆155Updated last year
• j-min / DallEval
  DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models (ICCV 2023)
  ☆137Updated 11 months ago
• pzzhang / VinVL
  project page for VinVL
  ☆350Updated last year
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆130Updated last year
• buxiangzhiren / DDCap
  ☆85Updated last year
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆112Updated 2 years ago
• Yui010206 / SeViLA
  [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering
  ☆178Updated 9 months ago
• VT-NLP / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆133Updated last year
• TheoCoombes / ClipCap
  Using pretrained encoder and language models to generate captions from multimedia inputs.
  ☆95Updated last year
• goel-shashank / CyCLIP
  ☆113Updated last year