Alternatives and similar repositories for grit:

Users that are interested in grit are comparing it to the libraries listed below

• GT-RIPL / Xmodal-Ctx
  Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for …
  ☆61Updated 2 years ago
• 232525 / PureT
  Implementation of 'End-to-End Transformer Based Model for Image Captioning' [AAAI 2022]
  ☆67Updated 9 months ago
• zhangxuying1004 / RSTNet
  Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)
  ☆122Updated 2 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆191Updated last year
• RitaRamo / smallcap
  SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
  ☆100Updated last year
• microsoft / SwinBERT
  Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"
  ☆239Updated 2 years ago
• jchenghu / ExpansionNet_v2
  Implementation code of the work "Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning"
  ☆87Updated 2 months ago
• pzzhang / VinVL
  project page for VinVL
  ☆353Updated last year
• jacobswan1 / ViTCAP
  Implementation for CVPR 2022 paper " Injecting Semantic Concepts into End-to-End Image Captionin".
  ☆42Updated 2 years ago
• xuguohai / X-CLIP
  An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"
  ☆152Updated 11 months ago
• joeyz0z / ConZIC
  Official implementation of "ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing"
  ☆73Updated last year
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆185Updated 2 years ago
• terry-r123 / Awesome-Captioning
  A curated list of Multimodal Captioning related research(including image captioning, video captioning, and text captioning)
  ☆110Updated 2 years ago
• jianjieluo / OpenAI-CLIP-Feature
  An easy to use, user-friendly and efficient code for extracting OpenAI CLIP (Global/Grid) features from image and text respectively.
  ☆121Updated 2 months ago
• buxiangzhiren / DDCap
  ☆84Updated 2 years ago
• BryanPlummer / flickr30k_entities
  Flickr30K Entities Dataset
  ☆169Updated 6 years ago
• jianjieluo / SCD-Net
  [CVPR23] A cascaded diffusion captioning model with a novel semantic-conditional diffusion process that upgrades conventional diffusion m…
  ☆60Updated 9 months ago
• showlab / all-in-one
  [CVPR2023] All in One: Exploring Unified Video-Language Pre-training
  ☆281Updated last year
• dhg-wei / DeCap
  ICLR 2023 DeCap: Decoding CLIP Latents for Zero-shot Captioning
  ☆130Updated 2 years ago
• ttengwang / PDVC
  End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)
  ☆215Updated last year
• mzhaoshuai / CenterCLIP
  [SIGIR 2022] CenterCLIP: Token Clustering for Efficient Text-Video Retrieval. Also, a text-video retrieval toolbox based on CLIP + fast p…
  ☆130Updated 2 years ago
• clip-vil / CLIP-ViL
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆411Updated 2 years ago
• Yushi-Hu / PromptCap
  natual language guided image captioning
  ☆79Updated last year
• Yui010206 / SeViLA
  [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering
  ☆187Updated last year
• mrwu-mac / DIFNet
  [CVPR 2022] This repository is for the paper ``DIFNet: Boosting Visual Information Flow for Image Captioning'' .
  ☆20Updated 2 years ago
• allenai / reclip
  ☆82Updated 2 years ago
• SjokerLily / awesome-image-captioning
  A paper list of image captioning.
  ☆22Updated 2 years ago
• woodfrog / vse_infty
  Code for "Learning the Best Pooling Strategy for Visual Semantic Embedding", CVPR 2021 (Oral)
  ☆160Updated 2 years ago
• sail-sg / ptp
  [CVPR2023] The code for 《Position-guided Text Prompt for Vision-Language Pre-training》
  ☆151Updated last year
• rentainhe / TRAR-VQA
  [ICCV 2021] Official implementation of the paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering"
  ☆66Updated 3 years ago