Alternatives and similar repositories for hierarcaps

Users that are interested in hierarcaps are comparing it to the libraries listed below

• McGill-NLP / diffusion-itm
  Code and data setup for the paper "Are Diffusion Models Vision-and-language Reasoners?"
  ☆32Updated last year
• ytaek-oh / vl_compo
  ☆10Updated last year
• Hritikbansal / videocon
  ☆58Updated last year
• dhg-wei / TOPA
  (NeurIPS 2024 Spotlight) TOPA: Extend Large Language Models for Video Understanding via Text-Only Pre-Alignment
  ☆31Updated 9 months ago
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆27Updated last year
• kaist-ami / BEAF
  [ECCV’24] Official repository for "BEAF: Observing Before-AFter Changes to Evaluate Hallucination in Vision-language Models"
  ☆20Updated 3 months ago
• naver-ai / prolip
  ☆51Updated 4 months ago
• wjpoom / SPEC
  [CVPR 2024] The official implementation of paper "synthesize, diagnose, and optimize: towards fine-grained vision-language understanding"
  ☆43Updated last month
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆41Updated 7 months ago
• jaehong31 / SAFREE
  [ICLR 2025] SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image and Video Generation
  ☆40Updated 5 months ago
• showlab / MovieSeq
  [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆39Updated 4 months ago
• amitakamath / vl_text_encoders_are_bottlenecks
  Code and datasets for "Text encoders are performance bottlenecks in contrastive vision-language models". Coming soon!
  ☆11Updated 2 years ago
• ninatu / howtocaption
  Official implementation of "HowToCaption: Prompting LLMs to Transform Video Annotations at Scale." ECCV 2024
  ☆54Updated 9 months ago
• QUVA-Lab / PIN
  Official code repo of PIN: Positional Insert Unlocks Object Localisation Abilities in VLMs
  ☆26Updated 6 months ago
• RAIVNLab / CREPE
  [CVPR23 Highlight] CREPE: Can Vision-Language Foundation Models Reason Compositionally?
  ☆33Updated 2 years ago
• egolife-ai / Ego-R1
  Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning
  ☆79Updated 2 weeks ago
• shashankvkt / DoRA_ICLR24
  This repo contains the official implementation of ICLR 2024 paper "Is ImageNet worth 1 video? Learning strong image encoders from 1 long …
  ☆90Updated last year
• tsunghan-wu / reverse_vlm
  🔥 Official implementation of "Generate, but Verify: Reducing Visual Hallucination in Vision-Language Models with Retrospective Resamplin…
  ☆39Updated last month
• ytaek-oh / fsc-clip
  [EMNLP 2024] Preserving Multi-Modal Capabilities of Pre-trained VLMs for Improving Vision-Linguistic Compositionality
  ☆16Updated 9 months ago
• xvjiarui / IMProv
  IMProv: Inpainting-based Multimodal Prompting for Computer Vision Tasks
  ☆57Updated 9 months ago
• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆28Updated 9 months ago
• sterzhang / PVIT
  Official Repository of Personalized Visual Instruct Tuning
  ☆31Updated 4 months ago
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆45Updated last year
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆24Updated 7 months ago
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆56Updated last year
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆33Updated 8 months ago
• snumprlab / isr-dpo
  Official Implementation of ISR-DPO:Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO (AAAI'25)
  ☆20Updated 5 months ago
• showlab / datacentric.vlp
  Compress conventional Vision-Language Pre-training data
  ☆51Updated last year
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆54Updated last year
• md-mohaiminul / BIMBA
  ☆19Updated 3 months ago