Alternatives and similar repositories for ControlCap:

Users that are interested in ControlCap are comparing it to the libraries listed below

• wusize / F-LMM
  [CVPR2025] Code Release of F-LMM: Grounding Frozen Large Multimodal Models
  ☆84Updated 9 months ago
• lizhou-cs / mglmm
  ☆30Updated 7 months ago
• callsys / DynRefer
  [CVPR 2025] DynRefer: Delving into Region-level Multimodal Tasks via Dynamic Resolution
  ☆47Updated 2 months ago
• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆81Updated 3 weeks ago
• ncTimTang / AKS
  [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding
  ☆57Updated last week
• showlab / VideoLISA
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  ☆116Updated 4 months ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆58Updated 3 months ago
• mightyzau / RegionBLIP
  ☆58Updated last year
• Visual-AI / PruneVid
  The official repository for paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".
  ☆36Updated 2 months ago
• wuw2019 / LoTLIP
  [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
  ☆43Updated 3 months ago
• congvvc / InstructSeg
  Official implementation of "InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Models"
  ☆36Updated 2 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆59Updated 10 months ago
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆40Updated last month
• Rubics-Xuan / MRES
  This repo holds the official code and data for "Unveiling Parts Beyond Objects: Towards Finer-Granularity Referring Expression Segmentati…
  ☆67Updated 11 months ago
• Paranioar / UniPT
  [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
  ☆68Updated 6 months ago
• haochenheheda / LVVIS
  Large-Vocabulary Video Instance Segmentation dataset
  ☆86Updated 10 months ago
• jianzongwu / betrayed-by-captions
  (ICCV 2023) Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation
  ☆47Updated 9 months ago
• appletea233 / LLaVA-ST
  [CVPR 2025] LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understanding
  ☆42Updated 2 months ago
• mc-lan / ClearCLIP
  [ECCV2024] ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inference
  ☆80Updated last month
• ProvenceStar / PartGLEE
  [ECCV2024] PartGLEE: A Foundation Model for Recognizing and Parsing Any Objects
  ☆45Updated 7 months ago
• AFeng-x / Draw-and-Understand
  [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆72Updated 3 months ago
• TencentARC / SEED-Bench-R1
  ☆80Updated last month
• callsys / GenPromp
  [ICCV 2023] Generative Prompt Model for Weakly Supervised Object Localization
  ☆57Updated last year
• hshjerry / VideoEspresso
  [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆75Updated 3 weeks ago
• Becomebright / GroundVQA
  Official PyTorch code of GroundVQA (CVPR'24)
  ☆60Updated 7 months ago
• hmxiong / StreamChat
  Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025
  ☆48Updated last month
• yongliu20 / SCAN
  [CVPR 2024] The repository contains the official implementation of "Open-Vocabulary Segmentation with Semantic-Assisted Calibration"
  ☆70Updated 7 months ago
• wdrink / OpenTokenizer
  ☆21Updated 3 months ago
• mbzuai-oryx / VideoGLaMM
  [CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos
  ☆62Updated 3 weeks ago
• FeipengMa6 / VLoRA
  [NeurIPS 2024] Visual Perception by Large Language Model’s Weights
  ☆44Updated last month