Alternatives and similar repositories for segment-caption-anything

Users that are interested in segment-caption-anything are comparing it to the libraries listed below

• YuchenLiu98 / COMM
  Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models
  ☆205Updated 10 months ago
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆331Updated last year
• berkeley-hipie / HIPIE
  [NeurIPS2023] Code release for "Hierarchical Open-vocabulary Universal Image Segmentation"
  ☆292Updated 5 months ago
• zamling / PSALM
  [ECCV2024] This is an official implementation for "PSALM: Pixelwise SegmentAtion with Large Multi-Modal Model"
  ☆262Updated 11 months ago
• MaverickRen / PixelLM
  [CVPR 2024] PixelLM is an effective and efficient LMM for pixel-level reasoning and understanding.
  ☆243Updated 9 months ago
• cilinyan / VISA
  [ECCV24] VISA: Reasoning Video Object Segmentation via Large Language Model
  ☆196Updated last year
• bytedance / coconut_cvpr2024
  ☆194Updated 6 months ago
• showlab / VideoLISA
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  ☆141Updated 11 months ago
• wysoczanska / clip_dinoiser
  Official implementation of 'CLIP-DINOiser: Teaching CLIP a few DINO tricks' paper.
  ☆263Updated last year
• baaivision / DIVA
  [ICLR 2025] Diffusion Feedback Helps CLIP See Better
  ☆295Updated 10 months ago
• facebookresearch / VLPart
  [ICCV2023] VLPart: Going Denser with Open-Vocabulary Part Segmentation
  ☆390Updated 2 years ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆168Updated last year
• haochenheheda / LVVIS
  Large-Vocabulary Video Instance Segmentation dataset
  ☆95Updated last year
• V3Det / V3Det
  ☆114Updated last year
• NVlabs / LITA
  ☆189Updated last year
• Surrey-UP-Lab / RegionSpot
  Recognize Any Regions
  ☆122Updated 11 months ago
• PhoenixZ810 / MG-LLaVA
  Official repository for paper MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning(https://arxiv.org/abs/2406.17770).
  ☆158Updated last year
• JacobYuan7 / RLIPv2
  [ICCV 2023] RLIPv2: Fast Scaling of Relational Language-Image Pre-training
  ☆135Updated last year
• AFeng-x / Draw-and-Understand
  [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆91Updated this week
• facebookresearch / DCI
  Densely Captioned Images (DCI) dataset repository.
  ☆194Updated last year
• UX-Decoder / FIND
  [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"
  ☆128Updated last year
• TencentARC / ViT-Lens
  [CVPR 2024] ViT-Lens: Towards Omni-modal Representations
  ☆184Updated 10 months ago
• ProvenceStar / PartGLEE
  [ECCV2024] PartGLEE: A Foundation Model for Recognizing and Parsing Any Objects
  ☆54Updated last year
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• wusize / CLIPSelf
  [ICLR2024 Spotlight] Code Release of CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction
  ☆198Updated last year
• ShareGPT4Omni / ShareGPT4V
  [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
  ☆244Updated last year
• FoundationVision / GenerateU
  [CVPR2024] Generative Region-Language Pretraining for Open-Ended Object Detection
  ☆186Updated 8 months ago
• shikras / d-cube
  A detection/segmentation dataset with labels characterized by intricate and flexible expressions. "Described Object Detection: Liberating…
  ☆138Updated last year
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆80Updated last year
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆158Updated 11 months ago