merveenoyan / siglip
Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration π€
β169Updated last year
Alternatives and similar repositories for siglip:
Users that are interested in siglip are comparing it to the libraries listed below
- Data release for the ImageInWords (IIW) paper.β208Updated 2 months ago
- [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"β197Updated 8 months ago
- Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Modelsβ192Updated last month
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"β144Updated 2 weeks ago
- VisionLLaMA: A Unified LLaMA Backbone for Vision Tasksβ381Updated 7 months ago
- Object Recognition as Next Token Prediction (CVPR 2024 Highlight)β171Updated last month
- When do we not need larger vision models?β364Updated last week
- Densely Captioned Images (DCI) dataset repository.β168Updated 7 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Promptsβ310Updated 6 months ago
- [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"β309Updated 8 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformerβ364Updated last month
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistantβ226Updated 6 months ago
- My implementation of "Patch nβ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"β213Updated 2 weeks ago
- The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A suβ¦β222Updated last month
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"β239Updated 3 weeks ago
- [CVPR 24] The repository provides code for running inference and training for "Segment and Caption Anything" (SCA) , links for downloadinβ¦β211Updated 4 months ago
- a family of highly capabale yet efficient large multimodal modelsβ176Updated 5 months ago
- LLaVA-Interactive-Demoβ362Updated 6 months ago
- β159Updated 4 months ago
- E5-V: Universal Embeddings with Multimodal Large Language Modelsβ230Updated last month
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Expertsβ139Updated 8 months ago
- [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Modelsβ271Updated 9 months ago
- [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scaleβ203Updated 11 months ago
- [IJCV 2024] MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentationβ119Updated 4 months ago
- β164Updated last year
- [NeurIPS 2024] SlimSAM: 0.1% Data Makes Segment Anything Slimβ321Updated 2 months ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Contextβ144Updated 4 months ago
- Python Library to evaluate VLM models' robustness across diverse benchmarksβ188Updated last month
- Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".β188Updated 2 months ago
- Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)β158Updated last year