ylaxor / clip-like
Train (fine-tune) OpenAI's CLIP-like models on custom image-caption data sets, cf. COCO dataset. PyTorch implementation.
☆20Updated 2 years ago
Alternatives and similar repositories for clip-like
Users that are interested in clip-like are comparing it to the libraries listed below
Sorting:
- Plotting heatmaps with the self-attention of the [CLS] tokens in the last layer.☆45Updated 3 years ago
- [ICLR 2024] Official code for the paper "LLM Blueprint: Enabling Text-to-Image Generation with Complex and Detailed Prompts"☆76Updated 11 months ago
- Safe-CLIP: Removing NSFW Concepts from Vision-and-Language Models. ECCV 2024☆60Updated 9 months ago
- Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)☆119Updated last year
- [BMVC 2024 Oral ✨] Revisiting Image Captioning Training Paradigm via Direct CLIP-based Optimization☆18Updated 8 months ago
- Clipora is a powerful toolkit for fine-tuning OpenCLIP models using Low Rank Adapters (LoRA).☆21Updated 8 months ago
- [CVPR 2024 Highlight] OpenBias: Open-set Bias Detection in Text-to-Image Generative Models☆23Updated 3 months ago
- Data-Efficient Multimodal Fusion on a Single GPU☆59Updated last year
- [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models☆87Updated 7 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆319Updated 9 months ago
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆154Updated 2 years ago
- Official code for "Can We Talk Models Into Seeing the World Differently?" (ICLR 2025).☆23Updated 3 months ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆83Updated last year
- ☆37Updated last month
- Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).☆116Updated 2 weeks ago
- ☆32Updated last year
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆27Updated 11 months ago
- Official implementation of MAIA, A Multimodal Automated Interpretability Agent☆80Updated 2 months ago
- LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft☆44Updated 9 months ago
- Matryoshka Multimodal Models☆104Updated 3 months ago
- Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"☆90Updated last year
- official implementation of "Interpreting CLIP's Image Representation via Text-Based Decomposition"☆211Updated 5 months ago
- Official code repo for "Editing Implicit Assumptions in Text-to-Image Diffusion Models"☆86Updated 2 years ago
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆81Updated 6 months ago
- ☆45Updated 3 months ago
- [CVPR24] Official Implementation of GEM (Grounding Everything Module)☆121Updated last month
- Densely Captioned Images (DCI) dataset repository.☆181Updated 10 months ago
- [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning☆54Updated 3 months ago
- [ICLR 2025] Official code repository for "TULIP: Token-length Upgraded CLIP"☆25Updated 3 months ago
- ☆65Updated 9 months ago