UCSC-VLAA / CLIPALinks
[NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"
☆316Updated last year
Alternatives and similar repositories for CLIPA
Users that are interested in CLIPA are comparing it to the libraries listed below
Sorting:
- Densely Captioned Images (DCI) dataset repository.☆192Updated last year
- Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)☆176Updated 3 months ago
- Learning from synthetic data - code and models☆322Updated last year
- Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training☆138Updated 2 years ago
- When do we not need larger vision models?☆407Updated 7 months ago
- [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale☆212Updated last year
- Official Implementation for "MyVLM: Personalizing VLMs for User-Specific Queries" (ECCV 2024)☆179Updated last year
- [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"☆286Updated last year
- [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"☆142Updated last year
- Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"☆259Updated last year
- Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models☆205Updated 8 months ago
- CLIP Itself is a Strong Fine-tuner: Achieving 85.7% and 88.0% Top-1 Accuracy with ViT-B and ViT-L on ImageNet☆221Updated 2 years ago
- ☆228Updated last year
- This repo contains documentation and code needed to use PACO dataset: data loaders and training and evaluation scripts for objects, parts…☆286Updated last year
- ☆103Updated last year
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"☆246Updated 8 months ago
- ☆232Updated 3 months ago
- Official code for "TOAST: Transfer Learning via Attention Steering"☆188Updated 2 years ago
- ☆133Updated last year
- Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)☆121Updated last year
- Matryoshka Multimodal Models☆111Updated 8 months ago
- GRiT: A Generative Region-to-text Transformer for Object Understanding (ECCV2024)☆335Updated last year
- Official Open Source code for "Scaling Language-Image Pre-training via Masking"☆428Updated 2 years ago
- SVIT: Scaling up Visual Instruction Tuning☆164Updated last year
- TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering☆175Updated last year
- EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties☆130Updated 10 months ago
- Code base of SynthCLIP: CLIP training with purely synthetic text-image pairs from LLMs and TTIs.☆100Updated 6 months ago
- Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023☆182Updated 2 years ago
- 🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".☆482Updated last year
- FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions☆55Updated last year