kevinzakka / clip_playground
An ever-growing playground of notebooks showcasing CLIP's impressive zero-shot capabilities
☆154Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for clip_playground
- ☆47Updated 3 years ago
- Generate text captions for images from their embeddings.☆102Updated last year
- ☆114Updated last year
- A task-agnostic vision-language architecture as a step towards General Purpose Vision☆92Updated 3 years ago
- L-Verse: Bidirectional Generation Between Image and Text☆108Updated 2 years ago
- Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers☆86Updated last year
- CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)☆187Updated 9 months ago
- ☆50Updated 2 years ago
- Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training☆132Updated last year
- Command-line tool for downloading and extending the RedCaps dataset.☆45Updated 11 months ago
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆202Updated last year
- ☆45Updated 6 months ago
- ☆171Updated last year
- PyTorch code for MUST☆106Updated last year
- Reliably download millions of images efficiently☆113Updated 3 years ago
- ICLR 2023 DeCap: Decoding CLIP Latents for Zero-shot Captioning☆125Updated last year
- [NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Models☆156Updated last year
- Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023☆136Updated last year
- [NeurIPS 2023] A faithful benchmark for vision-language compositionality☆70Updated 9 months ago
- DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models (ICCV 2023)☆137Updated 11 months ago
- Patching open-vocabulary models by interpolating weights☆90Updated last year
- [BMVC22] Official Implementation of ViCHA: "Efficient Vision-Language Pretraining with Visual Concepts and Hierarchical Alignment"☆54Updated 2 years ago
- This repo contains documentation and code needed to use PACO dataset: data loaders and training and evaluation scripts for objects, parts…☆271Updated 9 months ago
- ☆219Updated 11 months ago
- Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)☆153Updated 11 months ago
- ☆64Updated last year
- ☆65Updated last year
- [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383☆402Updated 2 years ago
- https://arxiv.org/abs/2209.15162☆48Updated last year
- [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.☆107Updated last year