fkodom / clip-text-decoder
Generate text captions for images from their embeddings.
☆97Updated last year
Related projects: ⓘ
- Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023☆127Updated last year
- ☆50Updated 2 years ago
- [ICCV 2023] Unsupervised Compositional Concepts Discovery with Text-to-Image Generative Models☆75Updated 11 months ago
- Release of ImageNet-Captions☆45Updated last year
- ☆47Updated 3 years ago
- Sparse Linear Concept Embeddings☆47Updated last month
- ☆111Updated last year
- EILEV: Efficient In-Context Learning in Vision-Language Models for Egocentric Videos☆108Updated 3 months ago
- CLIPScore EMNLP code☆185Updated last year
- Densely Captioned Images (DCI) dataset repository.☆155Updated 2 months ago
- Official repository of paper "Subobject-level Image Tokenization"☆58Updated 4 months ago
- ICLR 2023 DeCap: Decoding CLIP Latents for Zero-shot Captioning☆118Updated last year
- PyTorch code for MUST☆105Updated last year
- Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)☆149Updated 9 months ago
- ☆72Updated 5 months ago
- ☆46Updated last year
- ☆152Updated 2 years ago
- Official implementation of the paper "Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models☆156Updated 11 months ago
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆97Updated 11 months ago
- Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)☆97Updated 5 months ago
- Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers☆85Updated last year
- RichHF-18K dataset contains rich human feedback labels we collected for our CVPR'24 paper: https://arxiv.org/pdf/2312.10240, along with t…☆96Updated 2 months ago
- Code and Models for "GeneCIS A Benchmark for General Conditional Image Similarity"☆54Updated last year
- Research code for paper "Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesis"☆112Updated last year
- [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"☆292Updated 3 months ago
- Implementation of the video diffusion model and training scheme presented in the paper, Flexible Diffusion Modeling of Long Videos, in Py…☆84Updated 2 years ago
- ☆89Updated 4 months ago
- A task-agnostic vision-language architecture as a step towards General Purpose Vision☆92Updated 3 years ago
- DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models (ICCV 2023)☆136Updated 9 months ago
- FuseCap: Large Language Model for Visual Data Fusion in Enriched Caption Generation☆47Updated 5 months ago