lucidrains / x-clip
A concise but complete implementation of CLIP with various experimental improvements from recent papers
β693Updated last year
Related projects β
Alternatives and complementary repositories for x-clip
- Code release for SLIP Self-supervision meets Language-Image Pre-trainingβ747Updated last year
- Implementation of 𦩠Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorchβ1,215Updated 2 years ago
- A PyTorch Lightning solution to training OpenAI's CLIP from scratch.β665Updated 2 years ago
- Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigmβ636Updated 2 years ago
- CLIP-like model evaluationβ615Updated 3 months ago
- Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorchβ1,067Updated 11 months ago
- Robust fine-tuning of zero-shot modelsβ649Updated 2 years ago
- Official implementation of VQ-Diffusionβ899Updated 7 months ago
- Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorchβ523Updated 11 months ago
- Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.β368Updated last year
- Official Jax Implementation of MaskGITβ449Updated 2 years ago
- Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorchβ869Updated 8 months ago
- iBOT : Image BERT Pre-Training with Online Tokenizer (ICLR 2022)β679Updated 2 years ago
- Official PyTorch implementation of GroupViT: Semantic Segmentation Emerges from Text Supervision, CVPR 2022.β738Updated 2 years ago
- [CVPR 2022] Official code for "Unified Contrastive Learning in Image-Text-Label Space"β389Updated last year
- Pytorch implementation of MaskGIT: Masked Generative Image Transformer (https://arxiv.org/pdf/2202.04200.pdf)β412Updated last year
- Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).β1,136Updated 4 months ago
- A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch modelβ517Updated last month
- β443Updated 2 years ago
- [ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decodeβ¦β801Updated last year
- Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorchβ333Updated last year
- DataComp: In search of the next generation of multimodal datasetsβ657Updated 10 months ago
- A method to increase the speed and lower the memory footprint of existing vision transformers.β970Updated 5 months ago
- An unofficial implementation of both ViT-VQGAN and RQ-VAE in Pytorchβ286Updated last year
- Open reproduction of MUSE for fast text2image generation.β332Updated 5 months ago
- OpenAI CLIP text encoders for multiple languages!β763Updated last year
- Simple implementation of OpenAI CLIP model in PyTorch.β633Updated 7 months ago
- β978Updated 2 years ago
- [CVPR 2022] Official PyTorch Implementation for DiffusionCLIP: Text-guided Image Manipulation Using Diffusion Modelsβ806Updated last year
- Implementation of NΓWA, state of the art attention network for text to video synthesis, in Pytorchβ545Updated last year