Using pretrained encoder and language models to generate captions from multimedia inputs.
☆101Mar 11, 2023Updated 3 years ago
Alternatives and similar repositories for ClipCap
Users that are interested in ClipCap are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- I have created a dataset of Image-Text-Pairs by using the cosine similarity of the CLIP embeddings of the image & it's caption derrived f…☆18Apr 22, 2021Updated 5 years ago
- ☆13Aug 23, 2024Updated 2 years ago
- Aim for the moon. If you miss, you may hit a star.☆168Feb 14, 2023Updated 3 years ago
- Simple image captioning model☆1,423Jun 9, 2024Updated 2 years ago
- CaMEL: Mean Teacher Learning for Image Captioning. ICPR 2022☆30Dec 1, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Efficiently read embedding in streaming from any filesystem☆106Aug 9, 2025Updated last year
- Refactoring dalle-pytorch and taming-transformers for TPU VM☆60Aug 30, 2021Updated 5 years ago
- ☆21Mar 15, 2023Updated 3 years ago
- PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)☆247Jun 10, 2025Updated last year
- ☆11Jun 2, 2022Updated 4 years ago
- Home of `erlich` and `ongo`. Finetune latent-diffusion/glid-3-xl text2image on your own data.☆181Aug 5, 2022Updated 4 years ago
- Let's make a video clip☆97Jul 29, 2022Updated 4 years ago
- ☆109Aug 5, 2021Updated 5 years ago
- Optimized code based on M2 for faster image captioning training☆21Nov 18, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- GLIDE: a diffusion-based text-conditional image synthesis model. Now with example files for local running.☆11Jan 25, 2022Updated 4 years ago
- CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)☆211Jan 28, 2024Updated 2 years ago
- This project provides a data set with bounding boxes, body poses, 3D face meshes & captions of people from our LAION-2.2B. Additionally i…☆14Jan 2, 2022Updated 4 years ago
- Describe the format of image/text datasets☆12Apr 26, 2022Updated 4 years ago
- Baseline model for nocaps benchmark, ICCV 2019 paper "nocaps: novel object captioning at scale".☆77Oct 3, 2023Updated 3 years ago
- SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION☆36Nov 7, 2022Updated 4 years ago
- Repository for "Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search"☆179Sep 30, 2021Updated 5 years ago
- Implementation of the deepmind Flamingo vision-language model, based on Hugging Face language models and ready for training☆169Apr 27, 2023Updated 3 years ago
- Repository for the paper "Data Efficient Masked Language Modeling for Vision and Language".☆18Sep 17, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Easily compute clip embeddings and build a clip retrieval system with them☆2,798Mar 28, 2026Updated 7 months ago
- CLOOB Conditioned Latent Diffusion training and inference code☆112Apr 15, 2022Updated 4 years ago
- Aggregating embeddings over time☆32Jan 19, 2023Updated 3 years ago
- OpenAI CLIP text encoders for multiple languages!☆830May 15, 2023Updated 3 years ago
- Dataset for Paper "Exploring Content Selection in Summarization of Novel Chapters"☆13Mar 20, 2023Updated 3 years ago
- CLOOB training (JAX) and inference (JAX and PyTorch)☆76May 16, 2022Updated 4 years ago
- Inverts CLIP text embeds to image embeds and visualizes with deep-image-prior.☆37Jul 3, 2022Updated 4 years ago
- Controllable mage captioning model with unsupervised modes☆21Apr 14, 2023Updated 3 years ago
- Xfce Desktop container designed for direct access to the GPU with EGL using VirtualGL for GPUs. Does not require /tmp/.X11-unix host sock…☆10Jul 25, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A tool for generating awesome AI art☆17Jul 29, 2022Updated 4 years ago
- Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action☆37Apr 3, 2023Updated 3 years ago
- StableDiffusion scripts based on huggingface diffusers.☆16Feb 23, 2025Updated last year
- Unified API to facilitate usage of pre-trained "perceptor" models, a la CLIP☆38Nov 26, 2022Updated 3 years ago
- Easily compute clip embeddings from video frames☆150Oct 31, 2023Updated 3 years ago
- Doing style transfer with linguistic features using OpenAI's CLIP.☆14May 4, 2021Updated 5 years ago
- ☆10Aug 25, 2019Updated 7 years ago
Are these results useful?