apple / ml-veclipLinks
The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"
☆246Updated 9 months ago
Alternatives and similar repositories for ml-veclip
Users that are interested in ml-veclip are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"☆319Updated last year
- Data release for the ImageInWords (IIW) paper.☆221Updated 11 months ago
- This is the official repository for the LENS (Large Language Models Enhanced to See) system.☆355Updated 3 months ago
- When do we not need larger vision models?☆412Updated 9 months ago
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆219Updated 3 weeks ago
- Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗☆280Updated 8 months ago
- E5-V: Universal Embeddings with Multimodal Large Language Models☆274Updated 10 months ago
- ☆59Updated last year
- a family of highly capabale yet efficient large multimodal models☆191Updated last year
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆159Updated last year
- Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models" ICLR 2024☆108Updated last year
- ☆87Updated last year
- ☆65Updated 2 years ago
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"☆145Updated 3 weeks ago
- [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"☆143Updated last year
- PyTorch Implementation of Object Recognition as Next Token Prediction [CVPR'24 Highlight]☆180Updated 6 months ago
- Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)☆127Updated last week
- Matryoshka Multimodal Models☆115Updated 9 months ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆158Updated last year
- [ICCVW 25] LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning☆155Updated 3 months ago
- (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…☆82Updated 3 months ago
- Learning from synthetic data - code and models☆324Updated last year
- This is the repository for the Photorealistic Unreal Graphics (PUG) datasets for representation learning.☆237Updated last year
- An open source implementation of CLIP (With TULIP Support)☆163Updated 6 months ago
- ☆188Updated last year
- Densely Captioned Images (DCI) dataset repository.☆191Updated last year
- Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models☆205Updated 10 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆331Updated last year
- Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…☆209Updated last year
- PyTorch code for hierarchical k-means -- a data curation method for self-supervised learning☆218Updated last year