apple / ml-veclipLinks
The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"
☆244Updated 5 months ago
Alternatives and similar repositories for ml-veclip
Users that are interested in ml-veclip are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"☆314Updated last year
- ☆58Updated last year
- When do we not need larger vision models?☆395Updated 4 months ago
- Data release for the ImageInWords (IIW) paper.☆215Updated 7 months ago
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆208Updated this week
- E5-V: Universal Embeddings with Multimodal Large Language Models☆254Updated 6 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆324Updated 11 months ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆149Updated last year
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"☆145Updated 2 months ago
- ☆179Updated 8 months ago
- Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models".☆102Updated last year
- Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)☆120Updated last year
- Learning from synthetic data - code and models☆318Updated last year
- An open source implementation of CLIP (With TULIP Support)☆157Updated last month
- OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learning☆264Updated last month
- PyTorch Implementation of Object Recognition as Next Token Prediction [CVPR 2024 Highlight]☆180Updated last month
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆158Updated last year
- Matryoshka Multimodal Models☆110Updated 5 months ago
- Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…☆202Updated 9 months ago
- Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗☆250Updated 4 months ago
- ☆203Updated last year
- DataComp: In search of the next generation of multimodal datasets☆719Updated last month
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆125Updated 10 months ago
- a family of highly capabale yet efficient large multimodal models☆185Updated 10 months ago
- Densely Captioned Images (DCI) dataset repository.☆185Updated 11 months ago
- 🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".☆456Updated last year
- ☆87Updated last year
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆380Updated 2 months ago
- Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models