Alternatives and similar repositories for datacomp

Users that are interested in datacomp are comparing it to the libraries listed below

• LAION-AI / CLIP_benchmark
  CLIP-like model evaluation
  ☆756Updated last week
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆482Updated last year
• allenai / unified-io-2
  ☆622Updated last year
• kohjingyu / gill
  🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".
  ☆460Updated last year
• UCSC-VLAA / CLIPA
  [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"
  ☆316Updated last year
• facebookresearch / MetaCLIP
  ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expert…
  ☆1,652Updated last week
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,256Updated 2 years ago
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆352Updated last month
• kyegomez / CM3Leon
  An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …
  ☆363Updated last year
• mlfoundations / wise-ft
  Robust fine-tuning of zero-shot models
  ☆731Updated 3 years ago
• huggingface / open-muse
  Open reproduction of MUSE for fast text2image generation.
  ☆354Updated last year
• penghao-wu / vstar
  PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
  ☆667Updated last year
• bfshi / scaling_on_scales
  When do we not need larger vision models?
  ☆406Updated 6 months ago
• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆207Updated 11 months ago
• google-research-datasets / conceptual-12m
  Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
  ☆397Updated last month
• microsoft / GenerativeImage2Text
  GIT: A Generative Image-to-text Transformer for Vision and Language
  ☆572Updated last year
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆938Updated 5 months ago
• facebookresearch / LaViLa
  Code release for "Learning Video Representations from Large Language Models"
  ☆530Updated last year
• apple / ml-veclip
  The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"
  ☆246Updated 7 months ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆346Updated 7 months ago
• iejMac / video2dataset
  Easily create large video dataset from video urls
  ☆627Updated last year
• m-bain / webvid
  Large-scale text-video dataset. 10 million captioned short videos.
  ☆654Updated last year
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆522Updated last year
• AILab-CVC / SEED
  Official implementation of SEED-LLaMA (ICLR 2024).
  ☆620Updated 11 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆757Updated last year
• MMMU-Benchmark / MMMU
  This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…
  ☆483Updated 3 months ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆307Updated 7 months ago
• allenai / unified-io-inference
  ☆228Updated last year
• HenryHZY / Awesome-Multimodal-LLM
  Research Trends in LLM-guided Multimodal Learning.
  ☆356Updated last year
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆263Updated 8 months ago