Alternatives and similar repositories for fromage

Users that are interested in fromage are comparing it to the libraries listed below

• mlfoundations / datacomp
  DataComp: In search of the next generation of multimodal datasets
  ☆731Updated 3 months ago
• kohjingyu / gill
  🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".
  ☆460Updated last year
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆352Updated 2 weeks ago
• UCSC-VLAA / CLIPA
  [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"
  ☆316Updated last year
• Vision-CAIR / ChatCaptioner
  Official Repository of ChatCaptioner
  ☆464Updated 2 years ago
• dhansmair / flamingo-mini
  Implementation of the deepmind Flamingo vision-language model, based on Hugging Face language models and ready for training
  ☆167Updated 2 years ago
• google-research-datasets / conceptual-12m
  Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
  ☆394Updated 3 weeks ago
• allenai / unified-io-inference
  ☆227Updated last year
• facebookresearch / LaViLa
  Code release for "Learning Video Representations from Large Language Models"
  ☆529Updated last year
• LAION-AI / CLIP_benchmark
  CLIP-like model evaluation
  ☆748Updated 2 weeks ago
• allenai / unified-io-2
  ☆621Updated last year
• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆206Updated 11 months ago
• microsoft / GenerativeImage2Text
  GIT: A Generative Image-to-text Transformer for Vision and Language
  ☆572Updated last year
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,256Updated 2 years ago
• kyegomez / CM3Leon
  An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …
  ☆363Updated last year
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆269Updated last year
• huggingface / open-muse
  Open reproduction of MUSE for fast text2image generation.
  ☆354Updated last year
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆936Updated 4 months ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆346Updated 6 months ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆307Updated 6 months ago
• AILab-CVC / SEED
  Official implementation of SEED-LLaMA (ICLR 2024).
  ☆619Updated 10 months ago
• HenryHZY / Awesome-Multimodal-LLM
  Research Trends in LLM-guided Multimodal Learning.
  ☆357Updated last year
• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆258Updated 3 years ago
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆521Updated last year
• xplip / pixel
  Research code for pixel-based encoders of language (PIXEL)
  ☆338Updated 3 weeks ago
• m-bain / webvid
  Large-scale text-video dataset. 10 million captioned short videos.
  ☆651Updated 11 months ago
• microsoft / XPretrain
  Multi-modality pre-training
  ☆501Updated last year
• mertyg / vision-language-models-are-bows
  Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR …
  ☆282Updated 2 years ago
• JialianW / GRiT
  GRiT: A Generative Region-to-text Transformer for Object Understanding (ECCV2024)
  ☆330Updated last year
• HaozheZhao / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆352Updated last year