Alternatives and similar repositories for flamingo-mini

Users that are interested in flamingo-mini are comparing it to the libraries listed below

• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆202Updated 9 months ago
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆482Updated last year
• sanjayss34 / codevqa
  ☆85Updated last year
• huggingface / m4-logs
  M4 experiment logbook
  ☆58Updated last year
• microsoft / BridgeTower
  Open source code for AAAI 2023 Paper "BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning"
  ☆165Updated last year
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆205Updated 2 years ago
• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆256Updated 3 years ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated 2 months ago
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆134Updated 2 years ago
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆267Updated last year
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆107Updated 2 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆197Updated last year
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆140Updated 3 years ago
• microsoft / FIBER
  Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  ☆129Updated last year
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆371Updated last year
• facebookresearch / diht
  Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training
  ☆137Updated 2 years ago
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆188Updated last month
• kyegomez / PALI
  Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
  ☆91Updated last year
• UCSC-VLAA / CLIPA
  [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"
  ☆314Updated last year
• LAION-AI / General-GPT
  ☆64Updated last year
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆93Updated last year
• xplip / pixel
  Research code for pixel-based encoders of language (PIXEL)
  ☆335Updated last year
• TheoCoombes / ClipCap
  Using pretrained encoder and language models to generate captions from multimedia inputs.
  ☆97Updated 2 years ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆343Updated 5 months ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated last year
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆303Updated 5 months ago
• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆43Updated 2 years ago
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆254Updated 6 months ago
• Yui010206 / SeViLA
  [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering
  ☆185Updated last year