Alternatives and similar repositories for flamingo-mini:

Users that are interested in flamingo-mini are comparing it to the libraries listed below

• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆197Updated 6 months ago
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆479Updated last year
• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆256Updated 2 years ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆291Updated 2 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated last month
• microsoft / FIBER
  Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  ☆128Updated last year
• Yui010206 / SeViLA
  [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering
  ☆187Updated last year
• LAION-AI / General-GPT
  ☆64Updated last year
• VT-NLP / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆136Updated last year
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆132Updated last year
• sanjayss34 / codevqa
  ☆83Updated last year
• SALT-NLP / LLaVAR
  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"
  ☆265Updated 9 months ago
• mshukor / UnIVAL
  [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.
  ☆225Updated last year
• kyegomez / PALI
  Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
  ☆88Updated last year
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆204Updated 2 years ago
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆368Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆156Updated last year
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆223Updated 3 years ago
• kohjingyu / gill
  🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".
  ☆448Updated last year
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆191Updated last year
• FuxiaoLiu / LRV-Instruction
  [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  ☆272Updated last year
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆332Updated 2 months ago
• microsoft / BridgeTower
  Open source code for AAAI 2023 Paper "BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning"
  ☆161Updated last year
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆185Updated 2 years ago
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆139Updated 2 years ago
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆103Updated 2 years ago
• facebookresearch / diht
  Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training
  ☆136Updated 2 years ago
• google-research-datasets / conceptual-12m
  Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
  ☆384Updated 2 years ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆82Updated last year
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆174Updated 6 months ago