Alternatives and similar repositories for prismatic-vlms:

Users that are interested in prismatic-vlms are comparing it to the libraries listed below

• remyxai / VQASynth
  Compose multimodal datasets 🎹
  ☆261Updated last month
• TRI-ML / vlm-evaluation
  VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning
  ☆97Updated 4 months ago
• bfshi / scaling_on_scales
  When do we not need larger vision models?
  ☆354Updated last month
• mbzuai-oryx / groundingLMM
  [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…
  ☆814Updated last month
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆306Updated 9 months ago
• facebookresearch / open-eqa
  OpenEQA Embodied Question Answering in the Era of Foundation Models
  ☆250Updated 3 months ago
• h-zhao1997 / cobra
  [AAAI-25] Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference
  ☆266Updated last week
• allenai / unified-io-2
  ☆588Updated 11 months ago
• kyegomez / PALM-E
  Implementation of "PaLM-E: An Embodied Multimodal Language Model"
  ☆280Updated 11 months ago
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆709Updated last month
• liruiw / HPT
  Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.
  ☆445Updated last month
• OpenGVLab / all-seeing
  [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …
  ☆472Updated 5 months ago
• tsb0601 / MMVP
  ☆304Updated 11 months ago
• allenai / molmo
  Code for the Molmo Vision-Language Model
  ☆236Updated last month
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆324Updated this week
• OpenGVLab / Instruct2Act
  Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
  ☆348Updated 6 months ago
• RL4VLM / RL4VLM
  Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
  ☆249Updated last month
• deepcs233 / Visual-CoT
  [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …
  ☆202Updated 3 weeks ago
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆308Updated 6 months ago
• thunlp / LLaVA-UHD
  LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer
  ☆348Updated this week
• Robot-VLAs / RoboVLMs
  ☆235Updated this week
• simpler-env / SimplerEnv
  Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Goo…
  ☆441Updated 2 months ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆278Updated 2 months ago
• yuhangzang / ContextDET
  Contextual Object Detection with Multimodal Large Language Models
  ☆212Updated 3 months ago
• llava-rlhf / LLaVA-RLHF
  Aligning LMMs with Factually Augmented RLHF
  ☆339Updated last year
• kyegomez / RT-X
  Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"
  ☆186Updated 2 weeks ago
• penghao-wu / vstar
  PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
  ☆556Updated last year
• RLHF-V / RLAIF-V
  RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness
  ☆273Updated last month
• vision-x-nyu / thinking-in-space
  Official repo and evaluation implementation of VSI-Bench
  ☆326Updated this week