Alternatives and similar repositories for prismatic-vlms:

Users that are interested in prismatic-vlms are comparing it to the libraries listed below

• remyxai / VQASynth
  Compose multimodal datasets 🎹
  ☆351Updated this week
• RL4VLM / RL4VLM
  Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
  ☆341Updated 4 months ago
• kyegomez / PALM-E
  Implementation of "PaLM-E: An Embodied Multimodal Language Model"
  ☆299Updated last year
• Robot-VLAs / RoboVLMs
  ☆332Updated 3 months ago
• vision-x-nyu / thinking-in-space
  Official repo and evaluation implementation of VSI-Bench
  ☆463Updated last month
• moojink / openvla-oft
  Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
  ☆343Updated 3 weeks ago
• simpler-env / SimplerEnv
  Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Goo…
  ☆595Updated 3 weeks ago
• allenai / unified-io-2
  ☆610Updated last year
• TRI-ML / vlm-evaluation
  VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning
  ☆108Updated 7 months ago
• liruiw / HPT
  Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.
  ☆485Updated 4 months ago
• h-zhao1997 / cobra
  [AAAI-25] Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference
  ☆272Updated 3 months ago
• facebookresearch / open-eqa
  OpenEQA Embodied Question Answering in the Era of Foundation Models
  ☆272Updated 7 months ago
• nvidia-cosmos / cosmos-reason1
  Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long c…
  ☆295Updated 3 weeks ago
• MichalZawalski / embodied-CoT
  Embodied Chain of Thought: A robotic policy that reason to solve the task.
  ☆225Updated 2 weeks ago
• embodiedreasoning / ERQA
  Embodied Reasoning Question Answer (ERQA) Benchmark
  ☆139Updated last month
• DirtyHarryLYL / LLM-in-Vision
  Recent LLM-based CV and related works. Welcome to comment/contribute!
  ☆862Updated last month
• BAAI-DCAI / SpatialBot
  The official repo for "SpatialBot: Precise Spatial Understanding with Vision Language Models.
  ☆243Updated 2 months ago
• mbzuai-oryx / groundingLMM
  [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…
  ☆866Updated 5 months ago
• LatentActionPretraining / LAPA
  [ICLR 2025] LAPA: Latent Action Pretraining from Videos
  ☆235Updated 3 months ago
• mees / calvin
  CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks
  ☆539Updated 2 months ago
• lucidrains / pi-zero-pytorch
  Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence
  ☆397Updated this week
• deepcs233 / Visual-CoT
  [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …
  ☆298Updated 4 months ago
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆800Updated 3 weeks ago
• OpenGVLab / Instruct2Act
  Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
  ☆359Updated 10 months ago
• google-research / language-table
  Suite of human-collected datasets and a multi-task continuous control benchmark for open vocabulary visuolinguomotor learning.
  ☆313Updated last week
• kyegomez / RT-X
  Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"
  ☆203Updated 2 weeks ago
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆311Updated last year
• bdaiinstitute / theia
  Theia: Distilling Diverse Vision Foundation Models for Robot Learning
  ☆226Updated 3 weeks ago
• pkunlp-icler / FastV
  [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…
  ☆413Updated 3 months ago
• bfshi / scaling_on_scales
  When do we not need larger vision models?
  ☆388Updated 2 months ago