Alternatives and similar repositories for VIRL:

Users that are interested in VIRL are comparing it to the libraries listed below

• dongyh20 / Octopus
  🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.
  ☆278Updated 7 months ago
• vision-x-nyu / thinking-in-space
  Official repo and evaluation implementation of VSI-Bench
  ☆326Updated this week
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆409Updated last month
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆306Updated 9 months ago
• remyxai / VQASynth
  Compose multimodal datasets 🎹
  ☆261Updated last month
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆356Updated last month
• mit-han-lab / vila-u
  VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
  ☆199Updated this week
• allenai / unified-io-2
  ☆588Updated 11 months ago
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆132Updated 4 months ago
• SHI-Labs / VCoder
  [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
  ☆272Updated 9 months ago
• facebookresearch / open-eqa
  OpenEQA Embodied Question Answering in the Era of Foundation Models
  ☆250Updated 3 months ago
• RL4VLM / RL4VLM
  Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
  ☆249Updated last month
• LLaVA-VL / LLaVA-Interactive-Demo
  LLaVA-Interactive-Demo
  ☆360Updated 5 months ago
• maitrix-org / Pandora
  Pandora: Towards General World Model with Natural Language Actions and Video States
  ☆492Updated 3 months ago
• 3d-vista / 3D-VisTA
  Official implementation of ICCV 2023 paper "3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment"
  ☆197Updated last year
• AILab-CVC / SEED
  Official implementation of SEED-LLaMA (ICLR 2024).
  ☆596Updated 3 months ago
• sled-group / chat-with-nerf
  Chat with NeRF enables users to interact with a NeRF model by typing in natural language.
  ☆305Updated 9 months ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆324Updated this week
• thunlp / LEGENT
  Open Platform for Embodied Agents
  ☆280Updated this week
• MLLM-Tool / MLLM-Tool
  MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning
  ☆105Updated 8 months ago
• weixi-feng / LayoutGPT
  Official repo for LayoutGPT
  ☆314Updated 9 months ago
• THUDM / CogCoM
  ☆159Updated 6 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆112Updated 6 months ago
• UMass-Foundation-Model / MultiPLY
  Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World
  ☆124Updated 2 months ago
• ZCMax / LLaVA-3D
  A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D World
  ☆195Updated last month
• phyworld / phyworld
  ☆99Updated last week
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆278Updated 2 months ago
• YueFan1014 / VideoAgent
  This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)
  ☆161Updated last month
• Vision-CAIR / LongVU
  ☆338Updated 2 months ago
• MMMU-Benchmark / MMMU
  This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…
  ☆378Updated this week