VIRL-Platform / VIRL

Related projects ⓘ

Alternatives and complementary repositories for VIRL

• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆391Updated 6 months ago
• dongyh20 / Octopus
  🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.
  ☆263Updated 5 months ago
• remyxai / VQASynth
  Compose multimodal datasets 🎹
  ☆204Updated this week
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆300Updated 6 months ago
• facebookresearch / open-eqa
  OpenEQA Embodied Question Answering in the Era of Foundation Models
  ☆233Updated last month
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆123Updated 2 months ago
• maitrix-org / Pandora
  Pandora: Towards General World Model with Natural Language Actions and Video States
  ☆477Updated last month
• thunlp / LEGENT
  Open Platform for Embodied Agents
  ☆263Updated 3 weeks ago
• sled-group / chat-with-nerf
  Chat with NeRF enables users to interact with a NeRF model by typing in natural language.
  ☆303Updated 6 months ago
• YueFan1014 / VideoAgent
  This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)
  ☆127Updated 2 months ago
• UMass-Foundation-Model / MultiPLY
  Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World
  ☆121Updated 2 weeks ago
• mit-han-lab / vila-u
  VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
  ☆120Updated 2 weeks ago
• 3d-vista / 3D-VisTA
  Official implementation of ICCV 2023 paper "3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment"
  ☆189Updated last year
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆317Updated 3 months ago
• tsb0601 / MMVP
  ☆287Updated 9 months ago
• RL4VLM / RL4VLM
  Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
  ☆199Updated last month
• SHI-Labs / VCoder
  VCoder: Versatile Vision Encoders for Multimodal Large Language Models, arXiv 2023 / CVPR 2024
  ☆261Updated 6 months ago
• THUDM / CogCoM
  ☆152Updated 4 months ago
• MMMU-Benchmark / MMMU
  This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…
  ☆353Updated 3 weeks ago
• allenai / unified-io-2
  ☆569Updated 8 months ago
• Vision-CAIR / LongVU
  ☆258Updated this week
• bytedance / lynx-llm
  paper: https://arxiv.org/abs/2307.02469 page: https://lynx-llm.github.io/
  ☆229Updated last year
• GigaAI-research / General-World-Models-Survey
  ☆282Updated 6 months ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆264Updated this week
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆328Updated 2 weeks ago
• UMass-Foundation-Model / Co-LLM-Agents
  [ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"
  ☆223Updated 2 weeks ago
• ZCMax / LLaVA-3D
  A Simple yet Effective Pathway to Empowering LLaVA to Understand and Interact with 3D World
  ☆162Updated 3 weeks ago
• JeffWang987 / WorldDreamer
  WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens
  ☆193Updated 9 months ago
• OpenGVLab / ControlLLM
  ControlLLM: Augment Language Models with Tools by Searching on Graphs
  ☆186Updated 3 months ago
• CraftJarvis / ROCKET-1
  ☆26Updated this week