thunlp / LEGENT

Related projects ⓘ

Alternatives and complementary repositories for LEGENT

• RL4VLM / RL4VLM
  Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
  ☆199Updated last month
• dongyh20 / Octopus
  🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.
  ☆263Updated 5 months ago
• UMass-Foundation-Model / Co-LLM-Agents
  [ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"
  ☆223Updated 2 weeks ago
• OpenRobotLab / GRUtopia
  GRUtopia: Dream General Robots in a City at Scale
  ☆503Updated 2 months ago
• PKU-Alignment / align-anything
  Align Anything: Training All-modality Model with Feedback
  ☆220Updated this week
• THUDM / VisualAgentBench
  Towards Large Multimodal Models as Visual Foundation Agents
  ☆113Updated last week
• WooooDyy / AgentGym
  Code and implementations for the paper "AgentGym: Evolving Large Language Model-based Agents across Diverse Environments" by Zhiheng Xi e…
  ☆346Updated last month
• showlab / Awesome-GUI-Agent
  💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.
  ☆175Updated last week
• RLHF-V / RLAIF-V
  RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness
  ☆230Updated this week
• DigiRL-agent / digirl
  Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.
  ☆252Updated last month
• IranQin / MP5
  [CVPR2024] This is the official implement of MP5
  ☆83Updated 4 months ago
• facebookresearch / open-eqa
  OpenEQA Embodied Question Answering in the Era of Foundation Models
  ☆233Updated last month
• Gary3410 / TaPA
  [arXiv 2023] Embodied Task Planning with Large Language Models
  ☆155Updated last year
• haoranD / Awesome-Embodied-AI
  A curated list of awesome papers on Embodied AI and related research/industry-driven resources.
  ☆282Updated 3 months ago
• LeapLabTHU / ExpeL
  ☆85Updated 3 months ago
• OpenGVLab / Instruct2Act
  Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
  ☆333Updated 4 months ago
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆300Updated 6 months ago
• VIRL-Platform / VIRL
  (ECCV 2024) Code for V-IRL: Grounding Virtual Intelligence in Real Life
  ☆313Updated 3 months ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆215Updated 2 months ago
• BAAI-DCAI / SpatialBot
  The official repo for "SpatialBot: Precise Spatial Understanding with Vision Language Models.
  ☆158Updated 3 weeks ago
• jun0wanan / awesome-large-multimodal-agents
  ☆339Updated last month
• Timothyxxx / WorldModelPapers
  Paper collections of the continuous effort start from World Models.
  ☆130Updated 4 months ago
• PKU-RL / Creative-Agents
  ☆40Updated 10 months ago
• pkunlp-icler / PCA-EVAL
  [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain
  ☆100Updated 7 months ago
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆196Updated 3 months ago
• embodied-generalist / embodied-generalist
  [ICML 2024] Official code repository for 3D embodied generalist agent LEO
  ☆363Updated 3 weeks ago
• UMass-Foundation-Model / 3D-VLA
  [ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model
  ☆341Updated last week
• remyxai / VQASynth
  Compose multimodal datasets 🎹
  ☆204Updated this week
• THUDM / CogCoM
  ☆152Updated 4 months ago
• UMass-Foundation-Model / MultiPLY
  Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World
  ☆121Updated 2 weeks ago