Alternatives and similar repositories for SIMA

Users that are interested in SIMA are comparing it to the libraries listed below

• CraftJarvis / GROOT
  GROOT: Learning to Follow Instructions by Watching Gameplay Videos (ICLR'24, Spotlight)
  ☆66Updated 2 years ago
• kyegomez / AutoRT
  Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"
  ☆42Updated last year
• CraftJarvis / JarvisVLA
  Official Implementation of "JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse"
  ☆115Updated 4 months ago
• kyegomez / Sora
  Implementation of the premier Text to Video model from OpenAI
  ☆56Updated last year
• PKU-RL / Creative-Agents
  ☆46Updated 2 years ago
• OpenDFM / MobA
  🎮Manipulates mobile phones just like how you would. Official code for "MobA: Multifaceted Memory-Enhanced Adaptive Planning for Efficien…
  ☆26Updated 2 months ago
• DeckardAgent / deckard
  Official implementation of the DECKARD Agent from the paper "Do Embodied Agents Dream of Pixelated Sheep?"
  ☆94Updated 2 years ago
• OpenGVLab / EmbodiedGPT
  ☆34Updated 2 years ago
• kyegomez / Qwen-VL
  My personal implementation of the model from "Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities", they haven't rel…
  ☆12Updated last year
• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆47Updated 10 months ago
• JiuTian-VL / Optimus-1
  [NeurIPS 2024] Official Implementation for Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks
  ☆91Updated 6 months ago
• PKU-RL / LLaMA-Rider
  ☆28Updated 2 years ago
• ygjin11 / r2-play
  The official implementation of the paper "Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction".
  ☆34Updated last year
• CraftJarvis / OmniJARVIS
  ☆30Updated last year
• showlab / AUI
  Computer-Use Agents as Judges for Generative UI
  ☆39Updated last month
• facebookresearch / NeuralMemory
  A Data Source for Reasoning Embodied Agents
  ☆19Updated 2 years ago
• mindagent / mindagent
  ☆98Updated last year
• superagi / Veagle
  Enhancement in Multimodal Representation Learning.
  ☆41Updated last year
• DigiRL-agent / digiq
  ☆118Updated 9 months ago
• showlab / VideoGUI
  [NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos
  ☆48Updated 6 months ago
• kyegomez / awesome-robotic-foundation-models
  A vast array of Multi-Modal Embodied Robotic Foundation Models!
  ☆27Updated last year
• fabienfrfr / tptt
  😊 TPTT: Transforming Pretrained Transformers into Titans
  ☆49Updated last month
• dongyh20 / Octopus
  [ECCV2024] 🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.
  ☆293Updated last year
• kyegomez / TinyGPTV
  Simple Implementation of TinyGPTV in super simple Zeta lego blocks
  ☆16Updated last year
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆39Updated last year
• RCHI-Lab / voicepilot
  ☆19Updated 11 months ago
• PhysGame / PhysGame
  PhysGame Benchmark for Physical Commonsense Evaluation in Gameplay Videos
  ☆46Updated 6 months ago
• KastanDay / video-pretrained-transformer
  Multi-model video-to-text by combining embeddings from Flan-T5 + CLIP + Whisper + SceneGraph. The 'backbone LLM' is pre-trained from scra…
  ☆53Updated 2 years ago
• PKU-YuanGroup / LLaVA-o1
  ☆56Updated last year
• ancorasir / DecisionRWKV
  ☆20Updated last year