EgoToM is an egocentric theory-of-mind benchmark built on Ego4D videos, containing multi-choice questions that evaluate multimodal large language models' ability to infer a camera wearer's goals, in-the-moment belief states, and future actions.
☆17Apr 1, 2025Updated last year
Alternatives and similar repositories for EgoToM
Users that are interested in EgoToM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- EPIC-Bench is a fine-grained embodied visual grounding benchmark for evaluating VLMs on target localization, navigation-oriented percepti…☆16May 28, 2026Updated 3 months ago
- [ICCV 2023] This is for the paper "Deep Homography Mixture for Single Image Rolling Shutter Correction".☆17May 25, 2025Updated last year
- [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"☆20Sep 15, 2023Updated 3 years ago
- ☆23Jun 12, 2025Updated last year
- [NeurIPS 2023] Zero-shot Visual Relation Detection via Composite Visual Cues from Large Language Models☆23Oct 21, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- BigOBench assesses the capacity of Large Language Models (LLMs) to comprehend time-space computational complexity of input or generated c…☆43Apr 15, 2025Updated last year
- A Survey on Causal Generative Modeling (TMLR 2024)☆16Dec 18, 2024Updated last year
- [ICLR 26] Context Tokens are Anchors: Understanding the Repeat Curse in dMLLMs from an Information Flow Perspective☆31Mar 6, 2026Updated 6 months ago
- Dataset and evaluation benchmark for Privacy Leakage Evaluation of Autonomous Web Agents☆47Apr 18, 2026Updated 5 months ago
- [CVPR 2025] Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priors☆21Jun 6, 2025Updated last year
- [ACM MM 2025] ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Models☆18Jul 15, 2025Updated last year
- [ICLR'26] ssToken: Self-modulated and Semantic-aware Token Selection for LLM Fine-tuning☆16Feb 28, 2026Updated 6 months ago
- code for the paper Imitation Learning from Observation with Automatic Discount Scheduling☆13Mar 27, 2024Updated 2 years ago
- Official implementation of Scaling Laws in Patchification: An Image Is Worth 50,176 Tokens And More☆25Feb 25, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14Apr 23, 2025Updated last year
- Unifying 2D and 3D Vision-Language Understanding☆130Jul 2, 2026Updated 2 months ago
- [ACM MM 2025] This repository is the official implementation of the paper "Motion Matters: Motion-guided Modulation Network for Skeleton-…☆22Updated this week
- This repository contains the Adverbs in Recipes (AIR) dataset and the code published at the CVPR 23 paper: "Learning Action Changes by Me…☆13May 25, 2023Updated 3 years ago
- Code for "StreamGaze: Gaze-Guided Temporal Reasoning and Proactive Understanding in Streaming Videos"☆28May 13, 2026Updated 4 months ago
- [ECCV2024] Nonverbal Interaction Detection☆32Oct 30, 2024Updated last year
- This is the official repository for the paper "Mastering Collaborative Multi-modal Data Selection: A Focus on Informativeness, Uniqueness…☆17Dec 18, 2025Updated 9 months ago
- [ICML 2026] Heima☆76May 20, 2026Updated 4 months ago
- [CVPR 2026 Highlight] PersonaVLM: Long-Term Personalized Multimodal LLMs☆121Apr 16, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Can VLMs understand students' hand-drawn math work?☆19Jan 20, 2026Updated 8 months ago
- Data release for Step Differences in Instructional Video (CVPR24)☆15Jun 19, 2024Updated 2 years ago
- ☆11Jun 12, 2023Updated 3 years ago
- Official Implementation of ConceptLM.☆28Mar 18, 2026Updated 6 months ago
- ☆13Jul 16, 2024Updated 2 years ago
- MemoryEQA☆28May 4, 2026Updated 4 months ago
- ☆37Jan 25, 2024Updated 2 years ago
- A list of robotics related papers accepted by ICLR'25☆27Aug 28, 2025Updated last year
- ☆34Sep 19, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆31Dec 23, 2024Updated last year
- This repo holds the implementation of PAVE: Patching and Adapting Video Large Language Models (CVPR2025)☆28Sep 6, 2025Updated last year
- [ICLR26] GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning☆107Jan 27, 2026Updated 7 months ago
- This repository is the official implementation of TimeHC-RL (Distilabel (Data Generation) + TRL (SFT) + VeRL (GRPO)).☆48Jun 4, 2025Updated last year
- ☆27Nov 20, 2025Updated 10 months ago
- Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency☆62Jun 6, 2025Updated last year
- [NeurIPS 2024] Official code for paper "EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detection"☆42Jul 7, 2025Updated last year