Alternatives and similar repositories for FIRE:

Users that are interested in FIRE are comparing it to the libraries listed below

• mat-agent / MAT-Agent
  ☆19Updated 2 weeks ago
• thunlp / EmbodiedEval
  Evaluate Multimodal LLMs as Embodied Agents
  ☆39Updated last month
• ChenYi99 / EgoPlan
  ☆69Updated 3 months ago
• yale-nlp / TOMATO
  ☆24Updated 4 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆44Updated last year
• MAmmoTH-VL / MAmmoTH-VL
  MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
  ☆35Updated 3 months ago
• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆25Updated 6 months ago
• DAMO-NLP-SG / CMM
  ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  ☆44Updated 5 months ago
• liangcici / Probes-VLN
  ☆20Updated 3 years ago
• UMass-Embodied-AGI / CoVLM
  Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
  ☆45Updated last year
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆29Updated 4 months ago
• claws-lab / projection-in-MLLMs
  Code and data for ACL 2024 paper on 'Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Space'
  ☆13Updated 8 months ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated last year
• EmbodiedGPT / EgoCOT_Dataset
  ☆45Updated 11 months ago
• HAWLYQ / ET-Cap
  ☆25Updated last year
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆59Updated 8 months ago
• Vinoground / Vinoground
  ☆10Updated 5 months ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆21Updated 10 months ago
• muirbench / MuirBench
  A Comprehensive Benchmark for Robust Multi-image Understanding
  ☆10Updated 6 months ago
• xfgao / DialFRED
  Repository for DialFRED.
  ☆42Updated last year
• AdaCheng / EgoThink
  [CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Lan…
  ☆58Updated last week
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆33Updated last year
• GuangyanS / Sys2-LLaVA
  ☆20Updated last month
• haoyiq114 / VALOR
  Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)
  ☆16Updated 11 months ago
• Walter0807 / RepBelief
  [ICML 2024] Language Models Represent Beliefs of Self and Others
  ☆31Updated 6 months ago
• zhaowei-wang-nlp / DivScene
  The code of the paper "DivScene: Benchmarking LVLMs for Object Navigation with Diverse Scenes and Objects"
  ☆14Updated 5 months ago
• patrick-tssn / Awesome-Multimodal-Memory
  Reading List of Memory Augmented Multimodal Research, including multimodal context modeling, memory in vision and robotics, and external …
  ☆13Updated 6 months ago
• 2toinf / IVM
  [NeurIPS-2024] The offical Implementation of "Instruction-Guided Visual Masking"
  ☆33Updated 4 months ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• snumprlab / capeam
  Official Implementation of CAPEAM (ICCV'23)
  ☆12Updated 4 months ago