Alternatives and similar repositories for Sight-Beyond-Text

Users that are interested in Sight-Beyond-Text are comparing it to the libraries listed below

• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆46Updated 8 months ago
• gzcch / Bingo
  ☆55Updated last year
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆34Updated 2 years ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated 2 years ago
• ImKeTT / ZeroGen
  [NLPCC'23] ZeroGen: Zero-shot Multimodal Controllable Text Generation with Multiple Oracles PyTorch Implementation
  ☆13Updated 2 years ago
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• WangFei-2019 / SNARE
  Project for SNARE benchmark
  ☆11Updated last year
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆38Updated last year
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆42Updated 2 years ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆59Updated last year
• YujieLu10 / TIP
  Multimodal-Procedural-Planning
  ☆92Updated 2 years ago
• NewsStoriesData / newsstories.github.io
  ☆22Updated 3 years ago
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆73Updated 11 months ago
• OpenCausaLab / CELLO
  ☆21Updated 11 months ago
• lupantech / IconQA
  Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".
  ☆52Updated last year
• sled-group / world-to-words
  Official Code for ACL 2023 Outstanding Paper: World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Languag…
  ☆33Updated 2 years ago
• ByungKwanLee / Phantom
  [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …
  ☆61Updated last year
• ByteDance-BandAI / LLM-I
  🚀 LLM-I: Transform LLMs into natural interleaved multimodal creators! ✨ Tool-use framework supporting image search, generation, code ex…
  ☆31Updated last week
• si0wang / ViCrit
  ☆24Updated 4 months ago
• top-yun / SPARK
  A benchmark dataset and simple code examples for measuring the perception and reasoning of multi-sensor Vision Language models.
  ☆19Updated 10 months ago
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆27Updated 3 months ago
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated 2 years ago
• kokolerk / TON
  [NeurIPS 2025] Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆47Updated last month
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆49Updated 5 months ago
• HanSolo9682 / CounterCurate
  This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.
  ☆18Updated last year
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 6 months ago
• yonatanbitton / wysiwyr
  ☆37Updated 2 years ago
• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆16Updated 7 months ago
• ShujinWu-0814 / MACAROON
  Public code repo for EMNLP 2024 Findings paper "MACAROON: Training Vision-Language Models To Be Your Engaged Partners"
  ☆14Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆88Updated last year