Alternatives and similar repositories for TIP

Users that are interested in TIP are comparing it to the libraries listed below

• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆20Updated 2 years ago
• lupantech / IconQA
  Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".
  ☆54Updated last year
• sanjayss34 / codevqa
  ☆83Updated 2 years ago
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated 2 years ago
• showlab / assistgpt
  ☆66Updated 2 years ago
• belindal / LaMPP
  Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action
  ☆37Updated 2 years ago
• OpenGVLab / Awesome-LLM4Tool
  A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools
  ☆68Updated 2 years ago
• NewsStoriesData / newsstories.github.io
  ☆22Updated 3 years ago
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• umd-huang-lab / Mementos
  ☆32Updated last year
• taogoddd / GPT-4V-API
  Self-hosted GPT-4V api
  ☆27Updated 2 years ago
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆69Updated 3 years ago
• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆124Updated 7 months ago
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆138Updated 2 years ago
• limanling / KnowledgeVL-Reading
  ☆67Updated 2 years ago
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆62Updated last year
• YujieLu10 / LLMScore
  LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
  ☆134Updated 2 years ago
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆35Updated 2 years ago
• pleaseconnectwifi / DANCE
  PyTorch code for Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles (DANCE)
  ☆23Updated 3 years ago
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated 2 years ago
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆104Updated 2 years ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated last year
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆74Updated last year
• google / storybench
  ☆52Updated 2 years ago
• lbaermann / qaego4d
  Code and Dataset for the CVPRW Paper "Where did I leave my keys? — Episodic-Memory-Based Question Answering on Egocentric Videos"
  ☆29Updated 2 years ago
• michaelsaxon / CoCoCroLa
  The Conceptual Coverage Across Languages Benchmark for Text-to-Image Models
  ☆12Updated last year
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated 2 years ago
• kkahatapitiya / LangRepo
  Code for our ACL 2025 paper "Language Repository for Long Video Understanding"
  ☆33Updated last year
• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆47Updated 10 months ago