Alternatives and similar repositories for TIP:

Users that are interested in TIP are comparing it to the libraries listed below

• google / storybench
  ☆48Updated last year
• lupantech / IconQA
  Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".
  ☆51Updated last year
• sanjayss34 / codevqa
  ☆83Updated last year
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated last year
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆19Updated last year
• YujieLu10 / LLMScore
  LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
  ☆127Updated last year
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated last year
• belindal / LaMPP
  Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action
  ☆36Updated last year
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆34Updated last year
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆56Updated last year
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆36Updated last year
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated 9 months ago
• yonatanbitton / wysiwyr
  ☆35Updated last year
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆43Updated 9 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆41Updated 2 weeks ago
• limanling / KnowledgeVL-Reading
  ☆67Updated last year
• salesforce / paprika
  Code for CVPR 2023 paper "Procedure-Aware Pretraining for Instructional Video Understanding"
  ☆48Updated last month
• UMass-Embodied-AGI / CoVLM
  Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
  ☆45Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆49Updated 5 months ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated last year
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆116Updated last year
• eric-ai-lab / Screen-Point-and-Read
  Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"
  ☆24Updated 7 months ago
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆114Updated 2 years ago
• hila-chefer / Conceptor
  Official implementation of the paper The Hidden Language of Diffusion Models
  ☆71Updated last year
• isekai-portal / Link-Context-Learning
  ☆95Updated 10 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆59Updated 8 months ago
• ChenDelong1999 / polite-flamingo
  🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)
  ☆64Updated last year
• WildVision-AI / LMM-Engines
  ☆16Updated 4 months ago
• showlab / Awesome-Long-Context
  A curated list of resources about long-context in large-language models and video understanding.
  ☆30Updated last year