YujieLu10 / TIP

Related projects ⓘ

Alternatives and complementary repositories for TIP

• lupantech / IconQA
  Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".
  ☆49Updated 9 months ago
• sanjayss34 / codevqa
  ☆83Updated last year
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆32Updated last year
• limanling / KnowledgeVL-Reading
  ☆68Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆47Updated last month
• UCSC-VLAA / Sight-Beyond-Text
  This repository includes the official implementation of our paper "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness …
  ☆19Updated last year
• YujieLu10 / LLMScore
  LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
  ☆125Updated last year
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated last year
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆110Updated last month
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated last year
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆38Updated 7 months ago
• google / storybench
  ☆48Updated last year
• showlab / Awesome-Long-Context
  A curated list of resources about long-context in large-language models and video understanding.
  ☆30Updated last year
• CHATS-lab / KokoMind
  KokoMind: Can LLMs Understand Social Interactions?
  ☆104Updated last year
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆48Updated last year
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆47Updated 10 months ago
• joez17 / ChatBridge
  ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…
  ☆47Updated last year
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆112Updated 2 years ago
• belindal / LaMPP
  Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action
  ☆35Updated last year
• NewsStoriesData / newsstories.github.io
  ☆22Updated 2 years ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆42Updated 3 weeks ago
• RifleZhang / LLaVA-Hound-DPO
  ☆121Updated 3 weeks ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆43Updated 5 months ago
• UMass-Foundation-Model / CoVLM
  Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
  ☆42Updated last year
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆61Updated 2 years ago
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆107Updated last year
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆64Updated 6 months ago
• SALT-NLP / PersuationGames
  [ACL2023, Findings] Source codes for the paper "Werewolf Among Us: Multimodal Resources for Modeling Persuasion Behaviors in Social Deduc…
  ☆12Updated 2 months ago
• isekai-portal / Link-Context-Learning
  ☆90Updated 6 months ago
• umd-huang-lab / Mementos
  ☆25Updated 9 months ago