YujieLu10 / TIP
Multimodal-Procedural-Planning
☆92Updated last year
Alternatives and similar repositories for TIP:
Users that are interested in TIP are comparing it to the libraries listed below
- LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation☆128Updated last year
- Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".☆52Updated last year
- An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"☆52Updated last year
- ☆65Updated last year
- ☆85Updated last year
- ☆48Updated last year
- Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"☆54Updated 5 months ago
- [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"☆19Updated last year
- Source code for the paper "Prefix Language Models are Unified Modal Learners"☆43Updated last year
- Official Code of IdealGPT☆34Updated last year
- FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …☆100Updated 4 months ago
- [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.☆120Updated 2 years ago
- ☆68Updated last year
- Touchstone: Evaluating Vision-Language Models by Language Models☆82Updated last year
- A curated list of resources about long-context in large-language models and video understanding.☆30Updated last year
- Official repo for StableLLAVA☆95Updated last year
- Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)☆56Updated last year
- Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners☆115Updated 2 years ago
- A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools☆67Updated last year
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆42Updated last month
- Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models☆44Updated 10 months ago
- ☆22Updated 2 years ago
- Official implementation of WebVLN: Vision-and-Language Navigation on Websites☆28Updated last year
- [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"☆104Updated last year
- ☆22Updated last year
- PyTorch code for Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles (DANCE)☆23Updated 2 years ago
- ☆57Updated 11 months ago
- KokoMind: Can LLMs Understand Social Interactions?☆106Updated last year
- [NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos☆33Updated last week
- ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…☆50Updated last year