YujieLu10 / TIP
Multimodal-Procedural-Planning
☆91Updated last year
Alternatives and similar repositories for TIP:
Users that are interested in TIP are comparing it to the libraries listed below
- Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".☆50Updated last year
- ☆48Updated last year
- ☆83Updated last year
- LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation☆126Updated last year
- Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding☆43Updated last year
- Language Repository for Long Video Understanding☆31Updated 7 months ago
- Official repo for StableLLAVA☆94Updated last year
- Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"☆48Updated 3 months ago
- [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"☆19Updated last year
- ☆47Updated last year
- [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.☆108Updated last year
- [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"☆104Updated last year
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆33Updated 3 months ago
- [NeurIPS2024] VideoGUI: A Benchmark for GUI Automation from Instructional Videos☆27Updated last month
- ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…☆49Updated last year
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆41Updated this week
- Source code for the paper "Prefix Language Models are Unified Modal Learners"☆43Updated last year
- Code for CVPR 2023 paper "Procedure-Aware Pretraining for Instructional Video Understanding"☆47Updated this week
- Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action☆35Updated last year
- Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners☆113Updated 2 years ago
- Official Code of IdealGPT☆34Updated last year
- ☆66Updated last year
- Touchstone: Evaluating Vision-Language Models by Language Models☆81Updated last year
- ☆34Updated last year
- [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation☆47Updated last year
- Official Code for ACL 2023 Outstanding Paper: World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Languag…☆23Updated last year
- ☆92Updated 8 months ago
- ☆72Updated 8 months ago
- ☆22Updated 2 years ago
- Language Quantized AutoEncoders☆97Updated last year