QC-LY / UniBind
The source code for "UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them All"
☆36Updated 9 months ago
Alternatives and similar repositories for UniBind:
Users that are interested in UniBind are comparing it to the libraries listed below
- Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"☆82Updated last month
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆137Updated last week
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆66Updated 3 months ago
- VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆91Updated 6 months ago
- ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆30Updated last week
- [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos☆95Updated 3 weeks ago
- [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models☆61Updated 3 months ago
- Official repository of DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models☆78Updated 4 months ago
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆79Updated 10 months ago
- [CVPR 2024] ViT-Lens: Towards Omni-modal Representations☆169Updated 6 months ago
- Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.☆56Updated 4 months ago
- ☆61Updated 6 months ago
- ☆22Updated 3 months ago
- [CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities☆99Updated 10 months ago
- MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning☆106Updated 8 months ago
- Repo for paper "T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs"☆48Updated last month
- [NeurIPS 2024] Visual Perception by Large Language Model’s Weights☆35Updated 3 months ago
- Large Language Models are Temporal and Causal Reasoners for Video Question Answering (EMNLP 2023)☆74Updated 5 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆54Updated 7 months ago
- Data-Efficient Multimodal Fusion on a Single GPU☆52Updated 8 months ago
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆25Updated 8 months ago
- Official implement of MIA-DPO☆49Updated 2 months ago
- Codes for Paper: Towards Semantic Equivalence of Tokenization in Multimodal LLM☆48Updated 3 months ago
- [Preprint] TRACE: Temporal Grounding Video LLM via Casual Event Modeling☆58Updated 2 weeks ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆96Updated 2 months ago
- Visual self-questioning for large vision-language assistant.☆39Updated 3 months ago
- ☆64Updated last month
- Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"☆91Updated 5 months ago
- VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection☆46Updated this week
- Awesome papers & datasets specifically focused on long-term videos.☆238Updated 2 months ago