ShyFoo / Nemesis
Official implementation of Nemesis: Normalizing the Soft-prompt Vectors of Vision-Language Models (ICLR 2024 Spotlight)
☆13Updated last month
Alternatives and similar repositories for Nemesis:
Users that are interested in Nemesis are comparing it to the libraries listed below
- [NeurIPS-2024] The offical Implementation of "Instruction-Guided Visual Masking"☆32Updated 2 months ago
- [CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Lan…☆55Updated last month
- Official repository of DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models☆81Updated 4 months ago
- Can 3D Vision-Language Models Truly Understand Natural Language?☆21Updated 10 months ago
- [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…☆17Updated last month
- [CVPR2024] This is the official implement of MP5☆93Updated 7 months ago
- [ECCV 2024] STEVE in Minecraft is for See and Think: Embodied Agent in Virtual Environment☆35Updated last year
- [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models☆60Updated 3 months ago
- Official implementation of: Bootstrapping Language-Guided Navigation Learning with Self-Refining Data Flywheel☆15Updated last month
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆41Updated 3 months ago
- ☆65Updated last month
- Distilling Large Vision-Language Model with Out-of-Distribution Generalizability (ICCV 2023)☆54Updated 9 months ago
- A Self-Training Framework for Vision-Language Reasoning☆61Updated last week
- TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models☆27Updated 2 months ago
- Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding☆43Updated last year
- ☆14Updated last month
- ☆50Updated 3 weeks ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆62Updated 8 months ago
- Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"☆17Updated last month
- [CVPR 2024] Code for HiKER-SGG: Hierarchical Knowledge Enhanced Robust Scene Graph Generation☆67Updated 3 months ago
- Retrieval-Augmented Personalization☆12Updated last month
- Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision☆29Updated 3 months ago
- ☆32Updated last month
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆62Updated 7 months ago
- [NeurIPSw'24] This repo is the official implementation of "MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simu…☆77Updated this week
- [AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Visio…☆18Updated 3 weeks ago
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆77Updated 10 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆54Updated 7 months ago
- ☆14Updated 2 months ago
- VisualGPTScore for visio-linguistic reasoning☆26Updated last year