kyegomez / BRAVE-ViT-Swarm
Implementation of the paper: "BRAVE : Broadening the visual encoding of vision-language models"
☆22Updated this week
Alternatives and similar repositories for BRAVE-ViT-Swarm:
Users that are interested in BRAVE-ViT-Swarm are comparing it to the libraries listed below
- Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models☆72Updated 4 months ago
- ☆41Updated last year
- ☆35Updated 6 months ago
- ☆24Updated 3 weeks ago
- Official PyTorch Implementation for Task Vectors are Cross-Modal☆21Updated last month
- Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"☆19Updated this week
- [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…☆48Updated 3 months ago
- ☆24Updated 7 months ago
- Multimodal Video Understanding Framework (MVU)☆27Updated 8 months ago
- Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"☆35Updated last year
- ☆41Updated 2 weeks ago
- OLA-VLM: Elevating Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024☆47Updated this week
- [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation☆40Updated 3 months ago
- Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…☆20Updated last year
- Holistic evaluation of multimodal foundation models☆42Updated 5 months ago
- Official Pytorch Implementation of Self-emerging Token Labeling☆32Updated 10 months ago
- Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"☆53Updated this week
- [WACV 2025] Official implementation of "Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation" by Xiwen Wei, Guihong L…☆30Updated 2 months ago
- ☆21Updated 3 months ago
- Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆101Updated this week
- SMILE: A Multimodal Dataset for Understanding Laughter☆13Updated last year
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆118Updated 5 months ago
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆41Updated this week
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆49Updated last month
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆50Updated 5 months ago
- ☆37Updated 2 months ago
- ☆39Updated 6 months ago
- Official repository of paper "Subobject-level Image Tokenization"☆64Updated 9 months ago