bethgelab / frequency_determines_performanceLinks
Code for the paper: "No Zero-Shot Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance" [NeurIPS'24]
☆90Updated last year
Alternatives and similar repositories for frequency_determines_performance
Users that are interested in frequency_determines_performance are comparing it to the libraries listed below
Sorting:
- Code, Data and Red Teaming for ZeroBench☆46Updated 3 months ago
- ☆22Updated 6 months ago
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆29Updated 3 months ago
- ☆41Updated last year
- Holistic evaluation of multimodal foundation models☆48Updated 11 months ago
- [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models☆77Updated 2 months ago
- Patching open-vocabulary models by interpolating weights☆91Updated last year
- ☆129Updated 11 months ago
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆53Updated last year
- ☆34Updated last year
- Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"☆36Updated 11 months ago
- Code for T-MARS data filtering☆35Updated last year
- ☆39Updated last year
- Official implementation of the paper The Hidden Language of Diffusion Models☆74Updated last year
- If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions☆17Updated last year
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆210Updated this week
- Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind☆66Updated 10 months ago
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆74Updated 10 months ago
- Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)☆120Updated last year
- Official implementation of MAIA, A Multimodal Automated Interpretability Agent☆83Updated last month
- ☆26Updated last year
- [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …☆60Updated 9 months ago
- ☆65Updated last year
- Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…☆21Updated last year
- Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models".☆102Updated last year
- Matryoshka Multimodal Models☆112Updated 6 months ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆57Updated 7 months ago
- Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"☆36Updated last year
- Official pytorch implementation of "Interpreting the Second-Order Effects of Neurons in CLIP"☆39Updated 8 months ago
- ☆51Updated last year