bethgelab / frequency_determines_performance
Code for the paper: "No Zero-Shot Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance" [NeurIPS'24]
☆90Updated last year
Alternatives and similar repositories for frequency_determines_performance
Users that are interested in frequency_determines_performance are comparing it to the libraries listed below
Sorting:
- ☆41Updated 9 months ago
- Code, Data and Red Teaming for ZeroBench☆46Updated 2 weeks ago
- Patching open-vocabulary models by interpolating weights☆91Updated last year
- ☆22Updated 4 months ago
- Official PyTorch Implementation of "Rosetta Neurons: Mining the Common Units in a Model Zoo"☆30Updated last year
- ☆120Updated 8 months ago
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆205Updated this week
- Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".☆78Updated 2 years ago
- Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models".☆102Updated 11 months ago
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…☆124Updated 10 months ago
- [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation☆43Updated 7 months ago
- M4 experiment logbook☆57Updated last year
- 🦾 EvalGIM (pronounced as "EvalGym") is an evaluation library for generative image models. It enables easy-to-use, reproducible automatic…☆74Updated 4 months ago
- [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision☆62Updated 10 months ago
- ☆32Updated last year
- Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models☆77Updated this week
- Code release for "Improved baselines for vision-language pre-training"☆60Updated last year
- ☆47Updated last year
- Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)☆33Updated last year
- 🔥 [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"☆27Updated 3 months ago
- [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…☆69Updated 8 months ago
- Video descriptions of research papers relating to foundation models and scaling☆31Updated 2 years ago
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆51Updated 11 months ago
- Procedural Image Programs for Representation Learning - NeurIPS 2022☆33Updated 7 months ago
- Recursive Visual Programming (ECCV 2024)☆17Updated 5 months ago
- ☆50Updated last month
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆22Updated 2 weeks ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆54Updated 5 months ago
- Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"☆36Updated last year
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Updated last year