bethgelab / frequency_determines_performanceLinks
Code for the paper: "No Zero-Shot Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance" [NeurIPS'24]
☆90Updated last year
Alternatives and similar repositories for frequency_determines_performance
Users that are interested in frequency_determines_performance are comparing it to the libraries listed below
Sorting:
- Patching open-vocabulary models by interpolating weights☆91Updated 2 years ago
- ☆23Updated 9 months ago
- Code for T-MARS data filtering☆35Updated 2 years ago
- Code, Data and Red Teaming for ZeroBench☆46Updated 5 months ago
- [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models☆78Updated 4 months ago
- Holistic evaluation of multimodal foundation models☆48Updated last year
- ☆35Updated last year
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆31Updated 5 months ago
- Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models" ICLR 2024☆105Updated last year
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆101Updated last month
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆53Updated last year
- Repository for the paper Do SSL Models Have Déjà Vu? A Case of Unintended Memorization in Self-supervised Learning☆36Updated 2 years ago
- Official PyTorch Implementation of "Rosetta Neurons: Mining the Common Units in a Model Zoo"☆31Updated last year
- ☆41Updated last year
- ☆134Updated last month
- ☆40Updated last year
- Official implementation of the paper The Hidden Language of Diffusion Models☆74Updated last year
- If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions☆17Updated last year
- Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"☆36Updated last year
- https://arxiv.org/abs/2209.15162☆52Updated 2 years ago
- ☆26Updated last year
- Personal implementation of ASIF by Antonio Norelli☆26Updated last year
- Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)☆121Updated last year
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆56Updated last year
- ☆65Updated 2 years ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆58Updated 9 months ago
- Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…☆21Updated last year
- Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".☆78Updated 2 years ago
- ☆29Updated 2 years ago
- Original code base for On Pretraining Data Diversity for Self-Supervised Learning☆14Updated 9 months ago