bethgelab / frequency_determines_performance
Code for the paper: "No Zero-Shot Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance" [NeurIPS'24]
☆71Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for frequency_determines_performance
- ☆38Updated 3 months ago
- Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".☆34Updated 8 months ago
- M4 experiment logbook☆56Updated last year
- Code for T-MARS data filtering☆35Updated last year
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆25Updated 3 months ago
- [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…☆45Updated last month
- Sparse Linear Concept Embeddings☆67Updated 3 months ago
- Holistic evaluation of multimodal foundation models☆41Updated 3 months ago
- ☆33Updated 3 months ago
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆43Updated 5 months ago
- Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".☆78Updated last year
- Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…☆19Updated last year
- Patching open-vocabulary models by interpolating weights☆90Updated last year
- Recursive Visual Programming☆15Updated 3 months ago
- ☆25Updated 2 months ago
- Un-*** 50 billions multimodality dataset☆24Updated 2 years ago
- Official implementation of the paper The Hidden Language of Diffusion Models☆69Updated 9 months ago
- Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"☆35Updated 10 months ago
- [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation☆35Updated last month
- ☆29Updated 3 weeks ago
- ☆64Updated last year
- ☆30Updated 9 months ago
- ☆29Updated this week
- Matryoshka Multimodal Models☆81Updated last month
- A benchmark dataset and simple code examples for measuring the perception and reasoning of multi-sensor Vision Language models.☆16Updated 3 weeks ago
- Language Repository for Long Video Understanding☆28Updated 4 months ago
- Official implementation of MAIA, A Multimodal Automated Interpretability Agent☆62Updated 2 months ago
- Command-line tool for downloading and extending the RedCaps dataset.☆45Updated 10 months ago
- ☆43Updated last year