[ICLR2024] (EvALign-ICL Benchmark) Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context Learning
☆22Mar 1, 2024Updated 2 years ago
Alternatives and similar repositories for EvALign-ICL
Users that are interested in EvALign-ICL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Nov 6, 2022Updated 4 years ago
- GAN(TK)²: GAN Neural Tangent Kernel ToolKit☆13Jul 12, 2022Updated 4 years ago
- [CVPR 2024] How to Configure Good In-Context Sequence for Visual Question Answering☆21May 28, 2025Updated last year
- Code for Environment Inference for Invariant Learning (ICML 2021 Paper)☆52Jun 10, 2021Updated 5 years ago
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆45Oct 24, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Source code for the Nature Machine Intelligence paper: When and how convolutional neural networks generalize to out-of-distribution categ…☆24Feb 26, 2022Updated 4 years ago
- The repository for the official Biased Action Recognition (BAR) dataset for the paper Learning from Failure: Training Debiased Classifier…☆35Nov 10, 2020Updated 5 years ago
- ☆18Oct 29, 2021Updated 5 years ago
- Repo for ICCV 2021 paper: Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering☆29Jul 1, 2024Updated 2 years ago
- Calculator that computes statistical power, MDE and required sample size for switchback experiments; based on paper Pankratev (2026) 'Pow…☆58Sep 3, 2026Updated 2 months ago
- Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…☆41May 19, 2023Updated 3 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆61Jan 10, 2021Updated 5 years ago
- Demonstrates failures of bias mitigation methods under varying types/levels of biases (WACV 2021)☆26Mar 31, 2024Updated 2 years ago
- Official Implementation for CVPR 2023 paper "Divide and Conquer: Answering Questions with Object Factorization and Compositional Reasonin…☆10Jun 16, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [TIP 2024] The official code of paper "Knowledge-Augmented Visual Question Answering with Natural Language Explanation"☆10Feb 27, 2024Updated 2 years ago
- Siamese network for unsupervised speech representation learning☆11Oct 12, 2018Updated 8 years ago
- Local self-attention in Transformer for visual question answering☆13Mar 17, 2024Updated 2 years ago
- reproduces experiments from "Grounding inductive biases in natural images: invariance stems from variations in data"☆17Sep 25, 2024Updated 2 years ago
- ☆13Jun 3, 2024Updated 2 years ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Jun 3, 2024Updated 2 years ago
- Evaluation codes of "From Images to Textual Prompts: Zero-shot VQA with Frozen Large Language Models".☆18May 15, 2023Updated 3 years ago
- ☆21Oct 10, 2023Updated 3 years ago
- ☆113Sep 20, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Implementing FastSent in theano☆12May 2, 2016Updated 10 years ago
- ImageNet Testbed, associated with the paper "Measuring Robustness to Natural Distribution Shifts in Image Classification."☆119Aug 5, 2023Updated 3 years ago
- ☆18May 25, 2022Updated 4 years ago
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆31Jan 31, 2023Updated 3 years ago
- Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"☆48Feb 19, 2026Updated 8 months ago
- Repository for the CLEVR-Hans dataset☆12Mar 11, 2021Updated 5 years ago
- Code release for Hu et al., Explainable Neural Computation via Stack Neural Module Networks. in ECCV, 2018☆71Nov 17, 2019Updated 6 years ago
- ☆35Mar 13, 2021Updated 5 years ago
- Codebase for AAAI 2024 conference paper Visual Chain-of-Thought Prompting for Knowledge-based Visual Reasoning☆40Mar 12, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation☆45Feb 27, 2023Updated 3 years ago
- ☆17Dec 13, 2023Updated 2 years ago
- Official Implementation of MICCAI 2024 paper "Depth-Driven Geometric Prompt Learning for Laparoscopic Liver Landmark Detection"☆20Feb 6, 2026Updated 9 months ago
- A simple but well-performing "single-hop" visual attention model for the GQA dataset☆20Aug 8, 2019Updated 7 years ago
- 基于 FISCO BCOS / Vechain 的 超级 NFT 平台。☆11May 11, 2021Updated 5 years ago
- ☆12Jul 16, 2023Updated 3 years ago
- [NeurIPS 2024] This is the official repository for our paper: ''Expanding Sparse Tuning for Low Memory Usage''.☆24Nov 8, 2025Updated 11 months ago