clinicalml / human_ai_deferral
Human-AI Deferral Evaluation Benchmark (Learning to Defer) AISTATS23
☆19Updated last year
Alternatives and similar repositories for human_ai_deferral:
Users that are interested in human_ai_deferral are comparing it to the libraries listed below
- Conformal prediction for controlling monotonic risk functions. Simple accompanying PyTorch code for conformal risk control in computer vi…☆62Updated 2 years ago
- Conformal Language Modeling☆28Updated last year
- Extending Conformal Prediction to LLMs☆63Updated 8 months ago
- Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Control☆66Updated 3 months ago
- Code for Learning to Defer to Multiple Experts: Consistent Surrogate Losses, Confidence Calibration, and Conformal Ensembles [AISTATS'23]☆12Updated last year
- ☆20Updated 2 months ago
- An Empirical Framework for Domain Generalization In Clinical Settings☆29Updated 2 years ago
- Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning (AISTATS 2022 Oral)☆40Updated 2 years ago
- [ICML 2023] Change is Hard: A Closer Look at Subpopulation Shift☆105Updated last year
- ☆14Updated 2 years ago
- A statistical toolkit for scientific discovery using machine learning☆73Updated 7 months ago
- Library implementing state-of-the-art Concept-based and Disentanglement Learning methods for Explainable AI☆52Updated 2 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆55Updated last year
- Locally Valid and Discriminative Prediction Intervals for Deep Learning Models☆13Updated last year
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆148Updated 2 years ago
- Official repository for CMU Machine Learning Department's 10732: Robustness and Adaptivity in Shifting Environments☆73Updated 2 years ago
- This repository contains the implementation of SimplEx, a method to explain the latent representations of black-box models with the help …☆24Updated 2 years ago
- This repository contains a Jax implementation of conformal training corresponding to the ICLR'22 paper "learning optimal conformal classi…☆129Updated 2 years ago
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated 2 years ago
- Unofficial implementation of Conformal Language Modeling by Quach et al☆29Updated last year
- Code accompanying paper: Meta-Learning to Improve Pre-Training☆37Updated 3 years ago
- A benchmark for distribution shift in tabular data☆50Updated 8 months ago
- Experiments to reproduce results in Interventional Causal Representation Learning.☆25Updated 2 years ago
- Code for the paper "Getting a CLUE: A Method for Explaining Uncertainty Estimates"☆35Updated 9 months ago
- Code for Language-Interfaced FineTuning for Non-Language Machine Learning Tasks.☆122Updated 3 months ago
- A collection of resources and information for concrete skills that are helpful when pursuing a PhD in computer science (specifically in M…☆23Updated last year
- ☆44Updated 2 years ago
- A package for conformal prediction with conditional guarantees.☆50Updated 3 weeks ago
- A fast, effective data attribution method for neural networks in PyTorch☆192Updated 3 months ago
- ☆83Updated 7 months ago