socialfoundations / folktextsLinks
Evaluate uncertainty, calibration, accuracy, and fairness of LLMs on real-world survey data!
☆25Updated 6 months ago
Alternatives and similar repositories for folktexts
Users that are interested in folktexts are comparing it to the libraries listed below
Sorting:
- Extending Conformal Prediction to LLMs☆68Updated last year
- Fairness toolkit for pytorch, scikit learn and autogluon☆32Updated 2 weeks ago
- A collection of implementations of fair ML algorithms☆12Updated 7 years ago
- ☆78Updated last year
- PyTorch package to train and audit ML models for Individual Fairness☆66Updated last month
- A Natural Language Interface to Explainable Boosting Machines☆68Updated last year
- Efficient multi-prompt evaluation of LLMs☆23Updated 10 months ago
- We develop benchmarks and analysis tools to evaluate the causal reasoning abilities of LLMs.☆130Updated last year
- ☆40Updated 2 years ago
- Experimental library integrating LLM capabilities to support causal analyses☆252Updated 2 weeks ago
- PAIR.withgoogle.com and friend's work on interpretability methods☆207Updated last month
- Conformal Language Modeling☆32Updated last year
- Achieve error-rate fairness between societal groups for any score-based classifier.☆19Updated 2 months ago
- The official implementation of "The Shapley Value of Classifiers in Ensemble Games" (CIKM 2021).☆220Updated 2 years ago
- Comparing fairness-aware machine learning techniques.☆159Updated 2 years ago
- Data Benchmarking☆22Updated last year
- Explainable Artificial Intelligence through Contextual Importance and Utility☆28Updated 3 weeks ago
- The code and data for "Are Large Pre-Trained Language Models Leaking Your Personal Information?" (Findings of EMNLP '22)☆24Updated 2 years ago
- Code repository for the NAACL 2022 paper "ExSum: From Local Explanations to Model Understanding"☆64Updated 3 years ago
- Lawma: A lightly fine-tuned Llama model for legal classification tasks.☆24Updated last year
- Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning (AISTATS 2022 Oral)☆41Updated 2 years ago
- Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.☆44Updated 7 months ago
- Discovering Data-driven Hypotheses in the Wild☆114Updated 4 months ago
- Measuring data importance over ML pipelines using the Shapley value.☆43Updated 2 months ago
- ☆110Updated 8 months ago
- Adversarial Attacks on Post Hoc Explanation Techniques (LIME/SHAP)☆84Updated 2 years ago
- The Prism Alignment Project☆83Updated last year
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆20Updated 2 months ago
- ☆32Updated 3 years ago
- A lightweight library for Bayesian analysis of LLM evals (ICML 2025 Spotlight Position Paper)☆21Updated 5 months ago