mlcommons / dataperf
Data Benchmarking
☆19Updated 7 months ago
Alternatives and similar repositories for dataperf:
Users that are interested in dataperf are comparing it to the libraries listed below
- In-context Example Selection with Influences☆15Updated last year
- Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.☆38Updated 8 months ago
- ☆22Updated 9 months ago
- ☆23Updated 2 months ago
- Adding new tasks to T0 without catastrophic forgetting☆32Updated 2 years ago
- Recycling diverse models☆44Updated 2 years ago
- Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.☆48Updated last year
- A supplementary code for Editable Neural Networks, an ICLR 2020 submission.☆46Updated 4 years ago
- The Codebase for Causal Distillation for Language Models (NAACL '22)☆25Updated 2 years ago
- Code for preprint: Summarizing Differences between Text Distributions with Natural Language☆42Updated last year
- Source code and data for ADEPT: A DEbiasing PrompT Framework (AAAI-23).☆14Updated last month
- Code for the ICLR 2021 Paper "In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustness"☆12Updated 3 years ago
- Tasks for describing differences between text distributions.☆16Updated 5 months ago
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆36Updated 2 years ago
- ☆13Updated 2 years ago
- ☆21Updated 8 months ago
- Code for the PAPA paper☆27Updated 2 years ago
- AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)☆46Updated 10 months ago
- ☆17Updated 2 years ago
- ☆13Updated 4 months ago
- NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models☆10Updated last year
- Official PyTorch implementation of "Neural Relation Graph: A Unified Framework for Identifying Label Noise and Outlier Data" (NeurIPS'23)☆15Updated last year
- Data for "Datamodels: Predicting Predictions with Training Data"☆94Updated last year
- ☆29Updated last year
- Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"☆15Updated 2 years ago
- Foundation Models for Data Tasks☆102Updated last year
- `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.☆55Updated 2 weeks ago
- Code for "The Expressive Power of Low-Rank Adaptation".☆19Updated 9 months ago
- Code for the paper "Studying Large Language Model Behaviors Under Context-Memory Conflicts With Real Documentss"☆12Updated 3 months ago
- Generating diverse counterfactual data for Natural Language Understanding tasks using Large Language Models (LLMs). The generator support…☆36Updated last year