Alternatives and similar repositories for dataperf

Users that are interested in dataperf are comparing it to the libraries listed below

• openreview / openreview-py
  Official Python client library for the OpenReview API
  ☆221Updated this week
• cambridgeltl / autopeft
  AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)
  ☆51Updated last year
• data-centric-ai / dcbench
  A benchmark of data-centric tasks from across the machine learning lifecycle.
  ☆71Updated 3 years ago
• UCSB-NLP-Chang / llm_uncertainty
  ☆41Updated last year
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• MiaoXiong2320 / llm-uncertainty
  code repo for ICLR 2024 paper "Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs"
  ☆142Updated last year
• p-lambda / incontext-learning
  Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…
  ☆106Updated 2 years ago
• JieyuZ2 / wrench
  [NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
  ☆226Updated last year
• sayakpaul / robustness-foundation-models
  This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.
  ☆72Updated 3 years ago
• PAIR-code / interpretability
  PAIR.withgoogle.com and friend's work on interpretability methods
  ☆217Updated last week
• HazyResearch / fm_data_tasks
  Foundation Models for Data Tasks
  ☆110Updated 2 years ago
• hartvigsen-group / composable-interventions
  ☆28Updated 10 months ago
• zlin7 / UQ-NLG
  ☆103Updated last year
• eric-mitchell / mend
  MEND: Fast Model Editing at Scale
  ☆256Updated 2 years ago
• LinxinS97 / NLPBench
  NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models
  ☆10Updated 2 years ago
• lifan-yuan / OOD_NLP
  [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…
  ☆36Updated 2 years ago
• MadryLab / datamodels
  ☆32Updated 2 years ago
• kawine / dataset_difficulty
  "Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)
  ☆89Updated 2 years ago
• naotoo1 / Beyond-Neural-Scaling
  Implementation of Beyond Neural Scaling beating power laws for deep models and prototype-based models
  ☆34Updated 2 months ago
• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆118Updated last week
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆43Updated last year
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆43Updated 2 years ago
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆57Updated 2 years ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆137Updated last year
• Kaleidophon / nlp-uncertainty-zoo
  Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.
  ☆55Updated 2 years ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆109Updated 2 years ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 3 years ago
• HannahKirk / prism-alignment
  The Prism Alignment Project
  ☆87Updated last year
• sylinrl / CalibratedMath
  Teaching Models to Express Their Uncertainty in Words
  ☆39Updated 3 years ago
• MadryLab / trak
  A fast, effective data attribution method for neural networks in PyTorch
  ☆227Updated last year