Alternatives and similar repositories for dataperf

Users that are interested in dataperf are comparing it to the libraries listed below

• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• MadryLab / datamodels
  ☆30Updated 2 years ago
• lifan-yuan / OOD_NLP
  [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…
  ☆35Updated 2 years ago
• sayakpaul / robustness-foundation-models
  This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.
  ☆72Updated 2 years ago
• MadryLab / trak
  A fast, effective data attribution method for neural networks in PyTorch
  ☆220Updated 11 months ago
• mlfoundations / dataset2metadata
  ☆26Updated last year
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆57Updated 2 years ago
• OAfzal / nlp-for-peer-review
  ☆49Updated 11 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆129Updated last year
• cambridgeltl / autopeft
  AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)
  ☆49Updated last year
• Kaleidophon / nlp-uncertainty-zoo
  Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.
  ☆53Updated 2 years ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆111Updated 2 years ago
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆90Updated 2 years ago
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆41Updated last year
• hartvigsen-group / composable-interventions
  ☆28Updated 8 months ago
• VITA-Group / DP-OPT
  [ICLR'24 Spotlight] DP-OPT: Make Large Language Model Your Privacy-Preserving Prompt Engineer
  ☆46Updated last year
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆43Updated 2 years ago
• HazyResearch / fm_data_tasks
  Foundation Models for Data Tasks
  ☆110Updated 2 years ago
• ykwon0407 / dataoob
  Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data Value (ICML 2023)
  ☆20Updated 2 years ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• MiaoXiong2320 / llm-uncertainty
  code repo for ICLR 2024 paper "Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs"
  ☆133Updated last year
• naotoo1 / Beyond-Neural-Scaling
  Implementation of Beyond Neural Scaling beating power laws for deep models and prototype-based models
  ☆34Updated 3 months ago
• ZaydH / influence_analysis_papers
  Influence Analysis and Estimation - Survey, Papers, and Taxonomy
  ☆83Updated last year
• felipemaiapolo / prompteval
  Efficient multi-prompt evaluation of LLMs
  ☆23Updated 10 months ago
• openreview / openreview-py
  Official Python client library for the OpenReview API
  ☆205Updated last week
• kawine / dataset_difficulty
  "Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)
  ☆88Updated 2 years ago
• qcznlp / uncertainty_attack
  ☆21Updated last month
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 2 years ago
• vr25 / hallucination-foundation-model-survey
  A Survey of Hallucination in Large Foundation Models
  ☆55Updated last year
• ruyimarone / data-portraits
  Documenting large text datasets 🖼️ 📚
  ☆13Updated 10 months ago