Alternatives and similar repositories for dataperf

Users that are interested in dataperf are comparing it to the libraries listed below

• HazyResearch / fm_data_tasks
  Foundation Models for Data Tasks
  ☆108Updated 2 years ago
• openreview / openreview-py
  Official Python client library for the OpenReview API
  ☆203Updated this week
• LinxinS97 / NLPBench
  NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models
  ☆10Updated last year
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• JieyuZ2 / wrench
  [NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
  ☆224Updated last year
• aaronmueller / MIB
  Landing page for MIB: A Mechanistic Interpretability Benchmark
  ☆19Updated last month
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated 2 years ago
• MadryLab / datamodels
  ☆30Updated 2 years ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆111Updated 2 years ago
• zlin7 / UQ-NLG
  ☆100Updated last year
• MadryLab / trak
  A fast, effective data attribution method for neural networks in PyTorch
  ☆217Updated 10 months ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 2 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago
• sayakpaul / robustness-foundation-models
  This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.
  ☆72Updated 2 years ago
• Kaleidophon / nlp-uncertainty-zoo
  Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.
  ☆53Updated 2 years ago
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆41Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• McGill-NLP / polytropon
  ☆54Updated 2 years ago
• TRAIS-Lab / dattri
  `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.
  ☆85Updated this week
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆23Updated 6 months ago
• p-lambda / incontext-learning
  Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…
  ☆108Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆78Updated 2 years ago
• ZaydH / influence_analysis_papers
  Influence Analysis and Estimation - Survey, Papers, and Taxonomy
  ☆82Updated last year
• data-centric-ai / dcbench
  A benchmark of data-centric tasks from across the machine learning lifecycle.
  ☆72Updated 3 years ago
• hartvigsen-group / composable-interventions
  ☆28Updated 6 months ago
• behavioral-data / BLADE
  Code for Benchmarking Language Model Agents for Data-Driven Science
  ☆31Updated 11 months ago
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆47Updated last year
• mlfoundations / dataset2metadata
  ☆26Updated last year
• kawine / dataset_difficulty
  "Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)
  ☆87Updated last year
• frankaging / Causal-Distill
  The Codebase for Causal Distillation for Language Models (NAACL '22)
  ☆25Updated 3 years ago