Alternatives and similar repositories for dataperf

Users that are interested in dataperf are comparing it to the libraries listed below

• zlin7 / UQ-NLG
  ☆96Updated last year
• openreview / openreview-py
  Official Python client library for the OpenReview API
  ☆191Updated last week
• p-lambda / incontext-learning
  Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…
  ☆108Updated last year
• MadryLab / datamodels-data
  Data for "Datamodels: Predicting Predictions with Training Data"
  ☆97Updated 2 years ago
• JieyuZ2 / wrench
  [NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
  ☆224Updated last year
• MadryLab / datamodels
  ☆30Updated 2 years ago
• LinxinS97 / NLPBench
  NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models
  ☆10Updated last year
• salesforce / fast-influence-functions
  ☆89Updated 3 months ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated 2 years ago
• Kaleidophon / nlp-uncertainty-zoo
  Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.
  ☆53Updated 2 years ago
• mlfoundations / dataset2metadata
  ☆26Updated last year
• causalNLP / corr2cause
  Data and code for the Corr2Cause paper (ICLR 2024)
  ☆108Updated last year
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆38Updated 2 years ago
• HazyResearch / fm_data_tasks
  Foundation Models for Data Tasks
  ☆108Updated 2 years ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• jmerullo / lm_vector_arithmetic
  ☆35Updated 2 years ago
• sayakpaul / robustness-foundation-models
  This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.
  ☆71Updated 2 years ago
• kawine / dataset_difficulty
  "Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)
  ☆87Updated last year
• JieyuZ2 / Awesome-Weak-Supervision
  A curated list of programmatic weak supervision papers and resources
  ☆190Updated 2 years ago
• lifan-yuan / OOD_NLP
  [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…
  ☆34Updated 2 years ago
• xiamengzhou / training_trajectory_analysis
  [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf
  ☆24Updated last year
• guy-dar / embedding-space
  ☆54Updated 2 years ago
• causalNLP / cladder
  We develop benchmarks and analysis tools to evaluate the causal reasoning abilities of LLMs.
  ☆119Updated last year
• ZaydH / influence_analysis_papers
  Influence Analysis and Estimation - Survey, Papers, and Taxonomy
  ☆80Updated last year
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆55Updated 2 years ago
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆46Updated last year
• cambridgeltl / autopeft
  AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)
  ☆46Updated last year
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆38Updated 11 months ago
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆23Updated 4 months ago
• McGill-NLP / polytropon
  ☆54Updated 2 years ago