Alternatives and similar repositories for prompteval:

Users that are interested in prompteval are comparing it to the libraries listed below

• stanford-crfm / air-bench-2024
  AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies
  ☆19Updated 8 months ago
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆17Updated 9 months ago
• XiangLi1999 / AutoBencher
  ☆27Updated 9 months ago
• jongjyh / TrFr
  Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning
  ☆46Updated last year
• JacksonWuxs / UsableXAI_LLM
  Using Explanations as a Tool for Advanced LLMs
  ☆60Updated 7 months ago
• baixianghuang / HalluEditBench
  Can Knowledge Editing Really Correct Hallucinations? (ICLR 2025)
  ☆12Updated 2 months ago
• hartvigsen-group / composable-interventions
  ☆28Updated last month
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆104Updated 6 months ago
• psunlpgroup / ReaLMistake
  This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".
  ☆28Updated 8 months ago
• SparkJiao / StructTest
  ☆15Updated last month
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆53Updated 2 years ago
• shuoli90 / Rank-Calibration
  This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
  ☆12Updated last year
• UW-Madison-Lee-Lab / LanguageInterfacedFineTuning
  Code for Language-Interfaced FineTuning for Non-Language Machine Learning Tasks.
  ☆125Updated 5 months ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆16Updated last year
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆21Updated 9 months ago
• LinxinS97 / NLPBench
  NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models
  ☆10Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 3 months ago
• lingchen0331 / UQ_ICL
  Uncertainty quantification for in-context learning of large language models
  ☆16Updated last year
• McGill-NLP / CHASE
  Synthetic Data Generation for Evaluation
  ☆12Updated 2 months ago
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆35Updated 8 months ago
• thestephencasper / explore_establish_exploit_llms
  ☆31Updated last year
• yikee / Knowledge_Conflict
  ✨ Resolving Knowledge Conflicts in Large Language Models, COLM 2024
  ☆16Updated 6 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• csinva / tree-prompt
  Tree prompting: easy-to-use scikit-learn interface for improved prompting.
  ☆35Updated last year
• microsoft / augmented-interpretable-models
  Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.
  ☆42Updated last month
• ExtensityAI / benchmark
  Evaluation of neuro-symbolic engines
  ☆35Updated 8 months ago
• Tiiiger / benchmark_llm_summarization
  ☆39Updated 2 years ago
• awwang10 / llmpromptboosting
  Accompanying code for "Boosted Prompt Ensembles for Large Language Models"
  ☆30Updated 2 years ago
• xiamengzhou / training_trajectory_analysis
  [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf
  ☆23Updated last year