Alternatives and similar repositories for prompteval

Users that are interested in prompteval are comparing it to the libraries listed below

• shuoli90 / Rank-Calibration
  This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
  ☆13Updated last year
• Tiiiger / benchmark_llm_summarization
  ☆39Updated 2 years ago
• lifan-yuan / OOD_NLP
  [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…
  ☆33Updated 2 years ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆23Updated 11 months ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆106Updated 8 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 5 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• BrachioLab / incontext_influences
  In-context Example Selection with Influences
  ☆15Updated 2 years ago
• UCSB-NLP-Chang / llm_uncertainty
  ☆30Updated last year
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 3 months ago
• LinxinS97 / NLPBench
  NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models
  ☆10Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 5 months ago
• hartvigsen-group / composable-interventions
  ☆28Updated 4 months ago
• XiangLi1999 / AutoBencher
  ☆29Updated 11 months ago
• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆26Updated 8 months ago
• SparkJiao / StructTest
  ☆18Updated 3 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 4 months ago
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆44Updated 7 months ago
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆77Updated 6 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• KaiNylund / lm-weights-encode-time
  ☆68Updated 10 months ago
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆37Updated 10 months ago
• dylan-slack / Tablet
  The TABLET benchmark for evaluating instruction learning with LLMs for tabular prediction.
  ☆21Updated 2 years ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆35Updated last year
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆55Updated 2 years ago
• Varal7 / conformal-language-modeling
  Conformal Language Modeling
  ☆30Updated last year
• SALT-NLP / DARG
  The official repo for DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph
  ☆16Updated 8 months ago
• xiamengzhou / training_trajectory_analysis
  [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf
  ☆24Updated last year
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆18Updated 2 weeks ago