Alternatives and similar repositories for prompteval

Users that are interested in prompteval are comparing it to the libraries listed below

• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆120Updated 6 months ago
• snap-stanford / optimas
  Optimize Any User-defined Compound AI Systems
  ☆63Updated 3 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆109Updated last year
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 8 months ago
• UW-Madison-Lee-Lab / LanguageInterfacedFineTuning
  Code for Language-Interfaced FineTuning for Non-Language Machine Learning Tasks.
  ☆133Updated last year
• intuit / sac3
  Official repo for SAC3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check Consistency
  ☆37Updated 10 months ago
• shuoli90 / Rank-Calibration
  This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
  ☆13Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated 10 months ago
• JacksonWuxs / UsableXAI_LLM
  Using Explanations as a Tool for Advanced LLMs
  ☆69Updated last year
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆19Updated 6 months ago
• causalNLP / corr2cause
  Data and code for the Corr2Cause paper (ICLR 2024)
  ☆111Updated last year
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆44Updated 8 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆169Updated last year
• msakarvadia / AttentionLens
  Interpretating the latent space representations of attention head outputs for LLMs
  ☆34Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• hartvigsen-group / composable-interventions
  ☆29Updated 9 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆151Updated 5 months ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆24Updated last year
• Varal7 / conformal-language-modeling
  Conformal Language Modeling
  ☆32Updated last year
• microsoft / augmented-interpretable-models
  Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.
  ☆44Updated last month
• XiangLi1999 / AutoBencher
  ☆32Updated last year
• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆112Updated this week
• SparkJiao / StructTest
  ☆19Updated 4 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆101Updated last year
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆49Updated last year
• primeqa / clapnq
  ☆43Updated 10 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• HazyResearch / fm_data_tasks
  Foundation Models for Data Tasks
  ☆110Updated 2 years ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆130Updated last year