Alternatives and similar repositories for prompteval

Users that are interested in prompteval are comparing it to the libraries listed below

• snap-stanford / optimas
  Optimize Any User-defined Compound AI Systems
  ☆66Updated 5 months ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆112Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆169Updated last year
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆127Updated 7 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆80Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆102Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 10 months ago
• XZhang97666 / AlpaCare
  ☆94Updated 11 months ago
• wshi83 / EhrAgent
  [EMNLP'24] EHRAgent: Code Empowers Large Language Models for Complex Tabular Reasoning on Electronic Health Records
  ☆118Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated last year
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆153Updated last year
• yikee / ScienceMeter
  ScienceMeter: Tracking Scientific Knowledge Updates in Language Models
  ☆17Updated 6 months ago
• bhaweshiitk / ConformalLLM
  Extending Conformal Prediction to LLMs
  ☆69Updated last year
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆96Updated 3 months ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• shuoli90 / Rank-Calibration
  This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
  ☆13Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆42Updated last year
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆47Updated 10 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆161Updated 6 months ago
• zorazrw / workflow-induction-toolkit
  A toolkit to induce interpretable workflows from raw computer-use activities.
  ☆35Updated 2 months ago
• JacksonWuxs / UsableXAI_LLM
  Using Explanations as a Tool for Advanced LLMs
  ☆68Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆222Updated last month
• ServiceNow / insight-bench
  ☆58Updated 3 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆32Updated last year
• poloclub / LLM-Attributor
  LLM Attributor: Attribute LLM's Generated Text to Training Data
  ☆70Updated 4 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆91Updated last year
• dmis-lab / OLAPH
  OLAPH: Improving Factuality in Biomedical Long-form Question Answering
  ☆37Updated last year
• hartvigsen-group / composable-interventions
  ☆28Updated 10 months ago
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year