Alternatives and similar repositories for prompteval

Users that are interested in prompteval are comparing it to the libraries listed below

• UW-Madison-Lee-Lab / LanguageInterfacedFineTuning
  Code for Language-Interfaced FineTuning for Non-Language Machine Learning Tasks.
  ☆126Updated 6 months ago
• hartvigsen-group / composable-interventions
  ☆28Updated 3 months ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆22Updated 10 months ago
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆18Updated 11 months ago
• Tiiiger / benchmark_llm_summarization
  ☆39Updated 2 years ago
• BrachioLab / incontext_influences
  In-context Example Selection with Influences
  ☆15Updated 2 years ago
• shuoli90 / Rank-Calibration
  This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
  ☆13Updated last year
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆106Updated 8 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆35Updated 9 months ago
• balevinstein / Probes
  ☆50Updated last year
• LinxinS97 / NLPBench
  NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models
  ☆10Updated last year
• kaistAI / factual-knowledge-acquisition
  ☆20Updated last month
• McGill-NLP / retriever-lm-reasoning
  Code for "Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Model", EMNLP Findings 20…
  ☆28Updated last year
• vr25 / hallucination-foundation-model-survey
  A Survey of Hallucination in Large Foundation Models
  ☆54Updated last year
• lifan-yuan / OOD_NLP
  [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…
  ☆33Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆30Updated 4 months ago
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆46Updated last year
• XiangLi1999 / AutoBencher
  ☆29Updated 10 months ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆70Updated 6 months ago
• jlko / long_hallucinations
  Codebase for reproducing the experiments of the semantic uncertainty paper (paragraph-length experiments).
  ☆60Updated last year
• SparkJiao / StructTest
  ☆17Updated 2 months ago
• OATML / semantic-entropy-probes
  ☆32Updated 10 months ago
• deeplearning-wisc / haloscope
  source code for NeurIPS'24 paper "HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detection"
  ☆45Updated last month
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 9 months ago
• technion-cs-nlp / hallucination-mitigation
  ☆22Updated 5 months ago
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆60Updated 2 years ago
• dylan-slack / Tablet
  The TABLET benchmark for evaluating instruction learning with LLMs for tabular prediction.
  ☆21Updated 2 years ago
• Cohere-Labs-Community / iterative-data-selection
  ☆28Updated 7 months ago