Alternatives and similar repositories for prompteval

Users that are interested in prompteval are comparing it to the libraries listed below

• UW-Madison-Lee-Lab / LanguageInterfacedFineTuning
  Code for Language-Interfaced FineTuning for Non-Language Machine Learning Tasks.
  ☆132Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆109Updated last year
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆118Updated 5 months ago
• snap-stanford / optimas
  Optimize Any User-defined Compound AI Systems
  ☆62Updated 3 months ago
• shuoli90 / Rank-Calibration
  This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
  ☆13Updated last year
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆44Updated 8 months ago
• XZhang97666 / AlpaCare
  ☆95Updated 9 months ago
• primeqa / clapnq
  ☆42Updated 10 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆168Updated last year
• target-benchmark / target
  TARGET is a benchmark for evaluating Table Retrieval for Generative Tasks such as Fact Verification and Text-to-SQL
  ☆25Updated 4 months ago
• jongjyh / TrFr
  Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning
  ☆46Updated last year
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆87Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated 10 months ago
• microsoft / augmented-interpretable-models
  Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.
  ☆44Updated last week
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆53Updated 3 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 8 months ago
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆159Updated last week
• causalNLP / corr2cause
  Data and code for the Corr2Cause paper (ICLR 2024)
  ☆111Updated last year
• yueyu1030 / AttrPrompt
  [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
  ☆155Updated 2 years ago
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆48Updated 2 years ago
• Tiiiger / benchmark_llm_summarization
  ☆42Updated 2 years ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆218Updated 2 weeks ago
• hartvigsen-group / composable-interventions
  ☆29Updated 8 months ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated last year
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• viswavi / few-shot-clustering
  ☆80Updated last year
• SparkJiao / StructTest
  ☆19Updated 3 months ago