Alternatives and similar repositories for prompteval

Users that are interested in prompteval are comparing it to the libraries listed below

• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆161Updated last year
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆111Updated 3 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆42Updated 6 months ago
• UW-Madison-Lee-Lab / LanguageInterfacedFineTuning
  Code for Language-Interfaced FineTuning for Non-Language Machine Learning Tasks.
  ☆130Updated 10 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆18Updated 3 months ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆108Updated 11 months ago
• causalNLP / corr2cause
  Data and code for the Corr2Cause paper (ICLR 2024)
  ☆111Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated 8 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆51Updated 6 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆216Updated last month
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆72Updated last year
• Tiiiger / benchmark_llm_summarization
  ☆41Updated 2 years ago
• shuoli90 / Rank-Calibration
  This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
  ☆13Updated last year
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 7 months ago
• jongjyh / TrFr
  Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning
  ☆46Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆97Updated 9 months ago
• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆91Updated 2 weeks ago
• bhaweshiitk / ConformalLLM
  Extending Conformal Prediction to LLMs
  ☆67Updated last year
• msakarvadia / AttentionLens
  Interpretating the latent space representations of attention head outputs for LLMs
  ☆34Updated last year
• SALT-NLP / demonstrated-feedback
  ☆127Updated 11 months ago
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆49Updated 10 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆88Updated last year
• XiangLi1999 / AutoBencher
  ☆31Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 8 months ago
• ChicagoHAI / hypothesis-generation
  This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…
  ☆87Updated last week
• hartvigsen-group / composable-interventions
  ☆28Updated 6 months ago
• target-benchmark / target
  TARGET is a benchmark for evaluating Table Retrieval for Generative Tasks such as Fact Verification and Text-to-SQL
  ☆23Updated 2 months ago