Alternatives and similar repositories for prompteval

Users that are interested in prompteval are comparing it to the libraries listed below

• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• UW-Madison-Lee-Lab / LanguageInterfacedFineTuning
  Code for Language-Interfaced FineTuning for Non-Language Machine Learning Tasks.
  ☆130Updated 11 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆42Updated 7 months ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆51Updated 7 months ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆109Updated last year
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆50Updated 2 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆113Updated 4 months ago
• hartvigsen-group / composable-interventions
  ☆28Updated 7 months ago
• snap-stanford / optimas
  Optimize Any User-defined Compound AI Systems
  ☆49Updated 2 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 9 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆98Updated 10 months ago
• JacksonWuxs / UsableXAI_LLM
  Using Explanations as a Tool for Advanced LLMs
  ☆67Updated last year
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆46Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆216Updated 2 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆163Updated last year
• msakarvadia / AttentionLens
  Interpretating the latent space representations of attention head outputs for LLMs
  ☆34Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆123Updated 10 months ago
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆54Updated 2 weeks ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆85Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆49Updated 8 months ago
• HazyResearch / fm_data_tasks
  Foundation Models for Data Tasks
  ☆109Updated 2 years ago
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆48Updated last year
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆111Updated 4 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 8 months ago
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆18Updated 4 months ago
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆47Updated last year
• sibyl-dev / Explingo
  Explaining ML models using LLMs
  ☆22Updated 11 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year