Alternatives and similar repositories for prompteval

Users that are interested in prompteval are comparing it to the libraries listed below

• UW-Madison-Lee-Lab / LanguageInterfacedFineTuning
  Code for Language-Interfaced FineTuning for Non-Language Machine Learning Tasks.
  ☆130Updated 9 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated 7 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆109Updated 2 months ago
• msakarvadia / AttentionLens
  Interpretating the latent space representations of attention head outputs for LLMs
  ☆34Updated last year
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆110Updated 11 months ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆85Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆96Updated 9 months ago
• XiangLi1999 / AutoBencher
  ☆31Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆26Updated 7 months ago
• jongjyh / TrFr
  Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning
  ☆46Updated last year
• XZhang97666 / AlpaCare
  ☆91Updated 6 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 11 months ago
• mlfoundations / rtfm
  Research on Tabular Foundation Models
  ☆55Updated 8 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆214Updated last month
• Tiiiger / benchmark_llm_summarization
  ☆41Updated 2 years ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 5 months ago
• rimon15 / evil_twins
  Code for the paper: Prompts have evil twins (EMNLP 2024)
  ☆18Updated 6 months ago
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆49Updated 9 months ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆44Updated last month
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆135Updated last year
• JacksonWuxs / UsableXAI_LLM
  Using Explanations as a Tool for Advanced LLMs
  ☆67Updated 11 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 5 months ago
• microsoft / augmented-interpretable-models
  Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.
  ☆43Updated 6 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆51Updated 5 months ago
• SparkJiao / StructTest
  ☆19Updated last month
• hartvigsen-group / composable-interventions
  ☆28Updated 6 months ago
• alexa / places
  This is the code for our paper: PLACES: Prompting Language Models for Social Conversation Synthesis
  ☆11Updated 2 years ago
• SalesforceAIResearch / FaithEval
  ☆47Updated 2 months ago