Alternatives and similar repositories for prompteval

Users that are interested in prompteval are comparing it to the libraries listed below

• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆80Updated last year
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆124Updated 6 months ago
• snap-stanford / optimas
  Optimize Any User-defined Compound AI Systems
  ☆65Updated 4 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆47Updated 9 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆222Updated 2 weeks ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆170Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆31Updated 11 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆102Updated last year
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆112Updated last year
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆153Updated last year
• dmis-lab / OLAPH
  OLAPH: Improving Factuality in Biomedical Long-form Question Answering
  ☆37Updated last year
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 10 months ago
• OSU-NLP-Group / ScienceAgentBench
  [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  ☆117Updated 4 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• pgasawa / BARE
  Leveraging Base Language Models for Few-Shot Synthetic Data Generation
  ☆40Updated 2 months ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆92Updated last year
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆42Updated last year
• jongjyh / TrFr
  Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning
  ☆46Updated 2 years ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated 11 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 9 months ago
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆55Updated last year
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆173Updated 3 weeks ago
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆19Updated 6 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 9 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆91Updated last year
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆66Updated last year
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆111Updated 8 months ago