Alternatives and similar repositories for PersonaGym

Users that are interested in PersonaGym are comparing it to the libraries listed below

• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆40Updated 2 years ago
• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆26Updated 8 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆73Updated last month
• ScalerLab / JudgeBench
  ☆86Updated 7 months ago
• joeljang / RLPHF
  Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
  ☆107Updated last year
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆35Updated last year
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆69Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆50Updated 3 weeks ago
• scandukuri / assistant-gate
  ☆25Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 5 months ago
• kevinwu23 / StanfordClashEval
  ☆36Updated 5 months ago
• XiangLi1999 / AutoBencher
  ☆29Updated 11 months ago
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆44Updated 11 months ago
• shadowkiller33 / Contrast-Instruction
  ☆19Updated last year
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆114Updated 5 months ago
• awslabs / rag-qa-arena
  ☆45Updated 10 months ago
• ytyz1307zzh / Auto-Instruct
  Code repo for EMNLP 2023 paper "Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models"
  ☆22Updated last year
• abhika-m / FAVA
  ☆72Updated last year
• csitfun / LogiCoT
  the instructions and demonstrations for building a formal logical reasoning capable GLM
  ☆53Updated 9 months ago
• Zayne-sprague / MuSR
  ☆44Updated 10 months ago
• jiangjiechen / auction-arena
  Source code for our paper: "Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction A…
  ☆45Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆89Updated 6 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 9 months ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆19Updated last year
• sotopia-lab / sotopia-pi
  Sotopia-π: Interactive Learning of Socially Intelligent Language Agents (ACL 2024)
  ☆65Updated last year
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆60Updated 2 years ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆54Updated last year