An automated pipeline for evaluating LLMs for role-playing.
☆212Sep 14, 2024Updated last year
Alternatives and similar repositories for RPBench-Auto
Users that are interested in RPBench-Auto are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆299May 27, 2025Updated last year
- Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas☆1,045Jun 19, 2026Updated 2 weeks ago
- Awesome papers for role-playing with language models☆229Nov 3, 2024Updated last year
- A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters…☆212May 28, 2024Updated 2 years ago
- ☆50May 19, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- SuperCLUE-Role中文原生角色扮演测评基准☆38Apr 3, 2024Updated 2 years ago
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆136Jan 9, 2025Updated last year
- RoleInteract: Evaluating the Social Interaction of Role-Playing Agents☆70Oct 12, 2024Updated last year
- RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models☆527Oct 11, 2024Updated last year
- [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".☆101Nov 8, 2025Updated 8 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆54Jun 6, 2025Updated last year
- A benchmark for role-playing language models☆120May 25, 2025Updated last year
- ☆10Jul 6, 2023Updated 3 years ago
- ☆116Oct 11, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆1,610Feb 19, 2025Updated last year
- Chat凉宫春日, An open sourced Role-Playing chatbot Cheng Li, Ziang Leng, and others.☆2,098Aug 13, 2024Updated last year
- [EMNLP'24] CharacterGLM: Customizing Chinese Conversational AI Characters with Large Language Models☆506Oct 2, 2025Updated 9 months ago
- Official Code Repository for paper "HYDRA: Model Factorization Framework for Black-Box LLM Personalization"☆16Oct 7, 2024Updated last year
- The plan which extend ChatHaruhi into Zero-shot Roleplaying model☆114Apr 12, 2024Updated 2 years ago
- Dialogue Action Tokens: Steering Language Models in Goal-Directed Dialogue with a Multi-Turn Planner☆31Jun 27, 2024Updated 2 years ago
- A Bilingual Role Evaluation Benchmark for Large Language Models☆43Jan 9, 2024Updated 2 years ago
- Based on the Evol-character framework and OpenAI API, enabling fine-grained role-playing data generation 🎭🧩.☆29Feb 1, 2024Updated 2 years ago
- Official code for the paper: InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews (previo…☆99May 27, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2☆145Nov 16, 2024Updated last year
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆272Jan 27, 2025Updated last year
- Codes for "Benchmarking the Generation of Fact Checking Explanations"☆10Aug 16, 2024Updated last year
- [AAAI'25] CharacterBench: Benchmarking Character Customization of Large Language Models☆23Aug 1, 2025Updated 11 months ago
- ☆18Oct 8, 2024Updated last year
- ☆10Oct 6, 2015Updated 10 years ago
- [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens☆25Nov 6, 2023Updated 2 years ago
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆22,312Updated this week
- A flexible and efficient training framework for large-scale alignment tasks☆453Oct 23, 2025Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systems☆82Jun 27, 2026Updated last week
- A general framework used on evaluating the performance of large language models (LLMs) based on the peer review mechanism among LLMs☆19Aug 3, 2024Updated last year
- ☆36Feb 21, 2025Updated last year
- Test-time compute in information retrieval☆59Jul 8, 2025Updated last year
- Conic10K: A large-scale dataset for closed-vocabulary math problem understanding. Accepted to EMNLP2023 Findings.☆34Dec 6, 2023Updated 2 years ago
- 🧙🏻 Code and benchmark for our Findings of ACL 2024 paper - "TimeChara: Evaluating Point-in-Time Character Hallucination of Role-Playing…☆21Dec 20, 2024Updated last year
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆26Jun 6, 2025Updated last year