An automated pipeline for evaluating LLMs for role-playing.
☆208Sep 14, 2024Updated last year
Alternatives and similar repositories for RPBench-Auto
Users that are interested in RPBench-Auto are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆290May 27, 2025Updated 10 months ago
- Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas☆1,001Dec 14, 2025Updated 3 months ago
- Awesome papers for role-playing with language models☆218Nov 3, 2024Updated last year
- A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters…☆210May 28, 2024Updated last year
- ☆50May 19, 2025Updated 10 months ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- SuperCLUE-Role中文原生角色扮演测评基准☆36Apr 3, 2024Updated last year
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆136Jan 9, 2025Updated last year
- [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".☆94Nov 8, 2025Updated 4 months ago
- RoleInteract: Evaluating the Social Interaction of Role-Playing Agents☆68Oct 12, 2024Updated last year
- RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models☆521Oct 11, 2024Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆54Jun 6, 2025Updated 9 months ago
- A benchmark for role-playing language models☆116May 25, 2025Updated 10 months ago
- ☆10Jul 6, 2023Updated 2 years ago
- official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…☆72Apr 2, 2025Updated 11 months ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆1,506Feb 19, 2025Updated last year
- Chat凉宫春日, An open sourced Role-Playing chatbot Cheng Li, Ziang Leng, and others.☆2,075Aug 13, 2024Updated last year
- [EMNLP'24] CharacterGLM: Customizing Chinese Conversational AI Characters with Large Language Models☆495Oct 2, 2025Updated 5 months ago
- Official Code Repository for paper "HYDRA: Model Factorization Framework for Black-Box LLM Personalization"☆16Oct 7, 2024Updated last year
- The plan which extend ChatHaruhi into Zero-shot Roleplaying model☆115Apr 12, 2024Updated last year
- Dialogue Action Tokens: Steering Language Models in Goal-Directed Dialogue with a Multi-Turn Planner☆31Jun 27, 2024Updated last year
- A Bilingual Role Evaluation Benchmark for Large Language Models☆43Jan 9, 2024Updated 2 years ago
- [AAAI'25] CharacterBench: Benchmarking Character Customization of Large Language Models☆21Aug 1, 2025Updated 7 months ago
- SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2☆136Nov 16, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Based on the Evol-character framework and OpenAI API, enabling fine-grained role-playing data generation 🎭🧩.☆30Feb 1, 2024Updated 2 years ago
- Official code for the paper: InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews (previo…☆94May 27, 2025Updated 10 months ago
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆272Jan 27, 2025Updated last year
- ☆18Oct 8, 2024Updated last year
- verl: Volcano Engine Reinforcement Learning for LLMs☆20,097Updated this week
- [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens☆25Nov 6, 2023Updated 2 years ago
- ☆21Sep 5, 2023Updated 2 years ago
- Test-time compute in information retrieval☆54Jul 8, 2025Updated 8 months ago
- A flexible and efficient training framework for large-scale alignment tasks☆451Oct 23, 2025Updated 5 months ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- A general framework used on evaluating the performance of large language models (LLMs) based on the peer review mechanism among LLMs☆19Aug 3, 2024Updated last year
- ☆36Feb 21, 2025Updated last year
- SummScreen: A Dataset for Abstractive Screenplay Summarization (ACL 2022)☆41May 22, 2022Updated 3 years ago
- Use the tokenizer in parallel to achieve superior acceleration☆20Mar 21, 2024Updated 2 years ago
- 🧙🏻 Code and benchmark for our Findings of ACL 2024 paper - "TimeChara: Evaluating Point-in-Time Character Hallucination of Role-Playing…☆21Dec 20, 2024Updated last year
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆25Jun 6, 2025Updated 9 months ago
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & TIS & vLLM & Ray & Async RL)☆9,231Updated this week