An automated pipeline for evaluating LLMs for role-playing.
☆206Sep 14, 2024Updated last year
Alternatives and similar repositories for RPBench-Auto
Users that are interested in RPBench-Auto are comparing it to the libraries listed below
Sorting:
- ☆287May 27, 2025Updated 9 months ago
- Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas☆987Dec 14, 2025Updated 2 months ago
- Awesome papers for role-playing with language models☆218Nov 3, 2024Updated last year
- A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters…☆211May 28, 2024Updated last year
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆137Jan 9, 2025Updated last year
- SuperCLUE-Role中文原生角色扮演测评基准☆36Apr 3, 2024Updated last year
- [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".☆94Nov 8, 2025Updated 3 months ago
- RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models☆520Oct 11, 2024Updated last year
- RoleInteract: Evaluating the Social Interaction of Role-Playing Agents☆68Oct 12, 2024Updated last year
- ☆50May 19, 2025Updated 9 months ago
- Repository for the EMNLP 2023 Demo Paper "Reaction Miner: An Integrated System for Chemical Reaction Extraction from Textual Data"☆19Jan 27, 2025Updated last year
- coded with and corrected by Google Anti-Gravity☆13Nov 23, 2025Updated 3 months ago
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆1,475Feb 19, 2025Updated last year
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆25Jun 6, 2025Updated 8 months ago
- Official code for the paper: InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews (previo…☆91May 27, 2025Updated 9 months ago
- Chat凉宫春日, An open sourced Role-Playing chatbot Cheng Li, Ziang Leng, and others.☆2,067Aug 13, 2024Updated last year
- ☆10Jul 6, 2023Updated 2 years ago
- [EMNLP'24] CharacterGLM: Customizing Chinese Conversational AI Characters with Large Language Models☆490Oct 2, 2025Updated 5 months ago
- SummScreen: A Dataset for Abstractive Screenplay Summarization (ACL 2022)☆41May 22, 2022Updated 3 years ago
- SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2☆135Nov 16, 2024Updated last year
- ☆112Oct 11, 2024Updated last year
- A Bilingual Role Evaluation Benchmark for Large Language Models☆43Jan 9, 2024Updated 2 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Jun 28, 2023Updated 2 years ago
- triton ver of gqa flash attn, based on the tutorial☆12Aug 4, 2024Updated last year
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- 一个批量下载人人网相册照片的工具。☆10Nov 15, 2018Updated 7 years ago
- ☆11Jan 3, 2024Updated 2 years ago
- https://xuruowei.com 是她的家人朋友们和她的爱人高策为纪念她留下的。徐若薇于 2026 年 2 月 28 日离世。我们希望通过这个时间线纪念她的一生——照片、故事、文字、音乐与她钟爱的一切。沿着她生命的轨迹漫步,重新触摸那些有温度的瞬间。☆27Updated this week
- Code and Data for the paper "Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Works".☆21Jul 24, 2024Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆53Jun 6, 2025Updated 8 months ago
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated last year
- ☆18Jun 14, 2025Updated 8 months ago
- Conic10K: A large-scale dataset for closed-vocabulary math problem understanding. Accepted to EMNLP2023 Findings.☆31Dec 6, 2023Updated 2 years ago
- verl: Volcano Engine Reinforcement Learning for LLMs☆19,519Updated this week
- A flexible and efficient training framework for large-scale alignment tasks☆451Oct 23, 2025Updated 4 months ago
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆189Dec 9, 2025Updated 2 months ago
- ☆10Oct 6, 2015Updated 10 years ago
- ☆12Jan 9, 2024Updated 2 years ago
- Dynamic bindings from R to the Qt library☆20Jul 16, 2025Updated 7 months ago