Neph0s / InCharacter
Official code for the paper: InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews (previously: Do Role-Playing Chatbots Capture the Character Personalities? Assessing Personality Traits for Role-Playing Chatbots)
☆72Updated 6 months ago
Alternatives and similar repositories for InCharacter:
Users that are interested in InCharacter are comparing it to the libraries listed below
- RoleInteract: Evaluating the Social Interaction of Role-Playing Agents☆55Updated 6 months ago
- repository for CharacterChat, a personalized social support system☆70Updated 9 months ago
- Code and Data for EMNLP 2024 Paper "Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent"☆126Updated 3 weeks ago
- ☆49Updated last year
- Repo for paper "Tell Me More! Towards Implicit User Intention Understanding of Language Model Driven Agents"☆50Updated last year
- Unofficial implementation of AlpaGasus☆91Updated last year
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆74Updated 11 months ago
- Awesome papers for role-playing with language models☆186Updated 6 months ago
- A Bilingual Role Evaluation Benchmark for Large Language Models☆40Updated last year
- ☆235Updated 5 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆65Updated 5 months ago
- Official Code for "Coser: Coordinating LLM-Based Persona Simulation of Established Roles"☆59Updated last month
- A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters…☆192Updated 11 months ago
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆81Updated 2 months ago
- Reformatted Alignment☆115Updated 7 months ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆76Updated 3 months ago
- [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios☆56Updated last year
- Code and Data for the paper "Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Works".☆17Updated 9 months ago
- The official repository of the Omni-MATH benchmark.☆83Updated 4 months ago
- Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.☆150Updated last year
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆125Updated 11 months ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆101Updated 2 months ago
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆126Updated 4 months ago
- MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversation☆27Updated last year
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆150Updated 8 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆62Updated 6 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆119Updated 6 months ago
- ☆42Updated 6 months ago
- CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generation☆49Updated 2 months ago