Flames is a highly adversarial benchmark in Chinese for LLM's harmlessness evaluation developed by Shanghai AI Lab and Fudan NLP Group.
☆68May 21, 2024Updated 2 years ago
Alternatives and similar repositories for Flames
Users that are interested in Flames are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Mar 22, 2024Updated 2 years ago
- ☆46Jun 19, 2025Updated last year
- [AAAI 2026] The Other Mind: How Language Models Exhibit Human Temporal Cognition☆13Dec 16, 2025Updated 10 months ago
- [ICML 2025] ReflectionBench: Evaluating Epistemic Agency in Large Language Models☆23Jun 24, 2025Updated last year
- [EMNLP 2024] ”ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models“☆27Jun 24, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Models☆123Feb 13, 2026Updated 8 months ago
- Open-source red teaming framework for MLLMs with 42+ attack methods☆279Jul 17, 2026Updated 3 months ago
- ☆11Oct 2, 2025Updated last year
- ☆21Aug 19, 2024Updated 2 years ago
- 面向中文大模型价值观的评估与对齐研究☆563Jul 20, 2023Updated 3 years ago
- ☆16May 16, 2025Updated last year
- This contains code to accompany the paper "A Roadmap to Pluralistic Alignment"☆11Feb 13, 2024Updated 2 years ago
- ☆16Nov 12, 2024Updated last year
- SC-Safety: 中文大模型多轮对抗安全基准☆152Mar 15, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 【ACL 2024】 SALAD benchmark & MD-Judge☆176Mar 8, 2025Updated last year
- Accepted by ECCV 2024☆222Oct 15, 2024Updated 2 years ago
- ☆15Jan 9, 2026Updated 9 months ago
- JailBench：大型语言模型越狱攻击风险评测中文数据集 [PAKDD 2025]☆193Mar 3, 2025Updated last year
- [ACL 2025] Data and Code for Paper VLSBench: Unveiling Visual Leakage in Multimodal Safety☆62Jul 21, 2025Updated last year
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆300Jul 28, 2025Updated last year
- Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。☆1,231Feb 27, 2024Updated 2 years ago
- [EMNLP'24 (Main)] DRPO(Dynamic Rewarding with Prompt Optimization) is a tuning-free approach for self-alignment. DRPO leverages a search-…☆24Nov 17, 2024Updated last year
- ☆17Oct 15, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The official code for "Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks".☆19Jun 24, 2026Updated 4 months ago
- The reinforcement learning codes for dataset SPA-VL☆48Jun 24, 2024Updated 2 years ago
- ☆18Apr 23, 2025Updated last year
- ☆30Feb 16, 2024Updated 2 years ago
- GAOGAO-Bench-Updates is a supplement to the GAOKAO-Bench, a dataset to evaluate large language models.☆50Jan 7, 2025Updated last year
- ☆17Nov 3, 2024Updated last year
- Dataset and evaluation code for measuring hallucinations in Chinese large language models☆140Jun 5, 2024Updated 2 years ago
- ☆10Jan 13, 2024Updated 2 years ago
- [EMNLP 2023 Demo] "CLEVA: Chinese Language Models EVAluation Platform"☆65May 16, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆34Sep 15, 2025Updated last year
- ☆84Mar 11, 2025Updated last year
- Xmixers: A collection of SOTA efficient token/channel mixers☆29Sep 4, 2025Updated last year
- ☆26Jun 22, 2025Updated last year
- Albert for Conversational Question Answering Challenge☆21Jun 12, 2023Updated 3 years ago
- UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)☆20Jul 6, 2021Updated 5 years ago
- A curated reading list for large language model (LLM) alignment. Take a look at our new survey "Large Language Model Alignment: A Survey"…☆82Sep 28, 2023Updated 3 years ago