Flames is a highly adversarial benchmark in Chinese for LLM's harmlessness evaluation developed by Shanghai AI Lab and Fudan NLP Group.
☆68May 21, 2024Updated 2 years ago
Alternatives and similar repositories for Flames
Users that are interested in Flames are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Mar 22, 2024Updated 2 years ago
- ☆46Jun 19, 2025Updated last year
- ☆11Oct 2, 2025Updated last year
- [ICML 2025] ReflectionBench: Evaluating Epistemic Agency in Large Language Models☆23Jun 24, 2025Updated last year
- The official implementation for the paper "From Sparse Decisions to Dense Reasoning: A Multi-attribute Trajectory Paradigm for Multimodal…☆13Feb 11, 2026Updated 9 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Speak Freely, Connect Kindly☆10Oct 31, 2025Updated last year
- ☆31Aug 9, 2023Updated 3 years ago
- Open-source red teaming framework for MLLMs with 42+ attack methods☆281Jul 17, 2026Updated 4 months ago
- [EMNLP 2024] ”ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models“☆13Oct 24, 2024Updated 2 years ago
- [EMNLP 2024] ”ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models“☆27Jun 24, 2024Updated 2 years ago
- ☆16Nov 12, 2024Updated 2 years ago
- S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Models☆123Feb 13, 2026Updated 9 months ago
- 面向中文大模型价值观的评估与对齐研究☆561Jul 20, 2023Updated 3 years ago
- ☆13Jun 17, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆21Aug 19, 2024Updated 2 years ago
- SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Types☆26Nov 29, 2024Updated last year
- ☆16May 16, 2025Updated last year
- This contains code to accompany the paper "A Roadmap to Pluralistic Alignment"☆11Feb 13, 2024Updated 2 years ago
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆301Jul 28, 2025Updated last year
- Self-Explainability Enhancement of LLMs’ Representations☆14Jul 2, 2025Updated last year
- ☆135Jul 29, 2026Updated 3 months ago
- ☆15Jan 9, 2026Updated 10 months ago
- JailBench:大型语言模型越狱攻击风险评测中文数据集 [PAKDD 2025]☆196Nov 4, 2026Updated 2 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors [EMNLP 2024 Findings]☆231Sep 29, 2024Updated 2 years ago
- Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts,用于评估和提升大模型的安全性。☆1,233Feb 27, 2024Updated 2 years ago
- [ACL 2025] Data and Code for Paper VLSBench: Unveiling Visual Leakage in Multimodal Safety☆62Jul 21, 2025Updated last year
- [EMNLP'24 (Main)] DRPO(Dynamic Rewarding with Prompt Optimization) is a tuning-free approach for self-alignment. DRPO leverages a search-…☆24Nov 17, 2024Updated 2 years ago
- ☆19Jun 11, 2024Updated 2 years ago
- Multilingual safety benchmark for Large Language Models☆53Sep 1, 2024Updated 2 years ago
- The official code for "Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks".☆19Jun 24, 2026Updated 4 months ago
- The reinforcement learning codes for dataset SPA-VL☆48Jun 24, 2024Updated 2 years ago
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆355Jun 7, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆18Apr 23, 2025Updated last year
- offical implementation of Jailbreak-R1☆17Jul 16, 2025Updated last year
- ☆30Feb 16, 2024Updated 2 years ago
- Official repository for the Findings of ACL 2023 paper "AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Co…☆22May 16, 2023Updated 3 years ago
- GAOGAO-Bench-Updates is a supplement to the GAOKAO-Bench, a dataset to evaluate large language models.☆53Jan 7, 2025Updated last year
- Dataset and evaluation code for measuring hallucinations in Chinese large language models☆140Jun 5, 2024Updated 2 years ago
- ☆10Jan 13, 2024Updated 2 years ago
Are these results useful?