Flames is a highly adversarial benchmark in Chinese for LLM's harmlessness evaluation developed by Shanghai AI Lab and Fudan NLP Group.
☆67May 21, 2024Updated 2 years ago
Alternatives and similar repositories for Flames
Users that are interested in Flames are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Mar 22, 2024Updated 2 years ago
- ☆46Jun 19, 2025Updated last year
- [ICML 2025] ReflectionBench: Evaluating Epistemic Agency in Large Language Models☆23Jun 24, 2025Updated last year
- S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Models☆121Feb 13, 2026Updated 7 months ago
- [EMNLP 2024] ”ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models“☆27Jun 24, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆31Aug 9, 2023Updated 3 years ago
- ☆21Aug 19, 2024Updated 2 years ago
- ☆16May 16, 2025Updated last year
- 面向中文大模型价值观的评估与对齐研究☆559Jul 20, 2023Updated 3 years ago
- Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge☆14Feb 20, 2024Updated 2 years ago
- ☆15Jan 9, 2026Updated 8 months ago
- ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors [EMNLP 2024 Findings]☆231Sep 29, 2024Updated last year
- ☆133Jul 29, 2026Updated last month
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆296Jul 28, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ReasoningShield: Safety Detection over Reasoning Traces of Large Reasoning Models☆26Aug 2, 2026Updated last month
- Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。☆1,218Feb 27, 2024Updated 2 years ago
- GAOGAO-Bench-Updates is a supplement to the GAOKAO-Bench, a dataset to evaluate large language models.☆51Jan 7, 2025Updated last year
- ☆30Feb 16, 2024Updated 2 years ago
- Accepted by ECCV 2024☆221Oct 15, 2024Updated last year
- ☆23Mar 2, 2026Updated 6 months ago
- [EMNLP 2023 Demo] "CLEVA: Chinese Language Models EVAluation Platform"☆64May 16, 2025Updated last year
- ☆33Sep 15, 2025Updated last year
- Open benchmark for AI agent security tools — prompt injection, data exfiltration, tool abuse, provenance☆26Sep 7, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆84Mar 11, 2025Updated last year
- ☆15Oct 7, 2022Updated 3 years ago
- Official implementation of ACL'26 (findings) paper WESR (Word-level Event-Speech Recognition): A comprehensive benchmark and baseline for…☆48Jan 30, 2026Updated 7 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆67Jul 8, 2024Updated 2 years ago
- Dataset and evaluation code for measuring hallucinations in Chinese large language models☆139Jun 5, 2024Updated 2 years ago
- A toolbox for benchmarking trustworthiness of multimodal large language models (MultiTrust, NeurIPS 2024 Track Datasets and Benchmarks)☆178Jun 27, 2025Updated last year
- 复旦白泽大模型安全基准测试集（2024年夏季版）☆50Jul 31, 2024Updated 2 years ago
- Adversarial Attack for Pre-trained Code Models☆10Jul 19, 2022Updated 4 years ago
- An active inference model of Lacanian psychoanalysis☆20Jun 7, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆153Jul 24, 2024Updated 2 years ago
- BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).☆183Oct 27, 2023Updated 2 years ago
- ☆10Mar 19, 2024Updated 2 years ago
- [ACL 2024] ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models☆29Jan 11, 2025Updated last year
- Code for Findings-EMNLP 2023 paper: Multi-step Jailbreaking Privacy Attacks on ChatGPT☆37Oct 15, 2023Updated 2 years ago
- "他山之石、可以攻玉"：复旦JADE团队发布的大模型测评与治理系列☆528Jul 23, 2026Updated last month
- FlagEval is an evaluation toolkit for AI large foundation models.☆338Apr 24, 2025Updated last year