Flames is a highly adversarial benchmark in Chinese for LLM's harmlessness evaluation developed by Shanghai AI Lab and Fudan NLP Group.
☆68May 21, 2024Updated 2 years ago
Alternatives and similar repositories for Flames
Users that are interested in Flames are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Mar 22, 2024Updated 2 years ago
- ☆46Jun 19, 2025Updated last year
- [ICML 2025] ReflectionBench: Evaluating Epistemic Agency in Large Language Models☆21Jun 24, 2025Updated last year
- S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Models☆120Feb 13, 2026Updated 5 months ago
- [EMNLP 2024] ”ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models“☆27Jun 24, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆31Aug 9, 2023Updated 3 years ago
- Open-source red teaming framework for MLLMs with 42+ attack methods☆261Jul 17, 2026Updated 3 weeks ago
- ☆21Aug 19, 2024Updated last year
- ☆16May 16, 2025Updated last year
- 面向中文大模型价值观的评估与对齐研究☆561Jul 20, 2023Updated 3 years ago
- Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge☆14Feb 20, 2024Updated 2 years ago
- ☆15Jan 9, 2026Updated 7 months ago
- ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors [EMNLP 2024 Findings]☆231Sep 29, 2024Updated last year
- ☆134Jul 29, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆17Oct 15, 2023Updated 2 years ago
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆297Jul 28, 2025Updated last year
- JailBench：大型语言模型越狱攻击风险评测中文数据集 [PAKDD 2025]☆191Mar 3, 2025Updated last year
- Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。☆1,194Feb 27, 2024Updated 2 years ago
- GAOGAO-Bench-Updates is a supplement to the GAOKAO-Bench, a dataset to evaluate large language models.☆48Jan 7, 2025Updated last year
- ☆30Feb 16, 2024Updated 2 years ago
- Accepted by ECCV 2024☆217Oct 15, 2024Updated last year
- ☆21Mar 2, 2026Updated 5 months ago
- [EMNLP 2023 Demo] "CLEVA: Chinese Language Models EVAluation Platform"☆64May 16, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Apr 23, 2025Updated last year
- ☆17Nov 3, 2024Updated last year
- ☆34Sep 15, 2025Updated 10 months ago
- [AAAI 2026 Oral] Implementation for "W2S-AlignTree: Weak-to-Strong Inference-Time Alignment for Large Language Models via Monte Carlo Tre…☆25Mar 5, 2026Updated 5 months ago
- Open benchmark for AI agent security tools — prompt injection, data exfiltration, tool abuse, provenance☆24Jun 3, 2026Updated 2 months ago
- ☆84Mar 11, 2025Updated last year
- ☆37Oct 14, 2021Updated 4 years ago
- Official implementation of ACL'26 (findings) paper WESR (Word-level Event-Speech Recognition): A comprehensive benchmark and baseline for…☆46Jan 30, 2026Updated 6 months ago
- This is the code repository for "Uncovering Safety Risks of Large Language Models through Concept Activation Vector"☆49Oct 13, 2025Updated 9 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆66Jul 8, 2024Updated 2 years ago
- SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Types☆26Nov 29, 2024Updated last year
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆139Jun 5, 2024Updated 2 years ago
- Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆84Mar 1, 2025Updated last year
- A toolbox for benchmarking trustworthiness of multimodal large language models (MultiTrust, NeurIPS 2024 Track Datasets and Benchmarks)☆177Jun 27, 2025Updated last year
- 复旦白泽大模型安全基准测试集（2024年夏季版）☆51Jul 31, 2024Updated 2 years ago
- Adversarial Attack for Pre-trained Code Models☆10Jul 19, 2022Updated 4 years ago