thu-coai / SafetyBench

Related projects ⓘ

Alternatives and complementary repositories for SafetyBench

• CLUEbenchmark / SuperCLUE-Safety
  SC-Safety: 中文大模型多轮对抗安全基准
  ☆107Updated 8 months ago
• thu-coai / ShieldLM
  ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors [EMNLP 2024 Findings]
  ☆158Updated last month
• AIFlames / Flames
  Flames is a highly adversarial benchmark in Chinese for LLM's harmlessness evaluation developed by Shanghai AI Lab and Fudan NLP Group.
  ☆33Updated 6 months ago
• whitzard-ai / jade-db
  "他山之石、可以攻玉"：复旦白泽智能发布面向国内开源和国外商用大模型的Demo数据集JADE-DB
  ☆313Updated last week
• thu-coai / AutoDetect
  Official github repo for AutoDetect, an automated weakness detection framework for LLMs.
  ☆38Updated 4 months ago
• niconi19 / LLM-Conversation-Safety
  [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey
  ☆76Updated 3 months ago
• Lordog / R-Judge
  R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)
  ☆61Updated last month
• PKU-Alignment / beavertails
  BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).
  ☆111Updated last year
• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆308Updated 2 months ago
• CASIA-LM / MoDS
  ☆120Updated 7 months ago
• Magnetic2014 / llm-alignment-survey
  A curated reading list for large language model (LLM) alignment. Take a look at our new survey "Large Language Model Alignment: A Survey"…
  ☆71Updated last year
• IS2Lab / S-Eval
  S-Eval: Automatic and Adaptive Test Generation for Benchmarking Safety Evaluation of Large Language Models
  ☆42Updated 2 weeks ago
• thu-coai / CritiqueLLM
  ☆129Updated 4 months ago
• thu-coai / Safety-Prompts
  Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。
  ☆871Updated 8 months ago
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆86Updated 2 months ago
• OpenSafetyLab / SALAD-BENCH
  【ACL 2024】 SALAD benchmark & MD-Judge
  ☆106Updated last month
• WhitzardIndex / WhitzardBench-2024A
  复旦白泽大模型安全基准测试集（2024年夏季版）
  ☆27Updated 3 months ago
• OpenMOSS / HalluQA
  Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"
  ☆109Updated 5 months ago
• X-PLUG / CValues
  面向中文大模型价值观的评估与对齐研究
  ☆479Updated last year
• renqibing / ActorAttack
  ☆53Updated 2 weeks ago
• GAIR-NLP / auto-j
  Generative Judge for Evaluating Alignment
  ☆217Updated 10 months ago
• pldlgb / nuggets
  ☆71Updated 10 months ago
• OFA-Sys / InsTag
  InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
  ☆218Updated last year
• Spico197 / Humback
  🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.
  ☆132Updated 4 months ago
• DAMO-NLP-SG / multilingual-safety-for-LLMs
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
  ☆62Updated 8 months ago
• ydyjya / LLM-IHS-Explanation
  ☆31Updated 5 months ago
• Junjie-Ye / ToolEyes
  ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆62Updated 7 months ago
• qiuhuachuan / latent-jailbreak
  ☆32Updated 6 months ago
• cby-pku / aligner
  [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct
  ☆120Updated last week
• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆67Updated last week