IS2Lab / S-Eval

Related projects: ⓘ

• OpenSafetyLab / SALAD-BENCH
  【ACL 2024】 SALAD benchmark & MD-Judge
  ☆81Updated this week
• chujiezheng / LLM-Safeguard
  Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"
  ☆64Updated 2 weeks ago
• Lordog / R-Judge
  R-Judge: Benchmarking Safety Risk Awareness for LLM Agents
  ☆57Updated last month
• ydyjya / LLM-IHS-Explanation
  ☆27Updated 3 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆79Updated 3 months ago
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆61Updated 4 months ago
• qiuhuachuan / latent-jailbreak
  ☆31Updated 4 months ago
• BeyonderXX / ShadowAlignment
  Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models
  ☆22Updated 11 months ago
• YihanWang617 / LLM-Jailbreaking-Defense-Backtranslation
  Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"
  ☆20Updated last month
• YancyKahn / CoA
  Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLM
  ☆13Updated 3 months ago
• isXinLiu / MM-SafetyBench
  Accepted by ECCV 2024
  ☆59Updated 2 months ago
• niconi19 / LLM-Conversation-Safety
  [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey
  ☆65Updated last month
• PKU-Alignment / beavertails
  BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).
  ☆99Updated 10 months ago
• jinzhuoran / RWKU
  RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models
  ☆50Updated 2 months ago
• HKUST-KnowComp / LLM-Multistep-Jailbreak
  Code for Findings-EMNLP 2023 paper: Multi-step Jailbreaking Privacy Attacks on ChatGPT
  ☆20Updated 11 months ago
• pillowsofwind / Course-Correction
  The official GitHub repo for the paper "Course-Correction: Safety Alignment Using Synthetic Preferences"
  ☆19Updated last month
• boyiwei / alignment-attribution-code
  Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
  ☆55Updated 2 months ago
• lapisrocks / rpo
  Official repository for "Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks"
  ☆37Updated last month
• DAMO-NLP-SG / multilingual-safety-for-LLMs
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
  ☆50Updated 6 months ago
• alphadl / SafeLLM_with_IntentionAnalysis
  Towards Safe LLM with our simple-yet-highly-effective Intention Analysis Prompting
  ☆10Updated 5 months ago
• Improbable-AI / curiosity_redteam
  Official implementation of ICLR'24 paper, "Curiosity-driven Red Teaming for Large Language Models" (https://openreview.net/pdf?id=4KqkizX…
  ☆57Updated 6 months ago
• AISG-Technology-Team / GCSS-Track-1A-Submission-Guide
  Submission Guide + Discussion Board for AI Singapore Global Challenge for Safe and Secure LLMs (Track 1A).
  ☆16Updated 2 months ago
• MingyuJ666 / LVLM-Safety
  [FCS'24] LVLM Safety paper
  ☆11Updated 5 months ago
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆56Updated 6 months ago
• Jarviswang94 / Multilingual_safety_benchmark
  Multilingual safety benchmark for Large Language Models
  ☆21Updated 2 weeks ago
• YihanWang617 / llm-jailbreaking-defense
  A lightweight library for large laguage model (LLM) jailbreaking defense.
  ☆26Updated last month
• THU-KEG / WaterBench
  [ACL2024-Main] Data and Code for WaterBench: Towards Holistic Evaluation of LLM Watermarks
  ☆17Updated 10 months ago
• Princeton-SysML / Jailbreak_LLM
  ☆143Updated 9 months ago
• UCSC-VLAA / vllm-safety-benchmark
  [ECCV 2024] Official PyTorch Implementation of "How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs"
  ☆61Updated 9 months ago
• zhxieml / remiss-jailbreak
  ☆20Updated 2 months ago