allenai / wildguard

Related projects: ⓘ

• paul-rottger / exaggerated-safety
  Röttger et al. (2023): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆55Updated 8 months ago
• allenai / safety-eval
  A simple evaluation of generative language models and safety classifiers.
  ☆19Updated last month
• centerforaisafety / wmdp
  WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…
  ☆72Updated 4 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆76Updated 6 months ago
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆89Updated 2 months ago
• OpenSafetyLab / SALAD-BENCH
  【ACL 2024】 SALAD benchmark & MD-Judge
  ☆81Updated this week
• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆50Updated this week
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆124Updated 2 months ago
• thestephencasper / explore_establish_exploit_llms
  ☆30Updated last year
• XuandongZhao / weak-to-strong
  Weak-to-Strong Jailbreaking on Large Language Models
  ☆62Updated 7 months ago
• ejones313 / auditing-llms
  ☆47Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆46Updated last month
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆70Updated 5 months ago
• ryoungj / ToolEmu
  A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆106Updated 6 months ago
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆61Updated 4 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆37Updated 10 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆79Updated 3 months ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆107Updated last month
• roeehendel / icl_task_vectors
  ☆69Updated 10 months ago
• milesaturpin / cot-unfaithfulness
  ☆29Updated 10 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆48Updated 6 months ago
• chrisliu298 / awesome-representation-engineering
  A resource repository for representation engineering in large language models
  ☆36Updated last week
• Improbable-AI / curiosity_redteam
  Official implementation of ICLR'24 paper, "Curiosity-driven Red Teaming for Large Language Models" (https://openreview.net/pdf?id=4KqkizX…
  ☆57Updated 6 months ago
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆73Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆56Updated 3 months ago
• tatsu-lab / opinions_qa
  ☆92Updated 4 months ago
• architsharma97 / dpo-rlaif
  ☆87Updated 2 months ago
• chujiezheng / LLM-Safeguard
  Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"
  ☆64Updated 2 weeks ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆39Updated 7 months ago
• tatsu-lab / test_set_contamination
  ☆32Updated 10 months ago