Algorithmic-Alignment-Lab / CommonClaim

Related projects: ⓘ

• thestephencasper / explore_establish_exploit_llms
  ☆30Updated last year
• ejones313 / auditing-llms
  ☆47Updated last year
• paul-rottger / exaggerated-safety
  Röttger et al. (2023): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆55Updated 8 months ago
• zhxieml / remiss-jailbreak
  ☆20Updated 2 months ago
• XuandongZhao / weak-to-strong
  Weak-to-Strong Jailbreaking on Large Language Models
  ☆62Updated 6 months ago
• deeplearning-wisc / args
  ☆30Updated 7 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆46Updated last month
• centerforaisafety / wmdp
  WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…
  ☆72Updated 4 months ago
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆35Updated 8 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆79Updated 3 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆44Updated 3 months ago
• Improbable-AI / curiosity_redteam
  Official implementation of ICLR'24 paper, "Curiosity-driven Red Teaming for Large Language Models" (https://openreview.net/pdf?id=4KqkizX…
  ☆57Updated 6 months ago
• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆43Updated 11 months ago
• chujiezheng / LLM-Safeguard
  Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"
  ☆64Updated 2 weeks ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆17Updated 2 months ago
• ZHZisZZ / emulated-disalignment
  [ACL'2024, Outstanding Paper] Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!
  ☆27Updated last month
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆48Updated 6 months ago
• zhaoyiran924 / Probe-Sampling
  Code of paper "Accelerating Greedy Coordinate Gradient via Probe Sampling"
  ☆16Updated 5 months ago
• ChenWu98 / agent-attack
  [Arxiv 2024] Adversarial attacks on multimodal agents
  ☆33Updated 2 months ago
• shadowkiller33 / Contrast-Instruction
  ☆19Updated 11 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆37Updated 10 months ago
• centerforaisafety / tdc2023-starter-kit
  This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.
  ☆77Updated 4 months ago
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆61Updated 4 months ago
• locuslab / acr-memorization
  ☆23Updated 4 months ago
• rishub-tamirisa / tamper-resistance
  Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"
  ☆34Updated 3 weeks ago
• OpenSafetyLab / SALAD-BENCH
  【ACL 2024】 SALAD benchmark & MD-Judge
  ☆81Updated this week
• PKU-Alignment / Awesome-LLM-Alignment
  ☆21Updated this week
• lingo-mit / lm-truthfulness
  ☆12Updated 8 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆76Updated 6 months ago
• dannyallover / overthinking_the_truth
  ☆24Updated 4 months ago