Alternatives and similar repositories for dpo_toxic:

Users that are interested in dpo_toxic are comparing it to the libraries listed below

• Unispac / shallow-vs-deep-alignment
  Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep
  ☆82Updated 8 months ago
• deeplearning-wisc / args
  ☆37Updated last year
• boyiwei / alignment-attribution-code
  [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
  ☆71Updated 3 weeks ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆91Updated 3 weeks ago
• chrisliu298 / awesome-representation-engineering
  A resource repository for representation engineering in large language models
  ☆113Updated 4 months ago
• IBM / activation-steering
  General-purpose activation steering library
  ☆52Updated 2 months ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆129Updated 10 months ago
• roeehendel / icl_task_vectors
  ☆93Updated last year
• dannyallover / overthinking_the_truth
  ☆30Updated 10 months ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆50Updated 3 months ago
• ejones313 / auditing-llms
  ☆53Updated 2 years ago
• s-ball-10 / jailbreak_dynamics
  ☆14Updated 9 months ago
• fc2869 / lo-fit
  LoFiT: Localized Fine-tuning on LLM Representations
  ☆34Updated 2 months ago
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆21Updated 9 months ago
• swj0419 / muse_bench
  ☆20Updated last week
• licong-lin / negative-preference-optimization
  ☆50Updated 8 months ago
• activatedgeek / calibration-tuning
  ☆47Updated 7 months ago
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆50Updated last year
• ykwon0407 / DataInf
  DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)
  ☆63Updated 5 months ago
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆78Updated 10 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆108Updated 9 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆90Updated 10 months ago
• CaoYuanpu / BiPO
  Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization
  ☆18Updated 7 months ago
• montemac / activation_additions
  Algebraic value editing in pretrained language models
  ☆63Updated last year
• hannamw / EAP-IG
  ☆23Updated 3 weeks ago
• balevinstein / Probes
  ☆47Updated last year
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆91Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆149Updated this week
• boyiwei / CoTaEval
  [NeurIPS 2024 D&B] Evaluating Copyright Takedown Methods for Language Models
  ☆17Updated 8 months ago