ZHZisZZ / emulated-disalignmentView external linksLinks
[ACL'24, Outstanding Paper] Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!
☆39Aug 2, 2024Updated last year
Alternatives and similar repositories for emulated-disalignment
Users that are interested in emulated-disalignment are comparing it to the libraries listed below
Sorting:
- This repo support auto line plot for multi-seed event file from TensorBoard☆12Jun 23, 2022Updated 3 years ago
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆96Aug 20, 2024Updated last year
- (NeurIPS '22) LISA: Learning Interpretable Skill Abstractions - A framework for unsupervised skill learning using Imitation☆29Feb 22, 2023Updated 2 years ago
- [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models☆66Dec 10, 2024Updated last year
- Python library for solving reinforcement learning (RL) problems using generative models.☆11Feb 18, 2025Updated 11 months ago
- ☆10Feb 3, 2025Updated last year
- ☆193Nov 26, 2023Updated 2 years ago
- Simple behavioural cloning baseline solution for BASALT 2022☆32Nov 3, 2022Updated 3 years ago
- Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifiers☆27Mar 1, 2025Updated 11 months ago
- Decision Intelligence platform for Biological Sequence Searching☆129Oct 10, 2022Updated 3 years ago
- PyTorch Sphinx Theme☆55Jul 7, 2024Updated last year
- This is the repositoary for our paper published at ICML24.☆11Jun 11, 2025Updated 8 months ago
- Still struggling with the high threshold or looking for the appropriate baseline? Come here and new starters can also play with your own …☆182Feb 20, 2023Updated 2 years ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆26Oct 14, 2025Updated 4 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆85Mar 7, 2025Updated 11 months ago
- Code and data for "ImgTrojan: Jailbreaking Vision-Language Models with ONE Image"☆24Mar 26, 2025Updated 10 months ago
- [ACL 2024 Findings] The official repo for "ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large …☆24May 29, 2024Updated last year
- [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models☆92May 2, 2025Updated 9 months ago
- OpenDILab RL HPC OP Lib, including CUDA and Triton kernel☆242Jul 4, 2024Updated last year
- Here are the most awesome tree structure computing solutions, make your life easier. （这里有目前性能最优的树形结构计算解决方案）☆246Oct 17, 2024Updated last year
- Codebase for "Uni[MASK]: Unified Inference in Sequential Decision Problems"☆57Jul 3, 2024Updated last year
- OpenDILab RL Object Store☆182Apr 20, 2022Updated 3 years ago
- Code for the paper "Learning Options via Compression" at NeurIPS 2022☆25Jan 11, 2023Updated 3 years ago
- Implementation of ICML 2023 paper: Future-conditioned Unsupervised Pretraining for Decision Transformer☆29Jul 25, 2023Updated 2 years ago
- Rewarded soups official implementation☆62Sep 27, 2023Updated 2 years ago
- Official repository for "Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks"☆61Aug 8, 2024Updated last year
- Detecting fraudulent transactions on the synthetic banksim dataset with machine learning☆23Apr 2, 2023Updated 2 years ago
- [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey☆109Aug 7, 2024Updated last year
- [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization☆32Jan 7, 2026Updated last month
- Official codebase for "STAIR: Improving Safety Alignment with Introspective Reasoning"☆88Feb 26, 2025Updated 11 months ago
- ☆47Aug 5, 2025Updated 6 months ago
- ☆30Jul 12, 2023Updated 2 years ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆127Mar 30, 2024Updated last year
- (ACL-2025 main conference) Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback☆38Jun 24, 2025Updated 7 months ago
- Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…☆32Apr 20, 2024Updated last year
- Predictable MDP Abstraction for Unsupervised Model-Based RL (ICML 2023)☆32Feb 6, 2023Updated 3 years ago
- Code and data for the paper "Understanding Hidden Context in Preference Learning: Consequences for RLHF"☆33Dec 14, 2023Updated 2 years ago
- Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"☆34Aug 16, 2024Updated last year
- ☆180Dec 26, 2022Updated 3 years ago