Codebase for "On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback". This repo implements a generative multi-turn RL environment with support for agent, user, user feedback, transition and veto models. It also implements KTO and expert iteration for training on user preferences.
☆25Dec 3, 2024Updated last year
Alternatives and similar repositories for Targeted-Manipulation-and-Deception-in-LLMs
Users that are interested in Targeted-Manipulation-and-Deception-in-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Code for our paper: "Language Models Learn to Mislead Humans via RLHF""☆20Oct 11, 2024Updated last year
- Attribution-based Parameter Decomposition☆35Jun 11, 2025Updated last year
- A TinyStories LM with SAEs and transcoders☆14Apr 3, 2025Updated last year
- ☆28Sep 5, 2024Updated last year
- Sparse Autoencoder Training Library☆58May 1, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Improving transparency of large language models' reasoning☆15Nov 25, 2025Updated 7 months ago
- see github.com/understanding-search/maze-transformer☆10Dec 8, 2023Updated 2 years ago
- Chess agent specification gaming☆25Jul 13, 2026Updated last week
- ☆17May 19, 2026Updated 2 months ago
- Datasets used in the paper "Reward hacking behavior can generalize across tasks"☆15Aug 17, 2025Updated 11 months ago
- Code for "On Measuring Faithfulness of Natural Language Explanations"☆23Updated this week
- ☆26Jun 22, 2025Updated last year
- Creating a game to play Figgie & Train an agent to play against☆15Dec 3, 2022Updated 3 years ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆22Sep 21, 2025Updated 9 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆15May 7, 2026Updated 2 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆48May 31, 2024Updated 2 years ago
- ☆10Oct 11, 2022Updated 3 years ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆33Jan 23, 2025Updated last year
- Repository for the "Chain-of-Thought Reasoning In The Wild Is Not Always Faithful" paper☆35Mar 31, 2026Updated 3 months ago
- ICLR 2025 Workshop & CHI 2025 SIG: "Bidirectional Human-AI Alignment"☆59Aug 6, 2024Updated last year
- Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)☆28Jun 27, 2024Updated 2 years ago
- A library for efficient patching and automatic circuit discovery.☆99Dec 31, 2025Updated 6 months ago
- ☆15Mar 30, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Debate interface, experiments, etc.☆11Mar 12, 2024Updated 2 years ago
- Inference API for many LLMs and other useful tools for empirical research☆133May 29, 2026Updated last month
- ☆11Apr 6, 2023Updated 3 years ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆265Feb 27, 2026Updated 4 months ago
- Mamba support for transformer lens☆20Sep 17, 2024Updated last year
- [2025-TMLR] A Survey on the Honesty of Large Language Models☆66Dec 8, 2024Updated last year
- Code for evaluating AI systems on the MASK honesty benchmark.☆24Mar 6, 2025Updated last year
- Functional lenses on C++ (highly experimental).☆10Aug 13, 2019Updated 6 years ago
- ☆34Nov 7, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.☆35Oct 28, 2025Updated 8 months ago
- An RL-Friendly Vision-Language Model for Minecraft☆41Oct 17, 2024Updated last year
- Evaluating the Moral Beliefs Encoded in LLMs☆38Dec 17, 2024Updated last year
- Code for "Positional Diffusion: Ordering Unordered Sets with Diffusion Probabilistic Models"☆18Mar 21, 2023Updated 3 years ago
- [NeurIPS 2025 MechInterp Workshop - Spotlight] Official implementation of the paper "RelP: Faithful and Efficient Circuit Discovery in La…☆29Nov 3, 2025Updated 8 months ago
- ☆13Jul 5, 2024Updated 2 years ago
- ilpyt: imitation learning library with modular, baseline implementations in Pytorch☆18Oct 25, 2023Updated 2 years ago