Codebase for "On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback". This repo implements a generative multi-turn RL environment with support for agent, user, user feedback, transition and veto models. It also implements KTO and expert iteration for training on user preferences.
☆26Dec 3, 2024Updated last year
Alternatives and similar repositories for Targeted-Manipulation-and-Deception-in-LLMs
Users that are interested in Targeted-Manipulation-and-Deception-in-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Code for our paper: "Language Models Learn to Mislead Humans via RLHF""☆20Oct 11, 2024Updated 2 years ago
- Attribution-based Parameter Decomposition☆35Jun 11, 2025Updated last year
- ☆16Oct 3, 2024Updated 2 years ago
- The app for time management, featuring calendar, task operation, statistics, feedback submission, user auth, and profile data management.☆11Jun 12, 2024Updated 2 years ago
- 🌳 Repository for the "Thought Branches: Interpreting LLM Reasoning Requires Resampling" paper.☆14Nov 5, 2025Updated 11 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- see github.com/understanding-search/maze-transformer☆10Dec 8, 2023Updated 2 years ago
- Engine for collecting, uploading, and downloading model activations☆31Apr 2, 2025Updated last year
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆21Jan 19, 2025Updated last year
- Repo for HAICOSYSTEM☆14Jun 1, 2025Updated last year
- A tiny easily hackable implementation of a feature dashboard.☆18Oct 21, 2025Updated last year
- ☆17May 19, 2026Updated 5 months ago
- ☆10Aug 29, 2021Updated 5 years ago
- Code for "On Measuring Faithfulness of Natural Language Explanations"☆23Jul 14, 2026Updated 3 months ago
- Server to generate GitLab issues for user feedback☆10Jan 7, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A react user feedback dialog + screenshot + canvas highlighting☆10Dec 11, 2022Updated 3 years ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆22Sep 21, 2025Updated last year
- ☆10Oct 11, 2022Updated 4 years ago
- ☆47Feb 18, 2026Updated 8 months ago
- Codes for paper: "LaMP-QA: A Benchmark for Personalized Long-form Question Answering"☆13Jun 3, 2025Updated last year
- Using randomized hill climbing to parameterize a PID Control solution to Lunar Lander☆12Jul 30, 2017Updated 9 years ago
- ICLR 2025 Workshop & CHI 2025 SIG: "Bidirectional Human-AI Alignment"☆59Aug 6, 2024Updated 2 years ago
- LXM3: XManager launch backend for HPC clusters☆11May 11, 2024Updated 2 years ago
- Repository for the "Chain-of-Thought Reasoning In The Wild Is Not Always Faithful" paper☆36Mar 31, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Suggest feature tool for easy user feedback and feature list☆13Nov 21, 2024Updated last year
- ☆12Oct 27, 2024Updated 2 years ago
- Custom graph/network/multi-weighted network class based on storing list of neighbors for each nodes (as opposed to edge list) for scalabl…☆11Jan 18, 2024Updated 2 years ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆34Jan 23, 2025Updated last year
- Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)☆29Jun 27, 2024Updated 2 years ago
- What's In My Human Feedback? Explaining preferences in human feedback using interpretability + LLMs. https://arxiv.org/abs/2510.26202☆29May 9, 2026Updated 5 months ago
- Implementation of path patching & activation patching (will eventually add to TransformerLens).☆16Jan 8, 2024Updated 2 years ago
- A library for efficient patching and automatic circuit discovery.☆103Aug 17, 2026Updated 2 months ago
- Framework for generating behavioral evaluations of frontier AI models.☆43Oct 21, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆21Mar 16, 2026Updated 7 months ago
- This repository is associated with the research paper titled ImageChain: Advancing Sequential Image-to-Text Reasoning in Multimodal Large…☆15Jun 4, 2025Updated last year
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆27Aug 15, 2025Updated last year
- Identify users most apt for copilot adoption and get real feedback about how copilot is helping once deployed.☆12Jul 15, 2025Updated last year
- Debate interface, experiments, etc.☆12Mar 12, 2024Updated 2 years ago
- This repository it used to keep track of user feedback, issues and suggestions for https://composablesui.com☆12Dec 24, 2025Updated 10 months ago
- An AI-powered Interview Preparation & Evaluation System that helps candidates practice job interviews. Users can upload their CV and sp…☆12Nov 1, 2025Updated 11 months ago