☆44Feb 18, 2026Updated 6 months ago
Alternatives and similar repositories for rl-rewardhacking
Users that are interested in rl-rewardhacking are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆20Mar 16, 2026Updated 5 months ago
- ☆31Jul 1, 2026Updated 2 months ago
- [ICLR 2025] On Evluating the Durability of Safegurads for Open-Weight LLMs☆13Jun 20, 2025Updated last year
- Code repo for the model organisms and convergent directions of EM papers.☆81Sep 22, 2025Updated 11 months ago
- This was designed for interp researchers who want to do research on or with interp agents to give quality of life improvements and fix …☆146Feb 8, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Dataset of hackable TerminalBench-style tasks and exploit trajectories☆40Apr 18, 2026Updated 4 months ago
- ☆20Dec 29, 2025Updated 8 months ago
- Project of ACL 2025 "UAlign: Leveraging Uncertainty Estimations for Factuality Alignment on Large Language Models"☆15Mar 25, 2025Updated last year
- ☆42Oct 21, 2025Updated 10 months ago
- ☆14Aug 9, 2023Updated 3 years ago
- Official repo for "Binary Retrieval-augmented Reward Mitigates Hallucinations"☆16Nov 13, 2025Updated 9 months ago
- Code for Representation Bending Paper☆16Jul 15, 2025Updated last year
- [ICML 2026] An Evaluation Suite for Chain-of-Thought Controllability☆53Mar 10, 2026Updated 5 months ago
- Reimplementation of https://github.com/montemac/algebraic_value_editing in pure PyTorch for efficiency on large models☆11Jun 28, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Codebase for "On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback". This repo implements a generative multi-tur…☆26Dec 3, 2024Updated last year
- ☆17May 7, 2026Updated 3 months ago
- Code used for "Training Agents to Self-Report Misbehavior"☆18Feb 27, 2026Updated 6 months ago
- https://scale.com/research/mrt☆20Mar 16, 2026Updated 5 months ago
- ☆28May 27, 2025Updated last year
- ☆96Apr 18, 2026Updated 4 months ago
- Documenting large text datasets 🖼️ 📚☆14Dec 17, 2024Updated last year
- ☆19May 2, 2026Updated 4 months ago
- ☆19Mar 5, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆70Jun 9, 2025Updated last year
- [ICLR26] Safety Mirage: How Spurious Correlations Undermine VLM Safety Fine-Tuning and Can Be Mitigated by Machine Unlearning☆21Apr 16, 2026Updated 4 months ago
- The Structure and Interpretation of Deep Networks Handbook☆14Dec 14, 2024Updated last year
- Officially unofficial PyTorch code for the NIPS paper 'Natural-Parameter Networks: A Class of Probabilistic Neural Networks'☆11Sep 28, 2021Updated 4 years ago
- ☆20Apr 26, 2026Updated 4 months ago
- ☆25Dec 13, 2024Updated last year
- The official code of Multi-player Nash Preference Optimization [ICLR 2026]☆35Feb 4, 2026Updated 6 months ago
- Creating a game to play Figgie & Train an agent to play against☆15Dec 3, 2022Updated 3 years ago
- Improving transparency of large language models' reasoning☆15Nov 25, 2025Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official Code for our paper: "Language Models Learn to Mislead Humans via RLHF""☆20Oct 11, 2024Updated last year
- Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆87Mar 1, 2025Updated last year
- Search engine of my Curius data☆16Apr 10, 2022Updated 4 years ago
- Official repository for "Safety in Large Reasoning Models: A Survey" - Exploring safety risks, attacks, and defenses for Large Reasoning …☆90Aug 25, 2025Updated last year
- ☆26Sep 5, 2024Updated last year
- Inference API for many LLMs and other useful tools for empirical research☆137May 29, 2026Updated 3 months ago
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆50Oct 10, 2024Updated last year