A curated list of papers and resources on Reward Hacking, Emergent Misalignment, and Proxy Exploitation in Large Models
☆51Apr 17, 2026Updated 4 months ago
Alternatives and similar repositories for Awesome-Reward-Hacking
Users that are interested in Awesome-Reward-Hacking are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2024 main] Aligning Large Language Models with Human Preferences through Representation Engineering (https://aclanthology.org/2024.…☆28Sep 25, 2024Updated last year
- Implementation code for ACL2024：Advancing Parameter Efficiency in Fine-tuning via Representation Editing☆15Apr 20, 2024Updated 2 years ago
- ☆20Mar 17, 2025Updated last year
- [ICLR 2026] Quantile Advantage Estimation for Entropy-Safe Reasoning☆29Oct 14, 2025Updated 10 months ago
- The Official Repository for Paper "HarmfulSkillBench: How Do Harmful Skills Weaponize Your Agents?"☆16May 2, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆17Jun 25, 2025Updated last year
- Official pytorch implementation of Spatial Relation Decomposition method (AAAI 23)☆23Dec 29, 2023Updated 2 years ago
- All projects I completed in Software Engineering in Fudan University from 2018 / 复旦大学2018级软件工程专业课程项目合集☆24Jan 20, 2022Updated 4 years ago
- PRD: Peer Rank and Discussion Improve Large Language Model based Evaluations☆14Apr 21, 2024Updated 2 years ago
- Mobile GUI Agents under Real-world Threats: Are We There Yet?☆18Aug 4, 2026Updated last month
- Accompanying code for our NeurIPS 2019 paper☆11Nov 7, 2019Updated 6 years ago
- MultiPriv offers multilingual, multimodal PII entities and prompts for studying privacy risks in LLMs/VLMs. It also supports broader PII-…☆38Jun 29, 2026Updated 2 months ago
- Official Repo for DAC-RL: Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability☆16Feb 26, 2026Updated 6 months ago
- The open-source repository for PAL: Sample-Efficient Personalized Reward Modeling for Pluralistic Alignment, which provides a general per…☆17Aug 28, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [🏆ECCV'26] Official Repo for SlowBA: An efficiency backdoor attack towards VLM-based GUI agents☆19Aug 31, 2026Updated last week
- Jailbreak Evo☆24Jun 2, 2025Updated last year
- [ICML 2026] Code for V1: Unifying Generation and Self-Verification for Parallel Reasoners.☆39Mar 5, 2026Updated 6 months ago
- ☆12Jul 6, 2023Updated 3 years ago
- Bridging the gap between image generation and real-world design: a benchmark for structured, multi-constraint commercial visual content g…☆22Apr 24, 2026Updated 4 months ago
- [ArXiv 2025] Imperceptible Jailbreaking against Large Language Models☆25Oct 7, 2025Updated 11 months ago
- COMPASS: A Framework for Evaluating Organization-Specific Policy Alignment in LLMs☆18Apr 7, 2026Updated 5 months ago
- ☆173May 28, 2025Updated last year
- ☆15Apr 11, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The official implementation of the paper "AgentLAB: Benchmarking LLM Agents against Long-Horizon Attacks"☆34Jun 1, 2026Updated 3 months ago
- LLM Safeguarding with Internal Representations☆20Apr 27, 2026Updated 4 months ago
- ☆85May 8, 2026Updated 4 months ago
- ☆25May 16, 2024Updated 2 years ago
- A course on implementing a Bayesian workflow using Stan.☆11Jun 17, 2022Updated 4 years ago
- HELP: a dataset for Handling Entailments with Lexical and logical Phenomena (Ver.1.0)☆15Jul 20, 2023Updated 3 years ago
- [ACL'23 Findings] This is the code repo for our ACL'23 Findings paper "ReGen: Zero-Shot Text Classification via Training Data Generation …☆24Sep 8, 2023Updated 3 years ago
- The Source Code for DR3-Eval☆40Aug 12, 2026Updated last month
- ☆16Jul 23, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Voronoi-Based Foveated Volume Rendering☆10Sep 30, 2021Updated 4 years ago
- A Security Benchmark for Claude Code Agent Skills☆75Aug 3, 2026Updated last month
- [COLM 2026] Official implementation for "MonitorBench: A Comprehensive Benchmark for Chain-of-Thought Monitorability in Large Language Mo…☆21Updated this week
- [ICML 2026] Hybrid Policy Distillation (HPD) is a practical distillation framework for reasoning-oriented language models. This repositor…☆25Apr 24, 2026Updated 4 months ago
- A curated list of Distribution Shift papers/articles and recent advancements.☆23Oct 20, 2022Updated 3 years ago
- Official Repository: A Comprehensive Benchmark for Logical Reasoning in MLLMs☆45Jun 17, 2025Updated last year
- Official repository for Beyond Binary Rewards: Training LMs to Reason about Their Uncertainty☆69Aug 20, 2025Updated last year