A curated list of papers and resources on Reward Hacking, Emergent Misalignment, and Proxy Exploitation in Large Models
☆39Apr 17, 2026Updated 2 months ago
Alternatives and similar repositories for Awesome-Reward-Hacking
Users that are interested in Awesome-Reward-Hacking are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2024 main] Aligning Large Language Models with Human Preferences through Representation Engineering (https://aclanthology.org/2024.…☆28Sep 25, 2024Updated last year
- Implementation code for ACL2024：Advancing Parameter Efficiency in Fine-tuning via Representation Editing☆15Apr 20, 2024Updated 2 years ago
- ☆21Mar 17, 2025Updated last year
- The Official Repository for Paper "HarmfulSkillBench: How Do Harmful Skills Weaponize Your Agents?"☆15May 2, 2026Updated 2 months ago
- 🚀 Sliding Window Attention Training for Efficient Large Language Models☆19Jun 7, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official pytorch implementation of Spatial Relation Decomposition method (AAAI 23)☆23Dec 29, 2023Updated 2 years ago
- [AAAI 2026] This is the official implementation of the paper "ExtendAttack: Attacking Servers of LRMs via Extending Reasoning".☆25Mar 18, 2026Updated 3 months ago
- ☆23May 21, 2025Updated last year
- LLM Safeguarding with Internal Representations☆19Apr 27, 2026Updated 2 months ago
- [ICLR 2026] Quantile Advantage Estimation for Entropy-Safe Reasoning☆29Oct 14, 2025Updated 9 months ago
- ☆38May 7, 2026Updated 2 months ago
- ☆12Jul 6, 2023Updated 3 years ago
- ☆15Apr 11, 2024Updated 2 years ago
- ☆25May 16, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An object detection model for NMNIST larger video frame☆13Feb 24, 2022Updated 4 years ago
- MiroEval: A benchmark and evaluation framework for deep research agents — 100 tasks (70 text, 30 multimodal) assessed across synthesis qu…☆45Jul 6, 2026Updated last week
- Official implementation of "TROJail: Trajectory-Level Optimization for Multi-Turn Large Language Model Jailbreaks with Process Rewards"☆30Updated this week
- [ICLR 2025] FLAT: LLM Unlearning via Loss Adjustment with Only Forget Data☆14Feb 26, 2025Updated last year
- ☆46Jun 16, 2026Updated 3 weeks ago
- This repo contains code for paper: "Uncertainty Estimation and Quantification for LLMs: A Simple Supervised Approach".☆25Oct 21, 2024Updated last year
- ☆225Dec 23, 2025Updated 6 months ago
- ☆16Jul 23, 2024Updated last year
- Voronoi-Based Foveated Volume Rendering☆10Sep 30, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A course on implementing a Bayesian workflow using Stan.☆10Jun 17, 2022Updated 4 years ago
- Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11…☆46Jul 2, 2024Updated 2 years ago
- HELP: a dataset for Handling Entailments with Lexical and logical Phenomena (Ver.1.0)☆15Jul 20, 2023Updated 2 years ago
- Aligning Agentic World Models via Knowledgeable Experience Learning☆36May 15, 2026Updated last month
- a library of works related to Large Language Models (LLMs) based Agent Hallucination☆59Oct 30, 2025Updated 8 months ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆28Jul 10, 2021Updated 5 years ago
- ☆15Jan 24, 2025Updated last year
- [ICML 2025] X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIP☆48Feb 3, 2026Updated 5 months ago
- AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems☆15May 12, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Implement of Implicit Knowledge Extraction Attack.☆24Apr 17, 2026Updated 2 months ago
- ☆23Sep 24, 2025Updated 9 months ago
- ☆72Apr 8, 2026Updated 3 months ago
- [ACM MM25] LongWriter-V: Enabling Ultra-Long and High-Fidelity Generation in Vision-Language Models☆24Mar 29, 2025Updated last year
- ☆51Jun 14, 2024Updated 2 years ago
- Official implementation of ECCV24 paper: POA☆24Aug 8, 2024Updated last year
- ☆23Jan 31, 2025Updated last year