Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.
☆21Sep 29, 2026Updated last month
Alternatives and similar repositories for decomposing-eval-awareness
Users that are interested in decomposing-eval-awareness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Apr 24, 2025Updated last year
- ☆33Dec 8, 2025Updated 11 months ago
- Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections☆24Jul 2, 2026Updated 4 months ago
- Efficient multi-token attribution for reasoning language models — Python package, CLI, and HTML token traces☆44Oct 30, 2026Updated last week
- ☆11May 18, 2026Updated 5 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Benchmark dataset for evaluating trusted monitors on AI agent transcripts☆20May 16, 2026Updated 5 months ago
- ☆27Mar 30, 2026Updated 7 months ago
- Experiments in eliciting shutdown avoidance☆11Sep 6, 2025Updated last year
- ☆15Feb 5, 2025Updated last year
- [ICML 2026] An Evaluation Suite for Chain-of-Thought Controllability☆60Mar 10, 2026Updated 8 months ago
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆16Dec 10, 2024Updated last year
- ☆13Oct 25, 2024Updated 2 years ago
- ☆10Jul 15, 2024Updated 2 years ago
- ☆61Feb 11, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Legacy-Bench: A benchmark for evaluating AI agents on legacy software engineering tasks☆21Jul 30, 2026Updated 3 months ago
- ☆16Oct 29, 2019Updated 7 years ago
- ☆10Jun 17, 2024Updated 2 years ago
- Multiple correspondence analysis☆10Apr 2, 2015Updated 11 years ago
- Code for evaluating AI systems on the MASK honesty benchmark.☆27Mar 6, 2025Updated last year
- Topic supervised non-negative matrix factorization with sparse matrices☆12Mar 24, 2020Updated 6 years ago
- Benchmarking Open-Ended Inference Optimization by AI Agents☆54Oct 26, 2026Updated 2 weeks ago
- Data and code for the paper Causal Reasoning of Entities and Events in Procedural Texts.☆11May 26, 2023Updated 3 years ago
- ☆10Apr 10, 2026Updated 7 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Replicating the basic adversarial multi-attack experimental results☆10Jul 31, 2023Updated 3 years ago
- Code and dataset for Polyglot Prompting: Multilingual Multitask Prompt Training.☆18Dec 7, 2022Updated 3 years ago
- Situational Awareness Dataset☆56Dec 14, 2024Updated last year
- ACL24☆11Jun 7, 2024Updated 2 years ago
- Structural Supervision & Human Psycholinguistic Data☆13Apr 16, 2021Updated 5 years ago
- This repository is for the paper Metaphor Generation with Conceptual Mappings (ACL 2021).☆12Sep 24, 2021Updated 5 years ago
- ☆11Sep 11, 2022Updated 4 years ago
- An Interpretable N-gram Perplexity Threat Model for Large Language Model Jailbreaks [ICML 2025]☆12Jun 11, 2025Updated last year
- The Cardiovascular Integrated Modelling and Simulation Environment's Open-Source Incompressibe Navier Stokes Finite Element Flowsolver☆15Jan 23, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Comparison of gradient estimation techniques for black-box adversarial examples☆11Oct 31, 2018Updated 8 years ago
- Plurals: A System for Guiding LLMs Via Simulated Social Ensembles☆42Sep 11, 2026Updated 2 months ago
- Benchmarking Dark Patterns in LLMs (ICLR 2025)☆20Mar 29, 2025Updated last year
- warpped libelas with opencv and used pangolin as GUI☆17Mar 14, 2017Updated 9 years ago
- An implementation of "Subspace Representations for Soft Set Operations and Sentence Similarities" (NAACL 2024)☆10May 31, 2024Updated 2 years ago
- ☆16Dec 9, 2023Updated 2 years ago
- Bash scripts for my day☆18Dec 6, 2021Updated 4 years ago
Are these results useful?