OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents [NeurIPS 2025 Spotlight]
☆72Sep 18, 2025Updated 11 months ago
Alternatives and similar repositories for os-harm
Users that are interested in os-harm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2025] Official repository of RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents☆124Dec 2, 2025Updated 8 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆34Jan 23, 2025Updated last year
- ☆46Jun 19, 2025Updated last year
- A powerful white-box adversarial attack that exploits knowledge about the geometry of neural networks to find minimal adversarial perturb…☆12Aug 5, 2020Updated 6 years ago
- [ICLR'26 Oral] RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments☆60Feb 9, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆43Nov 7, 2025Updated 9 months ago
- ☆20Mar 16, 2026Updated 5 months ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆228Updated this week
- On the effectiveness of adversarial training against common corruptions [UAI 2022]☆30May 16, 2022Updated 4 years ago
- Implementation of average- and worst-case robust flatness measures for adversarial training.☆15Nov 5, 2021Updated 4 years ago
- ☆48Dec 9, 2025Updated 8 months ago
- FuseLIP: Multimodal Embeddings via Early Fusion of Discrete Tokens☆17Sep 8, 2025Updated 11 months ago
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆21May 2, 2024Updated 2 years ago
- Provable Robustness of ReLU networks via Maximization of Linear Regions [AISTATS 2019]☆31Jul 15, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments☆3,113Updated this week
- AI Control evaluation library. Built natively on Inspect AI.☆17Feb 25, 2026Updated 6 months ago
- [WACV 2026] MomentMix Augmentation with Length-Aware DETR for Temporally Robust Moment Retrieval☆14Sep 18, 2025Updated 11 months ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆44Sep 11, 2023Updated 2 years ago
- ☆15Dec 7, 2021Updated 4 years ago
- [ECCV 2024] Towards Reliable Evaluation and Fast Training of Robust Semantic Segmentation Models☆21Jul 17, 2024Updated 2 years ago
- Provable Worst Case Guarantees for the Detection of Out-of-Distribution Data☆13Sep 20, 2022Updated 3 years ago
- [ICML'20] Multi Steepest Descent (MSD) for robustness against the union of multiple perturbation models.☆25Jul 25, 2024Updated 2 years ago
- ☆158Aug 11, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [ICLR 2025] DGQ: Distribution-Aware Group Quantization for Text-to-Image Diffusion Models☆20Mar 25, 2025Updated last year
- Code for the API, workload execution, and agents underlying the LLMail-Inject Adpative Prompt Injection Challenge☆26Apr 9, 2026Updated 4 months ago
- ☆196Oct 31, 2025Updated 9 months ago
- Source code of "Leaky Thoughts: Large Reasoning Models Are Not Private Thinkers" EMNLP 2025☆17Jan 12, 2026Updated 7 months ago
- [USENIX'23] TPatch: A Triggered Physical Adversarial Patch☆25Aug 8, 2023Updated 3 years ago
- Run Inspect AI evals in the cloud☆53Updated this week
- [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents☆87Aug 19, 2026Updated last week
- Official implementation of the WASP web agent security benchmark☆98Apr 13, 2026Updated 4 months ago
- ☆19Feb 25, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Nov 12, 2024Updated last year
- ☆25May 25, 2024Updated 2 years ago
- ☆20May 23, 2025Updated last year
- Code for the paper "Evading Black-box Classifiers Without Breaking Eggs" [SaTML 2024]☆21Apr 15, 2024Updated 2 years ago
- CoAct-1: Computer-using Agents with Coding as Actions☆28Jun 2, 2026Updated 2 months ago
- Code and data for the ICLR 2021 paper "Perceptual Adversarial Robustness: Defense Against Unseen Threat Models".☆56Jan 18, 2022Updated 4 years ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆779Jun 2, 2026Updated 2 months ago