AgentAlign: Navigating Safety Alignment in the Shift from Informative to Agentic Large Language Models
☆14Jun 2, 2025Updated last year
Alternatives and similar repositories for AgentAlign
Users that are interested in AgentAlign are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CVPR'26] SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimization☆23Feb 19, 2026Updated 9 months ago
- “ToolHazard: Scalable Red Teaming of LLM Agents via Adversarial Tool-Interactive Environment and Task Synthesis”☆15Aug 18, 2026Updated 3 months ago
- The official code of On-Policy Self-Evolution via Failure Trajectories for Agentic Safety Alignment☆30Oct 29, 2026Updated 3 weeks ago
- [ICML 2026] Official implementation for paper "Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Ag…☆40Jul 31, 2026Updated 3 months ago
- Accept by CVPR 2025 (highlight)☆27Jun 8, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for ICCV2025 paper——IDEATOR: Jailbreaking and Benchmarking Large Vision-Language Models Using Themselves☆18Jul 11, 2025Updated last year
- Code for the paper "Jailbreak Large Vision-Language Models Through Multi-Modal Linkage"☆36Dec 6, 2024Updated last year
- ☆20Dec 23, 2025Updated 10 months ago
- ☆168Aug 11, 2025Updated last year
- A Universal and Fine-grained Hallucination Evaluation Framework for Large Vision Language Models☆11Feb 29, 2024Updated 2 years ago
- The public repository of ICML 2026 "SafeHarbor: Defining Precise Decision Boundaries via Hierarchical Memory-Augmented Guardrail for LLM …☆15May 6, 2026Updated 6 months ago
- ☆11Dec 29, 2022Updated 3 years ago
- ☆12Jan 13, 2026Updated 10 months ago
- Official codebase for "STAIR: Improving Safety Alignment with Introspective Reasoning"☆91Feb 26, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The official repository for AAAI 2024 Oral paper "Structured Probabilistic Coding".☆13Sep 7, 2024Updated 2 years ago
- Official implementation of “Contextual Image Attack: How Visual Context Exposes Multimodal Safety Vulnerabilities”☆11Apr 1, 2026Updated 7 months ago
- ☆17Aug 27, 2026Updated 2 months ago
- ☆24Jun 16, 2025Updated last year
- Beyond Environment and User Inputs: A Comprehensive Survey of Skill-Oriented Security in Agentic AI☆14Aug 28, 2026Updated 2 months ago
- [ECCV'24 Oral] The official GitHub page for ''Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking …☆39Oct 23, 2024Updated 2 years ago
- GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness Evolution☆26Sep 29, 2026Updated last month
- Repo for HAICOSYSTEM☆14Jun 1, 2025Updated last year
- Accepted by ECCV 2024☆222Oct 15, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The repo for using the model https://huggingface.co/thu-coai/Attacker-v0.1☆13Apr 23, 2025Updated last year
- [CVPR 2025] Official implementation for "Steering Away from Harm: An Adaptive Approach to Defending Vision Language Model Against Jailbre…☆66Jul 5, 2025Updated last year
- Code repository for the paper "Heuristic Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models"☆21Aug 7, 2025Updated last year
- ThanoRA: Task Heterogeneity-Aware Multi-Task Low-Rank Adaptation☆13Oct 1, 2025Updated last year
- Official implementation of Visco-Attack (EMNLP 2025 Main). An open-source one-click reproduction script is also provided.☆31Apr 11, 2026Updated 7 months ago
- SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Types☆26Nov 29, 2024Updated last year
- [ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.☆91Jan 19, 2025Updated last year
- Official implementation for "DREAM: Scalable Red Teaming for Text-to-Image Generative Systems via Distribution Modeling" (IEEE S&P 2026)☆14Jan 28, 2026Updated 9 months ago
- Official Implementation of VoxTracer (MM' 23)☆11Oct 27, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆14Jun 25, 2024Updated 2 years ago
- [ICLR 2025] Understanding and Enhancing Safety Mechanisms of LLMs via Safety-Specific Neuron☆36Apr 30, 2025Updated last year
- Official repository for ACM Multimedia'23 paper "MATK: The Meme Analytical Tool Kit"☆14May 29, 2024Updated 2 years ago
- Unified adversarial verifier hardening loop☆17Jul 3, 2026Updated 4 months ago
- DIVE: Scaling Diversity in Agentic Task Synthesis for Generalizable Tool Use☆34Mar 13, 2026Updated 8 months ago
- ☆34May 14, 2026Updated 6 months ago
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆14Sep 4, 2024Updated 2 years ago
Are these results useful?