Learning Safety Constraints for Large Language Models (ICML2025)
☆35May 25, 2026Updated last month
Alternatives and similar repositories for SafetyPolytope
Users that are interested in SafetyPolytope are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- offical implementation of MTSA: Multi-turn Safety Alignment for LLMs through Multi-round Red-teaming☆16Jun 2, 2025Updated last year
- ☆12Dec 22, 2025Updated 7 months ago
- Robust and safe deep reinforcement learning algorithms☆17Mar 27, 2024Updated 2 years ago
- Scaling safe exploration to vision control☆15Feb 19, 2025Updated last year
- The implementation of our IEEE S&P 2024 paper "Securely Fine-tuning Pre-trained Encoders Against Adversarial Examples".☆11Jun 28, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MISO: Learning Multiple Initial Solutions to Optimization Problems☆18Jun 18, 2026Updated last month
- Data and code for the paper: Finding Safety Neurons in Large Language Models☆29Jan 29, 2026Updated 5 months ago
- Official Implementation of NIPS 2022 paper Pre-activation Distributions Expose Backdoor Neurons☆15Jan 13, 2023Updated 3 years ago
- ☆13Aug 17, 2025Updated 11 months ago
- Official codebase for "STAIR: Improving Safety Alignment with Introspective Reasoning"☆89Feb 26, 2025Updated last year
- ☆14Mar 30, 2025Updated last year
- A collection of algorithms and experiment tools for safe sim to real transfer in robotics.☆28May 19, 2026Updated 2 months ago
- Official Code Implementation for the CCS 2022 Paper "On the Privacy Risks of Cell-Based NAS Architectures"☆11Nov 21, 2022Updated 3 years ago
- ☆15Jun 30, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆12Apr 4, 2025Updated last year
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆35Jan 31, 2025Updated last year
- Code to enable layer-level steering in LLMs using sparse auto encoders☆34Sep 18, 2025Updated 10 months ago
- Code implementation of “Flexible Coordination of Wind Generators and Energy Storages in joint Energy and Frequency Regulation Market“☆11Sep 26, 2023Updated 2 years ago
- Code for paper Feasible Actor-Critic: Constrained Reinforcement Learning for Ensuring Statewise Safety.☆20May 22, 2022Updated 4 years ago
- [NDSS'25] The official implementation of safety misalignment.☆19Jan 8, 2025Updated last year
- A research workbench for developing and testing attacks against large language models, with a focus on prompt injection vulnerabilities a…☆55Updated this week
- [RA-L 2025] RT-GuIDE: Real-Time Gaussian Splatting for Information-Driven Exploration☆23Nov 30, 2025Updated 7 months ago
- ☆33Jun 24, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code space for L4DC paper "State-wise Safe Reinforcement Learning With Pixel Observations"☆11Apr 5, 2024Updated 2 years ago
- Implementing DQNClipped and DQNReg Algorithms☆10Mar 2, 2021Updated 5 years ago
- Code repository for the paper --- [USENIX Security 2023] Towards A Proactive ML Approach for Detecting Backdoor Poison Samples☆31Jul 11, 2023Updated 3 years ago
- [ACL'24 Findings] Official code for "TLCR: Token-Level Continuous Reward for Fine-grained Reinforcement Learning from Human Feedback"☆12Dec 6, 2024Updated last year
- A modular power electronics hardware starter kit designed for sub-100V applications. Originally developed for the National Electronic Des…☆18Jan 5, 2026Updated 6 months ago
- [IROS2024] STAIR: Semantic-Targeted Active Implicit Reconstruction☆16Aug 3, 2024Updated last year
- Official codebase for Image Hijacks: Adversarial Images can Control Generative Models at Runtime☆56Sep 19, 2023Updated 2 years ago
- Adversarial Attack for Pre-trained Code Models☆10Jul 19, 2022Updated 4 years ago
- ☆17Jul 2, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The code implementation of MuScleLoRA (Accepted in ACL 2024)☆10Dec 1, 2024Updated last year
- Train text generation model with JavaScript.☆15Jul 14, 2024Updated 2 years ago
- ☆41Jul 3, 2026Updated 2 weeks ago
- Deploy RL on your Real-World Franka Emika Panda☆15Feb 22, 2026Updated 5 months ago
- Convergent Policy Optimization for Safe Reinforcement Learning☆11Oct 26, 2019Updated 6 years ago
- ☆18May 14, 2026Updated 2 months ago
- [EMNLP 2024] Introducing Filtered Direct Preference Optimization (fDPO) that enhances language model alignment with human preferences by …☆16Nov 27, 2024Updated last year