Alternatives and similar repositories for EnvDistraction:

Users that are interested in EnvDistraction are comparing it to the libraries listed below

• Lordog / R-Judge
  R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)
  ☆65Updated 2 weeks ago
• zhxieml / remiss-jailbreak
  ☆21Updated 7 months ago
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆50Updated 10 months ago
• DYR1 / MoGU
  Our research proposes a novel MoGU framework that improves LLMs' safety while preserving their usability.
  ☆13Updated last month
• Improbable-AI / curiosity_redteam
  Official implementation of ICLR'24 paper, "Curiosity-driven Red Teaming for Large Language Models" (https://openreview.net/pdf?id=4KqkizX…
  ☆70Updated 11 months ago
• SALT-NLP / PopupAttack
  Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups
  ☆26Updated last month
• pillowsofwind / Course-Correction
  [EMNLP 2024] The official GitHub repo for the paper "Course-Correction: Safety Alignment Using Synthetic Preferences"
  ☆19Updated 4 months ago
• YihanWang617 / LLM-Jailbreaking-Defense-Backtranslation
  Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"
  ☆27Updated 6 months ago
• AI4Good24 / PsySafe
  ☆39Updated 2 weeks ago
• OSU-NLP-Group / AgentAttack
  ☆17Updated 3 months ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆48Updated 2 months ago
• Unispac / shallow-vs-deep-alignment
  Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep
  ☆71Updated 7 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆58Updated 5 months ago
• EchoseChen / SPA-VL-RLHF
  The reinforcement learning codes for dataset SPA-VL
  ☆28Updated 7 months ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆53Updated 2 months ago
• hanxuhu / SeqIns
  The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…
  ☆29Updated 2 months ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆45Updated 3 months ago
• Jometeorie / KnowledgeSpread
  ☆29Updated 4 months ago
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆56Updated last month
• princeton-nlp / benign-data-breaks-safety
  ☆30Updated 4 months ago
• hkust-nlp / mstar
  M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆55Updated last month
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆60Updated 4 months ago
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆58Updated 3 weeks ago
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆104Updated 5 months ago
• ChnQ / TracingLLM
  ☆25Updated 9 months ago
• ChenWu98 / agent-attack
  [Arxiv 2024] Dissecting Adversarial Robustness of Multimodal LM Agents
  ☆60Updated last month
• AI45Lab / MLLMGuard
  ☆21Updated 3 months ago
• zitian-gao / SC-MCTS
  Interpretable Contrastive Monte Carlo Tree Search Reasoning
  ☆42Updated 3 months ago
• thu-coai / JailbreakDefense_GoalPriority
  [ACL 2024] Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization
  ☆19Updated 7 months ago