Alternatives and similar repositories for CodeHalu

Users that are interested in CodeHalu are comparing it to the libraries listed below

• eth-sri / SafeCoder
  ☆42Updated 10 months ago
• floatai / HumanEval-XL
  [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization
  ☆39Updated 2 months ago
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆84Updated last year
• AI-secure / RedCode
  [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents
  ☆35Updated last month
• CodeLLM-Research / CodeJudge-Eval
  [COLING25] CodeJudge Eval: Can Large Language Models be Good Judges in Code Understanding?
  ☆12Updated 6 months ago
• SORRY-Bench / sorry-bench
  Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)
  ☆54Updated 3 months ago
• OSU-NLP-Group / AgentSafety
  ☆76Updated last month
• xbmxb / EnvDistraction
  ☆19Updated 7 months ago
• uiuc-kang-lab / InjecAgent
  ☆63Updated 11 months ago
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆77Updated 10 months ago
• PurCL / ProSec
  Official repo for "ProSec: Fortifying Code LLMs with Proactive Security Alignment"
  ☆14Updated 2 months ago
• zhaoyiran924 / Probe-Sampling
  [NeurIPS 2024] Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Sampling
  ☆28Updated 6 months ago
• seketeam / EvoCodeBench
  An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
  ☆60Updated 9 months ago
• YihanWang617 / LLM-Jailbreaking-Defense-Backtranslation
  Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"
  ☆29Updated 9 months ago
• ntunlp / ExecEval
  A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.
  ☆54Updated 7 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆100Updated last year
• facebookresearch / SecAlign
  Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"
  ☆48Updated 2 months ago
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆60Updated 2 weeks ago
• Co1lin / CWEval
  Simultaneous evaluation on both functionality and security of LLM-generated code.
  ☆17Updated 4 months ago
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆61Updated 4 months ago
• ydyjya / LLM-IHS-Explanation
  ☆49Updated 11 months ago
• SALT-NLP / PopupAttack
  Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups
  ☆32Updated 5 months ago
• xyliu-cs / RISE
  Official Implementation of RISE (Reinforcing Reasoning with Self-Verification)
  ☆23Updated last week
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆142Updated last year
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆93Updated last year
• thunlp / Advbench
  Code and data of the EMNLP 2022 paper "Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversaria…
  ☆50Updated 2 years ago
• Lordog / R-Judge
  R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)
  ☆76Updated 3 weeks ago
• reddy-lab-code-research / PPOCoder
  Code for the TMLR 2023 paper "PPOCoder: Execution-based Code Generation using Deep Reinforcement Learning"
  ☆112Updated last year
• amazon-science / mxeval
  ☆110Updated 10 months ago
• AI-secure / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆126Updated last month