Alternatives and similar repositories for xlab-ai-security

Users that are interested in xlab-ai-security are comparing it to the libraries listed below

• decoderesearch / SAELens
  Training Sparse Autoencoders on Language Models
  ☆1,130Updated this week
• callummcdougall / ARENA_3.0
  ☆854Updated last month
• ndif-team / nnsight
  The nnsight package enables interpreting and manipulating the internals of deep learned models.
  ☆738Updated last week
• TransformerLensOrg / TransformerLens
  A library for mechanistic interpretability of GPT-style language models
  ☆2,921Updated 2 weeks ago
• UKGovernmentBEIS / control-arena
  ControlArena is a collection of settings, model organisms and protocols - for running control experiments.
  ☆143Updated last week
• GraySwanAI / nanoGCG
  A fast + lightweight implementation of the GCG algorithm in PyTorch
  ☆306Updated 7 months ago
• ai-safety-foundation / sparse_autoencoder
  Sparse Autoencoder for Mechanistic Interpretability
  ☆285Updated last year
• curt-tigges / probity
  ☆19Updated 8 months ago
• thejaminator / latteries
  James' cookbook of evaluations and finetuning experiments
  ☆15Updated last week
• locuslab / open-unlearning
  [NeurIPS D&B '25] The one-stop repository for LLM unlearning
  ☆452Updated this week
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆673Updated last week
• stanfordnlp / pyvene
  Stanford NLP Python library for understanding and improving PyTorch models via interventions
  ☆843Updated 2 months ago
• centerforaisafety / HarmBench
  HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal
  ☆813Updated last year
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆321Updated 6 months ago
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆303Updated last year
• saprmarks / dictionary_learning
  ☆373Updated 4 months ago
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆289Updated 2 years ago
• hijohnnylin / neuronpedia
  open source interpretability platform 🧠
  ☆562Updated last week
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆313Updated last week
• ArthurConmy / Automatic-Circuit-Discovery
  ☆261Updated last year
• Dakingrai / awesome-mechanistic-interpretability-lm-papers
  ☆223Updated last year
• callummcdougall / ARENA_2.0
  Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.
  ☆236Updated 4 months ago
• LRudL / evalugator
  (Model-written) LLM evals library
  ☆18Updated last year
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆389Updated last year
• emergent-misalignment / emergent-misalignment
  ☆233Updated 3 weeks ago
• Butanium / nnterp
  Unified access to Large Language Model modules using NNsight
  ☆70Updated last month
• kutay25 / ai-safety-alignment-camps
  An repository of 2025-2026 AI Safety and Alignment programs, camps, and workshops.
  ☆21Updated 7 months ago
• jacobdunefsky / transcoder_circuits
  ☆192Updated last year
• EdinburghNLP / awesome-hallucination-detection
  List of papers on hallucination detection in LLMs.
  ☆1,008Updated last month
• METR / task-standard
  METR Task Standard
  ☆169Updated 10 months ago