Alternatives and similar repositories for prism-alignment

Users that are interested in prism-alignment are comparing it to the libraries listed below

• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆119Updated 2 years ago
• roeehendel / icl_task_vectors
  ☆103Updated 2 years ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆99Updated 2 years ago
• tatsu-lab / opinions_qa
  ☆116Updated last year
• activatedgeek / calibration-tuning
  ☆52Updated 8 months ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆67Updated last year
• saprmarks / geometry-of-truth
  ☆95Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆122Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆187Updated 7 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆130Updated last year
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆151Updated 5 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆84Updated 9 months ago
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆165Updated last year
• IBM / activation-steering
  [ICLR 2025] General-purpose activation steering library
  ☆127Updated 2 months ago
• causalNLP / corr2cause
  Data and code for the Corr2Cause paper (ICLR 2024)
  ☆111Updated last year
• joeljang / RLPHF
  Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
  ☆113Updated 2 years ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆24Updated last year
• balevinstein / Probes
  ☆57Updated 2 years ago
• OATML / semantic-entropy-probes
  ☆49Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• explanare / ravel
  Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
  ☆57Updated last month
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆133Updated last year
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆154Updated 3 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆99Updated 4 years ago
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆193Updated 9 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆80Updated 4 months ago
• neubig / research-career-tools
  ☆165Updated last year
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆196Updated last year
• XiangLi1999 / AutoBencher
  ☆32Updated last year