Alternatives and similar repositories for prism-alignment

Users that are interested in prism-alignment are comparing it to the libraries listed below

• tatsu-lab / opinions_qa
  ☆116Updated last year
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆124Updated last year
• roeehendel / icl_task_vectors
  ☆103Updated 2 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆119Updated 2 years ago
• vinid / NegotiationArena
  ☆80Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆100Updated 2 years ago
• activatedgeek / calibration-tuning
  ☆52Updated 9 months ago
• joeljang / RLPHF
  Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
  ☆116Updated 2 years ago
• IBM / activation-steering
  [ICLR 2025] General-purpose activation steering library
  ☆136Updated 4 months ago
• saprmarks / geometry-of-truth
  ☆98Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆69Updated this week
• balevinstein / Probes
  ☆57Updated 2 years ago
• XiangLi1999 / AutoBencher
  ☆32Updated last year
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆85Updated 3 weeks ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆99Updated 4 years ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆132Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆85Updated 10 months ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆190Updated 9 months ago
• google / belief-localization
  This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…
  ☆60Updated 2 years ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆161Updated 6 months ago
• edenbiran / HoppingTooLate
  Exploring the Limitations of Large Language Models on Multi-Hop Queries
  ☆29Updated 10 months ago
• neubig / research-career-tools
  ☆165Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆165Updated last year
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆100Updated 2 years ago
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆156Updated 4 months ago
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆162Updated 2 months ago
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆26Updated 10 months ago
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆29Updated last year