Alternatives and similar repositories for lm-polygraph

Users that are interested in lm-polygraph are comparing it to the libraries listed below

• adamkarvonen / SAEBench
  ☆93Updated last month
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆97Updated 2 months ago
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆217Updated 7 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆116Updated 11 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆200Updated last week
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆92Updated last year
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆115Updated last year
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆172Updated 3 months ago
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆203Updated 7 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆73Updated last year
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆100Updated 2 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆191Updated 5 months ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆151Updated 11 months ago
• zlin7 / UQ-NLG
  ☆88Updated 10 months ago
• OpenMOSS / Language-Model-SAEs
  For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
  ☆114Updated this week
• evandez / relations
  How do transformer LMs encode relations?
  ☆48Updated last year
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆105Updated last year
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆172Updated this week
• AIRI-Institute / SAE-Reasoning
  ☆59Updated last month
• roeehendel / icl_task_vectors
  ☆94Updated last year
• vinid / NegotiationArena
  ☆69Updated last year
• balevinstein / Probes
  ☆50Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆123Updated 8 months ago
• cooperleong00 / Awesome-LLM-Interpretability
  A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..
  ☆235Updated last month
• jacobdunefsky / transcoder_circuits
  ☆112Updated 6 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆218Updated 6 months ago
• davidbau / baukit
  ☆206Updated last year
• wesg52 / sparse-probing-paper
  Sparse probing paper full code.
  ☆56Updated last year
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆211Updated last month
• inseq-team / inseq
  Interpretability for sequence generation models 🐛 🔍
  ☆413Updated 3 weeks ago