Alternatives and similar repositories for lm-polygraph:

Users that are interested in lm-polygraph are comparing it to the libraries listed below

• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆167Updated last month
• adamkarvonen / SAEBench
  ☆78Updated last week
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆163Updated 4 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆219Updated 5 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆193Updated this week
• OpenMOSS / Language-Model-SAEs
  For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
  ☆105Updated last week
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆195Updated 5 months ago
• evandez / relations
  How do transformer LMs encode relations?
  ☆46Updated last year
• roeehendel / icl_task_vectors
  ☆93Updated last year
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆108Updated 9 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆59Updated last month
• inseq-team / inseq
  Interpretability for sequence generation models 🐛 🔍
  ☆410Updated 4 months ago
• hannamw / EAP-IG
  ☆23Updated last month
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆163Updated this week
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆131Updated 10 months ago
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆237Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆116Updated 5 months ago
• tatsu-lab / opinions_qa
  ☆104Updated 10 months ago
• redwoodresearch / Easy-Transformer
  ☆113Updated 7 months ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆90Updated last month
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆190Updated 6 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆147Updated 11 months ago
• balevinstein / Probes
  ☆47Updated last year
• explanare / ravel
  Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
  ☆42Updated 5 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆73Updated last year
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆91Updated last year
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆52Updated 4 months ago
• jkallini / mission-impossible-language-models
  Code repository for the paper "Mission: Impossible Language Models."
  ☆50Updated this week
• google-deepmind / mishax
  ☆124Updated this week
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆71Updated last year