Alternatives and similar repositories for lm-polygraph:

Users that are interested in lm-polygraph are comparing it to the libraries listed below

• OpenMOSS / Language-Model-SAEs
  For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
  ☆91Updated this week
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆160Updated this week
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆102Updated 8 months ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆82Updated this week
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆122Updated 8 months ago
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆179Updated 4 months ago
• evandez / relations
  How do transformer LMs encode relations?
  ☆46Updated 11 months ago
• EleutherAI / delphi
  ☆149Updated this week
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆213Updated last year
• davidbau / baukit
  ☆189Updated 11 months ago
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆181Updated 4 months ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆137Updated 4 months ago
• wesg52 / sparse-probing-paper
  Sparse probing paper full code.
  ☆53Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆115Updated 4 months ago
• balevinstein / Probes
  ☆46Updated last year
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆182Updated 2 months ago
• ArthurConmy / Automatic-Circuit-Discovery
  ☆203Updated 4 months ago
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆87Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆71Updated last year
• redwoodresearch / Easy-Transformer
  ☆109Updated 6 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆184Updated 2 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆182Updated 2 months ago
• AlexTMallen / adaptive-retrieval
  ☆174Updated 2 years ago
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆318Updated 8 months ago
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆316Updated 3 months ago
• ai-safety-foundation / sparse_autoencoder
  Sparse Autoencoder for Mechanistic Interpretability
  ☆215Updated 6 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆83Updated 6 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆145Updated 2 months ago
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆462Updated last year
• roeehendel / icl_task_vectors
  ☆89Updated last year