Alternatives and similar repositories for evalugator:

Users that are interested in evalugator are comparing it to the libraries listed below

• METR / task-standard
  METR Task Standard
  ☆142Updated 2 weeks ago
• timaeus-research / devinterp
  Tools for studying developmental interpretability in neural networks.
  ☆84Updated 3 weeks ago
• Cadenza-Labs / sleeper-agents
  ☆10Updated 7 months ago
• redwoodresearch / interp
  Redwood Research's transformer interpretability tools
  ☆14Updated 2 years ago
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆78Updated this week
• amack315 / unsupervised-steering-vectors
  ☆29Updated 9 months ago
• redwoodresearch / alignment_faking_public
  ☆40Updated last month
• ArthurConmy / Automatic-Circuit-Discovery
  ☆203Updated 4 months ago
• redwoodresearch / mlab
  Machine Learning for Alignment Bootcamp
  ☆70Updated 2 years ago
• annahdo / implementing_activation_steering
  A collection of different ways to implement accessing and modifying internal model activations for LLMs
  ☆11Updated 4 months ago
• callummcdougall / sae_visualizer
  ☆25Updated 10 months ago
• slavachalnev / SAE-TS
  Improving Steering Vectors by Targeting Sparse Autoencoder Features
  ☆15Updated 3 months ago
• adamkarvonen / SAEBench
  ☆52Updated this week
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆53Updated this week
• jacobdunefsky / transcoder_circuits
  ☆55Updated 3 months ago
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆232Updated 2 months ago
• koayon / atp_star
  PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)
  ☆18Updated last month
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆116Updated last year
• Aaquib111 / edge-attribution-patching
  Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"
  ☆29Updated 8 months ago
• EleutherAI / elk
  Keeping language models honest by directly eliciting knowledge encoded in their activations.
  ☆195Updated last week
• redwoodresearch / rust_circuit_public
  ☆61Updated 2 years ago
• AsaCooperStickland / situational-awareness-evals
  Measuring the situational awareness of language models
  ☆34Updated last year
• google-deepmind / dangerous-capability-evaluations
  ☆50Updated 4 months ago
• METR / public-tasks
  ☆83Updated last month
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆88Updated this week
• thestephencasper / everything-you-need
  we got you bro
  ☆35Updated 6 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆182Updated 2 months ago
• alignedai / HappyFaces
  The Happy Faces Benchmark
  ☆14Updated last year
• saprmarks / feature-circuits
  ☆142Updated 3 weeks ago