quantified-uncertainty / ai-safety-papers

Related projects ⓘ

Alternatives and complementary repositories for ai-safety-papers

• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆49Updated 2 years ago
• moirage / alignment-research-dataset
  A dataset of alignment research and code to reproduce it
  ☆69Updated last year
• anthropics / PySvelte
  A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations
  ☆174Updated 2 years ago
• paulfchristiano / amplification
  ☆9Updated 5 years ago
• JacobPfau / procgenAISC
  ☆18Updated last year
• redwoodresearch / interp
  Redwood Research's transformer interpretability tools
  ☆12Updated 2 years ago
• understanding-search / maze-transformer
  This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.
  ☆24Updated 2 months ago
• adamjermyn / toy_model_interpretability
  ☆11Updated 2 years ago
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆97Updated 2 years ago
• EleutherAI / elk
  Keeping language models honest by directly eliciting knowledge encoded in their activations.
  ☆186Updated this week
• timaeus-research / devinterp
  Tools for studying developmental interpretability in neural networks.
  ☆77Updated last week
• koayon / atp_star
  PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)
  ☆14Updated 7 months ago
• jbloomAus / DecisionTransformerInterpretability
  Interpreting how transformers simulate agents performing RL tasks
  ☆73Updated last year
• google-deepmind / cartesian-frames
  A formalisation of Cartesian Frames, a perspective on embedded agency, in the HOL theorem prover.
  ☆19Updated 2 years ago
• redwoodresearch / rust_circuit_public
  ☆61Updated last year
• alignedai / HappyFaces
  The Happy Faces Benchmark
  ☆14Updated last year
• dit7ya / awesome-ai-alignment
  A curated list of awesome resources for Artificial Intelligence Alignment research
  ☆64Updated last year
• thestephencasper / everything-you-need
  we got you bro
  ☆33Updated 3 months ago
• mishajw / repeng
  Experiments with representation engineering
  ☆10Updated 8 months ago
• alexander-turner / attainable-utility-preservation
  ☆12Updated 3 years ago
• apple / ml-np-rasp
  ☆18Updated 10 months ago
• apartresearch / interpretability-starter
  🧠 Starter templates for doing interpretability research
  ☆63Updated last year
• apartresearch / readingwhatwecan
  📚📚📚📚📚📚📚📚📚 Reading everything
  ☆12Updated 7 months ago
• callummcdougall / sae_visualizer
  ☆24Updated 7 months ago
• StampyAI / stampy-ui
  AI Safety Q&A web frontend
  ☆35Updated last week
• EleutherAI / project-menu
  See the issue board for the current status of active and prospective projects!
  ☆65Updated 2 years ago
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated last year
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆200Updated 4 months ago
• neale / avoiding-side-effects
  Code for reproducing the results from the paper Avoiding Side Effects in Complex Environments
  ☆12Updated 3 years ago
• samacqua / LARC
  Language-annotated Abstraction and Reasoning Corpus
  ☆79Updated last year