dit7ya / awesome-ai-alignmentLinks
A curated list of awesome resources for Artificial Intelligence Alignment research
ā71Updated 2 years ago
Alternatives and similar repositories for awesome-ai-alignment
Users that are interested in awesome-ai-alignment are comparing it to the libraries listed below
Sorting:
- Keeping language models honest by directly eliciting knowledge encoded in their activations.ā209Updated last week
- š§ Starter templates for doing interpretability researchā73Updated 2 years ago
- A dataset of alignment research and code to reproduce itā77Updated 2 years ago
- we got you broā36Updated last year
- Tools for studying developmental interpretability in neural networks.ā101Updated 2 months ago
- Machine Learning for Alignment Bootcampā78Updated 3 years ago
- ā293Updated last year
- Emergent world representations: Exploring a sequence model trained on a synthetic taskā188Updated 2 years ago
- ā276Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"ā89Updated last year
- Mechanistic Interpretability Visualizations using Reactā282Updated 8 months ago
- ā138Updated last month
- ā238Updated 11 months ago
- ā106Updated 6 months ago
- Tools for understanding how transformer predictions are built layer-by-layerā521Updated 3 weeks ago
- ā74Updated 2 years ago
- ā27Updated 2 years ago
- Utilities for the HuggingFace transformers libraryā70Updated 2 years ago
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".ā112Updated last year
- A puzzle to learn about promptingā132Updated 2 years ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from eā¦ā28Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spacesā95Updated last year
- ā267Updated 7 months ago
- RuLES: a benchmark for evaluating rule-following in language modelsā230Updated 6 months ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMsā19Updated 10 months ago
- Mechanistic Interpretability for Transformer Modelsā51Updated 3 years ago
- ā57Updated last month
- Erasing concepts from neural representations with provable guarantees