moirage / alignment-research-dataset
A dataset of alignment research and code to reproduce it
☆73Updated last year
Alternatives and similar repositories for alignment-research-dataset:
Users that are interested in alignment-research-dataset are comparing it to the libraries listed below
- Mechanistic Interpretability for Transformer Models☆49Updated 2 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆195Updated last week
- Measuring the situational awareness of language models☆34Updated last year
- A repository for transformer critique learning and generation☆88Updated last year
- ☆61Updated 3 weeks ago
- ☆22Updated last year
- ☆25Updated 10 months ago
- ☆253Updated 7 months ago
- Factored Cognition Primer: How to write compositional language model programs☆48Updated last year
- One stop shop for all things carp☆59Updated 2 years ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆164Updated this week
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆112Updated 2 years ago
- we got you bro☆35Updated 6 months ago
- Redwood Research's transformer interpretability tools☆14Updated 2 years ago
- Erasing concepts from neural representations with provable guarantees☆222Updated 3 weeks ago
- Utilities for the HuggingFace transformers library☆64Updated 2 years ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆64Updated 8 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆71Updated last year
- ☆128Updated 3 months ago
- A curated list of awesome resources for Artificial Intelligence Alignment research☆68Updated last year
- Drive a browser with Cohere☆72Updated last year
- See the issue board for the current status of active and prospective projects!☆65Updated 3 years ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆78Updated this week
- ☆50Updated 4 months ago
- ☆44Updated 3 months ago
- ☆93Updated 2 months ago
- ☆81Updated last week
- gzip Predicts Data-dependent Scaling Laws☆34Updated 8 months ago