moirage / alignment-research-dataset
A dataset of alignment research and code to reproduce it
☆69Updated last year
Related projects ⓘ
Alternatives and complementary repositories for alignment-research-dataset
- Mechanistic Interpretability for Transformer Models☆49Updated 2 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆186Updated this week
- ☆239Updated 4 months ago
- One stop shop for all things carp☆59Updated 2 years ago
- Measuring the situational awareness of language models☆33Updated 9 months ago
- Factored Cognition Primer: How to write compositional language model programs☆48Updated last year
- ☆24Updated 7 months ago
- ☆46Updated this week
- Drive a browser with Cohere☆72Updated last year
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 2 years ago
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆196Updated 5 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆62Updated last year
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆72Updated 3 months ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆152Updated this week
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆17Updated 10 months ago
- A repository for transformer critique learning and generation☆86Updated 11 months ago
- Erasing concepts from neural representations with provable guarantees☆209Updated last week
- Experiments with generating opensource language model assistants☆97Updated last year
- A library for squeakily cleaning and filtering language datasets.☆45Updated last year
- ☆22Updated last year
- Redwood Research's transformer interpretability tools☆12Updated 2 years ago
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆68Updated last year
- ☆44Updated last month
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆97Updated 2 years ago
- ☆101Updated 3 months ago
- Multi-Domain Expert Learning☆67Updated 9 months ago
- A library to create and manage configuration files, especially for machine learning projects.☆77Updated 2 years ago
- ☆122Updated 2 weeks ago
- we got you bro☆33Updated 3 months ago
- Small, simple agent task environments for training and evaluation☆16Updated 2 weeks ago