moirage / alignment-research-dataset
A dataset of alignment research and code to reproduce it
☆74Updated last year
Alternatives and similar repositories for alignment-research-dataset:
Users that are interested in alignment-research-dataset are comparing it to the libraries listed below
- Mechanistic Interpretability for Transformer Models☆50Updated 2 years ago
- Measuring the situational awareness of language models☆34Updated last year
- ☆26Updated 11 months ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆197Updated this week
- ☆65Updated last month
- we got you bro☆35Updated 7 months ago
- Drive a browser with Cohere☆72Updated last year
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 2 years ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- Factored Cognition Primer: How to write compositional language model programs☆48Updated 2 years ago
- ☆20Updated 3 years ago
- Utilities for the HuggingFace transformers library☆66Updated 2 years ago
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆168Updated this week
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆73Updated last year
- Erasing concepts from neural representations with provable guarantees☆226Updated last month
- ☆124Updated this week
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆67Updated 9 months ago
- ☆22Updated last year
- See the issue board for the current status of active and prospective projects!☆65Updated 3 years ago
- ☆44Updated 4 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆117Updated 2 years ago
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆73Updated 7 months ago
- One stop shop for all things carp☆59Updated 2 years ago
- Redwood Research's transformer interpretability tools☆14Updated 2 years ago
- ☆260Updated 8 months ago
- A repository for transformer critique learning and generation☆89Updated last year
- Code repository for the c-BTM paper☆106Updated last year
- 🧠 Starter templates for doing interpretability research☆67Updated last year
- ☆86Updated last week