METR / RE-BenchLinks
☆76Updated last month
Alternatives and similar repositories for RE-Bench
Users that are interested in RE-Bench are comparing it to the libraries listed below
Sorting:
- Open source interpretability artefacts for R1.☆140Updated last month
- ☆22Updated this week
- ☆114Updated 3 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated last year
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆173Updated 2 months ago
- Replicating O1 inference-time scaling laws☆87Updated 6 months ago
- PyTorch library for Active Fine-Tuning☆77Updated 3 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆75Updated 6 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆89Updated last week
- Measuring the situational awareness of language models☆35Updated last year
- Sparse Autoencoder Training Library☆50Updated last month
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆169Updated this week
- ☆131Updated 2 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆60Updated last month
- ☆174Updated last month
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆94Updated this week
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆76Updated last year
- Functional Benchmarks and the Reasoning Gap☆86Updated 8 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆54Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆70Updated 11 months ago
- ☆83Updated 9 months ago
- A library for efficient patching and automatic circuit discovery.☆65Updated last month
- ☆54Updated 8 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆106Updated last year
- ☆50Updated 2 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆190Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆180Updated this week
- Repository for the paper Stream of Search: Learning to Search in Language☆146Updated 4 months ago
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆105Updated last year
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year