UKGovernmentBEIS / inspect_aiLinks
Inspect: A framework for large language model evaluations
☆1,323Updated this week
Alternatives and similar repositories for inspect_ai
Users that are interested in inspect_ai are comparing it to the libraries listed below
Sorting:
- Collection of evals for Inspect AI☆233Updated this week
- A library for making RepE control vectors☆636Updated 8 months ago
- A benchmark to evaluate language models on questions I've previously asked them to solve.☆1,030Updated 4 months ago
- utilities for decoding deep representations (like sentence embeddings) back to text☆939Updated last month
- METR Task Standard☆159Updated 7 months ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆986Updated 4 months ago
- Inference-time scaling for LLMs-as-a-judge.☆297Updated 2 weeks ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,942Updated this week
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,594Updated this week
- ☆31Updated this week
- open source interpretability platform 🧠☆413Updated this week
- System 2 Reasoning Link Collection☆852Updated 6 months ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆813Updated last month
- A library for generative social simulation☆1,020Updated this week
- Code and Data for Tau-Bench☆843Updated 3 weeks ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆665Updated this week
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆93Updated this week
- procedural reasoning datasets☆1,102Updated this week
- Training Sparse Autoencoders on Language Models☆967Updated last week
- OO for LLMs☆849Updated this week
- A tool for evaluating LLMs☆423Updated last year
- A small library of LLM judges☆282Updated last month
- Automatically evaluate your LLMs in Google Colab☆659Updated last year
- Stanford NLP Python library for understanding and improving PyTorch models via interventions☆806Updated 3 weeks ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆692Updated this week
- Synthetic data curation for post-training and structured data extraction☆1,500Updated last month
- Sparsify transformers with SAEs and transcoders☆622Updated this week
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆564Updated last year
- End-to-end Generative Optimization for AI Agents☆645Updated last month
- An agent benchmark with tasks in a simulated software company.☆551Updated this week