METR / eval-analysis-public
Public repository containing METR's DVC pipeline for eval data analysis
☆47Updated 2 weeks ago
Alternatives and similar repositories for eval-analysis-public:
Users that are interested in eval-analysis-public are comparing it to the libraries listed below
- Train your own SOTA deductive reasoning model☆86Updated last month
- ☆38Updated 8 months ago
- ☆17Updated 6 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 2 months ago
- look how they massacred my boy☆63Updated 6 months ago
- ☆37Updated 2 months ago
- Tools to make language models a bit easier to use☆42Updated this week
- ☆48Updated last year
- ☆22Updated 11 months ago
- A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX☆53Updated last year
- ☆28Updated 5 months ago
- ☆128Updated 3 weeks ago
- Verdict is a library for scaling judge-time compute.☆197Updated this week
- ☆28Updated 7 months ago
- Chat Markup Language conversation library☆55Updated last year
- ☆48Updated 5 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆21Updated 2 weeks ago
- ☆41Updated this week
- ☆36Updated 2 months ago
- LLM reads a paper and produce a working prototype☆52Updated last week
- A reading list of relevant papers and projects on foundation model annotation☆25Updated last month
- ☆72Updated 2 months ago
- Very minimal (and stateless) agent framework☆42Updated 3 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆90Updated 3 months ago
- ☆14Updated last month
- ☆64Updated last month
- Sphynx Hallucination Induction☆53Updated 2 months ago
- Testing paligemma2 finetuning on reasoning dataset☆18Updated 3 months ago
- ☆21Updated 3 weeks ago
- ☆19Updated last week