haizelabs / verdictLinks
Inference-time scaling for LLMs-as-a-judge.
☆263Updated 2 weeks ago
Alternatives and similar repositories for verdict
Users that are interested in verdict are comparing it to the libraries listed below
Sorting:
- ⚖️ Awesome LLM Judges ⚖️☆108Updated 3 months ago
- A framework for optimizing DSPy programs with RL☆94Updated this week
- ☆130Updated 4 months ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆448Updated 10 months ago
- Red-Teaming Language Models with DSPy☆203Updated 5 months ago
- Sphynx Hallucination Induction☆53Updated 6 months ago
- ☆154Updated 8 months ago
- TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle☆288Updated this week
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆87Updated 10 months ago
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆259Updated last month
- Attribute (or cite) statements generated by LLMs back to in-context information.☆261Updated 9 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆100Updated this week
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆174Updated 4 months ago
- Open source interpretability artefacts for R1.☆157Updated 3 months ago
- Train your own SOTA deductive reasoning model☆101Updated 4 months ago
- ☆64Updated 2 months ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆568Updated this week
- j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.☆94Updated 2 weeks ago
- Synthetic Data for LLM Fine-Tuning☆120Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆102Updated last year
- ☆340Updated last month
- ☆123Updated 11 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆217Updated last week
- ☆194Updated last month
- Use the OpenAI Batch tool to make async batch requests to the OpenAI API.☆99Updated last year
- Collection of evals for Inspect AI☆198Updated this week
- A small library of LLM judges☆241Updated last month
- ☆57Updated 3 weeks ago
- ☆101Updated last week
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆45Updated 2 months ago