haizelabs / verdict
Scaling inference-time compute for LLM-as-a-judge, automated evaluations, guardrails, and reinforcement learning.
☆189Updated last week
Alternatives and similar repositories for verdict:
Users that are interested in verdict are comparing it to the libraries listed below
- ⚖️ Awesome LLM Judges ⚖️☆86Updated last month
- ☆106Updated last week
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆97Updated this week
- A strongly typed Python DSL for developing message passing multi agent systems☆52Updated 11 months ago
- ☆97Updated 5 months ago
- Train your own SOTA deductive reasoning model☆81Updated 3 weeks ago
- Sphynx Hallucination Induction☆53Updated last month
- ☆113Updated 7 months ago
- Letting Claude Code develop his own MCP tools :)☆90Updated 2 weeks ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated 11 months ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆425Updated 6 months ago
- ☆67Updated last month
- Functional Benchmarks and the Reasoning Gap☆84Updated 5 months ago
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆129Updated last week
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆168Updated 2 months ago
- Red-Teaming Language Models with DSPy☆175Updated last month
- Claude Deep Research config for Claude Code.☆155Updated last week
- smolLM with Entropix sampler on pytorch☆150Updated 4 months ago
- Tutorial for building LLM router☆186Updated 8 months ago
- Prompt design in Python☆55Updated 4 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆229Updated last month
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆165Updated 2 weeks ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 7 months ago
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆93Updated 2 months ago
- ☆150Updated 3 months ago
- ☆108Updated 2 weeks ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆50Updated 5 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆224Updated 10 months ago
- ☆85Updated 2 months ago
- An MCP Server that's also an MCP Client. Useful for letting Claude develop and test MCPs without needing to reset the application.☆106Updated 2 weeks ago