Alternatives and similar repositories for judges

Users that are interested in judges are comparing it to the libraries listed below

• haizelabs / verdict
  Verdict is a library for scaling judge-time compute.
  ☆211Updated 2 weeks ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆243Updated 2 months ago
• apple / ml-superposition-prompting
  ☆143Updated 9 months ago
• codelion / adaptive-classifier
  A flexible, adaptive classification system for dynamic text classification
  ☆165Updated last week
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆231Updated 7 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆281Updated 6 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆97Updated 2 weeks ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 7 months ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆166Updated 7 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• AnswerDotAI / fastdata
  ☆151Updated 5 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆38Updated 10 months ago
• MoritzLaurer / zeroshot-classifier
  Notebooks for training universal 0-shot classifiers on many different tasks
  ☆126Updated 4 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆109Updated last month
• cognitivecomputations / spectrum
  ☆120Updated last month
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆421Updated last year
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆116Updated last week
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆295Updated this week
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• apple / ToolSandbox
  ☆169Updated 9 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆110Updated 8 months ago
• cohere-ai / DiskVectorIndex
  ☆210Updated 10 months ago
• Liyan06 / MiniCheck
  MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
  ☆160Updated 4 months ago
• writer / writing-in-the-margins
  ☆117Updated 8 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆129Updated 2 weeks ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆86Updated 7 months ago
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆115Updated last year
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆235Updated 3 months ago
• dottxt-ai / demos
  ☆100Updated last month
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆217Updated 6 months ago