Alternatives and similar repositories for judges:

Users that are interested in judges are comparing it to the libraries listed below

• haizelabs / verdict
  Verdict is a library for scaling judge-time compute.
  ☆199Updated last week
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆228Updated 6 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆272Updated 5 months ago
• AnswerDotAI / fastdata
  ☆150Updated 4 months ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆114Updated last week
• codelion / adaptive-classifier
  A flexible, adaptive classification system for dynamic text classification
  ☆156Updated last month
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆240Updated last week
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆93Updated 2 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆257Updated this week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆241Updated 2 months ago
• zeroentropy-ai / legalbenchrag
  This is the repo for the LegalBench-RAG Paper: https://arxiv.org/abs/2408.10343.
  ☆79Updated 3 months ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆422Updated last year
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆276Updated last week
• jxnl / n-levels-of-rag
  ☆194Updated 11 months ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆163Updated 7 months ago
• tonywu71 / colpali-cookbooks
  Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳
  ☆271Updated last week
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆114Updated last year
• brandonstarxel / chunking_evaluation
  This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…
  ☆293Updated last month
• writer / writing-in-the-margins
  ☆117Updated 7 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• 567-labs / systematically-improving-rag
  ☆116Updated this week
• SynaLinks / synalinks
  🧠🔗 Graph-Based Programmable Neuro-Symbolic LM Framework - a production-first LM framework built with decade old Deep Learning best prac…
  ☆184Updated this week
• ivanleomk / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆100Updated 2 weeks ago
• MoritzLaurer / zeroshot-classifier
  Notebooks for training universal 0-shot classifiers on many different tasks
  ☆124Updated 3 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• OpenPipe / ART
  OpenPipe ART (Agent Reinforcement Trainer): train LLM agents
  ☆108Updated this week
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆273Updated 9 months ago
• apple / ml-superposition-prompting
  ☆143Updated 9 months ago
• isaacus-dev / semchunk
  A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.
  ☆293Updated 3 weeks ago