Alternatives and similar repositories for judges

Users that are interested in judges are comparing it to the libraries listed below

• haizelabs / verdict
  Scale your LLM-as-a-judge.
  ☆240Updated 3 weeks ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆242Updated 8 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• writer / writing-in-the-margins
  ☆118Updated 10 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆332Updated this week
• apple / ml-superposition-prompting
  ☆144Updated 11 months ago
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆452Updated 2 weeks ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆425Updated last year
• 567-labs / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆221Updated this week
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆283Updated last month
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 9 months ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆173Updated 9 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆131Updated last month
• brandonstarxel / chunking_evaluation
  This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…
  ☆334Updated 3 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆282Updated 7 months ago
• jxnl / n-levels-of-rag
  ☆195Updated last year
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• AnswerDotAI / fastdata
  ☆152Updated 6 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆82Updated 8 months ago
• suvansh / ChromaAdaptEmbed
  ☆29Updated last year
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆122Updated last month
• MoritzLaurer / zeroshot-classifier
  Notebooks for training universal 0-shot classifiers on many different tasks
  ☆130Updated 6 months ago
• Knowledgator / GLiClass
  Generalist and Lightweight Model for Text Classification
  ☆134Updated 2 weeks ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆107Updated last year
• CYQIQ / MultiCoT
  Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph
  ☆144Updated last year
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆112Updated 2 weeks ago
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆348Updated 4 months ago
• cognitivecomputations / spectrum
  ☆124Updated 2 months ago
• vespa-engine / pyvespa
  Python API for https://vespa.ai, the open big data serving engine
  ☆127Updated this week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆246Updated 4 months ago