Alternatives and similar repositories for judges:

Users that are interested in judges are comparing it to the libraries listed below

• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆200Updated 4 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆233Updated this week
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆100Updated 10 months ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆406Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆261Updated 3 months ago
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆241Updated 2 weeks ago
• AnswerDotAI / fastdata
  ☆147Updated 2 months ago
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆79Updated 3 weeks ago
• eugeneyan / align-app
  ☆58Updated 3 months ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆147Updated 4 months ago
• apple / ml-superposition-prompting
  ☆141Updated 7 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆101Updated last year
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆106Updated last week
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆122Updated 2 months ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆93Updated this week
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆74Updated 5 months ago
• tonywu71 / colpali-cookbooks
  Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳
  ☆258Updated 2 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆208Updated this week
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆111Updated last year
• Knowledgator / GLiClass
  Generalist and Lightweight Model for Text Classification
  ☆79Updated this week
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆57Updated 11 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆93Updated 2 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆168Updated last week
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆47Updated 3 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆182Updated 7 months ago
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆185Updated 4 months ago
• ivanleomk / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆70Updated 3 weeks ago
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆63Updated last year