Alternatives and similar repositories for judges

Users that are interested in judges are comparing it to the libraries listed below

• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆446Updated last year
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆184Updated last year
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆325Updated 2 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆255Updated 11 months ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆172Updated last week
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆305Updated 7 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆315Updated last year
• AnswerDotAI / fastdata
  ☆161Updated last year
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆424Updated 3 weeks ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆321Updated 2 weeks ago
• 567-labs / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆414Updated 4 months ago
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆687Updated 2 weeks ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆126Updated 2 months ago
• tonywu71 / colpali-cookbooks
  Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳
  ☆352Updated 7 months ago
• Knowledgator / GLiClass
  Generalist and Lightweight Model for Text Classification
  ☆168Updated last week
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆505Updated last month
• apple / ml-superposition-prompting
  ☆147Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆119Updated 9 months ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆305Updated last week
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆113Updated last year
• diicellman / dspy-rag-fastapi
  FastAPI wrapper around DSPy
  ☆290Updated last year
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆276Updated last year
• cohere-ai / DiskVectorIndex
  ☆210Updated 6 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆107Updated 4 months ago
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆141Updated 4 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆103Updated 2 years ago
• lightonai / fast-plaid
  High-Performance Engine for Multi-Vector Search
  ☆201Updated last week
• eugeneyan / align-app
  ☆85Updated last year
• MoritzLaurer / zeroshot-classifier
  Notebooks for training universal 0-shot classifiers on many different tasks
  ☆137Updated last year
• writer / writing-in-the-margins
  ☆120Updated last year