quotient-ai / judgesLinks
A small library of LLM judges
☆251Updated last week
Alternatives and similar repositories for judges
Users that are interested in judges are comparing it to the libraries listed below
Sorting:
- Inference-time scaling for LLMs-as-a-judge.☆272Updated 3 weeks ago
- ☆154Updated 8 months ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆130Updated last week
- Attribute (or cite) statements generated by LLMs back to in-context information.☆268Updated 10 months ago
- Generalist and Lightweight Model for Text Classification☆148Updated last month
- A Lightweight Library for AI Observability☆250Updated 5 months ago
- awesome synthetic (text) datasets☆291Updated last month
- Simple UI for debugging correlations of text embeddings☆288Updated 2 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆434Updated last year
- Late Interaction Models Training & Retrieval☆524Updated this week
- Notebooks for training universal 0-shot classifiers on many different tasks☆135Updated 7 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆173Updated 10 months ago
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆260Updated last month
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆188Updated 11 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆101Updated last year
- 🤗 Benchmark Large Language Models Reliably On Your Data☆381Updated this week
- ☆211Updated last month
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆102Updated last year
- ☆145Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆114Updated last month
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆152Updated 3 months ago
- code for training & evaluating Contextual Document Embedding models☆196Updated 2 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆32Updated 11 months ago
- 📝 Automatically annotate papers using LLMs☆332Updated 3 months ago
- A framework for optimizing DSPy programs with RL☆96Updated this week
- An Awesome list of curated DSPy resources.☆395Updated 5 months ago
- High-Performance Engine for Multi-Vector Search☆134Updated 2 months ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆113Updated 4 months ago
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆210Updated 3 months ago
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆322Updated 2 months ago