quotient-ai / judgesLinks
A small library of LLM judges
☆302Updated 3 months ago
Alternatives and similar repositories for judges
Users that are interested in judges are comparing it to the libraries listed below
Sorting:
- Inference-time scaling for LLMs-as-a-judge.☆310Updated 2 weeks ago
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆366Updated 2 months ago
- Attribute (or cite) statements generated by LLMs back to in-context information.☆300Updated last year
- Simple UI for debugging correlations of text embeddings☆300Updated 5 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆179Updated last year
- 🤗 Benchmark Large Language Models Reliably On Your Data☆411Updated this week
- ☆159Updated 11 months ago
- A Lightweight Library for AI Observability☆251Updated 9 months ago
- A framework for optimizing DSPy programs with RL☆281Updated this week
- awesome synthetic (text) datasets☆305Updated last week
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆152Updated this week
- Late Interaction Models Training & Retrieval☆652Updated last week
- An Awesome list of curated DSPy resources.☆471Updated last month
- Generalist and Lightweight Model for Text Classification☆165Updated 5 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆442Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆106Updated 2 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆123Updated 3 weeks ago
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆341Updated 5 months ago
- TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle☆299Updated 2 weeks ago
- Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+te…☆321Updated 2 months ago
- ☆146Updated last year
- FastAPI wrapper around DSPy☆281Updated last year
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆190Updated last year
- ☆84Updated last year
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆138Updated 2 months ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆117Updated 7 months ago
- ⚖️ Awesome LLM Judges ⚖️☆133Updated 6 months ago
- ☆210Updated 4 months ago
- Banishing LLM Hallucinations Requires Rethinking Generalization☆275Updated last year
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆102Updated last year