ai-evals-course / judgyLinks
Python package for estimating a CIs for metrics evaluated by LLM-as-Judges.
☆77Updated 8 months ago
Alternatives and similar repositories for judgy
Users that are interested in judgy are comparing it to the libraries listed below
Sorting:
- Get a markdown version of any webpage with a keyboard shortcut.☆67Updated 11 months ago
- Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+te…☆348Updated 4 months ago
- ☆85Updated last year
- Simple UI for debugging correlations of text embeddings☆305Updated 7 months ago
- How to build the best search, one step at a time!☆232Updated 2 months ago
- ☆85Updated 4 months ago
- dspy-cli is a tool for creating, developing, testing, and deploying DSPy programs as HTTP APIs.☆110Updated last week
- DSPydantic: Auto-Optimize Your Pydantic Models with DSPy☆238Updated last month
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆52Updated last year
- Context Engineering Course with DSPy☆211Updated 6 months ago
- A comprehensive 0-to-1 guide for building self-improving LLM applications with DSPy framework☆200Updated 3 months ago
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆78Updated 9 months ago
- ☆50Updated 5 months ago
- Plug-and-play document AI with zero-shot models.☆122Updated this week
- A Lightweight Library for AI Observability☆255Updated 11 months ago
- ☆54Updated 9 months ago
- Dynamic Metadata based RAG Framework☆78Updated last month
- ☆67Updated 5 months ago
- A collection of Compound Retrieval Systems implemented with DSPy and Weaviate.☆92Updated 2 weeks ago
- Extract structured data from any content using LLMs.☆109Updated last month
- A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.☆90Updated last year
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆119Updated 9 months ago
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆414Updated 4 months ago
- This codebase demonstrates various DSPy functionalities through practical examples.☆56Updated 11 months ago
- ☆54Updated last year
- ☆37Updated 8 months ago
- ☆53Updated last year
- Minimal agent runtime built with DSPy modules and a thin Python loop. Includes CLI, FastAPI server, and eval harness with OpenAI/Ollama s…☆66Updated last month
- Minimal example of MCP for parsing llms.txt☆40Updated 9 months ago
- ☆87Updated 3 months ago