AlmogBaku / pytest-evalsLinks
A pytest plugin for running and analyzing LLM evaluation tests.
☆147Updated 10 months ago
Alternatives and similar repositories for pytest-evals
Users that are interested in pytest-evals are comparing it to the libraries listed below
Sorting:
- Calculate prices for calling LLM inference APIs.☆188Updated this week
- Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …☆80Updated 3 months ago
- Convert an AI Agent into a A2A server! ✨☆148Updated 2 months ago
- Pydantic extension for annotating autocorrecting fields.☆221Updated last year
- Work with OpenAI's streaming API at ease with Python generators☆122Updated last year
- ☆77Updated last week
- ☆139Updated last week
- OpenTelemetry Instrumentation for AI Observability☆770Updated this week
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆119Updated this week
- Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere☆159Updated 2 weeks ago
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆113Updated 5 months ago
- Python browser sandbox.☆184Updated 8 months ago
- Jambo - JSON Schema to Pydantic Converter☆86Updated last week
- The Logfire MCP Server is here!☆128Updated 3 weeks ago
- Promptimize is a prompt engineering evaluation and testing toolkit.☆487Updated last week
- A small library of LLM judges☆308Updated 4 months ago
- 🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …☆308Updated this week
- Transform your pythonic research to an artifact that engineers can deploy easily.☆157Updated 6 months ago
- ☆84Updated last year
- Python Deep Agent framework built on top of Pydantic-AI designed to help you quickly build production-grade autonomous agents with planni…☆41Updated last week
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆377Updated 3 months ago
- ☆11Updated last year
- Build reliable, secure, and production-ready AI apps easily.☆94Updated 3 weeks ago
- 🧪🤖 Pytest plugin for OpenAI requests☆53Updated 2 weeks ago
- A Lightweight Library for AI Observability☆252Updated 10 months ago
- Easily deploy Haystack pipelines as REST APIs and MCP Tools.☆131Updated this week
- DSPydantic: Auto-Optimize Your Pydantic Models with DSPy☆203Updated last week
- HyPSTER - Configuration Framework for Optimizing AI & AI Systems☆55Updated 3 months ago
- ☆63Updated 8 months ago
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…☆264Updated last week