AlmogBaku / pytest-evalsLinks
A pytest plugin for running and analyzing LLM evaluation tests.
☆147Updated 10 months ago
Alternatives and similar repositories for pytest-evals
Users that are interested in pytest-evals are comparing it to the libraries listed below
Sorting:
- Pydantic extension for annotating autocorrecting fields.☆221Updated last year
- Calculate prices for calling LLM inference APIs.☆188Updated this week
- Convert an AI Agent into a A2A server! ✨☆148Updated 2 months ago
- Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …☆80Updated 3 months ago
- ☆139Updated last week
- ☆77Updated last week
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆119Updated 5 months ago
- Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere☆159Updated 2 weeks ago
- ☆84Updated last year
- Python browser sandbox.☆184Updated 8 months ago
- Promptimize is a prompt engineering evaluation and testing toolkit.☆487Updated last week
- The Logfire MCP Server is here!☆128Updated 3 weeks ago
- Work with OpenAI's streaming API at ease with Python generators☆122Updated last year
- SUQL: Conversational Search over Structured and Unstructured Data with LLMs☆293Updated last month
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…☆264Updated last week
- An AI extension for IPython that makes it work like Cursor☆69Updated 11 months ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆52Updated last year
- A Lightweight Library for AI Observability☆252Updated 10 months ago
- 🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …☆308Updated this week
- DSPydantic: Auto-Optimize Your Pydantic Models with DSPy☆203Updated last week
- RAG orchestration framework ⛵️☆201Updated 5 months ago
- ☆258Updated 3 weeks ago
- Additional packages (components, document stores and the likes) to extend the capabilities of Haystack☆175Updated this week
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆113Updated 5 months ago
- Synchronicity lets you interoperate with asynchronous Python APIs.☆131Updated last week
- An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer☆275Updated 5 months ago
- Playground for using large language models into the Modern Data Stack for entity matching☆108Updated 2 years ago
- Build reliable AI and agentic applications with DataFrames☆417Updated this week
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆377Updated 3 months ago
- ☆201Updated 3 weeks ago