AlmogBaku / pytest-evalsLinks
A pytest plugin for running and analyzing LLM evaluation tests.
☆152Updated 11 months ago
Alternatives and similar repositories for pytest-evals
Users that are interested in pytest-evals are comparing it to the libraries listed below
Sorting:
- Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …☆81Updated 4 months ago
- Convert an AI Agent into a A2A server! ✨☆160Updated 3 months ago
- Calculate prices for calling LLM inference APIs.☆212Updated last week
- Pydantic extension for annotating autocorrecting fields.☆221Updated last year
- ☆161Updated 2 weeks ago
- Python browser sandbox.☆185Updated 9 months ago
- DSPydantic: Auto-Optimize Your Prompts and Pydantic Models with DSPy☆242Updated this week
- ☆80Updated 3 weeks ago
- The Logfire MCP Server is here!☆140Updated 3 weeks ago
- Talks about Pydantic, PydanticAI and Logfire☆60Updated last month
- Promptimize is a prompt engineering evaluation and testing toolkit.☆490Updated last week
- Work with OpenAI's streaming API at ease with Python generators☆123Updated last year
- OpenAI powered AI CLI in just a few lines of code.☆126Updated last year
- Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere☆173Updated this week
- Plug-and-play document AI with zero-shot models.☆122Updated last week
- 🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …☆338Updated last week
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆121Updated this week
- Jambo - JSON Schema to Pydantic Converter☆91Updated 2 weeks ago
- Additional packages (components, document stores and the likes) to extend the capabilities of Haystack☆178Updated last week
- Library-friendly Agents☆41Updated this week
- HyPSTER - Configuration Framework for Optimizing AI & AI Systems☆56Updated 4 months ago
- A Lightweight Library for AI Observability☆255Updated 11 months ago
- Quickstart for Hatchet using the Python SDK with examples for common frameworks☆44Updated this week
- Synchronicity lets you interoperate with asynchronous Python APIs.☆134Updated last month
- Helm Chart for running Logfire 🪵️🔥☆35Updated this week
- SUQL: Conversational Search over Structured and Unstructured Data with LLMs☆296Updated last week
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆415Updated 4 months ago
- A fun party trick to run Python code from another venv into this one.☆218Updated 10 months ago
- MCP server to run Python code in a sandbox.☆182Updated last month
- ☆85Updated last year