AlmogBaku / pytest-evalsLinks
A pytest plugin for running and analyzing LLM evaluation tests.
☆148Updated 11 months ago
Alternatives and similar repositories for pytest-evals
Users that are interested in pytest-evals are comparing it to the libraries listed below
Sorting:
- Calculate prices for calling LLM inference APIs.☆200Updated last week
- Pydantic extension for annotating autocorrecting fields.☆221Updated last year
- ☆79Updated this week
- Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …☆81Updated 3 months ago
- Convert an AI Agent into a A2A server! ✨☆152Updated 2 months ago
- ☆151Updated last week
- Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere☆170Updated 2 weeks ago
- The Logfire MCP Server is here!☆130Updated last month
- ☆85Updated last year
- Python browser sandbox.☆185Updated 9 months ago
- Jambo - JSON Schema to Pydantic Converter☆89Updated last month
- ☆262Updated last month
- An AI extension for IPython that makes it work like Cursor☆69Updated last year
- A Lightweight Library for AI Observability☆253Updated 10 months ago
- HyPSTER - Configuration Framework for Optimizing AI & AI Systems☆55Updated 4 months ago
- The Community Guide to Open-Source AI Software Craft☆33Updated 5 months ago
- Promptimize is a prompt engineering evaluation and testing toolkit.☆488Updated last month
- Library-friendly Agents☆39Updated last week
- Synchronicity lets you interoperate with asynchronous Python APIs.☆133Updated 2 weeks ago
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆120Updated 3 weeks ago
- Work with OpenAI's streaming API at ease with Python generators☆122Updated last year
- A simple DAG for executing LLM calls and using tools.☆42Updated 2 years ago
- OpenAI powered AI CLI in just a few lines of code.☆126Updated last year
- Plug-and-play document AI with zero-shot models.☆120Updated last week
- DSPydantic: Auto-Optimize Your Pydantic Models with DSPy☆237Updated 3 weeks ago
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆408Updated 4 months ago
- Declarative context engineering for agents☆423Updated this week
- An example to use MultiModal capabilities with Pydantic-AI to process and analyze images☆36Updated last year
- MCP server to run Python code in a sandbox.☆165Updated last month
- RAG orchestration framework ⛵️☆201Updated 5 months ago