AlmogBaku / pytest-evalsLinks
A pytest plugin for running and analyzing LLM evaluation tests.
☆148Updated 11 months ago
Alternatives and similar repositories for pytest-evals
Users that are interested in pytest-evals are comparing it to the libraries listed below
Sorting:
- Pydantic extension for annotating autocorrecting fields.☆221Updated last year
- Convert an AI Agent into a A2A server! ✨☆152Updated 2 months ago
- Calculate prices for calling LLM inference APIs.☆200Updated last week
- Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …☆81Updated 3 months ago
- Jambo - JSON Schema to Pydantic Converter☆89Updated last month
- ☆151Updated this week
- Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere☆170Updated 2 weeks ago
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆120Updated 3 weeks ago
- HyPSTER - Configuration Framework for Optimizing AI & AI Systems☆55Updated 4 months ago
- Plug-and-play document AI with zero-shot models.☆120Updated last week
- Python browser sandbox.☆185Updated 9 months ago
- DSPydantic: Auto-Optimize Your Pydantic Models with DSPy☆237Updated 3 weeks ago
- ☆78Updated last month
- RAG orchestration framework ⛵️☆201Updated 5 months ago
- The Logfire MCP Server is here!☆130Updated last month
- An AI extension for IPython that makes it work like Cursor☆69Updated last year
- ☆85Updated last year
- Work with OpenAI's streaming API at ease with Python generators☆122Updated last year
- Transform your pythonic research to an artifact that engineers can deploy easily.☆158Updated 6 months ago
- Synchronicity lets you interoperate with asynchronous Python APIs.☆133Updated 2 weeks ago
- Promptimize is a prompt engineering evaluation and testing toolkit.☆488Updated last month
- Claudette is Claude's friend☆308Updated this week
- OpenAI powered AI CLI in just a few lines of code.☆126Updated last year
- Declarative context engineering for agents☆423Updated this week
- A pattern to let you try several vector databases and change a little code as possible☆38Updated 2 years ago
- A Lightweight Library for AI Observability☆253Updated 10 months ago
- FastAPI to the Cloud, Batteries Included! ☁️🔋🚀☆145Updated 2 years ago
- ☆184Updated 2 years ago
- MCP server to run Python code in a sandbox.☆165Updated 3 weeks ago
- OpenTelemetry Instrumentation for AI Observability☆794Updated this week