Alternatives and similar repositories for pytest-evals:

Users that are interested in pytest-evals are comparing it to the libraries listed below

• AlmogBaku / openai-streaming
  Work with OpenAI's streaming API at ease with Python generators
  ☆121Updated 10 months ago
• raptor-ml / raptor
  Transform your pythonic research to an artifact that engineers can deploy easily.
  ☆151Updated last week
• gilad-rubin / hypster
  HyPSTER - HyperParameter optimization on STERoids
  ☆47Updated 4 months ago
• klilhalahmi / SLMs-based-RAG
  ☆10Updated 7 months ago
• ilanbenb / wa_llm
  ☆12Updated 3 weeks ago
• SaharCarmel / TheAlmanac
  ☆13Updated this week
• christo-olivier / modelsmith
  Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …
  ☆78Updated 8 months ago
• langfuse / langfuse-python
  🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …
  ☆151Updated this week
• pogjester / company-research-agent
  An agentic company research tool powered by LangGraph and Tavily that conducts deep diligence on companies using a multi-agent framework.…
  ☆40Updated this week
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆349Updated this week
• Optibus / playback
  Record your service operations in production and replay them locally at any time in a sandbox
  ☆105Updated 2 months ago
• deepset-ai / hayhooks
  Deploy Haystack pipelines behind a REST Api.
  ☆61Updated this week
• superwise-ai / elemeta
  Metafeature Extraction for Unstructured Data
  ☆101Updated 2 weeks ago
• mostly-ai / mostlyai
  Synthetic Data SDK ✨
  ☆351Updated this week
• gilad-rubin / modular-rag
  This project implements the "Modular RAG" framework using Haystack & Hypster
  ☆31Updated 4 months ago
• genia-dev / vibraniumdome
  LLM Security Platform.
  ☆10Updated 5 months ago
• helmanofer / pydantic-prompter
  A lightweight tool that lets you simply build prompts and get Pydantic objects as outputs
  ☆18Updated 10 months ago
• vbarda / encite
  Named Entity Recognition using Claude Citations
  ☆64Updated 2 weeks ago
• kwanUm / awesome-data-quality
  Curated list of tools and frameworks assisting in monitoring data quality
  ☆12Updated 2 years ago
• deepset-ai / haystack-core-integrations
  Additional packages (components, document stores and the likes) to extend the capabilities of Haystack version 2.0 and onwards
  ☆139Updated this week
• avilum / yalla
  A tiny LLM Agent with minimal dependencies, focused on local inference.
  ☆52Updated 5 months ago
• sticklight-io / declarai
  A Pythonic integration for LLMs.
  ☆88Updated last year
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆238Updated last month
• preset-io / promptimize
  Promptimize is a prompt engineering evaluation and testing toolkit.
  ☆456Updated last month
• 8400TheHealthNetwork / HebSpacy
  Hebrew oriented NER spaCy pipeline
  ☆15Updated 7 months ago
• jupyter-naas / abi
  An organizational AI system to build a suite of AI assistants leveraging ontologies as a unifying field that connect data, AI models, wor…
  ☆56Updated this week
• deepset-ai / haystack-experimental
  🧪 Experimental features for Haystack
  ☆41Updated this week
• vinayak-mehta / ipychat
  An AI extension for IPython that makes it work like Cursor
  ☆63Updated 2 months ago
• HetzVentures / repoInspector
  Inspect repository data, including countries and organizations of stargazers and forkers.
  ☆38Updated last year
• trubrics / trubrics-python
  Product analytics for AI Assistants
  ☆149Updated last week