AlmogBaku / pytest-evals
A pytest plugin for running and analyzing LLM evaluation tests.
☆91Updated 2 weeks ago
Alternatives and similar repositories for pytest-evals:
Users that are interested in pytest-evals are comparing it to the libraries listed below
- Work with OpenAI's streaming API at ease with Python generators☆120Updated 8 months ago
- Transform your pythonic research to an artifact that engineers can deploy easily.☆150Updated 9 months ago
- ☆10Updated 5 months ago
- Self Support ChatBot☆16Updated 11 months ago
- A tiny LLM Agent with minimal dependencies, focused on local inference.☆52Updated 4 months ago
- HyPSTER - HyperParameter optimization on STERoids☆46Updated 2 months ago
- Make your GenAI Apps Safe & Secure Test & harden your system prompt☆435Updated 4 months ago
- Open-source AI copilot that lets you chat with your observability data and code 🧙♂️☆327Updated 2 months ago
- A Whatsapp-bot that allows access to GPT3 while also serving as your own memory backup☆134Updated last year
- HeBERT: Pre-training BERT for modern Hebrew☆75Updated last year
- This GitHub Action installs, configures & runs Redefine to optimize CI execution time and resources.☆21Updated 7 months ago
- LLM Playground☆10Updated 3 months ago
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆50Updated 2 months ago
- A lightweight tool that lets you simply build prompts and get Pydantic objects as outputs☆17Updated 8 months ago
- Metafeature Extraction for Unstructured Data☆101Updated 6 months ago
- ☆34Updated 3 years ago
- A question answering dataset in Modern Hebrew, containing 30,147 questions.☆21Updated 2 months ago
- Inspect repository data, including countries and organizations of stargazers and forkers.☆38Updated 11 months ago
- Hebrew Machine and Deep Learning Tutorials☆234Updated last year
- Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…☆762Updated last week
- 🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …☆134Updated this week
- A Pythonic integration for LLMs.☆87Updated last year
- OpenTelemetry Instrumentation for AI Observability☆297Updated this week
- Framework to bring LLM applications to production☆304Updated this week
- Robot 1X bot for Telegram and WhatsApp☆17Updated last year
- Analyze credit card file outputs and organize them in a neat table☆35Updated last month
- Additional packages (components, document stores and the likes) to extend the capabilities of Haystack version 2.0 and onwards☆134Updated this week
- Curated list of tools and frameworks assisting in monitoring data quality☆12Updated 2 years ago
- ☆130Updated last year