A pytest plugin for running and analyzing LLM evaluation tests.
☆162Feb 5, 2025Updated last year
Alternatives and similar repositories for pytest-evals
Users that are interested in pytest-evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Work with OpenAI's streaming API at ease with Python generators☆119May 22, 2024Updated 2 years ago
- ☆12Aug 25, 2024Updated 2 years ago
- ☆14Jun 4, 2025Updated last year
- ☆14Jun 2, 2025Updated last year
- a complete reproducible example of training a word2vec model for Hebrew☆13Nov 20, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An HTTP endpoint to create on-demand dynamic HTML reports powered by Jupyter Notebooks☆18Oct 27, 2021Updated 5 years ago
- Use XML tags for long context prompting using Claude's multi-document structure.☆27Aug 9, 2025Updated last year
- ☆27Jun 7, 2026Updated 5 months ago
- A simple JavaScript kernel for JupyterLite, running in a Web Worker☆15Oct 10, 2026Updated last month
- Exploration of FEC contributions data with dplyr☆13Dec 5, 2013Updated 12 years ago
- Parses Google Documents formatted for annotated transcripts –– with JavaScript☆18Feb 14, 2022Updated 4 years ago
- ☆17Updated this week
- Watch a git repository, mirror it on a web server, and push to S3 with the appropriate commit message.☆17Apr 6, 2016Updated 10 years ago
- Modern JavaScript runtime in Python, powered by V8 and bridged by Rust☆59Oct 25, 2026Updated 3 weeks ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A command-line tool for generating AP API JSON files for testing elections applications.☆15Jul 5, 2022Updated 4 years ago
- Classy-fire is multiclass text classification approach leveraging OpenAI LLM model APIs optimally using clever parameter tuning and promp…☆80Sep 14, 2026Updated 2 months ago
- Toy project to showcase Litestar, HTMX, TailwindCSS. Network Information API☆17Apr 28, 2024Updated 2 years ago
- A pytest plugin for automatically updating doctest outputs☆81Updated this week
- Simple python binding for rust chardetng library☆14Oct 27, 2025Updated last year
- Python wrapper for ONLP YAP https://github.com/OnlpLab/yap☆16Jan 27, 2023Updated 3 years ago
- arXiv fragment loader plugin for https://llm.datasette.io/☆18May 17, 2025Updated last year
- Use LLMs to extract structured data from news articles. From the Star Tribune AI Lab.☆15Sep 15, 2025Updated last year
- ☆10Jun 23, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Nice Ride data analysis☆17Jan 20, 2014Updated 12 years ago
- Intraday ridership data from Washington Metro Area Transit Authority for 2009 and 2017 inaugurations and the Women's March.☆15Feb 7, 2017Updated 9 years ago
- PyQt Custom Window☆14Mar 13, 2023Updated 3 years ago
- Experiments with GitHub event data☆20Apr 29, 2026Updated 6 months ago
- A Python library for downloading, parsing and cleaning Federal Election Commission filings.☆28Jan 30, 2024Updated 2 years ago
- AI agent for enhancing datasets with information from the internet☆21Nov 6, 2025Updated last year
- ☆15Mar 11, 2024Updated 2 years ago
- ☆23Mar 7, 2025Updated last year
- Add state and county fips codes to data☆43Nov 5, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Context-efficient command runner for coding agents.☆26Oct 18, 2026Updated last month
- LSP Server powered by libcst for refactoring tasks☆19Dec 11, 2024Updated last year
- An Python object protocol for projects to interchange data frame-like data without forcing pandas.DataFrame as the intermediary☆15Apr 9, 2020Updated 6 years ago
- Show how Google Maps renders disputed territories differently depending on who's looking (in-progress for #owhack)☆34Jun 24, 2014Updated 12 years ago
- Answer questions against collections stored in LLM using Retrieval Augmented Generation☆30Jan 29, 2024Updated 2 years ago
- 🤗 Collection of examples on how to train, deploy and monitor HuggingFace models in Google Cloud Vertex AI☆23Feb 26, 2024Updated 2 years ago
- A Python wrapper for the OpenFEC API.☆29Nov 12, 2019Updated 7 years ago
Are these results useful?