A comprehensive Python framework for evaluating LLM-extracted structured data against ground truth labels. Supports binary classification, scalar values, and list fields with detailed performance metrics, confidence-based evaluation, and statistical uncertainty quantification via non-parametric bootstrap confidence intervals.
☆23Sep 3, 2026Updated last month
Alternatives and similar repositories for llm-validation-framework
Users that are interested in llm-validation-framework are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This tool is an example how to import profiles to Oncoshot via its API☆16May 26, 2025Updated last year
- Retrieve and normalize records from ICTRP☆10May 26, 2020Updated 6 years ago
- FFmpeg coding tutorial - learn how to code custom transmuxing, transcoding, metadata extraction, frame-by-frame reading and more☆13Sep 25, 2021Updated 5 years ago
- Make ClickHouse available to Dapper☆15Jan 29, 2019Updated 7 years ago
- DotNetCore ArangoDB Driver☆15May 16, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An example of using ASP.NET Core 2.2 to create an email templating engine☆15Jun 2, 2019Updated 7 years ago
- Peakflo Unified Model Context Protocol (pfMCP)☆21Updated this week
- Application Insights module for Nuxt 2☆18Oct 13, 2026Updated 2 weeks ago
- uatraits is a simple tool for user agent detection☆20Dec 21, 2017Updated 8 years ago
- [KDD 2026] An automatic, extensible Framework to Evaluate User-Proxy Agents for Human-Likeness. 🌟 Star if you like it!☆25May 18, 2026Updated 5 months ago
- Fastcgi-daemon component for Elliptics file storage☆18Nov 19, 2012Updated 13 years ago
- Extension for the .NET Framework cryptography subsystem, which introduces the Paillier public key cryptosystem with support for homomorph…☆11Sep 3, 2024Updated 2 years ago
- ☆10Aug 5, 2025Updated last year
- The Odin Tabs extension is a browser extension that allows you to navigate through your browser tabs using speech recognition and the Lar…☆24Feb 20, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆19Jun 18, 2026Updated 4 months ago
- ethdebug.py is a debugger-side implementation of the EthDebug format☆15May 19, 2026Updated 5 months ago
- ☆12Apr 18, 2021Updated 5 years ago
- Extension for the .NET Framework cryptography subsystem, which introduces the ElGamal public key cryptosystem with support for homomorphi…☆15Sep 3, 2024Updated 2 years ago
- Visual Studio Team Services Build and Release Management extensions that help you update files using JSON patch and similar syntax☆22Jan 27, 2025Updated last year
- Manim (math animation) skills for AI coding agents — animate equations, plot functions, and render 3Blue1Brown-style explainers to MP4 wi…☆15Jun 22, 2026Updated 4 months ago
- Same-brief agentic build comparison: GPT-6 Astra High vs Gemini 3.8 Flash High building a playable 3D AI civilization simulation game.☆20Sep 6, 2026Updated last month
- A scientific-method runtime for AI agents: hypotheses, experiments, evidence, provenance, reproducibility, and auditable conclusions.☆21Updated this week
- ☆24Sep 23, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 6LBR copy of TinyDTLS, see official repository for support outside 6LBR☆27Dec 7, 2016Updated 9 years ago
- A lightweight wrapper around MySQLdb, but MySQLdb dosn`t support python3, This lib change driver from MySQLdb to pymysql, in order to sup…☆16Aug 5, 2026Updated 2 months ago
- Make DateOnly and TimeOnly data types available for all .NET versions prior to .NET 6☆28Oct 14, 2026Updated 2 weeks ago
- ☆25Jun 21, 2022Updated 4 years ago
- A Claude Skill that builds polished, interactive HTML explainers, with an automatic QA loop and anti-slop visual guards.☆23Aug 12, 2026Updated 2 months ago
- Docker container used to allows Visual Studio to build a Linux application.☆20Dec 31, 2019Updated 6 years ago
- Lib.Web.Mvc is a library which contains some helper classes for ASP.NET MVC such as strongly typed jqGrid helper, attribute and helper pr…☆46Jan 3, 2026Updated 9 months ago
- HE-MAN – Homomorphically Encrypted MAchine learning with oNnx models and TenSEAL☆20Oct 11, 2024Updated 2 years ago
- A demo e-commerce application using Platzi fake e-commerce rest api☆21Mar 29, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- EHR2Vec is a embedding translation tool for medical entities based on attention mechanism. We have provided a version of tensorflow imple…☆12Nov 14, 2020Updated 5 years ago
- ☆19May 5, 2026Updated 5 months ago
- TouchBarDisabler allows users to manually turn off the Touch Bar on 2016 MacBook Pro devices. You will be guided to turn off System Integ…☆37Apr 26, 2017Updated 9 years ago
- MMC, the MUD client for UNIX and Win32☆18Dec 2, 2016Updated 9 years ago
- TeXRA — an AI theorist (math, physics, computer science). VS Code extension and terminal CLI.☆35Updated this week
- Parse, don't validate (in Rust!)☆11Jul 19, 2023Updated 3 years ago
- Classify Drum audio samples through the use of Artifical Intelligence / Machine Learning.☆22Aug 20, 2023Updated 3 years ago