EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.
☆102Apr 9, 2026Updated 3 months ago
Alternatives and similar repositories for eval-assist
Users that are interested in eval-assist are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Agent specification certification pipeline — from skill specs to governed, certified Mellea pipelines☆39Updated this week
- Demo setups for ai-atlas-nexus☆16Jul 15, 2026Updated 2 weeks ago
- The repo consists of a Python package that works with functional data. In particular, it includes two distinct methodologies: Functional …☆14Sep 18, 2025Updated 10 months ago
- Mellea is a library for writing generative programs.☆1,783Updated this week
- An OWL ontology and RDF knowledge graph of the top 100 IMDb movies, modeled in Protégé and stored in GraphDB. Demonstrates semantic model…☆27Dec 4, 2025Updated 7 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆13Jul 22, 2026Updated last week
- Prompt Declaration Language (PDL) is a declarative prompt programming language.☆309Updated this week
- Centralize and streamline ML/AI lifecycle observability and compliance processes.☆12Apr 21, 2026Updated 3 months ago
- Source code for Activated LoRA☆26Updated this week
- Scalable DBSCAN and OPTICS for clustering high-dimensional datasets using random projections☆14Nov 1, 2024Updated last year
- A framework for agentic tool use training with reinforcement learning☆195Apr 8, 2026Updated 3 months ago
- Code to enable layer-level steering in LLMs using sparse auto encoders☆34Sep 18, 2025Updated 10 months ago
- Official Implementation of ACL 2025 paper "GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Check…☆20May 30, 2025Updated last year
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆218May 27, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Interact with the Deep Search platform for new knowledge explorations and discoveries☆228Jan 24, 2025Updated last year
- source code for ICLR'24 paper "How does unlabeled data provably help OOD detection?"☆13Feb 1, 2024Updated 2 years ago
- Granite Snack Cookbook -- easily consumable recipes (python notebooks) that showcase the capabilities of the Granite models☆387Updated this week
- Bridge operator repo☆22Sep 17, 2025Updated 10 months ago
- Forked from tdozat/Parser and adapted to tensorflow 0.12☆19Mar 21, 2021Updated 5 years ago
- Create new plugins for tiddlywiki 5 easily☆12Dec 6, 2022Updated 3 years ago
- Python SDK for working with OSDU☆12Mar 4, 2025Updated last year
- The fore client package☆13Jul 16, 2024Updated 2 years ago
- custom failure message on any jasmine v1.3 assertion☆14Apr 15, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Lakera - ChatGPT Data Leak Protection☆30Jul 4, 2024Updated 2 years ago
- ☆30Nov 5, 2024Updated last year
- ☆18Mar 25, 2025Updated last year
- 🤗 Benchmark Large Language Models Reliably On Your Data☆452Apr 2, 2026Updated 3 months ago
- Code for reproducing paper describing methods for representing peptides☆17Updated this week
- NeurIPS'24 - LLM Safety Landscape☆40Oct 21, 2025Updated 9 months ago
- Spektacular is a coding agent agnostic tool for spec driven development, use it as a cli, with github issues, or as an openclaw plugin☆17Jul 17, 2026Updated last week
- Benchmarks for the Evaluation of LLM Supervision☆35Jan 19, 2026Updated 6 months ago
- This is a text based fantasy AI game☆14Dec 15, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Open Source AI Project Governance and Security Baseline (OSAIPGS Baseline)☆25Updated this week
- Differentiable non-uniform interpolation: https://arxiv.org/abs/2012.13257☆11Oct 3, 2021Updated 4 years ago
- vLLM with support for span semantics☆26Feb 27, 2026Updated 5 months ago
- Prediction Explanations Clustering☆10Oct 19, 2023Updated 2 years ago
- SynthGenAI - Package for Generating Synthetic Datasets using LLMs.☆56Nov 24, 2025Updated 8 months ago
- Java implementation for performing operations on Apache Iceberg and Hive tables☆21May 25, 2026Updated 2 months ago
- A curated list of materials on AI guardrails☆61Jun 22, 2026Updated last month