EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.
☆102Apr 9, 2026Updated 4 months ago
Alternatives and similar repositories for eval-assist
Users that are interested in eval-assist are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Atlas Nexus: tooling to bring together resources related to governance of foundation models.☆134Updated this week
- Long-form factuality assessor for large language models☆37Aug 7, 2026Updated last week
- The AI Steerability 360 toolkit is an extensible library for general purpose steering of LLMs.☆103Aug 7, 2026Updated last week
- Agent specification certification pipeline — from skill specs to governed, certified Mellea pipelines☆43Updated this week
- Demo setups for ai-atlas-nexus☆16Jul 15, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for "Out-of-Distribution Detection using Synthetic Data Generation"☆20Feb 6, 2025Updated last year
- The Granite Guardian models are designed to detect risks in prompts and responses.☆168Updated this week
- The repo consists of a Python package that works with functional data. In particular, it includes two distinct methodologies: Functional …☆14Sep 18, 2025Updated 11 months ago
- Responsible Prompting is an LLM-agnostic tool that aims at dynamically supporting users in crafting prompts that embed responsible intent…☆49Jan 26, 2026Updated 6 months ago
- AI risk ontology☆26Aug 1, 2025Updated last year
- Ontology representing a 360-view of a person (or cohort) that spans across multiple domains, from health to social.☆35Sep 17, 2025Updated 11 months ago
- Diagnosing policy grounding in LLM judges via causal erasure. Companion code to the AIES 2026 submission READ.☆21Aug 1, 2026Updated 2 weeks ago
- Centralize and streamline ML/AI lifecycle observability and compliance processes.☆12Apr 21, 2026Updated 3 months ago
- Source code for Activated LoRA☆26Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A framework for agentic tool use training with reinforcement learning☆200Apr 8, 2026Updated 4 months ago
- Code to enable layer-level steering in LLMs using sparse auto encoders☆34Sep 18, 2025Updated 11 months ago
- Interact with the Deep Search platform for new knowledge explorations and discoveries☆228Jan 24, 2025Updated last year
- Independent evaluation set construction for trustworthy ML models in biochemistry☆15Jul 28, 2026Updated 3 weeks ago
- source code for ICLR'24 paper "How does unlabeled data provably help OOD detection?"☆14Feb 1, 2024Updated 2 years ago
- Granite Snack Cookbook -- easily consumable recipes (python notebooks) that showcase the capabilities of the Granite models☆387Updated this week
- Build production-ready AI agents in both Python and Typescript.☆3,380Aug 8, 2026Updated last week
- Forked from tdozat/Parser and adapted to tensorflow 0.12☆19Mar 21, 2021Updated 5 years ago
- Python SDK for working with OSDU☆12Mar 4, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The fore client package☆13Jul 16, 2024Updated 2 years ago
- A practical guide to using SonarQube Agentic Analysis and Context Augmentation with Claude Code to catch and prevent code quality issues …☆21Apr 16, 2026Updated 4 months ago
- Lakera - ChatGPT Data Leak Protection☆30Jul 4, 2024Updated 2 years ago
- Comprehensive LLM Error Analysis and Reporting☆54Jul 27, 2026Updated 3 weeks ago
- ☆18Mar 25, 2025Updated last year
- 🤗 Benchmark Large Language Models Reliably On Your Data☆456Apr 2, 2026Updated 4 months ago
- Code for reproducing paper describing methods for representing peptides☆18Aug 7, 2026Updated last week
- NeurIPS'24 - LLM Safety Landscape☆40Oct 21, 2025Updated 9 months ago
- Neural Unification for Logic Reasoning over Language☆22Nov 15, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Ukrainian ELECTRA model☆12Mar 11, 2023Updated 3 years ago
- Open Source AI Project Governance and Security Baseline (OSAIPGS Baseline)☆25Aug 9, 2026Updated last week
- ☆32Nov 8, 2025Updated 9 months ago
- This repo contains the dataset for the EMNLP 2022 paper "Why Do You Feel This Way? Summarizing Triggers of Emotions in Social Media Posts…☆19Oct 9, 2023Updated 2 years ago
- vLLM with support for span semantics☆26Feb 27, 2026Updated 5 months ago
- SynthGenAI - Package for Generating Synthetic Datasets using LLMs.☆57Nov 24, 2025Updated 8 months ago
- Proof Of Concept showcasing composable GPUs in Kubernetes☆29Jul 30, 2026Updated 2 weeks ago