EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.
☆102Apr 9, 2026Updated 4 months ago
Alternatives and similar repositories for eval-assist
Users that are interested in eval-assist are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Steerability toolkit is an extensible library for general purpose steering of language models.☆111Updated this week
- In-Context Explainability 360 toolkit☆72Mar 9, 2026Updated 5 months ago
- The Granite Guardian models are designed to detect risks in prompts and responses.☆174Aug 26, 2026Updated last week
- Responsible Prompting is an LLM-agnostic tool that aims at dynamically supporting users in crafting prompts that embed responsible intent…☆49Jan 26, 2026Updated 7 months ago
- AI risk ontology☆26Aug 1, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Source code for Activated LoRA☆26Aug 16, 2026Updated 3 weeks ago
- BERT baselines for extractive question answering on coqa (https://stanfordnlp.github.io/coqa/)☆10Jan 27, 2020Updated 6 years ago
- Open source no-code system for text annotation and building of text classifiers☆274May 26, 2025Updated last year
- Official Implementation of ACL 2025 paper "GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Check…☆20May 30, 2025Updated last year
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆217May 27, 2026Updated 3 months ago
- Interact with the Deep Search platform for new knowledge explorations and discoveries☆227Jan 24, 2025Updated last year
- MLFlow 3.0 Agent Monitoring + Databricks Apps + FastAPI☆16Jul 2, 2025Updated last year
- Bridge operator repo☆22Sep 17, 2025Updated 11 months ago
- Build production-ready AI agents in both Python and Typescript.☆3,391Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Forked from tdozat/Parser and adapted to tensorflow 0.12☆19Mar 21, 2021Updated 5 years ago
- The fore client package☆13Jul 16, 2024Updated 2 years ago
- A practical guide to using SonarQube Agentic Analysis and Context Augmentation with Claude Code to catch and prevent code quality issues …☆21Apr 16, 2026Updated 4 months ago
- ☆18Mar 25, 2025Updated last year
- 🤗 Benchmark Large Language Models Reliably On Your Data☆457Apr 2, 2026Updated 5 months ago
- Code for reproducing paper describing methods for representing peptides☆18Updated this week
- NeurIPS'24 - LLM Safety Landscape☆41Oct 21, 2025Updated 10 months ago
- Benchmarks for the Evaluation of LLM Supervision☆35Jan 19, 2026Updated 7 months ago
- Open Source AI Project Governance and Security Baseline (OSAIPGS Baseline)☆26Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Library for Semi-Automated Data Science☆349Updated this week
- This repo contains the dataset for the EMNLP 2022 paper "Why Do You Feel This Way? Summarizing Triggers of Emotions in Social Media Posts…☆19Oct 9, 2023Updated 2 years ago
- vLLM with support for span semantics☆26Feb 27, 2026Updated 6 months ago
- ☆17Mar 12, 2025Updated last year
- SynthGenAI - Package for Generating Synthetic Datasets using LLMs.☆58Nov 24, 2025Updated 9 months ago
- Open source project for data preparation for GenAI applications☆958Updated this week
- A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …☆67Feb 6, 2025Updated last year
- A library of components to help agent builders boost their agent performance (tool-calling, instruction following, policy, etc.)☆119Aug 19, 2026Updated 2 weeks ago
- Spotify Skills for Claude - Production Spotify API integration + complete toolkit for creating Claude Desktop Skills. Includes OAuth 2.0,…☆17Oct 30, 2025Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The unified multimodal backend for AI data apps. Database, orchestration, and serving in one Python file.☆1,618Updated this week
- Learn rule-based models from examples using LLM-powered synthesis. Replace expensive LLM calls with fast, deterministic, inspectable rege…☆32Aug 12, 2026Updated 3 weeks ago
- TrustyAI Explainability Toolkit☆63Aug 4, 2026Updated last month
- DSPydantic: Auto-Optimize Your Prompts and Pydantic Models with DSPy☆331Mar 20, 2026Updated 5 months ago
- Synthetic Text Dataset Generation for LLM projects☆58Aug 21, 2026Updated 2 weeks ago
- [NAACL 2018] Robust Sequence Labeling with Adversarial Training☆10Sep 30, 2019Updated 6 years ago
- custom udpipe models☆12Jan 12, 2018Updated 8 years ago