EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.
☆103Oct 5, 2026Updated last week
Alternatives and similar repositories for eval-assist
Users that are interested in eval-assist are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Steerability toolkit is an extensible library for general purpose steering of language models.☆128Oct 3, 2026Updated 2 weeks ago
- LCN or Logical Credal Networks is a new probabilistic logic that allows specifying conditional probability bounds on propositional logic …☆15Sep 29, 2026Updated 2 weeks ago
- Demo setups for ai-atlas-nexus☆16Oct 3, 2026Updated 2 weeks ago
- Code for "Out-of-Distribution Detection using Synthetic Data Generation"☆20Feb 6, 2025Updated last year
- The Granite Guardian models are designed to detect risks in prompts and responses.☆184Aug 26, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Utility to incrementally learn regular expressions from examples☆27Sep 18, 2025Updated last year
- Responsible Prompting is an LLM-agnostic tool that aims at dynamically supporting users in crafting prompts that embed responsible intent…☆50Updated this week
- Library for streaming data and incremental learning algorithms.☆27Jul 6, 2026Updated 3 months ago
- An OWL ontology and RDF knowledge graph of the top 100 IMDb movies, modeled in Protégé and stored in GraphDB. Demonstrates semantic model…☆27Dec 4, 2025Updated 10 months ago
- Source code for Activated LoRA☆27Oct 10, 2026Updated last week
- BERT baselines for extractive question answering on coqa (https://stanfordnlp.github.io/coqa/)☆10Jan 27, 2020Updated 6 years ago
- Interactivity at a new level - MCP apps☆31Mar 12, 2026Updated 7 months ago
- Code Implementation of Adversarial Prompt Evaluation paper☆14Sep 18, 2025Updated last year
- Code to enable layer-level steering in LLMs using sparse auto encoders☆36Sep 18, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Interact with the Deep Search platform for new knowledge explorations and discoveries☆229Jan 24, 2025Updated last year
- Independent evaluation set construction for trustworthy ML models in biochemistry☆15Aug 24, 2026Updated last month
- a Julia wrapper of Python's lale automl package☆18Oct 11, 2021Updated 5 years ago
- source code for ICLR'24 paper "How does unlabeled data provably help OOD detection?"☆14Feb 1, 2024Updated 2 years ago
- Granite Snack Cookbook -- easily consumable recipes (python notebooks) that showcase the capabilities of the Granite models☆394Updated this week
- Official Implementation of ACL 2025 paper "GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Check…☆22May 30, 2025Updated last year
- Bridge operator repo☆22Sep 17, 2025Updated last year
- Unofficial implementation of Microsoft’s Claimify Paper: extracts specific, verifiable, decontextualized claims from LLM Q&A to be used f…☆19Aug 25, 2025Updated last year
- Forked from tdozat/Parser and adapted to tensorflow 0.12☆19Mar 21, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Build production-ready AI agents in both Python and Typescript.☆3,436Updated this week
- The fore client package☆12Jul 16, 2024Updated 2 years ago
- ☆30Nov 5, 2024Updated last year
- AI Travel Agent & Expense Planner (Purpose: Trip planning for any city worldwide with Realtime data)☆20Jun 26, 2025Updated last year
- Lakera - ChatGPT Data Leak Protection☆30Jul 4, 2024Updated 2 years ago
- 🤗 Benchmark Large Language Models Reliably On Your Data☆459Sep 8, 2026Updated last month
- This is a text based fantasy AI game☆14Dec 15, 2024Updated last year
- UI for extracting data from pdf files using watsonx prompts☆12Sep 18, 2025Updated last year
- ☆18Mar 25, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Comprehensive LLM Error Analysis and Reporting☆60Jul 27, 2026Updated 2 months ago
- NeurIPS'24 - LLM Safety Landscape☆41Oct 21, 2025Updated 11 months ago
- Neural Unification for Logic Reasoning over Language☆22Nov 15, 2021Updated 4 years ago
- User space file system extension to protect from data leakage. This is code associated to a research paper published at https://arxiv.org…☆18Sep 17, 2025Updated last year
- ☆32Nov 8, 2025Updated 11 months ago
- Differentiable non-uniform interpolation: https://arxiv.org/abs/2012.13257☆11Oct 3, 2021Updated 5 years ago
- Java implementation for performing operations on Apache Iceberg and Hive tables☆23Sep 29, 2026Updated 2 weeks ago