EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.
☆99Apr 9, 2026Updated 3 weeks ago
Alternatives and similar repositories for eval-assist
Users that are interested in eval-assist are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Granite Guardian models are designed to detect risks in prompts and responses.☆142Apr 29, 2026Updated last week
- Responsible Prompting is an LLM-agnostic tool that aims at dynamically supporting users in crafting prompts that embed responsible intent…☆46Jan 26, 2026Updated 3 months ago
- NeurIPS'24 - LLM Safety Landscape☆39Oct 21, 2025Updated 6 months ago
- Synthetic Text Dataset Generation for LLM projects☆58Apr 17, 2026Updated 2 weeks ago
- ☆24Jun 5, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Interact with the Deep Search platform for new knowledge explorations and discoveries☆227Jan 24, 2025Updated last year
- Centralize and streamline ML/AI lifecycle observability and compliance processes.☆12Apr 21, 2026Updated 2 weeks ago
- source code for ICLR'24 paper "How does unlabeled data provably help OOD detection?"☆13Feb 1, 2024Updated 2 years ago
- Prompt Declaration Language (PDL) is a declarative prompt programming language.☆292Updated this week
- Efficient and scalable zero-shot entity linking☆118Apr 6, 2026Updated last month
- Neural Unification for Logic Reasoning over Language☆22Nov 15, 2021Updated 4 years ago
- SynthGenAI - Package for Generating Synthetic Datasets using LLMs.☆56Nov 24, 2025Updated 5 months ago
- A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …☆65Feb 6, 2025Updated last year
- QT-DOG: QUANTIZATION-AWARE TRAINING FOR DOMAIN GENERALIZATION☆24Nov 30, 2025Updated 5 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Zero and Few shot named entity & relationships recognition☆402Sep 17, 2025Updated 7 months ago
- [KDD24-ADS] R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Models☆11Apr 9, 2024Updated 2 years ago
- A demonstration of hybrid search with reranking using Qdrant and BGE-M3 model. A showcase of dense and sparse retrieval combined with Col…☆31Apr 4, 2025Updated last year
- ☆10Dec 3, 2024Updated last year
- [NAACL 2018] Robust Sequence Labeling with Adversarial Training☆10Sep 30, 2019Updated 6 years ago
- 360M model running in the browser on WebGPU☆23Aug 20, 2024Updated last year
- A Samsung Tizen TV driver for Appium☆12Updated this week
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆213Apr 21, 2026Updated 2 weeks ago
- ☆12Oct 7, 2025Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Aug 3, 2022Updated 3 years ago
- ☆12Jul 6, 2022Updated 3 years ago
- Generate HTML forms from Pydantic models for your FastHTML application☆45Apr 2, 2026Updated last month
- A Node.js library that enables communication with iOS devices using remote XPC services. It supports device lockdown, property-list (plis…☆26Updated this week
- [ICLR 2025] General-purpose activation steering library☆166Sep 18, 2025Updated 7 months ago
- eTaPR☆17May 16, 2023Updated 2 years ago
- Chu-Lui-Edmonds decoding extracted from TurboParser☆14May 16, 2017Updated 8 years ago
- ☆18Mar 20, 2022Updated 4 years ago
- Appium CDP Driver is a W3C WebDriver that allows you to connect to chromium based android mobile browsers like chrome & samsung browser t…☆10Jul 16, 2025Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈☆16Updated this week
- ☆17Aug 14, 2024Updated last year
- Parsing only with Pretraining Networks☆16Jul 25, 2024Updated last year
- Open broad-coverage corpus for Finnish named entity recognition.☆12Aug 22, 2020Updated 5 years ago
- Hal Daume's hbc☆20Jan 23, 2010Updated 16 years ago
- Resk is a robust Python library designed to enhance security and manage context when interacting with LLMs. It provides a protective …☆19Apr 13, 2026Updated 3 weeks ago
- Part-of-speech tagging using BERT☆10Nov 14, 2019Updated 6 years ago