EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.
☆103Sep 24, 2026Updated this week
Alternatives and similar repositories for eval-assist
Users that are interested in eval-assist are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Atlas Nexus: tooling to bring together resources related to governance of foundation models.☆141Sep 17, 2026Updated last week
- Utility to incrementally learn regular expressions from examples☆27Sep 18, 2025Updated last year
- The repo consists of a Python package that works with functional data. In particular, it includes two distinct methodologies: Functional …☆14Sep 18, 2025Updated last year
- Synthetic Data Generation for Foundation Models☆21Nov 10, 2025Updated 10 months ago
- AI Robustness Evaluation System☆64Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Jul 22, 2026Updated 2 months ago
- Prompt Declaration Language (PDL) is a declarative prompt programming language.☆312Updated this week
- Ontology representing a 360-view of a person (or cohort) that spans across multiple domains, from health to social.☆34Sep 17, 2025Updated last year
- Centralize and streamline ML/AI lifecycle observability and compliance processes.☆12Apr 21, 2026Updated 5 months ago
- Source code for Activated LoRA☆26Sep 12, 2026Updated 2 weeks ago
- Code to enable layer-level steering in LLMs using sparse auto encoders☆35Sep 18, 2025Updated last year
- Code Implementation of Adversarial Prompt Evaluation paper☆14Sep 18, 2025Updated last year
- Official Implementation of ACL 2025 paper "GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Check…☆21May 30, 2025Updated last year
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆216Sep 20, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Interact with the Deep Search platform for new knowledge explorations and discoveries☆228Jan 24, 2025Updated last year
- Independent evaluation set construction for trustworthy ML models in biochemistry☆15Aug 24, 2026Updated last month
- MLFlow 3.0 Agent Monitoring + Databricks Apps + FastAPI☆16Jul 2, 2025Updated last year
- source code for ICLR'24 paper "How does unlabeled data provably help OOD detection?"☆14Feb 1, 2024Updated 2 years ago
- Build production-ready AI agents in both Python and Typescript.☆3,416Updated this week
- ☆20Feb 21, 2024Updated 2 years ago
- Comprehensive LLM Error Analysis and Reporting☆59Jul 27, 2026Updated 2 months ago
- Python SDK for working with OSDU☆13Mar 4, 2025Updated last year
- ☆18Mar 25, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 🤗 Benchmark Large Language Models Reliably On Your Data☆456Sep 8, 2026Updated 2 weeks ago
- Code for reproducing paper describing methods for representing peptides☆18Sep 11, 2026Updated 2 weeks ago
- NeurIPS'24 - LLM Safety Landscape☆41Oct 21, 2025Updated 11 months ago
- Ukrainian ELECTRA model☆12Mar 11, 2023Updated 3 years ago
- User space file system extension to protect from data leakage. This is code associated to a research paper published at https://arxiv.org…☆18Sep 17, 2025Updated last year
- vLLM with support for span semantics☆27Feb 27, 2026Updated 7 months ago
- This repo contains the dataset for the EMNLP 2022 paper "Why Do You Feel This Way? Summarizing Triggers of Emotions in Social Media Posts…☆19Oct 9, 2023Updated 2 years ago
- A curated list of materials on AI guardrails☆66Jul 30, 2026Updated last month
- Open source project for data preparation for GenAI applications☆964Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …☆67Feb 6, 2025Updated last year
- Uncertainty Quantification 360 (UQ360) is an extensible open-source toolkit that can help you estimate, communicate and use uncertainty i…☆269Sep 16, 2026Updated last week
- The backend agents build with - Multimodal database, orchestration, and serving in one file☆1,626Updated this week
- InstructLab Core package. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data…☆1,416Mar 30, 2026Updated 5 months ago
- Zero and Few shot named entity & relationships recognition☆403Sep 17, 2025Updated last year
- Spotify Skills for Claude - Production Spotify API integration + complete toolkit for creating Claude Desktop Skills. Includes OAuth 2.0,…☆17Oct 30, 2025Updated 10 months ago
- Learn rule-based models from examples using LLM-powered synthesis. Replace expensive LLM calls with fast, deterministic, inspectable rege…☆34Updated this week