EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other large language models by supporting users in iteratively refining evaluation criteria in a web-based user experience.
☆94Nov 28, 2025Updated 3 months ago
Alternatives and similar repositories for eval-assist
Users that are interested in eval-assist are comparing it to the libraries listed below
Sorting:
- Long-form factuality assessor for large language models☆28Feb 27, 2026Updated last week
- ☆28Jul 9, 2024Updated last year
- Code to enable layer-level steering in LLMs using sparse auto encoders☆31Sep 18, 2025Updated 5 months ago
- Centralize and streamline ML/AI lifecycle observability and compliance processes.☆12Feb 12, 2025Updated last year
- Synthetic Text Dataset Generation for LLM projects☆56Feb 27, 2026Updated last week
- ☆13Oct 5, 2025Updated 5 months ago
- ☆12Jul 6, 2022Updated 3 years ago
- A universal automation framework to handle mobile testing, web testing, api testing in a single powerful python package with capabilities…☆10Oct 21, 2024Updated last year
- Linear Relational Embeddings (LREs) and Linear Relational Concepts (LRCs) for LLMs in PyTorch☆10Aug 7, 2024Updated last year
- my profile readme☆14Updated this week
- ☆12Jul 8, 2024Updated last year
- A repo for implementing and understanding design patterns of agentic workflows☆22Feb 1, 2025Updated last year
- An automated Endometrial Cancer Diagnosis approach using Histopathological Image through image Preprocessing and Optimized gated Multi-La…☆10Jan 26, 2025Updated last year
- MobileManager is an application used for automation testing of iOS and Android mobile devices.☆10Jan 6, 2023Updated 3 years ago
- rag-pinecone-ray☆11Aug 14, 2023Updated 2 years ago
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆16Dec 10, 2024Updated last year
- The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈☆16Feb 25, 2026Updated last week
- This Guidance demonstrates how to effectively orchestrate multiple specialized AI agents to solve complex customer support challenges thr…☆29Feb 11, 2026Updated 3 weeks ago
- Easily stand up Keycloak and SPIRE for testing AI Agents☆29Sep 18, 2025Updated 5 months ago
- 1st Place Team Crane: @aswinkumar1999 @rathull @kyolebu☆29Sep 8, 2025Updated 5 months ago
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆12Oct 31, 2024Updated last year
- PyTorch code for DeepTime: Deep Time-Index Meta-Learning for Non-Stationary Time-Series Forecasting☆11Jan 9, 2023Updated 3 years ago
- Learning to Skip the Middle Layers of Transformers☆17Aug 7, 2025Updated 6 months ago
- Terraform resources to setup oauth2-protected MLFlow server in AWS infrastructure☆10Aug 18, 2023Updated 2 years ago
- ☆15Aug 19, 2025Updated 6 months ago
- Appium CDP Driver is a W3C WebDriver that allows you to connect to chromium based android mobile browsers like chrome & samsung browser t…☆10Jul 16, 2025Updated 7 months ago
- Predicting the Stock Market - Can we do it?☆10Jul 24, 2021Updated 4 years ago
- SIM Card Mobile Authentication Example for Android☆11Mar 18, 2021Updated 4 years ago
- ☆15Jul 14, 2023Updated 2 years ago
- ☆11Jul 30, 2024Updated last year
- A Benchmark for Multi-Stage Legal Case Documents Generation☆15Feb 24, 2025Updated last year
- ☆14Aug 7, 2024Updated last year
- A light library to allow changing pod log level without restarting the pod☆12Jul 29, 2023Updated 2 years ago
- [NAACL 2018] Robust Sequence Labeling with Adversarial Training☆10Sep 30, 2019Updated 6 years ago
- This is AlpaGasus2-QLoRA based on LLaMA2 with AlpaGasus mechanism using QLoRA!☆15Nov 22, 2023Updated 2 years ago
- UI for extracting data from pdf files using watsonx prompts☆12Sep 18, 2025Updated 5 months ago
- a demo for iOSperformanceTestDemo☆12Jan 26, 2026Updated last month
- Minimal Transformer base in JAX. A single backbone for language modelling, diffusion, classification, etc...☆14May 28, 2025Updated 9 months ago
- custom udpipe models☆11Jan 12, 2018Updated 8 years ago