Fiddler Auditor is a tool to evaluate language models.
☆195Mar 11, 2024Updated 2 years ago
Alternatives and similar repositories for fiddler-auditor
Users that are interested in fiddler-auditor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fairness toolkit for pytorch, scikit learn and autogluon☆33Jul 17, 2026Updated 3 weeks ago
- Research notes and extra resources for all the work at explodinggradients.com☆26Mar 11, 2025Updated last year
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆994Nov 22, 2024Updated last year
- Sample notebooks and prompts for LLM evaluation☆176Nov 2, 2025Updated 9 months ago
- A collection of implementations of fair ML algorithms☆12Jan 7, 2018Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- python jupyter notebook tutorials☆14Apr 14, 2026Updated 3 months ago
- A tool for evaluating LLMs☆428Mar 15, 2026Updated 4 months ago
- This project is focused on the accurate and efficient classification of sepsis cases using the FastAPI framework. Sepsis is a critical me…☆14Jun 15, 2023Updated 3 years ago
- Just a bunch of benchmark logs for different LLMs☆130Jul 28, 2024Updated 2 years ago
- Learn Docker☆25Dec 11, 2023Updated 2 years ago
- An end-to-end benchmark suite of multi-modal DNN applications for system-architecture co-design☆23Dec 13, 2024Updated last year
- Jump ReLU☆12Apr 8, 2019Updated 7 years ago
- Evaluating LLMs with CommonGen-Lite☆95Mar 21, 2024Updated 2 years ago
- A complete guide to evaluate LLMs and RAGs. Both theory and code based approaches covered.☆28Nov 16, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 💙 Unstructured Data Connectors for Haystack 2.0☆18Sep 21, 2023Updated 2 years ago
- An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts s…☆12Sep 11, 2022Updated 3 years ago
- Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML va…☆4,044Dec 28, 2025Updated 7 months ago
- CalData's MDSA project with Caltrans on Performance Measurement System (PeMS) data☆13Aug 19, 2025Updated 11 months ago
- 🐢 Open-Source Evaluation & Testing library for LLM Agents☆5,748Updated this week
- Build, evaluate, understand, and fix LLM-based apps☆491Jan 16, 2024Updated 2 years ago
- Template for model cards☆22Jan 24, 2023Updated 3 years ago
- Oxygen is a Robot Framework tool that empowers the user to convert the results of any testing tool or framework to Robot Framework's repo…☆26Jun 26, 2024Updated 2 years ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆65Mar 26, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Python SDK for running evaluations on LLM generated responses☆301Jun 6, 2025Updated last year
- A library for red-teaming LLM applications with LLMs.☆28Oct 11, 2024Updated last year
- ☆10Oct 11, 2022Updated 3 years ago
- LLM Prompt Injection Detector☆1,518Aug 7, 2024Updated 2 years ago
- ☆13Apr 6, 2025Updated last year
- Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. Fro…☆7,804Aug 5, 2026Updated last week
- Simulate SDTM datasets in SAS.☆12Jan 19, 2018Updated 8 years ago
- This sample shows how to use a Cosmos DB Trigger in Azure Functions Triggers (C# or Python) to automatically generate embeddings on data …☆21Mar 11, 2025Updated last year
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆6,936Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository contains the Julia code for the paper "Competitive Gradient Descent"☆25Dec 18, 2019Updated 6 years ago
- New ways of breaking app-integrated LLMs☆2,125Jul 17, 2025Updated last year
- Benchmarks of artificial neural network library for Spark MLlib☆11Dec 3, 2015Updated 10 years ago
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆327Jul 10, 2025Updated last year
- AI Observability & Evaluation☆11,033Updated this week
- The Security Toolkit for LLM Interactions☆3,202Jul 8, 2026Updated last month
- Neo4j Cybersecurity Demo☆20Mar 16, 2022Updated 4 years ago