Fiddler Auditor is a tool to evaluate language models.
☆190Mar 11, 2024Updated 2 years ago
Alternatives and similar repositories for fiddler-auditor
Users that are interested in fiddler-auditor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Mar 17, 2026Updated 3 weeks ago
- Fairness toolkit for pytorch, scikit learn and autogluon☆33Nov 12, 2025Updated 5 months ago
- Research notes and extra resources for all the work at explodinggradients.com☆26Mar 11, 2025Updated last year
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆980Nov 22, 2024Updated last year
- Scan your AI/ML models for problems before you put them into production.☆11Mar 31, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- LLM evaluation.☆16Nov 7, 2023Updated 2 years ago
- Coffee Chat Voice Assistant is a voice-driven ordering system powered by Azure OpenAI GPT-4o Realtime API, simulating the experience of o…☆30Mar 12, 2025Updated last year
- Python package for dimension reduction of high-dimensional biological data.☆16May 23, 2018Updated 7 years ago
- python jupyter notebook tutorials☆12Sep 24, 2025Updated 6 months ago
- A tool for evaluating LLMs☆428Mar 15, 2026Updated 3 weeks ago
- Just a bunch of benchmark logs for different LLMs☆121Jul 28, 2024Updated last year
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆64Mar 26, 2024Updated 2 years ago
- Evaluating LLMs with CommonGen-Lite☆95Mar 21, 2024Updated 2 years ago
- A complete guide to evaluate LLMs and RAGs. Both theory and code based approaches covered.☆28Nov 16, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- All Data Tools☆10Feb 28, 2023Updated 3 years ago
- First steps to interact with MLflow (mlflow.org)☆10Oct 18, 2018Updated 7 years ago
- Generating Realistic Synthetic Data☆43Feb 15, 2024Updated 2 years ago
- Data Pipeline that utilizes GCP, Python 3.10, Prefect, and more.☆10Jan 23, 2023Updated 3 years ago
- This is the end to end MLOps project I built through participated the MLOps Zoomcamp☆10Sep 11, 2022Updated 3 years ago
- ☆12Jun 10, 2024Updated last year
- Sample notebooks and prompts for LLM evaluation☆161Nov 2, 2025Updated 5 months ago
- 🐢 Open-Source Evaluation & Testing library for LLM Agents☆5,227Updated this week
- IBM Quantum Challenge Fall 2023☆10May 23, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- The Security Toolkit for LLM Interactions☆2,794Dec 15, 2025Updated 3 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- AI Observability & Evaluation☆9,201Updated this week
- A library for red-teaming LLM applications with LLMs.☆29Oct 11, 2024Updated last year
- Python SDK for running evaluations on LLM generated responses☆299Jun 6, 2025Updated 10 months ago
- Neo4j Cybersecurity Demo☆18Mar 16, 2022Updated 4 years ago
- This demo shows a multi-turn conversation with an AI agent running inside a Temporal workflow.☆34Sep 28, 2025Updated 6 months ago
- CalData's MDSA project with Caltrans on Performance Measurement System (PeMS) data☆12Aug 19, 2025Updated 7 months ago
- Adding guardrails to large language models.☆6,647Apr 3, 2026Updated last week
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- A Library for Scaling Mixed-Integer Optimization-Based Machine Learning.☆11Jun 24, 2024Updated last year
- LLM Prompt Injection Detector☆1,458Aug 7, 2024Updated last year
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆5,943Updated this week
- This sample shows how to use a Cosmos DB Trigger in Azure Functions Triggers (C# or Python) to automatically generate embeddings on data …☆21Mar 11, 2025Updated last year
- Building effective agents patterns implemented with Dapr Agents☆11May 21, 2025Updated 10 months ago
- Simulate SDTM datasets in SAS.☆12Jan 19, 2018Updated 8 years ago
- Code for the papers "Induction of Subgoal Automata for Reinforcement Learning" (AAAI-20) and "Induction and Exploitation of Subgoal Autom…☆14Aug 15, 2023Updated 2 years ago