Fiddler Auditor is a tool to evaluate language models.
☆190Mar 11, 2024Updated 2 years ago
Alternatives and similar repositories for fiddler-auditor
Users that are interested in fiddler-auditor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆984Nov 22, 2024Updated last year
- LLM evaluation.☆16Nov 7, 2023Updated 2 years ago
- python jupyter notebook tutorials☆12Apr 14, 2026Updated 2 weeks ago
- A tool for evaluating LLMs☆430Mar 15, 2026Updated last month
- Building the laion5B paper☆36May 6, 2022Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Just a bunch of benchmark logs for different LLMs☆124Jul 28, 2024Updated last year
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆64Mar 26, 2024Updated 2 years ago
- Evaluating LLMs with CommonGen-Lite☆95Mar 21, 2024Updated 2 years ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Sep 21, 2023Updated 2 years ago
- Sample project to get started with dbt-power-user vscode extension using dev-container☆12Apr 5, 2024Updated 2 years ago
- All Data Tools☆10Feb 28, 2023Updated 3 years ago
- An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts s…☆12Sep 11, 2022Updated 3 years ago
- First steps to interact with MLflow (mlflow.org)☆10Oct 18, 2018Updated 7 years ago
- Generating Realistic Synthetic Data☆43Feb 15, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Data Pipeline that utilizes GCP, Python 3.10, Prefect, and more.☆10Jan 23, 2023Updated 3 years ago
- This is the end to end MLOps project I built through participated the MLOps Zoomcamp☆10Sep 11, 2022Updated 3 years ago
- Sample notebooks and prompts for LLM evaluation☆161Nov 2, 2025Updated 6 months ago
- ☆12Jun 17, 2024Updated last year
- 🐢 Open-Source Evaluation & Testing library for LLM Agents☆5,313Updated this week
- KWeaver DIP is an enterprise-level digital employee platform, built on KWeaver Core. It provides an AI-native environment for developing …☆116Updated this week
- The official implementation of the iConference 2022 paper "Identifying Machine-Paraphrased Plagiarism".☆18Nov 19, 2022Updated 3 years ago
- The Security Toolkit for LLM Interactions☆2,892Dec 15, 2025Updated 4 months ago
- AI Observability & Evaluation☆9,459Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A library for red-teaming LLM applications with LLMs.☆29Oct 11, 2024Updated last year
- zero-vocab or low-vocab embeddings☆18Jul 17, 2022Updated 3 years ago
- Python SDK for running evaluations on LLM generated responses☆299Jun 6, 2025Updated 10 months ago
- Sample solution to automate tedious regulatory compliance processes using multi-agent systems☆26Apr 15, 2025Updated last year
- Neo4j Cybersecurity Demo☆19Mar 16, 2022Updated 4 years ago
- This demo shows a multi-turn conversation with an AI agent running inside a Temporal workflow.☆34Sep 28, 2025Updated 7 months ago
- Helpers for scikit learn☆16Dec 26, 2022Updated 3 years ago
- CalData's MDSA project with Caltrans on Performance Measurement System (PeMS) data☆12Aug 19, 2025Updated 8 months ago
- Adding guardrails to large language models.☆6,777Apr 3, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- LLM Prompt Injection Detector☆1,467Aug 7, 2024Updated last year
- ☆14Aug 6, 2023Updated 2 years ago
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆6,056Updated this week
- Apple OAuth2 Provider for Laravel Socialite☆10May 8, 2020Updated 5 years ago
- Lyrics Generation using LSTM , word2vec Analysis and more☆10Jun 7, 2018Updated 7 years ago
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆324Jul 10, 2025Updated 9 months ago
- Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. Fro…☆7,426Apr 22, 2026Updated last week