Fiddler Auditor is a tool to evaluate language models.
☆191Mar 11, 2024Updated 2 years ago
Alternatives and similar repositories for fiddler-auditor
Users that are interested in fiddler-auditor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Research notes and extra resources for all the work at explodinggradients.com☆27Mar 11, 2025Updated last year
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆990Nov 22, 2024Updated last year
- LLM evaluation.☆16Nov 7, 2023Updated 2 years ago
- Coffee Chat Voice Assistant is a voice-driven ordering system powered by Azure OpenAI GPT-4o Realtime API, simulating the experience of o…☆31May 4, 2026Updated last month
- python jupyter notebook tutorials☆13Apr 14, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A tool for evaluating LLMs☆429Mar 15, 2026Updated 2 months ago
- ☆20Sep 7, 2019Updated 6 years ago
- An end-to-end benchmark suite of multi-modal DNN applications for system-architecture co-design☆22Dec 13, 2024Updated last year
- Just a bunch of benchmark logs for different LLMs☆127Jul 28, 2024Updated last year
- Jump ReLU☆12Apr 8, 2019Updated 7 years ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Sep 21, 2023Updated 2 years ago
- A complete guide to evaluate LLMs and RAGs. Both theory and code based approaches covered.☆28Nov 16, 2023Updated 2 years ago
- Sample project to get started with dbt-power-user vscode extension using dev-container☆12Apr 5, 2024Updated 2 years ago
- Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML va…☆4,019Dec 28, 2025Updated 5 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Generating Realistic Synthetic Data☆45Feb 15, 2024Updated 2 years ago
- Sample notebooks and prompts for LLM evaluation☆160Nov 2, 2025Updated 7 months ago
- Build, evaluate, understand, and fix LLM-based apps☆491Jan 16, 2024Updated 2 years ago
- 🐢 Open-Source Evaluation & Testing library for LLM Agents☆5,420Jun 5, 2026Updated last week
- IBM Quantum Challenge Fall 2023☆10May 23, 2023Updated 3 years ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- AI Observability & Evaluation☆10,091Updated this week
- A library for red-teaming LLM applications with LLMs.☆29Oct 11, 2024Updated last year
- Python SDK for running evaluations on LLM generated responses☆300Jun 6, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Sample solution to automate tedious regulatory compliance processes using multi-agent systems☆28Apr 15, 2025Updated last year
- This demo shows a multi-turn conversation with an AI agent running inside a Temporal workflow.☆34Sep 28, 2025Updated 8 months ago
- LLM Prompt Injection Detector☆1,499Aug 7, 2024Updated last year
- Adding guardrails to large language models.☆6,995Updated this week
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆6,362Updated this week
- This sample shows how to use a Cosmos DB Trigger in Azure Functions Triggers (C# or Python) to automatically generate embeddings on data …☆21Mar 11, 2025Updated last year
- Building effective agents patterns implemented with Dapr Agents☆11May 21, 2025Updated last year
- Benchmarks of artificial neural network library for Spark MLlib☆11Dec 3, 2015Updated 10 years ago
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆325Jul 10, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Benchmark suite for LLMs from Fireworks.ai☆104Updated this week
- Whispers in the Machine: Confidentiality in Agentic Systems☆44Apr 20, 2026Updated last month
- Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. Fro…☆7,590May 2, 2026Updated last month
- the LLM vulnerability scanner☆8,035Updated this week
- New ways of breaking app-integrated LLMs☆2,098Jul 17, 2025Updated 10 months ago
- This repository contains the Julia code for the paper "Competitive Gradient Descent"☆25Dec 18, 2019Updated 6 years ago
- ☆55Aug 22, 2025Updated 9 months ago