Fiddler Auditor is a tool to evaluate language models.
☆193Mar 11, 2024Updated 2 years ago
Alternatives and similar repositories for fiddler-auditor
Users that are interested in fiddler-auditor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Research notes and extra resources for all the work at explodinggradients.com☆26Mar 11, 2025Updated last year
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆993Nov 22, 2024Updated last year
- Sample notebooks and prompts for LLM evaluation☆175Nov 2, 2025Updated 8 months ago
- LLM evaluation.☆16Nov 7, 2023Updated 2 years ago
- Coffee Chat Voice Assistant is a voice-driven ordering system powered by Azure OpenAI GPT-4o Realtime API, simulating the experience of o…☆32Jun 22, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A tool for evaluating LLMs☆428Mar 15, 2026Updated 4 months ago
- Just a bunch of benchmark logs for different LLMs☆130Jul 28, 2024Updated last year
- A complete guide to evaluate LLMs and RAGs. Both theory and code based approaches covered.☆28Nov 16, 2023Updated 2 years ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆18Sep 21, 2023Updated 2 years ago
- Generating Realistic Synthetic Data☆46Feb 15, 2024Updated 2 years ago
- Sample project to get started with dbt-power-user vscode extension using dev-container☆12Apr 5, 2024Updated 2 years ago
- Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML va…☆4,039Dec 28, 2025Updated 6 months ago
- 🐢 Open-Source Evaluation & Testing library for LLM Agents☆5,706Updated this week
- IBM Quantum Challenge Fall 2023☆10May 23, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Oxygen is a Robot Framework tool that empowers the user to convert the results of any testing tool or framework to Robot Framework's repo…☆26Jun 26, 2024Updated 2 years ago
- Python SDK for running evaluations on LLM generated responses☆301Jun 6, 2025Updated last year
- A library for red-teaming LLM applications with LLMs.☆28Oct 11, 2024Updated last year
- LLM Prompt Injection Detector☆1,514Aug 7, 2024Updated last year
- A content inspecting SMTP proxy☆17Jun 9, 2014Updated 12 years ago
- ☆13Apr 6, 2025Updated last year
- Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. Fro…☆7,744May 2, 2026Updated 2 months ago
- Mint and purchase NFTs representing time for performing freelance services and other use cases. Time NFTs can represent an on-chain attes…☆42Nov 28, 2022Updated 3 years ago
- Awesome material(papers, tools, etc.) about testing machine learning system, including deep learning system.☆47Oct 12, 2021Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- This sample shows how to use a Cosmos DB Trigger in Azure Functions Triggers (C# or Python) to automatically generate embeddings on data …☆21Mar 11, 2025Updated last year
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆6,778Updated this week
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆56Aug 20, 2024Updated last year
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆337Jun 7, 2024Updated 2 years ago
- A novel BCI-based messaging web application that uses P300 speller and emotion detection to bridge the gap in social media accessibility …☆12Aug 31, 2021Updated 4 years ago
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆327Jul 10, 2025Updated last year
- AI Observability & Evaluation☆10,699Updated this week
- The Security Toolkit for LLM Interactions☆3,191Jul 8, 2026Updated 2 weeks ago
- Neo4j Cybersecurity Demo☆19Mar 16, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so yo…☆104Nov 24, 2023Updated 2 years ago
- This project provides a solution to AWS customers for reporting on what tags exists, the resources they are applied to, and what resource…☆25Feb 28, 2024Updated 2 years ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆180Feb 28, 2024Updated 2 years ago
- Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets☆5,046Updated this week
- Adding guardrails to large language models.☆7,194Updated this week
- [ECCV 2024] M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts.☆61Oct 1, 2024Updated last year
- [ICLR 2025 Spotlight] An open-sourced LLM judge for evaluating LLM-generated answers.☆438Feb 11, 2025Updated last year