Alternatives and similar repositories for fiddler-auditor

Users that are interested in fiddler-auditor are comparing it to the libraries listed below

• arthur-ai / bench
  A tool for evaluating LLMs
  ☆424Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆137Updated 3 months ago
• raga-ai-hub / raga-llm-hub
  Framework for LLM evaluation, guardrails and security
  ☆113Updated last year
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆115Updated 2 months ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆248Updated last year
• v7labs / benchllm
  Continuous Integration for LLM powered applications
  ☆252Updated 2 years ago
• Aggregate-Intellect / sherpa
  ☆169Updated this week
• deepset-ai / prompthub
  ☆177Updated last year
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆83Updated last year
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆79Updated 7 months ago
• tigerlab-ai / tiger
  Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
  ☆397Updated last year
• run-llama / ai-engineer-workshop
  ☆186Updated last year
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆214Updated 7 months ago
• cado-security / masked-ai
  Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.
  ☆119Updated 2 years ago
• anyscale / ray-summit-2023-training
  ☆87Updated 2 years ago
• Giskard-AI / awesome-ai-safety
  📚 A curated list of papers & technical articles on AI Quality & Safety
  ☆193Updated 5 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆292Updated 4 months ago
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆239Updated 2 years ago
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆318Updated 2 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆98Updated 7 months ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆142Updated last week
• stanford-crfm / EUAIActJune15
  Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
  ☆93Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆116Updated 6 months ago
• run-llama / llamaindex_aws_ingestion
  ☆89Updated last year
• kolenaIO / autoarena
  Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
  ☆105Updated 9 months ago
• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆105Updated last year
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆151Updated 11 months ago
• whyhow-ai / whyhow
  Automated knowledge graph creation SDK
  ☆122Updated 10 months ago
• fw-ai / cookbook
  Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.
  ☆123Updated last week