Alternatives and similar repositories for fiddler-auditor

Users that are interested in fiddler-auditor are comparing it to the libraries listed below

• arthur-ai / bench
  A tool for evaluating LLMs
  ☆428Updated last year
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆116Updated 6 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆250Updated 11 months ago
• Giskard-AI / awesome-ai-safety
  📚 A curated list of papers & technical articles on AI Quality & Safety
  ☆200Updated 9 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆159Updated 3 months ago
• raga-ai-hub / raga-llm-hub
  Framework for LLM evaluation, guardrails and security
  ☆114Updated last year
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆84Updated 2 years ago
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated 2 years ago
• deepset-ai / prompthub
  ☆185Updated 2 years ago
• run-llama / ai-engineer-workshop
  ☆187Updated 2 years ago
• tigerlab-ai / tiger
  Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
  ☆399Updated 2 years ago
• stanford-crfm / EUAIActJune15
  Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
  ☆93Updated 2 years ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆248Updated last year
• Aggregate-Intellect / sherpa
  ☆171Updated 2 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆295Updated 7 months ago
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆154Updated last year
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆46Updated last year
• statice / awesome-synthetic-data
  A curated list of awesome synthetic data tools (open source and commercial).
  ☆239Updated 2 years ago
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆321Updated 6 months ago
• hwchase17 / langfuzz
  ☆76Updated last year
• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆106Updated last year
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆126Updated 3 months ago
• anyscale / ray-summit-2023-training
  ☆90Updated 2 years ago
• v7labs / benchllm
  Continuous Integration for LLM powered applications
  ☆254Updated 2 years ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆176Updated last week
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆84Updated last year
• cleanlab / cleanlab-studio
  Client interface to Cleanlab Studio
  ☆31Updated 11 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆119Updated 10 months ago
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆255Updated last year
• run-llama / llamaindex_aws_ingestion
  ☆90Updated 2 years ago