Alternatives and similar repositories for fiddler-auditor

Users that are interested in fiddler-auditor are comparing it to the libraries listed below

• arthur-ai / bench
  A tool for evaluating LLMs
  ☆424Updated last year
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆114Updated 3 weeks ago
• deepset-ai / prompthub
  ☆174Updated last year
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆208Updated 6 months ago
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆83Updated last year
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆151Updated 10 months ago
• Giskard-AI / awesome-ai-safety
  📚 A curated list of papers & technical articles on AI Quality & Safety
  ☆191Updated 4 months ago
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆82Updated last year
• run-llama / ai-engineer-workshop
  ☆185Updated last year
• raga-ai-hub / raga-llm-hub
  Framework for LLM evaluation, guardrails and security
  ☆113Updated 11 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆138Updated 2 months ago
• tigerlab-ai / tiger
  Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
  ☆398Updated last year
• stanford-crfm / EUAIActJune15
  Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
  ☆94Updated last year
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆292Updated 2 months ago
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆317Updated last month
• statice / awesome-synthetic-data
  A curated list of awesome synthetic data tools (open source and commercial).
  ☆199Updated last year
• Aggregate-Intellect / sherpa
  ☆168Updated last week
• CYQIQ / MultiCoT
  Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph
  ☆147Updated last year
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆252Updated 10 months ago
• run-llama / llamaindex_aws_ingestion
  ☆89Updated last year
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆246Updated 10 months ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆136Updated this week
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆168Updated last year
• fw-ai / cookbook
  Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.
  ☆124Updated this week
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆114Updated last month
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆44Updated last year
• cado-security / masked-ai
  Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.
  ☆119Updated 2 years ago
• anyscale / ray-summit-2023-training
  ☆87Updated last year
• v7labs / benchllm
  Continuous Integration for LLM powered applications
  ☆249Updated 2 years ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆250Updated 6 months ago