Alternatives and similar repositories for EUAIActJune15:

Users that are interested in EUAIActJune15 are comparing it to the libraries listed below

• stanford-crfm / fmti
  The Foundation Model Transparency Index
  ☆75Updated 8 months ago
• stanford-crfm / ecosystem-graphs
  ☆262Updated 3 weeks ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆175Updated 11 months ago
• holistic-ai / holisticai
  This is an open-source tool to assess and improve the trustworthiness of AI systems.
  ☆87Updated this week
• compl-ai / compl-ai
  An open-source compliance-centered evaluation framework for Generative AI models
  ☆131Updated 2 months ago
• Giskard-AI / awesome-ai-safety
  📚 A curated list of papers & technical articles on AI Quality & Safety
  ☆169Updated last year
• eugeneyan / visualizing-finetunes
  ☆77Updated 8 months ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆93Updated this week
• credo-ai / credoai_lens
  Credo AI Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central …
  ☆46Updated 8 months ago
• avidml / evaluating-LLMs
  Creating the tools and data sets necessary to evaluate vulnerabilities in LLMs.
  ☆23Updated last week
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• olly-styles / WorkBench
  WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting.
  ☆37Updated 6 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated 10 months ago
• huggingface / disaggregators
  🤗 Disaggregators: Curated data labelers for in-depth analysis.
  ☆65Updated 2 years ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆100Updated 10 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 8 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆120Updated 2 months ago
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆166Updated 9 months ago
• jongjyh / TrFr
  Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning
  ☆45Updated last year
• MantisAI / hugie
  Command Line Interface for Hugging Face Inference Endpoints
  ☆67Updated 10 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆106Updated last week
• pacman100 / peft-codegen-25
  ☆24Updated last year
• AthenaCore / AwesomeResponsibleAI
  A curated list of awesome academic research, books, code of ethics, data sets, institutes, maturity models, newsletters, principles, podc…
  ☆65Updated this week
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆101Updated 2 months ago
• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆79Updated this week
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆210Updated 3 weeks ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆93Updated 11 months ago
• TheAtticusProject / maud
  ☆76Updated 2 years ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆402Updated 9 months ago
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆106Updated this week