Alternatives and similar repositories for awesome-ai-safety

Users that are interested in awesome-ai-safety are comparing it to the libraries listed below

• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆181Updated last year
• compl-ai / compl-ai
  An open-source compliance-centered evaluation framework for Generative AI models
  ☆152Updated 3 weeks ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• avidml / evaluating-LLMs
  Creating the tools and data sets necessary to evaluate vulnerabilities in LLMs.
  ☆23Updated 2 months ago
• stanford-crfm / EUAIActJune15
  Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
  ☆94Updated last year
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆238Updated last year
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆118Updated 3 weeks ago
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆110Updated 8 months ago
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆234Updated 2 months ago
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆239Updated 3 months ago
• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆92Updated this week
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆322Updated 6 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆195Updated 3 months ago
• stanford-crfm / ecosystem-graphs
  ☆266Updated 4 months ago
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆327Updated 10 months ago
• stanford-crfm / fmti
  The Foundation Model Transparency Index
  ☆79Updated last year
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆172Updated 8 months ago
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆103Updated 7 months ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆423Updated last year
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆228Updated 4 months ago
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆631Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆131Updated this week
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆526Updated 11 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• Giskard-AI / giskard-vision
  📸 Open-Source Evaluation & Testing for Computer Vision AI systems
  ☆28Updated 7 months ago
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• EleutherAI / elk
  Keeping language models honest by directly eliciting knowledge encoded in their activations.
  ☆205Updated this week
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆187Updated last year
• v7labs / benchllm
  Continuous Integration for LLM powered applications
  ☆241Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆281Updated 7 months ago