Giskard-AI / awesome-ai-safetyLinks
π A curated list of papers & technical articles on AI Quality & Safety
β192Updated 6 months ago
Alternatives and similar repositories for awesome-ai-safety
Users that are interested in awesome-ai-safety are comparing it to the libraries listed below
Sorting:
- Fiddler Auditor is a tool to evaluate language models.β188Updated last year
- β268Updated 9 months ago
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.β115Updated 3 months ago
- Red-Teaming Language Models with DSPyβ235Updated 8 months ago
- The Foundation Model Transparency Indexβ83Updated last year
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Actβ93Updated 2 years ago
- β256Updated 7 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to aβ¦β427Updated last year
- π¦ Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data β¦β211Updated last week
- Mixing Language Models with Self-Verification and Meta-Verificationβ109Updated 10 months ago
- π Datasets and models for instruction-tuningβ237Updated 2 years ago
- A curated list of awesome publications and researchers on prompting framework updated and maintained by The Intelligent System Security (β¦β84Updated 9 months ago
- An open-source compliance-centered evaluation framework for Generative AI modelsβ169Updated last week
- A curated list of awesome synthetic data tools (open source and commercial).β217Updated last year
- Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuningβ46Updated last year
- π A curated list of resources dedicated to synthetic dataβ137Updated 3 years ago
- Open Implementations of LLM Analysesβ107Updated last year
- Framework for LLM evaluation, guardrails and securityβ113Updated last year
- Curation of prompts that are known to be adversarial to large language modelsβ184Updated 2 years ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo rankerβ120Updated this week
- awesome synthetic (text) datasetsβ302Updated 3 months ago
- Moonshot - A simple and modular tool to evaluate and red-team any LLM application.β278Updated last month
- Ghostbuster: Detecting Text Ghostwritten by Large Language Models (NAACL 2024)β163Updated last year
- A tool for evaluating LLMsβ424Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absoluteβ¦β50Updated last year
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.β107Updated this week
- Toolkit for attaching, training, saving and loading of new heads for transformer modelsβ289Updated 7 months ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various useβ¦β144Updated 2 weeks ago
- β43Updated last year
- A curated list of awesome academic research, books, code of ethics, courses, databases, data sets, frameworks, institutes, maturity modeβ¦β87Updated this week