Giskard-AI / awesome-ai-safetyLinks
📚 A curated list of papers & technical articles on AI Quality & Safety
☆192Updated 5 months ago
Alternatives and similar repositories for awesome-ai-safety
Users that are interested in awesome-ai-safety are comparing it to the libraries listed below
Sorting:
- Fiddler Auditor is a tool to evaluate language models.☆187Updated last year
- ☆267Updated 7 months ago
- 📚 Datasets and models for instruction-tuning☆238Updated last year
- Red-Teaming Language Models with DSPy☆213Updated 7 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆117Updated this week
- AI Verify☆32Updated last week
- The Foundation Model Transparency Index☆82Updated last year
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆93Updated last year
- An open-source compliance-centered evaluation framework for Generative AI models☆163Updated last week
- A curated list of awesome synthetic data tools (open source and commercial).☆206Updated last year
- A tool for evaluating LLMs☆424Updated last year
- Curation of prompts that are known to be adversarial to large language models☆185Updated 2 years ago
- Moonshot - A simple and modular tool to evaluate and red-team any LLM application.☆268Updated 2 weeks ago
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 9 months ago
- 📖 A curated list of resources dedicated to synthetic data☆135Updated 3 years ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆416Updated last year
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆208Updated this week
- Continuous Integration for LLM powered applications☆249Updated 2 years ago
- A curated list of awesome publications and researchers on prompting framework updated and maintained by The Intelligent System Security (…☆84Updated 8 months ago
- ☆248Updated 5 months ago
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆114Updated last month
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆139Updated 3 weeks ago
- A joint community effort to create one central leaderboard for LLMs.☆306Updated last year
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆114Updated last year
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆104Updated this week
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆286Updated 6 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- LangFair is a Python library for conducting use-case level LLM bias and fairness assessments☆232Updated last week
- ☆337Updated last year
- Framework for LLM evaluation, guardrails and security☆113Updated last year