Giskard-AI / awesome-ai-safetyLinks
📚 A curated list of papers & technical articles on AI Quality & Safety
☆193Updated 7 months ago
Alternatives and similar repositories for awesome-ai-safety
Users that are interested in awesome-ai-safety are comparing it to the libraries listed below
Sorting:
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- ☆268Updated 9 months ago
- 📚 Datasets and models for instruction-tuning☆237Updated 2 years ago
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆115Updated 3 months ago
- Red-Teaming Language Models with DSPy☆235Updated 9 months ago
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆93Updated 2 years ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆433Updated last year
- A tool for evaluating LLMs☆427Updated last year
- An open-source compliance-centered evaluation framework for Generative AI models☆170Updated this week
- 📖 A curated list of resources dedicated to synthetic data☆138Updated 3 years ago
- ☆256Updated 7 months ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆149Updated this week
- The Foundation Model Transparency Index☆83Updated last year
- ☆43Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆109Updated 11 months ago
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆211Updated last week
- Framework for LLM evaluation, guardrails and security☆113Updated last year
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆294Updated last year
- Automatically evaluate your LLMs in Google Colab☆667Updated last year
- AI Verify☆37Updated 2 weeks ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆50Updated last year
- Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning☆46Updated last year
- RuLES: a benchmark for evaluating rule-following in language models☆239Updated 8 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆123Updated 2 weeks ago
- CodeSage: Code Representation Learning At Scale (ICLR 2024)☆114Updated last year
- A curated list of awesome publications and researchers on prompting framework updated and maintained by The Intelligent System Security (…☆86Updated 10 months ago
- A joint community effort to create one central leaderboard for LLMs.☆305Updated last year
- awesome synthetic (text) datasets☆305Updated this week
- data cleaning and curation for unstructured text☆329Updated last year
- ☆49Updated last year