aiverify-foundation / moonshotLinks
Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
☆295Updated this week
Alternatives and similar repositories for moonshot
Users that are interested in moonshot are comparing it to the libraries listed below
Sorting:
- AI Verify☆39Updated this week
- ☆50Updated last year
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- Contains all assets to run with Moonshot Library (Connectors, Datasets and Metrics)☆39Updated last week
- Red-Teaming Language Models with DSPy☆249Updated 10 months ago
- The Granite Guardian models are designed to detect risks in prompts and responses.☆126Updated 3 months ago
- Collection of evals for Inspect AI☆332Updated this week
- ☆76Updated last year
- LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR t…☆509Updated 11 months ago
- An open-source compliance-centered evaluation framework for Generative AI models☆178Updated 2 weeks ago
- A tool for evaluating LLMs☆428Updated last year
- The fastest Trust Layer for AI Agents☆146Updated 7 months ago
- A Comprehensive Assessment of Trustworthiness in GPT Models☆311Updated last year
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆302Updated last year
- Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!☆346Updated 2 months ago
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆830Updated last year
- Papers about red teaming LLMs and Multimodal models.☆159Updated 7 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆447Updated last year
- LangFair is a Python library for conducting use-case level LLM bias and fairness assessments☆250Updated this week
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆116Updated this week
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆196Updated 8 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆400Updated last month
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆373Updated 11 months ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆590Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆116Updated 5 months ago
- TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle☆302Updated 3 weeks ago
- Guardrails for secure and robust agent development☆378Updated 5 months ago
- This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation fr…☆19Updated 2 years ago
- Sample notebooks and prompts for LLM evaluation☆159Updated 2 months ago
- Automatically evaluate your LLMs in Google Colab☆679Updated last year