aiverify-foundation / moonshotLinks
Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
☆266Updated 3 weeks ago
Alternatives and similar repositories for moonshot
Users that are interested in moonshot are comparing it to the libraries listed below
Sorting:
- AI Verify☆28Updated this week
- ☆45Updated last year
- Red-Teaming Language Models with DSPy☆208Updated 6 months ago
- Fiddler Auditor is a tool to evaluate language models.☆187Updated last year
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆191Updated 4 months ago
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆281Updated last year
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆406Updated last year
- LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR t…☆470Updated 6 months ago
- Collection of evals for Inspect AI☆209Updated last week
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆333Updated 7 months ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆553Updated last year
- Guardrails for secure and robust agent development☆334Updated 3 weeks ago
- A Comprehensive Assessment of Trustworthiness in GPT Models☆302Updated 11 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆239Updated 2 weeks ago
- Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!☆314Updated 10 months ago
- A tool for evaluating LLMs☆424Updated last year
- An open-source compliance-centered evaluation framework for Generative AI models☆161Updated this week
- The Granite Guardian models are designed to detect risks in prompts and responses.☆102Updated 2 weeks ago
- A curated list of awesome synthetic data tools (open source and commercial).☆199Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆113Updated 3 weeks ago
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆938Updated 9 months ago
- ☆71Updated 10 months ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆136Updated this week
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆707Updated last year
- This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation fr…☆17Updated last year
- Contains all assets to run with Moonshot Library (Connectors, Datasets and Metrics)☆36Updated last week
- Attribute (or cite) statements generated by LLMs back to in-context information.☆272Updated 10 months ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆113Updated last year
- Sample notebooks and prompts for LLM evaluation☆138Updated 2 months ago
- Automatically evaluate your LLMs in Google Colab☆656Updated last year