Alternatives and similar repositories for moonshot-data

Users that are interested in moonshot-data are comparing it to the libraries listed below

• Babelscape / ALERT
  Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"
  ☆42Updated 9 months ago
• poloclub / llm-landscape
  NeurIPS'24 - LLM Safety Landscape
  ☆25Updated 4 months ago
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆157Updated last month
• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆95Updated this week
• RapidResponseBench / rapidresponsebench
  ☆34Updated 8 months ago
• FSoft-AI4Code / CodeMMLU
  [ICLR 2025] 🚀 CodeMMLU Evaluator: A framework for evaluating LM models on CodeMMLU MCQs benchmark.
  ☆23Updated 2 months ago
• compl-ai / compl-ai
  An open-source compliance-centered evaluation framework for Generative AI models
  ☆157Updated last week
• allenai / safety-eval
  A simple evaluation of generative language models and safety classifiers.
  ☆56Updated 11 months ago
• qcri / LLMeBench
  Benchmarking Large Language Models
  ☆99Updated 3 weeks ago
• allenai / super-benchmark
  ☆45Updated 3 months ago
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆106Updated last month
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆159Updated last year
• amazon-science / controlling-llm-memorization
  ☆36Updated 2 years ago
• ruyimarone / data-portraits
  Documenting large text datasets 🖼️ 📚
  ☆12Updated 6 months ago
• AI4Bharat / FBI
  FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists
  ☆28Updated 4 months ago
• JoshEngels / SAE-Probes
  Code for reproducing our paper "Are Sparse Autoencoders Useful? A Case Study in Sparse Probing"
  ☆25Updated 3 months ago
• allenai / hybrid-preferences
  Learning to route instances for Human vs AI Feedback (ACL 2025 Main)
  ☆23Updated last month
• XiangLi1999 / AutoBencher
  ☆29Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• aiverify-foundation / moonshot
  Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
  ☆253Updated last week
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆173Updated this week
• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆204Updated this week
• poloclub / LLM-Attributor
  LLM Attributor: Attribute LLM's Generated Text to Training Data
  ☆52Updated last year
• allenai / wildguard
  Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
  ☆84Updated 7 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆202Updated 4 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆54Updated 4 months ago
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆101Updated 5 months ago
• max-andr / adversarial-random-search-gpt4
  Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]
  ☆43Updated last year
• IBM / benchbench
  A package dedicated for running benchmark agreement testing
  ☆16Updated 2 months ago
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆35Updated 11 months ago