Alternatives and similar repositories for dspy-redteam

Users that are interested in dspy-redteam are comparing it to the libraries listed below

• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆317Updated last month
• haizelabs / get-haized
  A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.
  ☆100Updated 8 months ago
• haizelabs / bijection-learning
  ☆26Updated last year
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 10 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆146Updated 8 months ago
• ZenGuard-AI / fast-llm-security-guardrails
  The fastest Trust Layer for AI Agents
  ☆144Updated 7 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆188Updated last year
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆125Updated last month
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆112Updated last year
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆320Updated this week
• invariantlabs-ai / invariant
  Guardrails for secure and robust agent development
  ☆374Updated 5 months ago
• haizelabs / redteaming-resistance-benchmark
  ☆49Updated last year
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆177Updated 7 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆122Updated last year
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆95Updated 2 months ago
• microsoft / TaskTracker
  TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…
  ☆78Updated 3 months ago
• redteaming-arena / redteam-arena
  ☆38Updated 6 months ago
• PrimeIntellect-ai / genesys
  ☆136Updated 9 months ago
• compl-ai / compl-ai
  An open-source compliance-centered evaluation framework for Generative AI models
  ☆177Updated this week
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated 2 months ago
• princeton-pli / hal-harness
  ☆207Updated last week
• andyzorigin / cybench
  ☆182Updated 2 weeks ago
• hwchase17 / langfuzz
  ☆74Updated last year
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆116Updated 5 months ago
• hwchase17 / adversarial-prompts
  Curation of prompts that are known to be adversarial to large language models
  ☆186Updated 2 years ago
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆263Updated 10 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆312Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• google-deepmind / dangerous-capability-evaluations
  ☆63Updated last week
• google-deepmind / mishax
  ☆147Updated 3 months ago