Alternatives and similar repositories for dspy-redteam

Users that are interested in dspy-redteam are comparing it to the libraries listed below

• haizelabs / get-haized
  A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.
  ☆96Updated 5 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆300Updated last week
• haizelabs / bijection-learning
  ☆26Updated 11 months ago
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 8 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆130Updated 5 months ago
• princeton-pli / hal-harness
  ☆136Updated this week
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆241Updated this week
• invariantlabs-ai / invariant
  Guardrails for secure and robust agent development
  ☆348Updated 2 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆118Updated last year
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated last week
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆111Updated this week
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆114Updated last year
• andyzorigin / cybench
  ☆153Updated 3 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆89Updated this week
• ZenGuard-AI / fast-llm-security-guardrails
  The fastest Trust Layer for AI Agents
  ☆143Updated 4 months ago
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆170Updated 4 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆188Updated last year
• hwchase17 / langfuzz
  ☆73Updated 11 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆297Updated last week
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆289Updated last year
• hwchase17 / adversarial-prompts
  Curation of prompts that are known to be adversarial to large language models
  ☆186Updated 2 years ago
• PrimeIntellect-ai / genesys
  ☆135Updated 6 months ago
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆115Updated 2 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆118Updated 3 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆56Updated 6 months ago
• google-deepmind / dangerous-capability-evaluations
  ☆58Updated last week
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆110Updated 9 months ago
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆118Updated 3 weeks ago
• RapidResponseBench / rapidresponsebench
  ☆35Updated 10 months ago