haizelabs / dspy-redteam
Red-Teaming Language Models with DSPy
☆183Updated 2 months ago
Alternatives and similar repositories for dspy-redteam:
Users that are interested in dspy-redteam are comparing it to the libraries listed below
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆89Updated last week
- Sphynx Hallucination Induction☆53Updated 2 months ago
- Verdict is a library for scaling judge-time compute.☆199Updated last week
- ☆22Updated 6 months ago
- ⚖️ Awesome LLM Judges ⚖️☆93Updated 2 months ago
- OpenPipe ART (Agent Reinforcement Trainer): train LLM agents☆108Updated this week
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆100Updated last year
- Functional Benchmarks and the Reasoning Gap☆85Updated 6 months ago
- Guardrails for secure and robust agent development☆200Updated last week
- A better way of testing, inspecting, and analyzing AI Agent traces.☆35Updated last week
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆106Updated 7 months ago
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆77Updated 6 months ago
- Collection of evals for Inspect AI☆115Updated this week
- ☆72Updated 6 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆233Updated 2 months ago
- Code for the paper "Fishing for Magikarp"☆153Updated last month
- ☆93Updated last month
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆80Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated 8 months ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆109Updated last year
- ☆42Updated 8 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆89Updated last week
- ☆54Updated 6 months ago
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆107Updated 7 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆104Updated 4 months ago
- ☆128Updated 3 weeks ago
- Improving Alignment and Robustness with Circuit Breakers☆196Updated 7 months ago
- Fiddler Auditor is a tool to evaluate language models.☆179Updated last year
- ☆75Updated 5 months ago
- A toolkit for describing model features and intervening on those features to steer behavior.☆178Updated 5 months ago