chziakas / redeval
A library for red-teaming LLM applications with LLMs.
☆24Updated 4 months ago
Alternatives and similar repositories for redeval:
Users that are interested in redeval are comparing it to the libraries listed below
- Red-Teaming Language Models with DSPy☆168Updated last week
- ☆77Updated 2 months ago
- Sphynx Hallucination Induction☆52Updated 3 weeks ago
- Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"☆39Updated 5 months ago
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆89Updated 8 months ago
- A prompt injection game to collect data for robust ML research☆52Updated 3 weeks ago
- ☆14Updated 4 months ago
- ☆27Updated 3 months ago
- Dataset for the Tensor Trust project☆36Updated 11 months ago
- ☆38Updated 2 weeks ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 7 months ago
- ☆64Updated last month
- A framework for high-fidelity retrieval augmented generation in industrial knowledge bases. Integrates jargon identification, context rec…☆28Updated 6 months ago
- Papers about red teaming LLMs and Multimodal models.☆96Updated 3 months ago
- Code to break Llama Guard☆31Updated last year
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆93Updated 11 months ago
- ☆70Updated 3 months ago
- ☆16Updated 8 months ago
- Open Implementations of LLM Analyses☆98Updated 4 months ago
- ☆20Updated 3 months ago
- ☆9Updated 10 months ago
- Code for "The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction an…☆10Updated 9 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆106Updated last week
- Thorn in a HaizeStack test for evaluating long-context adversarial robustness.☆26Updated 6 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆57Updated 11 months ago
- LLM Evals for Text Summarization and RAG use-cases.☆35Updated last year
- ☆25Updated 4 months ago
- Test LLMs against jailbreaks and unprecedented harms☆25Updated 4 months ago
- Realign is a testing and simulation framework for AI applications.☆14Updated 2 months ago