google-research / lm-extraction-benchmark
☆286Updated last week
Alternatives and similar repositories for lm-extraction-benchmark:
Users that are interested in lm-extraction-benchmark are comparing it to the libraries listed below
- Training data extraction on GPT-2☆185Updated 2 years ago
- Python package for measuring memorization in LLMs.☆152Updated 5 months ago
- A codebase that makes differentially private training of transformers easy.☆171Updated 2 years ago
- Repository for research in the field of Responsible NLP at Meta.☆199Updated 4 months ago
- Differentially-private transformers using HuggingFace and Opacus☆136Updated 7 months ago
- This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.☆86Updated 11 months ago
- [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models☆80Updated 7 months ago
- A one-stop repository for large language model (LLM) unlearning. Supports TOFU, MUSE and is an easily extensible framework for new datase…☆229Updated this week
- Code for watermarking language models☆78Updated 7 months ago
- Repo for arXiv preprint "Gradient-based Adversarial Attacks against Text Transformers"☆107Updated 2 years ago
- ☆131Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆95Updated 2 months ago
- A re-implementation of the "Extracting Training Data from Large Language Models" paper by Carlini et al., 2020☆35Updated 2 years ago
- A Comprehensive Assessment of Trustworthiness in GPT Models☆284Updated 7 months ago
- The repository contains the code for analysing the leakage of personally identifiable (PII) information from the output of next word pred…☆92Updated 8 months ago
- MEND: Fast Model Editing at Scale☆244Updated last year
- ☆54Updated 2 years ago
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆111Updated last year
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆111Updated 10 months ago
- ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.☆80Updated 11 months ago
- A survey of privacy problems in Large Language Models (LLMs). Contains summary of the corresponding paper along with relevant code☆67Updated 10 months ago
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆80Updated 4 years ago
- Official Repository for Dataset Inference for LLMs☆33Updated 9 months ago
- The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.☆177Updated 2 years ago
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆137Updated 4 months ago
- A fast, effective data attribution method for neural networks in PyTorch☆204Updated 5 months ago
- LLM Unlearning☆153Updated last year
- Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873☆152Updated 11 months ago
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆62Updated last year
- An unofficial implementation of AutoDAN attack on LLMs (arXiv:2310.15140)☆37Updated last year