Alternatives and similar repositories for mia_llms_benchmark

Users that are interested in mia_llms_benchmark are comparing it to the libraries listed below

• parameterlab / mia-scaling
  Source code of NAACL 2025 Findings "Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models"
  ☆15Updated 8 months ago
• iamgroot42 / mimir
  Python package for measuring memorization in LLMs.
  ☆172Updated 3 months ago
• QinbinLi / LLM-PBE
  A toolkit to assess data privacy in LLMs (under development)
  ☆62Updated 10 months ago
• centerforaisafety / tdc2023-starter-kit
  This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.
  ☆89Updated last year
• huseyinatahaninan / Differentially-Private-Fine-tuning-of-Language-Models
  ☆75Updated 3 years ago
• lxuechen / private-transformers
  A codebase that makes differentially private training of transformers easy.
  ☆176Updated 2 years ago
• ejones313 / auditing-llms
  ☆58Updated 2 years ago
• locuslab / acr-memorization
  ☆37Updated 10 months ago
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆41Updated last year
• jthickstun / watermark
  Code for watermarking language models
  ☆82Updated last year
• princeton-nlp / corpus-poisoning
  [EMNLP 2023] Poisoning Retrieval Corpora by Injecting Adversarial Passages https://arxiv.org/abs/2310.19156
  ☆40Updated last year
• ftramer / LM_Memorization
  Training data extraction on GPT-2
  ☆193Updated 2 years ago
• mireshghallah / ft-memorization
  ☆13Updated 3 years ago
• microsoft / dp-transformers
  Differentially-private transformers using HuggingFace and Opacus
  ☆143Updated last year
• Princeton-SysML / FILM
  Official repo for the paper: Recovering Private Text in Federated Learning of Language Models (in NeurIPS 2022)
  ☆61Updated 2 years ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆116Updated 8 months ago
• joeljang / knowledge-unlearning
  [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models
  ☆83Updated last year
• wyshi / lm_privacy
  ☆21Updated 4 years ago
• eth-sri / SynthPAI
  A Synthetic Dataset for Personal Attribute Inference (NeurIPS'24 D&B)
  ☆45Updated 3 months ago
• wagner-group / MarkMyWords
  ☆31Updated last year
• safr-ai-lab / survey-llm
  A survey of privacy problems in Large Language Models (LLMs). Contains summary of the corresponding paper along with relevant code
  ☆68Updated last year
• eth-sri / llmprivacy
  ☆69Updated 8 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆99Updated last year
• swj0419 / muse_bench
  ☆28Updated 7 months ago
• SORRY-Bench / sorry-bench
  Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)
  ☆64Updated 8 months ago
• facebookresearch / text-adversarial-attack
  Repo for arXiv preprint "Gradient-based Adversarial Attacks against Text Transformers"
  ☆109Updated 2 years ago
• eth-sri / lamp
  LAMP: Extracting Text from Gradients with Language Model Priors (NeurIPS '22)
  ☆26Updated 5 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆46Updated 8 months ago
• locuslab / open-unlearning
  [NeurIPS D&B '25] The one-stop repository for large language model (LLM) unlearning. Supports TOFU, MUSE, WMDP, and many unlearning metho…
  ☆403Updated 3 weeks ago
• YihanWang617 / llm-jailbreaking-defense
  A lightweight library for large laguage model (LLM) jailbreaking defense.
  ☆58Updated last month