Alternatives and similar repositories for mia_llms_benchmark

Users that are interested in mia_llms_benchmark are comparing it to the libraries listed below

• parameterlab / mia-scaling
  Source code of NAACL 2025 Findings "Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models"
  ☆13Updated 7 months ago
• QinbinLi / LLM-PBE
  A toolkit to assess data privacy in LLMs (under development)
  ☆62Updated 8 months ago
• iamgroot42 / mimir
  Python package for measuring memorization in LLMs.
  ☆166Updated 2 months ago
• centerforaisafety / tdc2023-starter-kit
  This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.
  ☆89Updated last year
• huseyinatahaninan / Differentially-Private-Fine-tuning-of-Language-Models
  ☆75Updated 3 years ago
• wagner-group / MarkMyWords
  ☆30Updated last year
• aounon / certified-llm-safety
  ☆44Updated last year
• lxuechen / private-transformers
  A codebase that makes differentially private training of transformers easy.
  ☆176Updated 2 years ago
• jthickstun / watermark
  Code for watermarking language models
  ☆82Updated last year
• ftramer / LM_Memorization
  Training data extraction on GPT-2
  ☆191Updated 2 years ago
• ethz-spylab / rlhf-poisoning
  Code for paper "Universal Jailbreak Backdoors from Poisoned Human Feedback"
  ☆59Updated last year
• locuslab / acr-memorization
  ☆37Updated 9 months ago
• Princeton-SysML / FILM
  Official repo for the paper: Recovering Private Text in Federated Learning of Language Models (in NeurIPS 2022)
  ☆59Updated 2 years ago
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆41Updated last year
• litian96 / AdaDPS
  Private Adaptive Optimization with Side Information (ICML '22)
  ☆16Updated 3 years ago
• locuslab / open-unlearning
  The one-stop repository for large language model (LLM) unlearning. Supports TOFU, MUSE, WMDP, and many unlearning methods. All features: …
  ☆368Updated 2 months ago
• arobey1 / smooth-llm
  ☆108Updated last year
• microsoft / dp-transformers
  Differentially-private transformers using HuggingFace and Opacus
  ☆142Updated last year
• ejones313 / auditing-llms
  ☆57Updated 2 years ago
• eth-sri / lamp
  LAMP: Extracting Text from Gradients with Language Model Priors (NeurIPS '22)
  ☆26Updated 3 months ago
• facebookresearch / text-adversarial-attack
  Repo for arXiv preprint "Gradient-based Adversarial Attacks against Text Transformers"
  ☆108Updated 2 years ago
• eth-sri / SynthPAI
  A Synthetic Dataset for Personal Attribute Inference (NeurIPS'24 D&B)
  ☆44Updated last month
• Vaidehi99 / InfoDeletionAttacks
  ☆45Updated 7 months ago
• mireshghallah / ft-memorization
  ☆13Updated 2 years ago
• eth-sri / llmprivacy
  ☆64Updated 7 months ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆111Updated 6 months ago
• safr-ai-lab / survey-llm
  A survey of privacy problems in Large Language Models (LLMs). Contains summary of the corresponding paper along with relevant code
  ☆67Updated last year
• sophie-xhonneux / Continuous-AdvTrain
  ☆28Updated 3 weeks ago
• OPTML-Group / Unlearn-WorstCase
  [ECCV24] "Challenging Forgets: Unveiling the Worst-Case Forget Sets in Machine Unlearning" by Chongyu Fan*, Jiancheng Liu*, Alfred Hero, …
  ☆22Updated 3 months ago
• lilakk / PostMark
  Official repository for "PostMark: A Robust Blackbox Watermark for Large Language Models"
  ☆27Updated last year