Alternatives and similar repositories for Private-LLM-Inference

Users that are interested in Private-LLM-Inference are comparing it to the libraries listed below

• Alibaba-Gemini-Lab / OpenPEGASUS
  ☆110Updated 4 years ago
• jeffreysijuntan / CryptGPU
  Fast Privacy-Preserving Machine Learning on the GPU
  ☆89Updated 4 years ago
• AntCPLab / OpenBumbleBee
  The repo of "BumbleBee: Secure Two-party Inference Framework for Large Transformers" (NDSS 2025)
  ☆53Updated last year
• zhouzhangwalker / HE3DB
  ☆39Updated 2 years ago
• ucbrise / piranha
  Piranha: A GPU Platform for Secure Computation
  ☆104Updated 2 years ago
• xingpz2008 / Iron
  Private Inference on Transformer
  ☆30Updated 2 years ago
• Clive2312 / BOLT
  Privacy-Preserving, Accurate and Efficient Inference for Transformers
  ☆33Updated last year
• shreya-28 / Secure-ML
  Secure Linear Regression in the Semi-Honest Two-Party Setting.
  ☆37Updated 6 years ago
• anderspkd / SecureQ8
  Input scripts for securely evaluating quantized ImageNet models with mp-spdz
  ☆19Updated 5 years ago
• snwagh / falcon-public
  Implementation of protocols in Falcon
  ☆95Updated last year
• mc2-project / delphi
  A Cryptographic Inference Service for Neural Networks
  ☆131Updated last year
• AntCPLab / malicious_3pc_binary
  The repo of "Efficient 3PC for Binary Circuits with Application to Maliciously-Secure DNN Inference" (USENIX Security 2023)
  ☆21Updated 2 years ago
• andeskyl / SHAFT
  A framework for secure, handy, accurate, and fast transformer inference
  ☆25Updated 5 months ago
• Fannxy / NFGen
  NFGen: Automatic Non-Linear Function Evaluation Code Generator for General-purpose MPC Platforms
  ☆20Updated last month
• chiraag / gazelle_mpc
  ☆67Updated 7 years ago
• Ye-D / PPML-Resource
  Materials about Privacy-Preserving Machine Learning
  ☆263Updated this week
• RasoulAM / private-decision-tree-evaluation
  Experimental Code for Private Decision Tree Evaluation
  ☆16Updated 2 years ago
• Stu-Yang / HITSZ-SecurityGroup-MPC
  MPC team of Security Group in HITSZ
  ☆19Updated 3 weeks ago
• DPPH / chimera-iDash2018
  Team CEA-EPFL-Inpher: code for the iDash 2018 competition
  ☆24Updated 7 years ago
• csiro-mlai / deep-mpc
  ☆38Updated last year
• Lucieno / gforce-public
  A crypto-assisted framework for protecting the privacy of models and queries in inference.
  ☆19Updated 4 years ago
• crypto-starlab / THOR
  ☆20Updated 4 months ago
• f7ed / hmmpc-public
  Implementation of protocols in the paper titled "Scalable Multi-Party Computation Protocols for Machine Learning in the Honest-Majority S…
  ☆31Updated 11 months ago
• XidianNSS / NssMPClib
  A secure multi-party computation library based on arithmetic secret sharing and function secret sharing.
  ☆92Updated last week
• ucbsky / elsa
  Secure Aggregation for Federated Learning with Malicious Actors
  ☆28Updated 3 years ago
• Ye-D / Meteor
  Improved Secure 3-Party Neural Network Inference with Reducing Online Communication Costs
  ☆11Updated 3 years ago
• Alibaba-Gemini-Lab / OpenCheetah
  ☆214Updated 11 months ago
• Ye-D / PaperNotes-MPC
  Paper Notes in MPC with Applications to PPML
  ☆71Updated last year
• encryptogroup / MOTION2NX
  A framework for generic hybrid two-party computation and private inference with neural networks
  ☆32Updated 2 years ago
• FudanMPL / pMPL
  pMPL: A Robust Multi-Party Learning Framework with a Privileged Party. This project is connected with the publication @ ACM CCS 2022.
  ☆18Updated last year