Official implementation of "Data Mixture Inference: What do BPE tokenizers reveal about their training data?"
☆23May 15, 2025Updated last year
Alternatives and similar repositories for tokenizer-attack
Users that are interested in tokenizer-attack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PathPiece tokenizer☆14Nov 10, 2024Updated last year
- ☆11May 18, 2025Updated last year
- Source code of NAACL 2025 Findings "Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models"☆16Dec 16, 2025Updated 7 months ago
- ☆19Jul 18, 2024Updated 2 years ago
- [USENIX Security 2025] SOFT: Selective Data Obfuscation for Protecting LLM Fine-tuning against Membership Inference Attacks☆23Sep 18, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [USENIX Security 2026] Membership Inference Attacks on Tokenizers of Large Language Models☆20May 22, 2026Updated last month
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.☆14Apr 9, 2024Updated 2 years ago
- Python Module implementing SRP☆12Jul 29, 2022Updated 3 years ago
- Benchmarking MIAs against LLMs.☆30Oct 8, 2024Updated last year
- [MM'23] ProTegO: Protect Text Content against OCR Extraction Attack☆14Mar 12, 2024Updated 2 years ago
- Our paper is titled "NUS-IDS at FinCausal 2021: Dependency Tree in Graph Neural Networks for better Cause-Effect Span Detection".☆13Feb 11, 2022Updated 4 years ago
- Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"☆16Aug 11, 2023Updated 2 years ago
- ☆14Feb 21, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The implementation for "Open Relation Modeling: Learning to Define Relations between Entities" (Findings of ACL '22)☆12Feb 28, 2022Updated 4 years ago
- This repository contains the source code for "Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemble", In Pro…☆11Jan 2, 2026Updated 6 months ago
- Website for release of TellMeWhy dataset for why question answering☆14Nov 11, 2022Updated 3 years ago
- PyTorch Implementation of "PICS: Pairwise Image Compositing with Spatial Interactions", ICLR 2026☆15Mar 2, 2026Updated 4 months ago
- [CVPR 2026] SWIFT: Sliding Window Reconstruction for Few-Shot Training-Free Generated Video Attribution☆18May 11, 2026Updated 2 months ago
- TransMix: Transformer-based Value Function Decomposition for Cooperative Multi-agent Reinforcement Learning☆11Oct 18, 2022Updated 3 years ago
- TokEval: intrinsic quality metrics for tokenizers across natural language, code, and math☆46Jul 4, 2026Updated 2 weeks ago
- A version of the SUSTAIN model of category learning (Love, Medin, & Gureckis, 2004) implemented in Python☆20Apr 20, 2016Updated 10 years ago
- Official code release for "SuperBPE: Space Travel for Language Models"☆97May 28, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Metric Space Magnitude Computations☆15Jun 30, 2026Updated 3 weeks ago
- Solution to Cartpole balancing problem with the help of reinforcement learning and Deep Neural Networks.☆11May 5, 2023Updated 3 years ago
- Programmable automated machine learning - proof of concept☆15Oct 9, 2024Updated last year
- ☆82Dec 19, 2024Updated last year
- ☆15Jun 2, 2026Updated last month
- Source code for EMNLP findings paper "Open-Vocabulary Argument Role Prediction for Event Extraction"☆19Nov 5, 2022Updated 3 years ago
- Linear Mode Connectivity in Multitask and Continual Learning: https://arxiv.org/abs/2010.04495☆13Oct 12, 2020Updated 5 years ago
- FlexiTokens☆23Dec 27, 2025Updated 6 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆28Nov 30, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Defeasible Natural Language Inference☆14Dec 4, 2020Updated 5 years ago
- [AAAI 2026 Oral] AEDR: Training-Free AI-Generated Image Attribution via Autoencoder Double-Reconstruction☆23Apr 21, 2026Updated 3 months ago
- Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."☆59Sep 25, 2025Updated 9 months ago
- Baseline models for the paper: "Modeling Naive Psychology of Characters in Simple Commonsense Stories" by Hannah Rashkin, Antoine Bosselu…☆16Feb 23, 2021Updated 5 years ago
- The second generation of the Triangle Regional Model☆13Jun 23, 2026Updated 3 weeks ago
- Notebooks and other course materials for Emory QTM 340 (Fall 2022)☆12Dec 13, 2022Updated 3 years ago
- Cycles agroecosystem model☆12Jun 11, 2026Updated last month