Official implementation of "Data Mixture Inference: What do BPE tokenizers reveal about their training data?"
☆23May 15, 2025Updated last year
Alternatives and similar repositories for tokenizer-attack
Users that are interested in tokenizer-attack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PathPiece tokenizer☆14Nov 10, 2024Updated last year
- ☆11May 18, 2025Updated last year
- ☆15Jun 28, 2025Updated last year
- Code for the paper "Greed is All You Need: An Evaluation of Tokenizer Inference Methods"☆15Nov 26, 2024Updated last year
- ☆20Jul 18, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.☆14Apr 9, 2024Updated 2 years ago
- Python Module implementing SRP☆12Jul 29, 2022Updated 4 years ago
- Benchmarking MIAs against LLMs.☆30Oct 8, 2024Updated last year
- Few-shot Learning with Auxiliary Data☆31Dec 8, 2023Updated 2 years ago
- ☆20Apr 26, 2026Updated 3 months ago
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- Python script for manipulating the existing tokenizer.☆21Mar 6, 2026Updated 5 months ago
- [MM'23] ProTegO: Protect Text Content against OCR Extraction Attack☆14Mar 12, 2024Updated 2 years ago
- ☆24Mar 1, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"☆16Aug 11, 2023Updated 3 years ago
- ☆14Feb 21, 2025Updated last year
- The implementation for "Open Relation Modeling: Learning to Define Relations between Entities" (Findings of ACL '22)☆12Feb 28, 2022Updated 4 years ago
- This repository contains the source code for "Membership Inference Attacks as Privacy Tools: Reliability, Disparity and Ensemble", In Pro…☆11Jan 2, 2026Updated 7 months ago
- PyTorch Implementation of "PICS: Pairwise Image Compositing with Spatial Interactions", ICLR 2026☆16Mar 2, 2026Updated 5 months ago
- TransMix: Transformer-based Value Function Decomposition for Cooperative Multi-agent Reinforcement Learning☆11Oct 18, 2022Updated 3 years ago
- Official code release for "SuperBPE: Space Travel for Language Models"☆98May 28, 2026Updated 2 months ago
- Metric Space Magnitude Computations☆15Jun 30, 2026Updated last month
- Programmable automated machine learning - proof of concept☆15Oct 9, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Control Blackmagic Design cameras using Bluetooth Low Energy☆12Apr 6, 2020Updated 6 years ago
- Codes of PrivateKT☆15May 7, 2023Updated 3 years ago
- Official code for Robust Symmetry Detection via Riemannian Langevin Dynamics [SA24]☆16May 28, 2025Updated last year
- User-friendly viewer for Parquet files☆16May 8, 2026Updated 3 months ago
- Linear Mode Connectivity in Multitask and Continual Learning: https://arxiv.org/abs/2010.04495☆13Oct 12, 2020Updated 5 years ago
- FlexiTokens☆23Dec 27, 2025Updated 7 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆28Nov 30, 2024Updated last year
- ☆15Oct 4, 2024Updated last year
- 🚀🤗 A collection of templates for Hugging Face Spaces☆35Oct 9, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [AAAI 2026 Oral] AEDR: Training-Free AI-Generated Image Attribution via Autoencoder Double-Reconstruction☆23Apr 21, 2026Updated 3 months ago
- Baseline models for the paper: "Modeling Naive Psychology of Characters in Simple Commonsense Stories" by Hannah Rashkin, Antoine Bosselu…☆16Feb 23, 2021Updated 5 years ago
- The second generation of the Triangle Regional Model☆13Jul 30, 2026Updated last week
- Cycles agroecosystem model☆12Jun 11, 2026Updated last month
- [ACL 2024] The official GitHub repo for the paper "The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Pe…☆83Jul 19, 2024Updated 2 years ago
- Code for the COLING 2022 paper "DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification"☆19Oct 19, 2022Updated 3 years ago
- ☆103Jul 4, 2025Updated last year