Official implementation of "Data Mixture Inference: What do BPE tokenizers reveal about their training data?"
☆18May 15, 2025Updated 9 months ago
Alternatives and similar repositories for tokenizer-attack
Users that are interested in tokenizer-attack are comparing it to the libraries listed below
Sorting:
- PathPiece tokenizer☆13Nov 10, 2024Updated last year
- User-friendly viewer for Parquet files☆10Jan 10, 2026Updated last month
- FlexiTokens☆18Dec 27, 2025Updated 2 months ago
- Python Module implementing SRP☆12Jul 29, 2022Updated 3 years ago
- ☆11May 18, 2025Updated 9 months ago
- This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.☆13Apr 9, 2024Updated last year
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"☆16Aug 11, 2023Updated 2 years ago
- https://footprints.baulab.info☆17Oct 4, 2024Updated last year
- DImensionality REduction in JAX☆25Nov 21, 2025Updated 3 months ago
- ☆24Mar 1, 2025Updated 11 months ago
- My NER Experiments with ModernBERT and Ettin☆26Jul 17, 2025Updated 7 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆27Nov 30, 2024Updated last year
- ☆19Sep 22, 2025Updated 5 months ago
- 🚀🤗 A collection of templates for Hugging Face Spaces☆35Oct 9, 2023Updated 2 years ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Aug 5, 2023Updated 2 years ago
- Notebooks and other course materials for Emory QTM 340 (Fall 2022)☆12Dec 13, 2022Updated 3 years ago
- ☆38Apr 18, 2025Updated 10 months ago
- Code for the paper "Distinguishing the Knowable from the Unknowable with Language Models"☆11Apr 15, 2024Updated last year
- Code for the paper "SMACE: A New Method for the Interpretability of Composite Decision Systems", ECML 2022☆15Apr 17, 2023Updated 2 years ago
- The second generation of the Triangle Regional Model☆13Feb 20, 2026Updated last week
- A library for probing Stockfish's NNUEs. The code for reading parameters and forward propagation is taken from Stockfish☆12Nov 18, 2025Updated 3 months ago
- Mathematical foundations of data analysis, Winter semester 22-23☆13Jan 31, 2023Updated 3 years ago
- A complete pipeline for fine-tuning YOLOv8 pose models with custom datasets. Supports automatic and semi-automatic annotation for efficie…☆15Feb 9, 2025Updated last year
- Enhanced Explainable Neural Network☆10Dec 25, 2021Updated 4 years ago
- Align the token outputs from Spacy and Huggingface to help understand what language structures transformers see☆44May 16, 2022Updated 3 years ago
- Software package for intertemporal pricing optimization under reference effects and consumer heterogeneity estimation. Please see REAMDE.…☆10Mar 7, 2024Updated last year
- solver for discrete Mixed Observable Markov Decision Processes☆11Oct 30, 2020Updated 5 years ago
- SODEN: A Scalable Continuous-Time Survival Model through Ordinary Differential Equation Networks☆14Mar 2, 2023Updated 2 years ago
- ☆10Oct 27, 2023Updated 2 years ago
- ☆11Jan 13, 2026Updated last month
- ☆15Oct 24, 2023Updated 2 years ago
- Official code for Conformal Isometry of Lie Group Representation in Recurrent Network of Grid Cells (NeurIPS workshop on Symmetry and Geo…☆13Nov 1, 2022Updated 3 years ago
- Deep Generative Model (Torch)☆11Apr 19, 2016Updated 9 years ago
- Comparing sequential forecasters via confidence sequences & e-processes☆11Oct 24, 2023Updated 2 years ago
- ☆10Oct 26, 2022Updated 3 years ago
- ☆13Feb 4, 2025Updated last year
- Temporal summarization framework☆10Dec 4, 2023Updated 2 years ago
- This repository reproduces the results in the paper "How expressive are transformers in spectral domain for graphs?"(published in TMLR)☆12Jul 10, 2022Updated 3 years ago