☆15Apr 2, 2025Updated 11 months ago
Alternatives and similar repositories for Tokens2Words
Users that are interested in Tokens2Words are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Complete set of English dialect transformation rules and evaluation code☆16Jun 7, 2024Updated last year
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆64Jul 6, 2025Updated 8 months ago
- ☆12Updated this week
- Röttger et al. (2024): "IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistance"☆16Mar 6, 2026Updated 2 weeks ago
- ☆23Jan 25, 2023Updated 3 years ago
- ☆59Nov 18, 2025Updated 4 months ago
- ☆20Oct 15, 2022Updated 3 years ago
- ☆19Feb 19, 2024Updated 2 years ago
- Code for our paper titled "Lens: Rethinking Multilingual Enhancement for Large Language Models"☆11Oct 15, 2024Updated last year
- ☆10Oct 28, 2024Updated last year
- Elevating Chess Strategy with Fine-Tuned Large Language Model☆17Dec 8, 2023Updated 2 years ago
- Listwise Reward Estimation for Offline Preference-based Reinforcement Learning (ICML 2024)☆17Jun 18, 2024Updated last year
- Implementation of models in our EMNLP 2019 paper: A Logic-Driven Framework for Consistency of Neural Models☆30Jun 13, 2021Updated 4 years ago
- NDL古典籍OCR学習用データセット（みんなで翻刻加工データ）☆20Mar 13, 2026Updated last week
- ☆101Jan 24, 2026Updated last month
- official code repo for paper "Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging"☆25Oct 11, 2025Updated 5 months ago
- ☆25Dec 12, 2025Updated 3 months ago
- LEIA: Facilitating Cross-Lingual Knowledge Transfer in Language Models with Entity-based Data Augmentation☆23Apr 24, 2024Updated last year
- The official implementation of the DAC 2024 paper GQA-LUT☆21Dec 20, 2024Updated last year
- gzip Predicts Data-dependent Scaling Laws☆34May 28, 2024Updated last year
- ☆22Feb 29, 2024Updated 2 years ago
- Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"☆35Sep 20, 2025Updated 6 months ago
- A supplementary code for Editable Neural Networks, an ICLR 2020 submission.☆46Jan 21, 2020Updated 6 years ago
- ☆20Jun 24, 2024Updated last year
- Notebooks and other course materials for Emory QTM 340 (Fall 2022)☆12Dec 13, 2022Updated 3 years ago
- Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."☆18Dec 13, 2024Updated last year
- Code snippets and reproductions from JustAByte☆25Jan 25, 2026Updated last month
- ☆44Jan 24, 2024Updated 2 years ago
- ☆10Feb 2, 2023Updated 3 years ago
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- FlexiTokens☆18Dec 27, 2025Updated 2 months ago
- User-friendly viewer for Parquet files☆11Mar 7, 2026Updated 2 weeks ago
- Reference implementation of models from Nyonic Model Factory☆12May 13, 2024Updated last year
- Code and data associated with the AmbiEnt dataset in "We're Afraid Language Models Aren't Modeling Ambiguity" (Liu et al., 2023)☆65Feb 5, 2024Updated 2 years ago
- Clustered Compositional Embeddings☆11Oct 25, 2023Updated 2 years ago
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated last year
- A PyTorch native platform for training generative AI models☆16Nov 18, 2025Updated 4 months ago
- NDL-DocLデータセット(資料画像レイアウトデータセット)☆29Mar 2, 2023Updated 3 years ago
- Python Module implementing SRP☆12Jul 29, 2022Updated 3 years ago