secsilm / chinese-tokens-in-tiktokenView external linksLinks
Chinese tokens in tiktoken tokenizers.
☆32May 15, 2024Updated last year
Alternatives and similar repositories for chinese-tokens-in-tiktoken
Users that are interested in chinese-tokens-in-tiktoken are comparing it to the libraries listed below
Sorting:
- Latest Evaluation Toolkit (LatestEval). Assessing the language models with latest, uncontaminated materials.☆28Feb 17, 2025Updated last year
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆93Jan 23, 2026Updated 3 weeks ago
- Code for "Dual Focal Loss for Calibration" (ICML 2023)☆32Apr 21, 2025Updated 9 months ago
- test images with not appropriate labels in MNIST dataset☆10Mar 3, 2018Updated 7 years ago
- This repository is a reimplementation of the paper(BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model: htt…☆11Nov 14, 2019Updated 6 years ago
- Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder☆10Mar 16, 2023Updated 2 years ago
- Real-time multi-language unit test generation tool via LSP☆31Updated this week
- Code for the experiments in the ACL 2020 paper "Estimating predictive uncertainty for rumour verification models"☆11May 15, 2020Updated 5 years ago
- ☆10Sep 6, 2024Updated last year
- Link any file anywhere on your computer!☆11May 11, 2024Updated last year
- Tools for extend OBJ-C classes (especially for extending classes belonging close sourced applications)☆54Oct 28, 2011Updated 14 years ago
- Repository of paper "Establishing Trustworthy LLM Evaluation via Shortcut Neuron Analysis" (ACL 2025 Main)☆19Jul 19, 2025Updated 6 months ago
- Single source publishing for vertical writing☆11Mar 15, 2021Updated 4 years ago
- Web of Science Alert to RSS☆10Nov 21, 2023Updated 2 years ago
- Official repository for Trustworthy Alignment of Retrieval-Augmented Large Language Models via Reinforcement Learning☆12Sep 2, 2024Updated last year
- AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation (EMNLP 2024 Findings)☆15Dec 30, 2024Updated last year
- ☆11Feb 25, 2025Updated 11 months ago
- Objective-C wrapper for the SearchKit API / Mac OS☆27Dec 6, 2011Updated 14 years ago
- Source code of the double-fetch bug detection approach based on Coccinelle engine☆10Jan 2, 2017Updated 9 years ago
- Engineering Blog article prototypes☆17Oct 12, 2025Updated 4 months ago
- Objective-C/C/C++ for Quartz Composer (on the fly)☆17Dec 6, 2012Updated 13 years ago
- ☆10Feb 19, 2018Updated 7 years ago
- [ISSTA'24] A Large-Scale Dataset Capable of Enhancing the Prowess of Large Language Models for Program Testing☆12Jan 7, 2025Updated last year
- 通过python3.6编程，利用DQN算法实现机器学习避开障碍走到迷宫终点。（Through python3.6 programming, I use DQN algorithm to achieve machine learning and avoid obstacles…☆10Apr 15, 2018Updated 7 years ago
- ☆10Jun 28, 2022Updated 3 years ago
- AutoCorrect extension for PopClip☆10Jul 12, 2024Updated last year
- ☆17May 3, 2025Updated 9 months ago
- ☆12Aug 23, 2019Updated 6 years ago
- Production repository for the all-new Advantage360 Professional using ZMK engine☆17Jan 2, 2025Updated last year
- [NeurIPS25] RULE: Reinforcement UnLEarning Achieves Forge-retain Pareto Optimality☆19Oct 22, 2025Updated 3 months ago
- A Swiss Army Knife for Objective-C developers☆80Jun 4, 2016Updated 9 years ago
- ICML 2025 Spotlight, PCEvolve: Private Contrastive Evolution for Synthetic Dataset Generation via Few-Shot Private Data and Generative AP…☆14Jun 27, 2025Updated 7 months ago
- ☆11Apr 23, 2023Updated 2 years ago
- UAV simulation in Gazebo☆10Dec 23, 2020Updated 5 years ago
- A tool for visualization of complex job searches.☆13Jul 8, 2022Updated 3 years ago
- Evaluation code of ASE24 accepted paper "On the Evaluation of LLM in Unit Test Generation"☆13Dec 9, 2024Updated last year
- A difftool implementation for use with gh cli☆19Updated this week
- Repository for the syscall document.☆12Dec 28, 2017Updated 8 years ago
- The official version of the paper "MMI-Det: Exploring Multi-Modal Integration for Visible and Infrared Object Detection"☆19Oct 24, 2024Updated last year