benchmarks for LLM tokenizers
☆17Feb 27, 2026Updated last month
Alternatives and similar repositories for tokka-bench
Users that are interested in tokka-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Go library for generating Time-Sorted Unique Identifiers (TSID)☆22Mar 9, 2025Updated last year
- Visualization of Huffman coding☆27Aug 23, 2022Updated 3 years ago
- Extension for bootstrap 5 which allows to build intro tours.☆15Jul 29, 2022Updated 3 years ago
- EKYC System for ID Proof authentication based on tensorflow image classifier.☆12Jul 26, 2017Updated 8 years ago
- A simple website example using routes.☆49Oct 2, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆44Feb 11, 2026Updated last month
- A collection of various NLP datasets, mainly Indonesia-related languages.☆15Apr 23, 2022Updated 3 years ago
- Collection of links to blogs/ resources on various ML topics☆14Jun 15, 2022Updated 3 years ago
- Example Spring Boot project with Angular 2 frontend☆16Mar 31, 2017Updated 8 years ago
- Automatically exported from code.google.com/p/transducersaurus☆11Apr 1, 2015Updated 10 years ago
- FlexiTokens☆19Dec 27, 2025Updated 3 months ago
- An admonitions React component, ported from remarkable-admonitions. Perfect for Docusaurus v2 and other React-based doc generators☆11Sep 15, 2020Updated 5 years ago
- Takes a question predicts the operation between them☆12Jan 2, 2018Updated 8 years ago
- Python SDK for the Solcast API☆13Jan 6, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- ☆14Jun 27, 2024Updated last year
- ☆16Jun 5, 2016Updated 9 years ago
- ☆11Nov 17, 2018Updated 7 years ago
- Code for solving a basic maze reinforcement learning problem using Q-learning☆14Aug 25, 2020Updated 5 years ago
- Nanoloop source files for the album "Prime 16"☆11Mar 7, 2026Updated 3 weeks ago
- ☆12Sep 1, 2021Updated 4 years ago
- Supervised and unsupervised self-organising maps☆12Mar 11, 2026Updated 2 weeks ago
- IDE for Rust language☆19Mar 15, 2026Updated 2 weeks ago
- Getting interpretable dimensions in word embedding spaces.☆15Jul 6, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- makemy is a tool that parses your text-posts and creates beautiful webpages out of them 📄 Powered entirely in NodeJS 🦾☆11Jan 16, 2022Updated 4 years ago
- Trainable embedding transformation for confidence estimation, feature extraction, explainability and conversion from dense to sparse.☆26Jun 9, 2025Updated 9 months ago
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 4 years ago
- Python implementation of DBCLASD, a non-parametric clustering algorithm☆11May 28, 2020Updated 5 years ago
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆21Feb 7, 2023Updated 3 years ago
- Echo State Network☆17May 2, 2014Updated 11 years ago
- Calculate the maximum string length for a photovoltaic system☆11Dec 8, 2022Updated 3 years ago
- Single cell analysis using Low Resource☆20Dec 1, 2025Updated 3 months ago
- Starter TS library template. Vitest, Biome, tsdown, CI publishing, JSR, Deno, etc.☆35Sep 17, 2025Updated 6 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An English lexical database from the Big 🍎, let's go Mets baby love da Mets☆18Dec 12, 2025Updated 3 months ago
- Calculate parameters that are not available in datasheet of photovoltaic modules using equations derived from diode model☆13Mar 9, 2017Updated 9 years ago
- Deep CCA (DCCA) network☆15Apr 12, 2016Updated 9 years ago
- Python implementation of the control charts used for process monitoring and anomaly detection☆13Jun 18, 2023Updated 2 years ago
- OCF's DataPipe based dataloader for training and inference☆14Jun 2, 2025Updated 9 months ago
- Generates ES modules from CSS☆20Updated this week
- Maitreya - A generalized LR parser generator written in javascript☆11Nov 20, 2015Updated 10 years ago