benchmarks for LLM tokenizers
☆18Mar 25, 2026Updated 3 weeks ago
Alternatives and similar repositories for tokka-bench
Users that are interested in tokka-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Go library for generating Time-Sorted Unique Identifiers (TSID)☆22Mar 9, 2025Updated last year
- Visualization of Huffman coding☆27Aug 23, 2022Updated 3 years ago
- Extension for bootstrap 5 which allows to build intro tours.☆14Jul 29, 2022Updated 3 years ago
- EKYC System for ID Proof authentication based on tensorflow image classifier.☆12Jul 26, 2017Updated 8 years ago
- A simple website example using routes.☆49Oct 2, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆45Feb 11, 2026Updated 2 months ago
- A collection of various NLP datasets, mainly Indonesia-related languages.☆15Apr 23, 2022Updated 3 years ago
- Collection of links to blogs/ resources on various ML topics☆14Jun 15, 2022Updated 3 years ago
- Example Spring Boot project with Angular 2 frontend☆16Mar 31, 2017Updated 9 years ago
- Automatically exported from code.google.com/p/transducersaurus☆11Apr 1, 2015Updated 11 years ago
- FlexiTokens☆19Dec 27, 2025Updated 3 months ago
- An admonitions React component, ported from remarkable-admonitions. Perfect for Docusaurus v2 and other React-based doc generators☆11Sep 15, 2020Updated 5 years ago
- Takes a question predicts the operation between them☆12Jan 2, 2018Updated 8 years ago
- Python SDK for the Solcast API☆12Jan 6, 2026Updated 3 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆14Jun 27, 2024Updated last year
- ☆16Jun 5, 2016Updated 9 years ago
- ☆12Nov 17, 2018Updated 7 years ago
- Code for solving a basic maze reinforcement learning problem using Q-learning☆13Aug 25, 2020Updated 5 years ago
- Nanoloop source files for the album "Prime 16"☆11Mar 7, 2026Updated last month
- ☆12Sep 1, 2021Updated 4 years ago
- Supervised and unsupervised self-organising maps☆13Mar 11, 2026Updated last month
- IDE for Rust language☆20Mar 15, 2026Updated last month
- Getting interpretable dimensions in word embedding spaces.☆15Jul 6, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- makemy is a tool that parses your text-posts and creates beautiful webpages out of them 📄 Powered entirely in NodeJS 🦾☆11Jan 16, 2022Updated 4 years ago
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 4 years ago
- Trainable embedding transformation for confidence estimation, feature extraction, explainability and conversion from dense to sparse.☆28Jun 9, 2025Updated 10 months ago
- Python implementation of DBCLASD, a non-parametric clustering algorithm☆11May 28, 2020Updated 5 years ago
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆21Feb 7, 2023Updated 3 years ago
- Echo State Network☆17May 2, 2014Updated 11 years ago
- Calculate the maximum string length for a photovoltaic system☆11Dec 8, 2022Updated 3 years ago
- Single cell analysis using Low Resource☆20Apr 3, 2026Updated 2 weeks ago
- Starter TS library template. Vitest, Biome, tsdown, CI publishing, JSR, Deno, etc.☆37Sep 17, 2025Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- An English lexical database from the Big 🍎, let's go Mets baby love da Mets☆18Dec 12, 2025Updated 4 months ago
- Calculate parameters that are not available in datasheet of photovoltaic modules using equations derived from diode model☆13Mar 9, 2017Updated 9 years ago
- Deep CCA (DCCA) network☆15Apr 12, 2016Updated 10 years ago
- Python implementation of the control charts used for process monitoring and anomaly detection☆13Jun 18, 2023Updated 2 years ago
- OCF's DataPipe based dataloader for training and inference☆14Jun 2, 2025Updated 10 months ago
- Generates ES modules from CSS☆20Updated this week
- Maitreya - A generalized LR parser generator written in javascript☆11Nov 20, 2015Updated 10 years ago