benchmarks for LLM tokenizers
☆18Mar 25, 2026Updated 2 months ago
Alternatives and similar repositories for tokka-bench
Users that are interested in tokka-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Go library for generating Time-Sorted Unique Identifiers (TSID)☆22Mar 9, 2025Updated last year
- Visualization of Huffman coding☆27Aug 23, 2022Updated 3 years ago
- Extension for bootstrap 5 which allows to build intro tours.☆14Jul 29, 2022Updated 3 years ago
- EKYC System for ID Proof authentication based on tensorflow image classifier.☆12Jul 26, 2017Updated 8 years ago
- A simple website example using routes.☆49Oct 2, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆45Feb 11, 2026Updated 3 months ago
- A collection of various NLP datasets, mainly Indonesia-related languages.☆15Apr 23, 2022Updated 4 years ago
- Collection of links to blogs/ resources on various ML topics☆14Jun 15, 2022Updated 3 years ago
- Example Spring Boot project with Angular 2 frontend☆16Mar 31, 2017Updated 9 years ago
- Automatically exported from code.google.com/p/transducersaurus☆11Apr 1, 2015Updated 11 years ago
- An admonitions React component, ported from remarkable-admonitions. Perfect for Docusaurus v2 and other React-based doc generators☆11Sep 15, 2020Updated 5 years ago
- Takes a question predicts the operation between them☆12Jan 2, 2018Updated 8 years ago
- Python SDK for the Solcast API☆12Jan 6, 2026Updated 4 months ago
- ☆14Jun 27, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- FlexiTokens☆23Dec 27, 2025Updated 5 months ago
- ☆16Jun 5, 2016Updated 9 years ago
- ☆12Nov 17, 2018Updated 7 years ago
- Code for solving a basic maze reinforcement learning problem using Q-learning☆13Aug 25, 2020Updated 5 years ago
- Nanoloop source files for the album "Prime 16"☆11Mar 7, 2026Updated 2 months ago
- ☆12Sep 1, 2021Updated 4 years ago
- ☆10Jan 19, 2022Updated 4 years ago
- Supervised and unsupervised self-organising maps☆13Mar 11, 2026Updated 2 months ago
- IDE for Rust language☆20May 17, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Getting interpretable dimensions in word embedding spaces.☆15Jul 6, 2023Updated 2 years ago
- makemy is a tool that parses your text-posts and creates beautiful webpages out of them 📄 Powered entirely in NodeJS 🦾☆11Jan 16, 2022Updated 4 years ago
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 4 years ago
- Trainable embedding transformation for confidence estimation, feature extraction, explainability and conversion from dense to sparse.☆28Jun 9, 2025Updated 11 months ago
- Python implementation of DBCLASD, a non-parametric clustering algorithm☆12May 28, 2020Updated 6 years ago
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆20Feb 7, 2023Updated 3 years ago
- Echo State Network☆17May 2, 2014Updated 12 years ago
- Single cell analysis using Low Resource☆20Apr 3, 2026Updated last month
- Calculate the maximum string length for a photovoltaic system☆12Dec 8, 2022Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Starter TS library template. Vitest, Biome, tsdown, CI publishing, JSR, Deno, etc.☆42Sep 17, 2025Updated 8 months ago
- An English lexical database from the Big 🍎, let's go Mets baby love da Mets☆18May 19, 2026Updated last week
- Calculate parameters that are not available in datasheet of photovoltaic modules using equations derived from diode model☆13Mar 9, 2017Updated 9 years ago
- Deep CCA (DCCA) network☆15Apr 12, 2016Updated 10 years ago
- Python implementation of the control charts used for process monitoring and anomaly detection☆13Jun 18, 2023Updated 2 years ago
- OCF's DataPipe based dataloader for training and inference☆15Jun 2, 2025Updated 11 months ago
- Generates ES modules from CSS☆20Updated this week