benchmarks for LLM tokenizers
☆21Mar 25, 2026Updated 6 months ago
Alternatives and similar repositories for tokka-bench
Users that are interested in tokka-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Nanoloop source files for the album "Prime 16"☆12Mar 7, 2026Updated 6 months ago
- Python SDK for the Solcast API☆12Sep 2, 2026Updated 3 weeks ago
- ☆12Nov 17, 2018Updated 7 years ago
- ☆12Sep 1, 2021Updated 5 years ago
- Getting interpretable dimensions in word embedding spaces.☆15Jul 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Calculate the maximum string length for a photovoltaic system☆13Dec 8, 2022Updated 3 years ago
- Python implementation of DBCLASD, a non-parametric clustering algorithm☆12May 28, 2020Updated 6 years ago
- A library to handle time series in NumPy/SciPy☆16Aug 7, 2010Updated 16 years ago
- TokEval: intrinsic quality metrics for tokenizers across natural language, code, and math☆55Aug 31, 2026Updated 3 weeks ago
- Sequencable robot operated digital tape machine☆19May 14, 2024Updated 2 years ago
- Floating DevTools panel that intercepts OpenAI, Anthropic, Gemini, Mistral, Groq, and Cohere calls in your Angular app and shows you the …☆156Jun 19, 2026Updated 3 months ago
- OCF's DataPipe based dataloader for training and inference☆15Jun 2, 2025Updated last year
- ☆10Mar 18, 2021Updated 5 years ago
- A Combinatory Categorial Grammar library.☆22Nov 11, 2013Updated 12 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A tool for making a probabilistic power forecast for a fleet of solar plants using an existing deterministic forecast☆16Dec 2, 2024Updated last year
- Time series analytics with Python☆17Dec 7, 2015Updated 10 years ago
- ☆18Feb 1, 2023Updated 3 years ago
- Code repo for Spatio-Temporal Denoising Graph Autoencoder (STD-GAE)☆12Sep 6, 2022Updated 4 years ago
- ☆25Aug 2, 2022Updated 4 years ago
- Tools for working with PubMed data.☆15Sep 26, 2020Updated 6 years ago
- Learning BPE embeddings by first learning a segmentation model and then training word2vec☆19Dec 18, 2022Updated 3 years ago
- ShopEasy is a containerized e‑commerce boilerplate with an Angular SPA and Spring Boot API (JWT‑secure), backed by MySQL and Kafka, deplo…☆15Sep 5, 2025Updated last year
- Python package that offers text scrubbing functionality, providing building blocks for string cleaning as well as normalizing geographica…☆22Aug 26, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Acoustic distance measure for comparing pronunciations☆17Aug 2, 2022Updated 4 years ago
- A web app where a user enters his address to receive the size of his rooftop available for solar panels. The app uses image segmentation …☆14Jul 16, 2019Updated 7 years ago
- ☆12Aug 1, 2025Updated last year
- (ICML 2023) Feature learning in deep classifiers through Intermediate Neural Collapse: Accompanying code☆16Jul 27, 2023Updated 3 years ago
- MUltiband Satellite Imagery for object Classification (MUSIC) to detect Photovoltaic Power Plants☆17Jan 26, 2018Updated 8 years ago
- A dependencies analyzer for Python☆30Dec 4, 2017Updated 8 years ago
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated 2 years ago
- Evolutionary Search for expert-level performance on any task with environmental feedback☆14Oct 12, 2025Updated 11 months ago
- Automated cloud masking for Landsat MSS images☆18Dec 12, 2018Updated 7 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- given a bounding box, provides a timeseries animation of way creation☆16Nov 17, 2017Updated 8 years ago
- A global catalog of solar irradiance monitoring stations.☆22Aug 29, 2026Updated 3 weeks ago
- PasteScript template for initializing a new buildout/pytest/travis/setuptools-enabled Python project☆25Mar 24, 2014Updated 12 years ago
- Unified API platform for free access to enterprise-grade AI models from Google, Groq, and OpenRouter. Industrial-ready integration with h…☆13Mar 14, 2025Updated last year
- An official angular component library for the Filestack☆10Sep 13, 2026Updated 2 weeks ago
- Drone plugin for deploy images on a Kubernetes cluster with Rancher 2.x.☆11Feb 7, 2020Updated 6 years ago
- A cool little API to output a tech savvy phrase with json and plaintext views☆22Feb 20, 2022Updated 4 years ago