benchmarks for LLM tokenizers
☆17Feb 27, 2026Updated last week
Alternatives and similar repositories for tokka-bench
Users that are interested in tokka-bench are comparing it to the libraries listed below
Sorting:
- ☆44Feb 11, 2026Updated 3 weeks ago
- Python SDK for the Solcast API☆13Jan 6, 2026Updated 2 months ago
- Python implementation of DBCLASD, a non-parametric clustering algorithm☆11May 28, 2020Updated 5 years ago
- A Python-based voice assistant integrating speech-to-text (STT), text-to-speech (TTS), and powerful AI capabilities using either a local …☆13Dec 8, 2025Updated 3 months ago
- Calculate the maximum string length for a photovoltaic system☆11Dec 8, 2022Updated 3 years ago
- A frontend interface for interacting with AI Models. Compatible with Ollama and OpenAI☆10May 1, 2025Updated 10 months ago
- Collection of links to blogs/ resources on various ML topics☆13Jun 15, 2022Updated 3 years ago
- ☆22Jun 10, 2025Updated 8 months ago
- Reinforcement Learning (PPO) applied to a multiplayer simple card game (Witches)☆10Jun 7, 2020Updated 5 years ago
- ☆12Aug 1, 2025Updated 7 months ago
- Glacier: Guided Locally Constrained Counterfactual Explanations for Time Series Classification (Machine Learning journal)☆10Mar 15, 2024Updated last year
- Building recommender Systems using contextual bandit methods to address cold-start issue and online real-time learning☆13Jul 1, 2021Updated 4 years ago
- Python implementation of the control charts used for process monitoring and anomaly detection☆13Jun 18, 2023Updated 2 years ago
- Evolutionary Search for expert-level performance on any task with environmental feedback☆14Oct 12, 2025Updated 4 months ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- A web app where a user enters his address to receive the size of his rooftop available for solar panels. The app uses image segmentation …☆14Jul 16, 2019Updated 6 years ago
- Multi-Modal Multi-Task (3MT) Road Segmentation, IEEE RA-L 2023☆15Feb 13, 2024Updated 2 years ago
- Nanoloop source files for the album "Prime 16"☆11Feb 28, 2026Updated last week
- ☆11Nov 17, 2018Updated 7 years ago
- Professional Wargaming LLM Toolbox☆21Jul 9, 2025Updated 7 months ago
- FlexiTokens☆18Dec 27, 2025Updated 2 months ago
- A zero-shot relation extractor, easily downloadable from the HuggingFace repo.☆12Aug 13, 2021Updated 4 years ago
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 4 years ago
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated last year
- Calculate parameters that are not available in datasheet of photovoltaic modules using equations derived from diode model☆13Mar 9, 2017Updated 8 years ago
- Identify and automatically fix issues in shell scripts☆15Nov 24, 2023Updated 2 years ago
- Estimate costs of complex LLM workflows in advance before spending money☆11Jan 10, 2026Updated last month
- An admonitions React component, ported from remarkable-admonitions. Perfect for Docusaurus v2 and other React-based doc generators☆11Sep 15, 2020Updated 5 years ago
- REBUS: A Robust Evaluation Benchmark of Understanding Symbols☆13Aug 13, 2024Updated last year
- A silly and weirdly useful experiment where I attempt to encode one bit of information with a VAE☆11Dec 31, 2016Updated 9 years ago
- This repository hosts a ChatGPT plugin that enables the uploading of a PDF URL. The plugin extracts information from the PDF, to enhance …☆11May 24, 2023Updated 2 years ago
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated last year
- Magento 2 Extension for Wizzy Search☆11Updated this week
- A/B tests are very commonly performed by data analysts and data scientists. It is important that you get some practice working with the d…☆11Apr 2, 2021Updated 4 years ago
- Collaborative AI Model☆11Nov 27, 2024Updated last year
- A Python library for summarizing event data into multivariate categorical data☆10May 16, 2020Updated 5 years ago
- ☆10Jun 9, 2023Updated 2 years ago
- ☆13Aug 12, 2024Updated last year
- AI Based "Happiness Optimizer"☆12Oct 20, 2024Updated last year