bgub / tokka-benchView external linksLinks
benchmarks for LLM tokenizers
☆16Jan 15, 2026Updated last month
Alternatives and similar repositories for tokka-bench
Users that are interested in tokka-bench are comparing it to the libraries listed below
Sorting:
- ☆44Updated this week
- Python SDK for the Solcast API☆13Jan 6, 2026Updated last month
- Collection of links to blogs/ resources on various ML topics☆13Jun 15, 2022Updated 3 years ago
- Python implementation of DBCLASD, a non-parametric clustering algorithm☆11May 28, 2020Updated 5 years ago
- A frontend interface for interacting with AI Models. Compatible with Ollama and OpenAI☆10May 1, 2025Updated 9 months ago
- A Python-based voice assistant integrating speech-to-text (STT), text-to-speech (TTS), and powerful AI capabilities using either a local …☆13Dec 8, 2025Updated 2 months ago
- Reinforcement Learning (PPO) applied to a multiplayer simple card game (Witches)☆10Jun 7, 2020Updated 5 years ago
- ☆12Aug 1, 2025Updated 6 months ago
- Glacier: Guided Locally Constrained Counterfactual Explanations for Time Series Classification (Machine Learning journal)☆10Mar 15, 2024Updated last year
- ☆22Jun 10, 2025Updated 8 months ago
- Building recommender Systems using contextual bandit methods to address cold-start issue and online real-time learning☆13Jul 1, 2021Updated 4 years ago
- ☆11Nov 17, 2018Updated 7 years ago
- Evolutionary Search for expert-level performance on any task with environmental feedback☆14Oct 12, 2025Updated 4 months ago
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 4 years ago
- Identify and automatically fix issues in shell scripts☆15Nov 24, 2023Updated 2 years ago
- Calculate parameters that are not available in datasheet of photovoltaic modules using equations derived from diode model☆13Mar 9, 2017Updated 8 years ago
- REBUS: A Robust Evaluation Benchmark of Understanding Symbols☆13Aug 13, 2024Updated last year
- A web app where a user enters his address to receive the size of his rooftop available for solar panels. The app uses image segmentation …☆14Jul 16, 2019Updated 6 years ago
- Estimate costs of complex LLM workflows in advance before spending money☆11Jan 10, 2026Updated last month
- FlexiTokens☆18Dec 27, 2025Updated last month
- Multi-Modal Multi-Task (3MT) Road Segmentation, IEEE RA-L 2023☆15Feb 13, 2024Updated 2 years ago
- Multilingual Entity Linking model by BELA model☆12Jul 20, 2023Updated 2 years ago
- Professional Wargaming LLM Toolbox☆20Jul 9, 2025Updated 7 months ago
- A silly and weirdly useful experiment where I attempt to encode one bit of information with a VAE☆11Dec 31, 2016Updated 9 years ago
- Nanoloop files for the album "Prime 16"☆11Aug 21, 2019Updated 6 years ago
- An admonitions React component, ported from remarkable-admonitions. Perfect for Docusaurus v2 and other React-based doc generators☆11Sep 15, 2020Updated 5 years ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated last year
- Python implementation of the control charts used for process monitoring and anomaly detection☆13Jun 18, 2023Updated 2 years ago
- A zero-shot relation extractor, easily downloadable from the HuggingFace repo.☆12Aug 13, 2021Updated 4 years ago
- A/B tests are very commonly performed by data analysts and data scientists. It is important that you get some practice working with the d…☆11Apr 2, 2021Updated 4 years ago
- Python package for downloading art and metadata of WikiArt and Google Arts & Culture☆15Apr 15, 2024Updated last year
- A Python library for summarizing event data into multivariate categorical data☆10May 16, 2020Updated 5 years ago
- ☆13Aug 12, 2024Updated last year
- Open source static analysis toolkit for LLM agent plans☆13Aug 9, 2025Updated 6 months ago
- NLP-based Contract Analysis☆12Sep 21, 2017Updated 8 years ago
- ☆10Jun 9, 2023Updated 2 years ago
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated last year
- A scalable solution that simplifies the integration of ComfyUI for developers☆11Jul 15, 2024Updated last year