Modern UTF-8 aware C++ tokenizer with vocabulary support, ideal for NLP and transformer models. Header-only and zero-dependency.
☆16Aug 7, 2025Updated last year
Alternatives and similar repositories for Modern-Text-Tokenizer
Users that are interested in Modern-Text-Tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Optimizing database queries with array programming☆20Sep 21, 2020Updated 6 years ago
- HuggingFace Transformers WordPiece Tokenizer in C++☆22Mar 14, 2025Updated last year
- ☆23Oct 6, 2026Updated 3 weeks ago
- Coq & Haskell code for Calculating Correct Compilers II☆12Feb 22, 2022Updated 4 years ago
- ☆41Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Creating AI agents with the simplicity of Python in Java.☆14Mar 21, 2026Updated 7 months ago
- Sandboxed code execution daemon with enforced memory, CPU, and output limits. JSON API for humans and AI agents.☆12May 21, 2026Updated 5 months ago
- Engage!☆11Aug 12, 2023Updated 3 years ago
- bddem is a SWI-Prolog pack for using Binary Decision Diagrams☆13Sep 25, 2026Updated last month
- Defining the semantics of K in K☆16May 6, 2020Updated 6 years ago
- BareMetal for Firecracker☆11Updated this week
- Experiments with reasoning models, training techniques, papers☆30Updated this week
- A complete Mamba implementation in Rust: Mamba, Mamba-2 and Mamba-3 (SISO and MIMO), inference and training on the CPU and on NVIDIA GPUs…☆20Updated this week
- The contents of what was formerly https://svn.declarativity.net☆11Dec 8, 2015Updated 10 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- DBToaster OCAML code☆11Jan 19, 2022Updated 4 years ago
- Compile natural-language function descriptions into reusable local PAW programs.☆18Updated this week
- MISCA: A Joint Model for Multiple Intent Detection and Slot Filling with Intent-Slot Co-Attention (EMNLP 2023 - Findings)☆35Jul 22, 2024Updated 2 years ago
- Code for InterSpeech 2024 Paper: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition☆20Jul 16, 2024Updated 2 years ago
- Portable Enso Launcher community edition.☆12Dec 29, 2016Updated 9 years ago
- ☆15Oct 18, 2026Updated last week
- A tool for converting CNL sentences to ASP rules.☆13Nov 6, 2025Updated 11 months ago
- GENISOM robots URDF models☆17Apr 23, 2026Updated 6 months ago
- ☆13Aug 26, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Simple agent framework using Ollama tool calling☆10Aug 27, 2024Updated 2 years ago
- A simple CLI for BareMetal☆15May 12, 2026Updated 5 months ago
- TRILL is a tableau reasoner able to compute probability of queries from probabilistic knowledge bases.☆15Updated this week
- ☆17Oct 21, 2026Updated last week
- Prebuilt binaries of llama.cpp libraries and executables for Linux with CUDA or Vulkan, Linux arm64 with CPU, Vulkan, or OpenCL, and WebA…☆14Updated this week
- k for BareMetal☆15Dec 10, 2024Updated last year
- Common Lisp wrapper for llama.cpp (Port of Facebook's LLaMA model in C/C++)☆12Dec 7, 2025Updated 10 months ago
- ⚡ A curated list of awesome Large Language Model (LLM), Machine Learning, and AI projects, libraries, and resources built with the Zig p…☆13Sep 25, 2026Updated last month
- Official implementation of NEXT: neural external torque estimation for commodity robot arms.☆28Sep 4, 2026Updated last month
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- CHR2 to SQL conversion☆15Aug 27, 2015Updated 11 years ago
- ☆24Apr 17, 2026Updated 6 months ago
- Facet-0: A Robotic Foundation Model for Contact-Rich Precise Manipulation (arXiv 2609.01596)☆32Oct 20, 2026Updated last week
- ☆18Jun 12, 2024Updated 2 years ago
- ☆13Aug 18, 2026Updated 2 months ago
- GPU-based interaction nets evaluator☆19Nov 30, 2011Updated 14 years ago
- GFPGAN face reconstruction with ncnn on a bare Raspberry Pi☆14Jan 4, 2023Updated 3 years ago