Modern UTF-8 aware C++ tokenizer with vocabulary support, ideal for NLP and transformer models. Header-only and zero-dependency.
☆16Aug 7, 2025Updated last year
Alternatives and similar repositories for Modern-Text-Tokenizer
Users that are interested in Modern-Text-Tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Port of Andrej Karpathy's llama2.c to Kotlin.☆21Sep 18, 2023Updated 2 years ago
- 网易云音乐受限歌曲解锁API || UnblockNeteaseMusic-utils api☆20Jul 26, 2026Updated 2 weeks ago
- Zero Memory Widget☆10Dec 30, 2020Updated 5 years ago
- Code for InterSpeech 2024 Paper: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition☆19Jul 16, 2024Updated 2 years ago
- ☆13Aug 26, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- k for BareMetal☆13Dec 10, 2024Updated last year
- MeloTTS demo on Axera☆14Jul 1, 2026Updated last month
- CHR2 to SQL conversion☆15Aug 27, 2015Updated 10 years ago
- GWR Toolbox☆14Jan 28, 2019Updated 7 years ago
- ALS Prolog Compiler & Development Environment☆20Jun 12, 2026Updated last month
- burn inference and training of dragon models 🔥🐉☆16Apr 12, 2026Updated 3 months ago
- UniRobot is an embodied intelligent software framework that integrates the robot brain (data, models, model training) with the robot body…☆18Nov 8, 2025Updated 9 months ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 10 months ago
- Expert system with deductive querying and verification of constraints expressed in natural language☆23Feb 15, 2026Updated 5 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Optimizing database queries with array programming☆20Sep 21, 2020Updated 5 years ago
- ☆18Jun 12, 2024Updated 2 years ago
- ☆14Sep 14, 2025Updated 10 months ago
- A desktop GUI for Flux 1.1 Pro built using DelphiFMX For Python☆11Oct 5, 2024Updated last year
- ☆15Jul 30, 2026Updated last week
- Summarize, explain, fact-check, or translate any text, URL, or file. No GPU. No cloud. One command☆22Jun 15, 2026Updated last month
- A simple example test implementation of the princeton graphMERT paper.☆16Oct 21, 2025Updated 9 months ago
- Simple agent framework using Ollama tool calling☆10Aug 27, 2024Updated last year
- GFPGAN face reconstruction with ncnn on a bare Raspberry Pi☆14Jan 4, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 一个即插即用的llm增强器，项目初衷是通过工程化架构让小参数模型获得能媲美大模型的能力。☆19May 23, 2026Updated 2 months ago
- Incremental View Maintenance support for DuckDB☆18Oct 24, 2023Updated 2 years ago
- The Lily programming language ⚜☆11Updated this week
- Lightweight API Specification for Intelligent Systems☆15Feb 16, 2026Updated 5 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆19Aug 30, 2024Updated last year
- Windows desktop application for Stable Diffusion☆13Jun 26, 2023Updated 3 years ago
- Protocol for transparent collections of files.☆12May 17, 2026Updated 2 months ago
- A curated list of papers and resources on byte-based large language models (LLMs) — models that operate directly on raw bytes.☆15Jul 12, 2025Updated last year
- Haskell bindings to llama.cpp☆12Dec 22, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Port of GGML to C#☆13Jul 1, 2023Updated 3 years ago
- Yet Another (LLM) Web UI, made with Gemini☆12Dec 25, 2024Updated last year
- ojjson is a library designed to facilitate JSON interactions with Ollama, a large language api (LLM). It leverages the power of Zod for s…☆12Nov 7, 2024Updated last year
- Компилятор "СтранниК Модула-Си-Паскаль"☆15Jun 12, 2016Updated 10 years ago
- This repo illustrates how to combine LLMs and rule-based services to generate answers grounded on business policies☆51Jul 6, 2026Updated last month
- flux1非官方的量化模型(flux1 unofficial quantize model)☆11Aug 14, 2024Updated last year
- Self-Organizing and Incremental Neural Networks☆20Sep 26, 2013Updated 12 years ago