C++ implementation of tokenizers, including tiktoken.
☆25Dec 7, 2023Updated 2 years ago
Alternatives and similar repositories for tokenizer
Users that are interested in tokenizer are comparing it to the libraries listed below
Sorting:
- C++ implementations for various tokenizers (sentencepiece, tiktoken etc).☆48Mar 12, 2026Updated last week
- ☆71Feb 27, 2023Updated 3 years ago
- Creating Your Divine Agent 😇☆10Jan 26, 2026Updated last month
- ☆24Aug 14, 2025Updated 7 months ago
- ☆13Jul 22, 2024Updated last year
- Recording models☆11Sep 19, 2023Updated 2 years ago
- ChatGLM4微调简介☆22Apr 8, 2025Updated 11 months ago
- Universal cross-platform tokenizers binding to HF and sentencepiece☆460Feb 20, 2026Updated last month
- Silent Whisper inference for privacy and performance. Configured for GPU Spot Instances.☆11Sep 28, 2023Updated 2 years ago
- Header-only safetensors loader and saver in C++☆78Dec 27, 2025Updated 2 months ago
- ☆18Dec 7, 2023Updated 2 years ago
- ONNX-compatible DocShadow: High-Resolution Document Shadow Removal. Supports TensorRT 🚀☆25Sep 13, 2023Updated 2 years ago
- A tool that allows you to draw on screen in real-time.☆19Nov 17, 2024Updated last year
- This project provides a set of translators to convert OpenAI Gym environments into text-based environments. It is designed to investigate…☆20May 29, 2024Updated last year
- Development environment for ImGui.☆20Sep 1, 2018Updated 7 years ago
- A javascript backend for llvm. Currently in the process of joining forces with Emscripten (http://code.google.com/p/emscripten/).☆18Dec 18, 2010Updated 15 years ago
- Compiles RenderMan shader kernels to native shader plugins via LLVM☆23Feb 28, 2012Updated 14 years ago
- subtitled NSMenuItems on macOS 10.11 and newer☆10Mar 16, 2021Updated 5 years ago
- Implements a themable recent locations (forward, backward, up. pop-up list) control a la Windows (7-10) Explorer☆11Jan 29, 2021Updated 5 years ago
- Nginx module for media transcoding☆10Dec 3, 2021Updated 4 years ago
- ☆27Jun 30, 2025Updated 8 months ago
- A simplified OOP implementation of the WordPress admin notices.☆14Apr 7, 2018Updated 7 years ago
- An engine that convert text to attributed strings and attributed strings to text. Supports HTML and markdown by default.☆23Nov 6, 2015Updated 10 years ago
- This WordPress plugin, useful to transcode audio and video file from any format to mp3 and mp4 respectively. Also it will generate thumbn…☆12Aug 22, 2025Updated 7 months ago
- A less opinionated code formatter for PHP, based on Laravel Pint.☆12Mar 7, 2024Updated 2 years ago
- MobileSAM のエンコーダー/デコーダーをONNXに変換し、推論するサンプル☆11Apr 11, 2024Updated last year
- Extensions to Apple's GLKit, tentatively: things we expect in GLKit version 2☆31Apr 6, 2014Updated 11 years ago
- Transform raw input data into consistent data transfer objects.☆12Jun 17, 2019Updated 6 years ago
- 支持多种 Linux 发行版的交互式/自动化 NVIDIA 驱动安装脚本☆47Mar 16, 2026Updated last week
- PyQt4, PyQt5, PySide, PySide2 のどれでも動くノードグラフ用フレームワーク☆11Jul 8, 2019Updated 6 years ago
- A WPF/MVVM control for selection of values in different units with automatic unit conversion☆11May 24, 2020Updated 5 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆12Mar 5, 2025Updated last year
- Converts CLIP models to ONNX☆10Jan 17, 2023Updated 3 years ago
- ☆12Mar 14, 2026Updated last week
- A hooks and filters system for writing event-driven or plugin-ready PHP.☆15Aug 21, 2015Updated 10 years ago
- A theme for zsh that looks like the fish theme☆10Mar 22, 2024Updated 2 years ago
- A local implementation of the map/reduce strategy in PHP☆11Nov 12, 2023Updated 2 years ago
- API to integrate GTK+ macOS applications with the Mac desktop☆25May 27, 2025Updated 9 months ago
- 使用ONNXRuntime部署一种用于边缘检测的轻量级密集卷积神经网络LDC，包含C++和Python两个版本的程序☆10Apr 24, 2023Updated 2 years ago