EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING
☆457Feb 2, 2026Updated 9 months ago
Alternatives and similar repositories for flash-tokenizer
Users that are interested in flash-tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆179May 14, 2022Updated 4 years ago
- ☆19Mar 18, 2022Updated 4 years ago
- ☆14Jun 10, 2025Updated last year
- transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)☆18Apr 7, 2022Updated 4 years ago
- It shows how to deploy and use an agent with LLM.☆19Mar 1, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Created a simple neural network using C++17 standard and the Eigen library that supports both forward and backward propagation.☆11Jul 27, 2024Updated 2 years ago
- A unified and extensible pipeline for deep learning model inference with C++. Now support yolov8, yolov9, clip, and nanosam. More models …☆12Aug 3, 2025Updated last year
- ☆11Apr 2, 2025Updated last year
- ☆12Oct 10, 2026Updated 3 weeks ago
- ONNX-compatible DocShadow: High-Resolution Document Shadow Removal. Supports TensorRT 🚀☆27Sep 13, 2023Updated 3 years ago
- A very simple performing matrix multiplication example for CPU / CUDA / METAL using GGML / llama.cpp☆13Jul 7, 2024Updated 2 years ago
- High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU…☆17Jul 6, 2026Updated 3 months ago
- Performant language agnostic tokenization for NLP.☆10Sep 19, 2020Updated 6 years ago
- A Multilingual Keyboard Layout-Based Typo Generator☆18Nov 23, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- C++ inference engine for running GLiNER (Generalist and Lightweight Named Entity Recognition) models☆57Jul 10, 2026Updated 3 months ago
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆27Nov 25, 2024Updated last year
- Generate Large Language Model text in a container.☆19Mar 24, 2023Updated 3 years ago
- ☆28Jun 5, 2025Updated last year
- The training codes of Jasper-Token-Compression-600M☆22Nov 19, 2025Updated 11 months ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated last year
- Code for the paper "BPE stays on SCRIPT", "Which Pieces Does Unigram Tokenization Really Need?" and MinGram☆22Oct 21, 2026Updated last week
- ☆17Sep 29, 2026Updated last month
- Torch-activation, a library of activation functions for PyTorch library☆25May 27, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Experimental validation of the Bayesian BM25 paper☆10Feb 16, 2026Updated 8 months ago
- Lightweight OpenCV-style API with pluggable AI inference backends (TensorFlow Lite, ONNX Runtime, MNN) for edge and mobile vision.☆29Jan 26, 2026Updated 9 months ago
- MeCab model trained with OpenKorPos.☆23Jun 19, 2022Updated 4 years ago
- A lightweight server for LightGBM☆15Oct 16, 2020Updated 6 years ago
- It shows how to use strands agent.☆27Oct 27, 2026Updated last week
- CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…☆243Jan 14, 2026Updated 9 months ago
- Enhanced multi-needle retrieval testing framework for evaluating LLM long-context understanding capabilities☆12Oct 8, 2025Updated last year
- Easy and Efficient Quantization for Transformers☆205Mar 25, 2026Updated 7 months ago
- This is the repository for MorphScore, a tokenizer evaluation framework for morphological alignment.☆19Jul 10, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆95Updated this week
- ☆11Mar 17, 2026Updated 7 months ago
- Official repository of the "DiverseVAR: Diversity Has Always Been There in Your Visual Autoregressive Models"☆15Dec 2, 2025Updated 11 months ago
- ☆14Sep 30, 2025Updated last year
- Korean MTEB Retrieval Evaluators for SPLADE, Dense, and Reranking models☆14Jul 21, 2026Updated 3 months ago
- various experiments for scaling inference time compute with small reasoning models☆17Jan 16, 2025Updated last year
- We provide pytorch training scripts for enformer and borzoi☆10Jul 11, 2025Updated last year