malibayram / custom-embedderView on GitHub
A high-performance Turkish tokenizer with Rust backend and Python wrapper. This package combines linguistic rules with BPE (Byte Pair Encoding) for optimal tokenization of Turkish text.
☆14Jun 24, 2025Updated last year

Alternatives and similar repositories for custom-embedder

Users that are interested in custom-embedder are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?