isLinXu / regex-tokenizer

Converted the Jina Tokenizer regex pattern to python.
26Updated 5 months ago

Alternatives and similar repositories for regex-tokenizer:

Users that are interested in regex-tokenizer are comparing it to the libraries listed below