This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser writt…
☆32Aug 20, 2026Updated last week
Alternatives and similar repositories for python-ucto
Users that are interested in python-ucto are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A multi-level marketing web application -- matrix type☆17Aug 20, 2015Updated 11 years ago
- python-timbl, originally developed by Sander Canisius, is a Python extension module wrapping the full TiMBL C++ programming interface. Wi…☆18May 2, 2025Updated last year
- C++ implementation of Generalised Brown clustering and python scripts for feature generation☆41Apr 8, 2016Updated 10 years ago
- Yet Another Sequence Encoder - Encode sequences to vector of vector in python !☆14May 15, 2017Updated 9 years ago
- A bag of miscellaneous demos!☆13Feb 5, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Python bindings to the dutch NLP tool Frog (pos tagger, lemmatiser, NER tagger, morphological analysis, shallow parser, dependency parser…☆50Aug 20, 2026Updated last week
- ☆34Aug 9, 2026Updated 3 weeks ago
- Automatically folds Python docstrings longer than 1 line.☆16Dec 2, 2023Updated 2 years ago
- word count of large file using prefix tree and parallel python processes☆18Sep 25, 2013Updated 12 years ago
- Context Aware Language Models☆28Jul 3, 2018Updated 8 years ago
- A Compiler and Type Inference System for a subset of Standard ML called Small.☆14May 19, 2017Updated 9 years ago
- A generic library for crafting adversarial NLP examples - WIP☆41Oct 26, 2018Updated 7 years ago
- Implementation of provably Rawlsian fair ML algorithms for contextual bandits.☆15May 10, 2017Updated 9 years ago
- FoLiA library for C++☆18Mar 25, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- SWAN: Saar Web-based ANotation system☆14May 16, 2019Updated 7 years ago
- weighted deepwalk implementation in c++☆18Feb 8, 2017Updated 9 years ago
- This is a gem that provides the ability to create a workspace, import scan data from nexpose, and perform a webscan, a web audit, and per…☆10Dec 13, 2017Updated 8 years ago
- ☆15Dec 26, 2021Updated 4 years ago
- Python implementation of cover trees, near-drop-in replacement for scipy.spatial.kdtree☆32Mar 13, 2012Updated 14 years ago
- A sentence aligner for comparable corpora☆131May 19, 2016Updated 10 years ago
- ☆16Sep 6, 2012Updated 13 years ago
- Data management utilities for Scala☆19Dec 13, 2016Updated 9 years ago
- First steps in Machine Learning☆12Mar 18, 2015Updated 11 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipg…☆133Feb 5, 2026Updated 6 months ago
- A python wrapper around the ZPar parser for English.☆50Apr 20, 2021Updated 5 years ago
- Simple CORPORA list crawler☆11Dec 2, 2016Updated 9 years ago
- Yet Another SEquence Tagger☆10Dec 8, 2022Updated 3 years ago
- Curated set of transformers that make your work with steppy faster and more effective☆23Nov 22, 2018Updated 7 years ago
- Fast structured perceptron sequential labeler☆15Dec 8, 2015Updated 10 years ago
- Deep learning spelling patterns with a recurrent neural network☆11Jun 5, 2017Updated 9 years ago
- A Python implementation of word2vec that allows custom sampling strategies☆10Jan 30, 2014Updated 12 years ago
- Translation of query languages to serialized KoralQuery protocol☆15Aug 24, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Re-usable low-level ML components☆11Oct 31, 2018Updated 7 years ago
- Tool for slot extraction from text☆15Oct 23, 2022Updated 3 years ago
- Repository for Manning Twitch session about building and deploying APIs with Python☆12Jul 19, 2021Updated 5 years ago
- A command-line clone of the excellent macOS program LaTeXiT.☆15Nov 13, 2017Updated 8 years ago
- ☆12Apr 13, 2023Updated 3 years ago
- Simple plotting for Python. Python wrapper for D3xter - render charts in the browser with simple Python syntax.☆30May 19, 2018Updated 8 years ago
- Hugging Face and Pyserini interoperability☆20May 18, 2023Updated 3 years ago