This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser writt…
☆31Aug 20, 2026Updated 2 months ago
Alternatives and similar repositories for python-ucto
Users that are interested in python-ucto are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic pr…☆72Aug 20, 2026Updated 2 months ago
- python-timbl, originally developed by Sander Canisius, is a Python extension module wrapping the full TiMBL C++ programming interface. Wi…☆19May 2, 2025Updated last year
- Collaborative Synchronized Corpus Annotation Tool☆10Dec 31, 2018Updated 7 years ago
- FoLiA library for C++☆18Oct 26, 2026Updated 3 weeks ago
- Python bindings to the dutch NLP tool Frog (pos tagger, lemmatiser, NER tagger, morphological analysis, shallow parser, dependency parser…☆49Aug 20, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Yet Another Sequence Encoder - Encode sequences to vector of vector in python !☆14May 15, 2017Updated 9 years ago
- C++ implementation of Generalised Brown clustering and python scripts for feature generation☆41Apr 8, 2016Updated 10 years ago
- all-paths graph kernel for protein-protein interaction extraction☆12Apr 22, 2014Updated 12 years ago
- A fully-fledge PyTorch package for Morphological Analysis, tailored to morphologically rich and historical languages.☆26Oct 27, 2023Updated 3 years ago
- python client library☆10Feb 15, 2017Updated 9 years ago
- TiMBL implements several memory-based learning algorithms.☆57Nov 10, 2026Updated last week
- Curated set of transformers that make your work with steppy faster and more effective☆23Nov 22, 2018Updated 7 years ago
- Fetch and parse the American Presidency Project's press-briefing and presidential-news-conference transcripts.☆11Aug 18, 2016Updated 10 years ago
- A software to detect text reuse with BLAST.☆13Oct 8, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipg…☆136Feb 5, 2026Updated 9 months ago
- ☆13May 4, 2017Updated 9 years ago
- Python implementation of cover trees, near-drop-in replacement for scipy.spatial.kdtree☆32Mar 13, 2012Updated 14 years ago
- word count of large file using prefix tree and parallel python processes☆18Sep 25, 2013Updated 13 years ago
- Generic Environment for Context-Aware Correction of Orthography☆24Sep 7, 2022Updated 4 years ago
- A python wrapper around the ZPar parser for English.☆50Apr 20, 2021Updated 5 years ago
- A Compiler and Type Inference System for a subset of Standard ML called Small.☆14May 19, 2017Updated 9 years ago
- A generic library for crafting adversarial NLP examples - WIP☆41Oct 26, 2018Updated 8 years ago
- A tool to start ArangoDB clusters and single servers conveniently.☆13Feb 10, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- SWAN: Saar Web-based ANotation system☆14May 16, 2019Updated 7 years ago
- A sentence aligner for comparable corpora☆131May 19, 2016Updated 10 years ago
- Experiment, Storage and Visualization Framework for Machine Learning research.☆32May 19, 2021Updated 5 years ago
- An extremely simple Python wrapper for the SRI Language Modeling toolkit☆70Oct 4, 2014Updated 12 years ago
- Integration of Bowerstatic in Pyramid☆14Mar 28, 2020Updated 6 years ago
- ☆16Sep 6, 2012Updated 14 years ago
- Fuzzy search modules for searching lists of words in low quality OCR and HTR text.☆23Nov 10, 2026Updated last week
- ☆37Jun 10, 2024Updated 2 years ago
- ☆27Feb 2, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12May 27, 2021Updated 5 years ago
- Chinese segmentation library☆81Apr 15, 2011Updated 15 years ago
- Named Entity Recognition (LSTM + CRF + FastText) with models for [historic] German☆26May 10, 2021Updated 5 years ago
- Data Science Laboratory☆11Mar 22, 2023Updated 3 years ago
- A set of scripts to semi-automatically generate workshop proceedings for CEUR-WS.org☆14Oct 21, 2020Updated 6 years ago
- Simple CORPORA list crawler☆11Dec 2, 2016Updated 9 years ago
- This repository contains machine-readable versions of the six German major parties' electoral programs for 2017 federal elections and cod…☆15Aug 31, 2017Updated 9 years ago
Are these results useful?