This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser writt…
☆31Feb 2, 2026Updated last month
Alternatives and similar repositories for python-ucto
Users that are interested in python-ucto are comparing it to the libraries listed below
Sorting:
- Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic pr…☆70Mar 12, 2026Updated last week
- python-timbl, originally developed by Sander Canisius, is a Python extension module wrapping the full TiMBL C++ programming interface. Wi…☆18May 2, 2025Updated 10 months ago
- ☆15Dec 26, 2021Updated 4 years ago
- Python bindings to the dutch NLP tool Frog (pos tagger, lemmatiser, NER tagger, morphological analysis, shallow parser, dependency parser…☆49Feb 2, 2026Updated last month
- Mine conversations from novels in Project Gutenberg, to generate data for data-driven dialogue systems.☆15May 7, 2019Updated 6 years ago
- A bag of miscellaneous demos!☆13Feb 5, 2017Updated 9 years ago
- python client library☆10Feb 15, 2017Updated 9 years ago
- ☆13May 4, 2017Updated 8 years ago
- Fetch and parse the American Presidency Project's press-briefing and presidential-news-conference transcripts.☆11Aug 18, 2016Updated 9 years ago
- Artistic Data Visualization☆11May 29, 2018Updated 7 years ago
- Data management utilities for Scala☆19Dec 13, 2016Updated 9 years ago
- word count of large file using prefix tree and parallel python processes☆18Sep 25, 2013Updated 12 years ago
- Tools, wrappers, etc... for data science with a concentration on text processing☆207Nov 9, 2022Updated 3 years ago
- Context Aware Language Models☆28Jul 3, 2018Updated 7 years ago
- ☆31Mar 4, 2026Updated 2 weeks ago
- Solidity Library for GIS Objects☆13Nov 6, 2018Updated 7 years ago
- A Compiler and Type Inference System for a subset of Standard ML called Small.☆13May 19, 2017Updated 8 years ago
- Implementation of provably Rawlsian fair ML algorithms for contextual bandits.☆14May 10, 2017Updated 8 years ago
- This is a gem that provides the ability to create a workspace, import scan data from nexpose, and perform a webscan, a web audit, and per…☆10Dec 13, 2017Updated 8 years ago
- A generic library for crafting adversarial NLP examples - WIP☆41Oct 26, 2018Updated 7 years ago
- I gave ownership of this project to Google many years ago☆37Oct 13, 2018Updated 7 years ago
- Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipg…☆129Feb 5, 2026Updated last month
- FoLiA library for C++☆17Mar 12, 2026Updated last week
- SWAN: Saar Web-based ANotation system☆14May 16, 2019Updated 6 years ago
- SimpleParse parser generator using mxTextTools (launchpad mirror)☆10Jan 12, 2026Updated 2 months ago
- A simple and fast search engine☆70Jun 21, 2022Updated 3 years ago
- A method to mine beyond-pairwise relationships using Min-Hashing for large-scale pattern discovery☆28Oct 10, 2021Updated 4 years ago
- Python implementation of cover trees, near-drop-in replacement for scipy.spatial.kdtree☆32Mar 13, 2012Updated 14 years ago
- The first Open Source document analysis platform☆65Aug 2, 2021Updated 4 years ago
- JAWS is "Just A Web Shell" framework for delivering Force.com web applications to iOS (iPhone/iPad) devices.☆14Mar 27, 2011Updated 14 years ago
- Unmaintained templating system used by old versions of Supervisor☆21Nov 15, 2022Updated 3 years ago
- A Rails adapter for test-unit☆11Nov 22, 2025Updated 3 months ago
- Python Environment for Bayesian Learning☆104Nov 16, 2011Updated 14 years ago
- First steps in Machine Learning☆12Mar 18, 2015Updated 11 years ago
- A python wrapper around the ZPar parser for English.☆50Apr 20, 2021Updated 4 years ago
- Template scripts for creating new rails applications.☆134Nov 2, 2009Updated 16 years ago
- Haskell NLP Work☆17Oct 13, 2025Updated 5 months ago
- Simple CORPORA list crawler☆10Dec 2, 2016Updated 9 years ago
- SomaFM Plugin for Kodi☆11Jan 11, 2022Updated 4 years ago