Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. Ucto comes with tokenisation rules…
☆72Aug 20, 2026Updated last week
Alternatives and similar repositories for ucto
Users that are interested in ucto are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FoLiA library for C++☆18Mar 25, 2026Updated 5 months ago
- Tools for TICCL☆14Dec 12, 2025Updated 8 months ago
- An extensive Python library for dealing with FoLiA (Format for Linguistic Annotation) documents, a rich XML-based format for linguistic a…☆18Nov 18, 2024Updated last year
- Visual Text Analytics for Digital Humanities☆17Apr 22, 2015Updated 11 years ago
- Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipg…☆133Feb 5, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Digital humanities things!☆21Mar 17, 2026Updated 5 months ago
- Turn CTS TEI corpora into CEX collection files☆12Jun 16, 2021Updated 5 years ago
- Graph-based tool for disambiguation and linking of named entities to Linked Data sets for Digital Humanities and heritage texts☆28Sep 20, 2021Updated 4 years ago
- A bunch of modules that use/extend CLTK in order to work with Greek and Latin corpora maintained by the Perseus DL☆12Oct 26, 2019Updated 6 years ago
- Miscellaneous Jupyter notebooks and slides for public talks☆11Jan 7, 2019Updated 7 years ago
- ☆37Jun 10, 2024Updated 2 years ago
- A set of (string) distance functions written in JavaScript / Python / PHP.☆18Feb 2, 2026Updated 6 months ago
- Training files for Greek cursive script (in early print)☆15May 26, 2021Updated 5 years ago
- TiMBL implements several memory-based learning algorithms.☆55Aug 17, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LaMachine - A software distribution of our in-house as well as some 3rd party NLP software - Virtual Machine, Docker, or local compilatio…☆71Sep 11, 2023Updated 2 years ago
- Frog is an integration of memory-based natural language processing (NLP) modules developed for Dutch. All NLP modules are based on Timbl,…☆83Aug 17, 2026Updated last week
- Juxta Web Service☆33Jul 7, 2022Updated 4 years ago
- Humanities Entity Recognition: robust, practical, efficient Named Entity Recognition for today's digital humanist☆37Mar 26, 2019Updated 7 years ago
- Implementation of Needleman-Wunsch algorithm in Python Using Nested Functions.☆13Jul 10, 2018Updated 8 years ago
- Search back-end for dependency tree search. See the docs at https://fginter.github.io/dep_search/☆17Apr 11, 2018Updated 8 years ago
- eComparatio: text diff and support for digital edition☆22Feb 3, 2021Updated 5 years ago
- Wikipedia Citations in Wikidata☆10May 6, 2021Updated 5 years ago
- utilities for validating and normalising Ancient Greek text☆24Jul 8, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Digital edition (TEI XML) of the Arabic monthly journal *al-Muqtabas* (مجلة المقتبس), published by Muḥammad Kurd ʿAlī in Cairo and Damasc…☆18Oct 19, 2025Updated 10 months ago
- Tutorial materials to teach Racket/Scribble to people without a math or CS background☆23Apr 2, 2018Updated 8 years ago
- Teaching materials for AR Methodological Workshop - Computational Background Skills for Digital Humanities at University of Vienna.☆48Apr 29, 2026Updated 4 months ago
- finite-state toolkit, EM and Bayesian (Gibbs sampling) training for FST and context-free derivation forests☆41Oct 14, 2022Updated 3 years ago
- The CIS OCR PostCorrectionTool☆45Nov 7, 2022Updated 3 years ago
- Expected edit distance implementation using OpenFst tools☆11May 13, 2015Updated 11 years ago
- Polytonic Greek OCR engine derived from Gamera and based on the work of Dalitz and Brandt☆33Nov 25, 2014Updated 11 years ago
- Mannheim library utilities☆28Dec 29, 2025Updated 8 months ago
- Text conversion tool (from e.g. Word, HTML, txt) to corpus formats TEI or FoLiA)☆23Feb 11, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A set of workflows for corpus building through OCR, post-correction and normalisation☆51Sep 7, 2022Updated 3 years ago
- The what (and how) digital humanities and news nerds want to explore together☆64Nov 6, 2015Updated 10 years ago
- A language-independent post-correction app for POS-tagging and lemmatization☆30Jun 17, 2026Updated 2 months ago
- Simple CORPORA list crawler☆11Dec 2, 2016Updated 9 years ago
- pronunciation LEXicons for Any Low-resource Language☆21Jul 14, 2020Updated 6 years ago
- FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…☆113Jan 24, 2025Updated last year
- Performs unique entity estimation corresponding to Chen, Shrivastava, Steorts (2018).☆15Feb 21, 2019Updated 7 years ago