Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. Ucto comes with tokenisation rules…
☆72Aug 20, 2026Updated last month
Alternatives and similar repositories for ucto
Users that are interested in ucto are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet…☆32Aug 20, 2026Updated last month
- Tools for TICCL☆14Dec 12, 2025Updated 9 months ago
- T-scan: an analysis tool for dutch texts to assess the complexity of the text, based on original work by Rogier Kraf☆19May 28, 2025Updated last year
- JS / Python3 / PHP Lib to work with UTF8 polytonic greek and latin☆10Sep 11, 2024Updated 2 years ago
- Visual Text Analytics for Digital Humanities☆17Apr 22, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Text-Induced Corpus Clean-up☆21Jun 20, 2023Updated 3 years ago
- Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipg…☆135Feb 5, 2026Updated 8 months ago
- The GitHub repository containing all the material related to the Computational Thinking and Programming course of the Digital Humanities …☆21May 11, 2018Updated 8 years ago
- Digital humanities things!☆21Mar 17, 2026Updated 6 months ago
- Turn CTS TEI corpora into CEX collection files☆12Jun 16, 2021Updated 5 years ago
- Graph-based tool for disambiguation and linking of named entities to Linked Data sets for Digital Humanities and heritage texts☆28Sep 20, 2021Updated 5 years ago
- Miscellaneous Jupyter notebooks and slides for public talks☆11Jan 7, 2019Updated 7 years ago
- A bunch of modules that use/extend CLTK in order to work with Greek and Latin corpora maintained by the Perseus DL☆13Oct 26, 2019Updated 6 years ago
- ☆37Jun 10, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Greek texts (eventually) with linguistic annotation (for Greek Learner Texts Project)☆17Jun 16, 2023Updated 3 years ago
- Digital Humanities course site☆21Nov 22, 2021Updated 4 years ago
- Frog is an integration of memory-based natural language processing (NLP) modules developed for Dutch. All NLP modules are based on Timbl,…☆83Aug 17, 2026Updated last month
- Juxta Web Service☆33Jul 7, 2022Updated 4 years ago
- Search back-end for dependency tree search. See the docs at https://fginter.github.io/dep_search/☆17Apr 11, 2018Updated 8 years ago
- Wikipedia Citations in Wikidata☆10May 6, 2021Updated 5 years ago
- finite-state toolkit, EM and Bayesian (Gibbs sampling) training for FST and context-free derivation forests☆41Oct 14, 2022Updated 3 years ago
- ☆27Sep 17, 2025Updated last year
- The CIS OCR PostCorrectionTool☆45Nov 7, 2022Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Python library for automatic analysis of Ancient Greek hexameter. The algorithm uses linguistic rules and finite-state technology.☆23Feb 13, 2024Updated 2 years ago
- Expected edit distance implementation using OpenFst tools☆11May 13, 2015Updated 11 years ago
- Mannheim library utilities☆28Dec 29, 2025Updated 9 months ago
- Text conversion tool (from e.g. Word, HTML, txt) to corpus formats TEI or FoLiA)☆23Feb 11, 2022Updated 4 years ago
- Liddell-Scott-Jones Greek-English Lexicon in JavaScript☆29Feb 8, 2021Updated 5 years ago
- Data management utilities for Scala☆19Dec 13, 2016Updated 9 years ago
- A set of workflows for corpus building through OCR, post-correction and normalisation☆51Sep 7, 2022Updated 4 years ago
- The what (and how) digital humanities and news nerds want to explore together☆64Nov 6, 2015Updated 10 years ago
- A language-independent post-correction app for POS-tagging and lemmatization☆30Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- pronunciation LEXicons for Any Low-resource Language☆21Jul 14, 2020Updated 6 years ago
- FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…☆113Jan 24, 2025Updated last year
- Code for "Mind Your Inflections! Improving NLP for Non-Standard Englishes with Base-Inflection Encoding" (EMNLP 2020).☆11May 1, 2025Updated last year
- Performs unique entity estimation corresponding to Chen, Shrivastava, Steorts (2018).☆15Feb 21, 2019Updated 7 years ago
- Original 2016 take at what is now Linked Paths, the demonstrator for GeoJSON-T developed under a Pelagios micro-grant☆90Feb 26, 2017Updated 9 years ago
- Note: the repo has been moved to https://gitlab.com/readcoop/Transkribus/TranskribusCore☆40Oct 28, 2020Updated 5 years ago
- Multi Tier Annotation Search☆24May 12, 2021Updated 5 years ago