LanguageMachines / ucto
Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. Ucto comes with tokenisation rules…
☆68Updated 3 months ago
Alternatives and similar repositories for ucto
Users that are interested in ucto are comparing it to the libraries listed below
Sorting:
- FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…☆112Updated 3 months ago
- Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipg…☆127Updated 4 months ago
- A tool for automatic spelling normalization☆20Updated 4 years ago
- finite-state toolkit, EM and Bayesian (Gibbs sampling) training for FST and context-free derivation forests☆41Updated 2 years ago
- Thot toolkit for statistical machine translation☆53Updated 2 years ago
- LaMachine - A software distribution of our in-house as well as some 3rd party NLP software - Virtual Machine, Docker, or local compilatio…☆68Updated last year
- Ukb: graph-based WSD and similarity☆106Updated 11 months ago
- TiMBL implements several memory-based learning algorithms.☆52Updated 4 months ago
- Multi Tier Annotation Search☆26Updated 4 years ago
- The Global WordNet Association Collaborative Inter-Lingual Index☆42Updated 6 months ago
- A highly extensible plattform for conversion and manipulation of linguistic data between an unbound set of formats. Pepper can be used st…☆24Updated 4 months ago
- Frog is an integration of memory-based natural language processing (NLP) modules developed for Dutch. All NLP modules are based on Timbl,…☆77Updated 4 months ago
- Framework for creating and accessing UBY resources – sense-linked lexical resources in standard UBY-LMF format☆22Updated 6 years ago
- FoLiA: Format for Linguistic Annotation - FoLiA is a rich XML-based annotation format for the representation of language resources (inclu…☆63Updated last year
- Machine translation for the real world☆23Updated 5 years ago
- A set of workflows for corpus building through OCR, post-correction and normalisation☆47Updated 2 years ago
- Various utilities for processing the data.☆209Updated last week
- German Morphological Analyzer☆47Updated 3 years ago
- spaCy-to-naf converter☆21Updated 11 months ago
- Parsito: Fast non-projective transition-based dependency parser☆14Updated 2 years ago
- A powerful, tagset-independent and theory-neutral meta model and API for storing, manipulating, and representing nearly all types of ling…☆15Updated 2 years ago
- A fully-fledge PyTorch package for Morphological Analysis, tailored to morphologically rich and historical languages.☆23Updated last year
- Morfessor is a tool for unsupervised and semi-supervised morphological segmentation☆192Updated 4 years ago
- The NLG tool for Finnish☆23Updated last year
- Python framework for processing Universal Dependencies data☆57Updated last week
- Hierarchical phrase-based machine translation system☆32Updated 10 years ago
- Named Entity Recognition data for Europeana Newspapers☆171Updated 2 years ago
- Learning by Reading pipeline of NLP and Entity Linking tools☆85Updated 2 years ago
- SMOR (Stuttgart Morphology) with alternative lemmatization component☆12Updated last year
- ANNIS is an open source, versatile web browser-based search and visualization architecture for complex multilevel linguistic corpora with…☆75Updated this week