LanguageMachines / uctoLinks
Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. Ucto comes with tokenisation rules…
☆68Updated 3 months ago
Alternatives and similar repositories for ucto
Users that are interested in ucto are comparing it to the libraries listed below
Sorting:
- Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipg…☆127Updated 5 months ago
- FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…☆112Updated 4 months ago
- A tool for automatic spelling normalization☆20Updated 4 years ago
- Multi Tier Annotation Search☆26Updated 4 years ago
- Open-source tools for morphological tagging, segmentation and stemming.☆40Updated 5 years ago
- Various utilities for processing the data.☆209Updated this week
- Hierarchical phrase-based machine translation system☆32Updated 10 years ago
- Ukb: graph-based WSD and similarity☆106Updated last year
- Extension of the mate-tools NLP pipeline☆67Updated 9 years ago
- Named Entity Recognition data for Europeana Newspapers☆171Updated 2 years ago
- finite-state toolkit, EM and Bayesian (Gibbs sampling) training for FST and context-free derivation forests☆41Updated 2 years ago
- Framework for creating and accessing UBY resources – sense-linked lexical resources in standard UBY-LMF format☆22Updated 7 years ago
- eXternally configurable REference and Non Named Entity Recognizer☆17Updated 11 months ago
- TiMBL implements several memory-based learning algorithms.☆52Updated 5 months ago
- ConllEditor is a tool to edit dependency syntax trees in CoNLL-U format.☆56Updated this week
- Thot toolkit for statistical machine translation☆53Updated 2 years ago
- Frog is an integration of memory-based natural language processing (NLP) modules developed for Dutch. All NLP modules are based on Timbl,…☆77Updated 5 months ago
- SMOR (Stuttgart Morphology) with alternative lemmatization component☆12Updated last year
- A highly extensible plattform for conversion and manipulation of linguistic data between an unbound set of formats. Pepper can be used st…☆24Updated 5 months ago
- This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet…☆29Updated 5 months ago
- Machine translation for the real world☆23Updated 5 years ago
- Python bindings to the dutch NLP tool Frog (pos tagger, lemmatiser, NER tagger, morphological analysis, shallow parser, dependency parser…☆49Updated 2 months ago
- FoLiA: Format for Linguistic Annotation - FoLiA is a rich XML-based annotation format for the representation of language resources (inclu…☆63Updated last year
- A Corpus Data Retrieval Index using Lucene for Look-Ups☆17Updated this week
- German Morphological Analyzer☆47Updated 3 years ago
- A set of workflows for corpus building through OCR, post-correction and normalisation☆49Updated 2 years ago
- Excitement Open Platform for Recognizing Textual Entailments☆89Updated 7 years ago
- Morfessor is a tool for unsupervised and semi-supervised morphological segmentation☆193Updated 4 years ago
- FoLiA library for C++☆16Updated 3 months ago
- spaCy-to-naf converter☆21Updated 11 months ago