amir-zeldes / RFTokenizerLinks
A character-wise tokenizer for morphologically rich languages
☆29Updated 3 months ago
Alternatives and similar repositories for RFTokenizer
Users that are interested in RFTokenizer are comparing it to the libraries listed below
Sorting:
- A multilingual parallel corpus created from translations of the Bible.☆191Updated 7 months ago
- ☆66Updated 4 months ago
- An NLP pipeline for Hebrew☆40Updated 6 months ago
- LingPy: Python library for quantitative tasks in historical linguistics☆139Updated last month
- UIMA CAS processing library written in Python☆90Updated 2 months ago
- A tool for automatic spelling normalization☆21Updated 4 years ago
- Multi Tier Annotation Search☆26Updated 4 years ago
- A neural network that jointly part-of-speech tags and lemmatizes sentences, boosting accuracy for morphologically-rich languages (Czech, …☆34Updated 6 years ago
- German Morphological Analyzer☆51Updated 4 years ago
- A minimal, pure Python library to interface with CoNLL-U format files.☆153Updated last month
- ANNIS is an open source, versatile web browser-based search and visualization architecture for complex multilevel linguistic corpora with…☆75Updated 3 months ago
- A fully-fledge PyTorch package for Morphological Analysis, tailored to morphologically rich and historical languages.☆24Updated 2 years ago
- Identifying Historical People, Places and other Entities: Shared Task on Named Entity Recognition and Linking on Historical Newspapers at…☆21Updated last year
- Compiled tools, datasets, and other resources for historical text normalization.☆20Updated 6 years ago
- Python framework for processing Universal Dependencies data☆58Updated last week
- Linguistic and stylistic complexity measures for (literary) texts☆84Updated last year
- A part-of-speech tagger with support for domain adaptation and external resources.☆23Updated 3 years ago
- Natural language processing resources for multiple languages, with an eye towards use for digital humanities.☆127Updated 4 years ago
- ConllEditor is a tool to edit dependency syntax trees in CoNLL-U format.☆57Updated 2 weeks ago
- Named Entity Recognition (LSTM + CRF + FastText) with models for [historic] German☆26Updated 4 years ago
- Detect and align similar passages☆115Updated 3 months ago
- A neural parsing pipeline for segmentation, morphological tagging, dependency parsing and lemmatization with pre-trained models for more …☆115Updated last year
- Runnable morphological analysis tools from the UniMorph project☆16Updated 7 years ago
- ☆64Updated 2 years ago
- A cloud-based, open-source system for writing and publishing dictionaries.☆98Updated 2 years ago
- Compound splitter for German language ("Komposita-Zerlegung") based on large dictionary combined with highly efficient multi-pattern stri…☆34Updated 3 years ago
- Various utilities for processing the data.☆216Updated this week
- Repository for the Georgetown University Multilayer Corpus (GUM)☆103Updated 2 months ago
- Morfessor is a tool for unsupervised and semi-supervised morphological segmentation☆200Updated 5 years ago
- CONLL-U to Pandas DataFrame☆31Updated 8 years ago