amir-zeldes / RFTokenizerLinks
A character-wise tokenizer for morphologically rich languages
☆28Updated last week
Alternatives and similar repositories for RFTokenizer
Users that are interested in RFTokenizer are comparing it to the libraries listed below
Sorting:
- ANNIS is an open source, versatile web browser-based search and visualization architecture for complex multilevel linguistic corpora with…☆75Updated 3 months ago
- A multilingual parallel corpus created from translations of the Bible.☆185Updated 4 months ago
- German Morphological Analyzer☆47Updated 3 years ago
- A fully-fledge PyTorch package for Morphological Analysis, tailored to morphologically rich and historical languages.☆23Updated last year
- Runnable morphological analysis tools from the UniMorph project☆16Updated 6 years ago
- A neural network that jointly part-of-speech tags and lemmatizes sentences, boosting accuracy for morphologically-rich languages (Czech, …☆34Updated 6 years ago
- ☆65Updated 3 weeks ago
- A cloud-based, open-source system for writing and publishing dictionaries.☆93Updated last year
- The Open Multilingual Wordnet☆64Updated last year
- LingPy: Python library for quantitative tasks in historical linguistics☆137Updated last month
- Natural language processing resources for multiple languages, with an eye towards use for digital humanities.☆127Updated 4 years ago
- A tool for automatic spelling normalization☆20Updated 4 years ago
- Various utilities for processing the data.☆211Updated this week
- ConllEditor is a tool to edit dependency syntax trees in CoNLL-U format.☆57Updated last month
- A part-of-speech tagger with support for domain adaptation and external resources.☆23Updated 2 years ago
- A minimal, pure Python library to interface with CoNLL-U format files.☆151Updated 2 weeks ago
- Compiled tools, datasets, and other resources for historical text normalization.☆19Updated 6 years ago
- Linguistic and stylistic complexity measures for (literary) texts☆84Updated last year
- Python framework for processing Universal Dependencies data☆57Updated this week
- A neural parsing pipeline for segmentation, morphological tagging, dependency parsing and lemmatization with pre-trained models for more …☆113Updated last year
- BERT and ELECTRA models trained on Europeana Newspapers☆38Updated 3 years ago
- A tokenizer and sentence splitter for German and English web and social media texts.☆147Updated 9 months ago
- Repository for the Georgetown University Multilayer Corpus (GUM)☆99Updated last month
- Named Entity Recognition (LSTM + CRF + FastText) with models for [historic] German☆26Updated 4 years ago
- Multi Tier Annotation Search☆26Updated 4 years ago
- Identifying Historical People, Places and other Entities: Shared Task on Named Entity Recognition and Linking on Historical Newspapers at…☆21Updated last year
- Translation Memory Open-source Purifier☆34Updated 2 years ago
- Open German WordNet☆97Updated last year
- Detect and align similar passages☆108Updated 4 months ago
- ☆29Updated 11 months ago