lang-uk / tokenize-ukLinks
Simple python lib to tokenize texts into sentences and sentences to words. Small, fast and robust. Comes with ukrainian flavour
☆61Updated 2 years ago
Alternatives and similar repositories for tokenize-uk
Users that are interested in tokenize-uk are comparing it to the libraries listed below
Sorting:
- Ukranian NER annotation project☆92Updated 9 months ago
- Браунський корпус української мови☆116Updated this week
- UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language☆268Updated 2 years ago
- Curated list of Ukrainian natural language processing (NLP) resources (corpora, pretrained models, libriaries, etc.)☆227Updated 3 months ago
- This is a project to demonstrate NLP API from LanguageTool for Ukrainian language.☆76Updated this week
- ☆29Updated 2 months ago
- Russian language models for spaCy☆241Updated 4 years ago
- Ukrainian tone dictionary☆48Updated 9 years ago
- the list of ~2000 ukrainian stopwords (with numbers)☆66Updated 4 years ago
- Term extraction for Russian language☆90Updated 7 years ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆156Updated last year
- Stemmer for Ukrainian language in Python☆24Updated 8 years ago
- Corpus of Russian news articles collected from Lenta.Ru☆145Updated 3 years ago
- A web-based engine for creating and annotating textual corpora☆253Updated 2 years ago
- Библиотека для анализа и генерации стихов на русском языке☆178Updated 2 years ago
- ☆51Updated 8 years ago
- Custom Russian tokenizer for spaCy☆44Updated 6 years ago
- Web-ify your word2vec: framework to serve distributional semantic models online☆204Updated 11 months ago
- ☆36Updated 3 years ago
- Large silver standart Russian corpus with NER, morphology and syntax markup☆71Updated 2 years ago
- Rule-based token, sentence segmentation for Russian language☆277Updated 2 years ago
- A Python wrapper of the Yandex Mystem 3.1 morphological analyzer (http://api.yandex.ru/mystem). The original tool is shipped as a binary …☆294Updated 4 years ago
- ☆86Updated 3 years ago
- Morphological analyzer / inflection engine for Russian and Ukrainian languages.☆1,166Updated last year
- Russian mass media stemmed texts corpus / Корпус лемматизированных (морфологически нормализованных) текстов российских СМИ☆92Updated 8 years ago
- Корпус ненормативной лексики русского языка для нужд NLP. Любые исправления и дополнения приветствуются☆138Updated 6 years ago
- ☆33Updated 8 years ago
- Rule-based facts extraction for Russian language☆330Updated 2 years ago
- Inspired by word2vec-pride-vis the replacement of words of Russian most valuable novels text with closest word2vec model words. By Boris …☆49Updated last year
- Ukrainian instruction-tuned language models and datasets☆96Updated last year