lang-uk / tokenize-ukLinks
Simple python lib to tokenize texts into sentences and sentences to words. Small, fast and robust. Comes with ukrainian flavour
☆61Updated 2 years ago
Alternatives and similar repositories for tokenize-uk
Users that are interested in tokenize-uk are comparing it to the libraries listed below
Sorting:
- Ukranian NER annotation project☆92Updated 7 months ago
- Браунський корпус української мови☆116Updated 2 months ago
- UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language☆267Updated last year
- Curated list of Ukrainian natural language processing (NLP) resources (corpora, pretrained models, libriaries, etc.)☆221Updated last month
- ☆29Updated last month
- Russian language models for spaCy☆241Updated 4 years ago
- This is a project to demonstrate NLP API from LanguageTool for Ukrainian language.☆75Updated 2 months ago
- Russian data from the SynTagRus corpus.☆85Updated last month
- Ukrainian tone dictionary☆48Updated 9 years ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆156Updated last year
- Term extraction for Russian language☆89Updated 7 years ago
- ☆84Updated 3 years ago
- Large silver standart Russian corpus with NER, morphology and syntax markup☆71Updated 2 years ago
- A Python wrapper of the Yandex Mystem 3.1 morphological analyzer (http://api.yandex.ru/mystem). The original tool is shipped as a binary …☆294Updated 3 years ago
- Открытые лингвистические датасеты: тональный словарь русского языка КартаСловСент, датасет по семантике, ассоциативный граф и датасет по …☆370Updated 4 years ago
- A web-based engine for creating and annotating textual corpora☆252Updated 2 years ago
- Compact high quality word embeddings for Russian language☆206Updated 2 years ago
- Corpus of Russian news articles collected from Lenta.Ru☆143Updated 3 years ago
- Rule-based token, sentence segmentation for Russian language☆277Updated 2 years ago
- Russian mass media stemmed texts corpus / Корпус лемматизированных (морфологически нормализованных) текстов российских СМИ☆92Updated 8 years ago
- Web-ify your word2vec: framework to serve distributional semantic models online☆203Updated 9 months ago
- Набір різноманітних колекцій даних українською мовою зібраний протягом роботи над антикорупційними проектами. CSV–формат, до деяких датас…☆28Updated 3 years ago
- Корпус ненормативной лексики русского языка для нужд NLP. Любые исправления и дополнения приветствуются☆137Updated 5 years ago
- Rule-based facts extraction for Russian language☆327Updated 2 years ago
- Ukrainian instruction-tuned language models and datasets☆96Updated last year
- Morphological analyzer / inflection engine for Russian and Ukrainian languages.☆1,159Updated last year
- python package russtress accentuates russian text☆61Updated 5 years ago
- ☆20Updated 8 years ago
- Deep Learning based NLP modeling for Russian language☆239Updated 2 years ago
- 🔬 Очистка датасетов от мусора (нормализация, препроцессинг)☆41Updated 4 years ago