lang-uk / tokenize-ukLinks
Simple python lib to tokenize texts into sentences and sentences to words. Small, fast and robust. Comes with ukrainian flavour
☆61Updated 2 years ago
Alternatives and similar repositories for tokenize-uk
Users that are interested in tokenize-uk are comparing it to the libraries listed below
Sorting:
- Ukranian NER annotation project☆92Updated 8 months ago
- Браунський корпус української мови☆116Updated this week
- UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language☆267Updated last year
- Curated list of Ukrainian natural language processing (NLP) resources (corpora, pretrained models, libriaries, etc.)☆224Updated 2 months ago
- ☆29Updated last month
- This is a project to demonstrate NLP API from LanguageTool for Ukrainian language.☆75Updated this week
- 🇺🇦 Speech Recognition & Synthesis for Ukrainian☆420Updated 3 months ago
- Russian data from the SynTagRus corpus.☆85Updated last month
- Large silver standart Russian corpus with NER, morphology and syntax markup☆71Updated 2 years ago
- Russian language models for spaCy☆241Updated 4 years ago
- Ukrainian tone dictionary☆48Updated 9 years ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆156Updated last year
- ☆51Updated 8 years ago
- Rule-based token, sentence segmentation for Russian language☆277Updated 2 years ago
- ☆20Updated 8 years ago
- Term extraction for Russian language☆90Updated 7 years ago
- Corpus of Russian news articles collected from Lenta.Ru☆143Updated 3 years ago
- Scripts for updating pymorphy2 dictionaries☆37Updated last year
- Библиотека для анализа и генерации стихов на русском языке☆179Updated last year
- Открытые лингвистические датасеты: тональный словарь русского языка КартаСловСент, датасет по семантике, ассоциа тивный граф и датасет по …☆370Updated 4 years ago
- Ukrainian instruction-tuned language models and datasets☆96Updated last year
- Rule-based facts extraction for Russian language☆328Updated 2 years ago
- Корпус ненормативной лексики русского языка для нужд NLP. Любые исправления и дополнения приветствуются☆138Updated 5 years ago
- ☆85Updated 3 years ago
- Deep Learning based NLP modeling for Russian language☆239Updated 2 years ago
- Adds word stress to Ukrainian texts☆59Updated last year
- Russian mass media stemmed texts corpus / Корпус лемматизированных (морфологически нормализованных) текстов российских СМИ☆92Updated 8 years ago
- A web-based engine for creating and annotating textual corpora☆253Updated 2 years ago
- Проект для перевода чисел, записанных в текстовом виде на русском языке.☆104Updated 4 years ago
- 🔬 Очистка датасетов от мусора (нормализация, препроцессинг)☆41Updated 4 years ago