Koziev / rutokenizerLinks
Russian text segmenter and tokenizer
☆17Updated 4 years ago
Alternatives and similar repositories for rutokenizer
Users that are interested in rutokenizer are comparing it to the libraries listed below
Sorting:
- Deep Learning based NLP modeling for Russian language☆240Updated 2 years ago
- ☆211Updated 4 years ago
- python package russtress accentuates russian text☆62Updated 5 years ago
- Compact high quality word embeddings for Russian language☆209Updated 2 years ago
- ☆58Updated 2 years ago
- 🇷🇺 Punctuation restoration production-ready model for Russian language 🇷🇺☆58Updated 4 years ago
- Russian text normalization pipeline for speech-to-text and other applications based on tagging s2s networks☆123Updated 4 years ago
- Простая модель расстановки запятых на основе BERT☆40Updated 5 years ago
- Russian SuperGLUE benchmark☆111Updated 2 years ago
- Augmentex — a library for augmenting texts with errors☆70Updated last year
- Russian language support for NLTK's PunktSentenceTokenizer☆55Updated 6 years ago
- ☆140Updated 8 months ago
- Rule-based token, sentence segmentation for Russian language☆276Updated 2 years ago
- Проект для перевода чисел, записанных в текстовом виде на русском языке.☆104Updated 4 years ago
- Библиотека для извлечения статистик из текстов на русском языке.☆124Updated 3 years ago
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆164Updated last month
- A Python wrapper for the RuWordNet thesaurus☆72Updated last year
- Russian GPT2 model☆60Updated 4 years ago
- Проект для распознавания речи на русском языке на основе pykaldi.☆342Updated last year
- My NLP datasets for Russian language☆385Updated 2 years ago
- Accentor and transcriptor for Russian language☆132Updated 3 years ago
- Код для файнтюна LM (rugpt, LLaMa, FRED T5) средствами transformers + deepspeed + LoRa☆14Updated 2 years ago
- Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat☆61Updated 2 years ago
- Large silver standart Russian corpus with NER, morphology and syntax markup☆71Updated 2 years ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆156Updated last year
- Question answering on russian with XLMRobertaLarge as a service☆21Updated 4 years ago
- Training GPT-2 on a Russian language corpus☆87Updated 5 years ago
- Punctuation and casing restoration for the Russian Language (BERT-based)☆24Updated 4 years ago
- Train punctuation and capitalization models for different languages☆26Updated 3 years ago
- Простой нормализатор текстов перед синтезом речи☆43Updated last year