Koziev / rutokenizerLinks
Russian text segmenter and tokenizer
☆17Updated 4 years ago
Alternatives and similar repositories for rutokenizer
Users that are interested in rutokenizer are comparing it to the libraries listed below
Sorting:
- Russian text normalization pipeline for speech-to-text and other applications based on tagging s2s networks☆120Updated 4 years ago
- Deep Learning based NLP modeling for Russian language☆236Updated 2 years ago
- ☆213Updated 4 years ago
- ☆133Updated 4 months ago
- Russian SuperGLUE benchmark☆110Updated 2 years ago
- Проект для перевода чисел, записанных в текстовом виде на русском языке.☆104Updated 4 years ago
- 🇷🇺 Punctuation restoration production-ready model for Russian language 🇷🇺☆58Updated 4 years ago
- Question answering on russian with XLMRobertaLarge as a service☆21Updated 3 years ago
- python package russtress accentuates russian text☆57Updated 5 years ago
- Compact high quality word embeddings for Russian language☆203Updated 2 years ago
- Простая модель расстановки запятых на основе BERT☆40Updated 5 years ago
- ☆57Updated last year
- Простой нормализатор текстов перед синтезом речи☆40Updated last year
- Foundational Model for Speech Recognition Tasks☆296Updated 2 months ago
- Russian GPT2 model☆59Updated 4 years ago
- Распознавание речи русского языка используя Tensorflow, обучаясь на базе Voxforge☆58Updated 3 years ago
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating fundament…☆62Updated 11 months ago
- Диалоговая система на базе FRED-T5☆37Updated 2 years ago
- Accentor and transcriptor for Russian language☆127Updated 3 years ago
- Rule-based token, sentence segmentation for Russian language☆273Updated 2 years ago
- Код для файнтюна LM (rugpt, LLaMa, FRED T5) средствами transformers + deepspeed + LoRa☆15Updated 2 years ago
- SAGE: Spelling correction, corruption and evaluation for multiple languages☆159Updated 9 months ago
- Проект для распознавания речи на русском языке на основе pykaldi.☆333Updated last year
- CLIP implementation for Russian language☆146Updated last year
- Augmentex — a library for augmenting texts with errors☆67Updated last year
- Training GPT-2 on a Russian language corpus☆87Updated 4 years ago
- Code and data of "Methods for Detoxification of Texts for the Russian Language" paper☆49Updated 6 months ago
- A Python wrapper for the RuWordNet thesaurus☆68Updated 10 months ago
- Train punctuation and capitalization models for different languages☆25Updated 3 years ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆45Updated 6 months ago