VKCOM / YouTokenToMeLinks
Unsupervised text tokenizer focused on computational efficiency
☆973Updated last year
Alternatives and similar repositories for YouTokenToMe
Users that are interested in YouTokenToMe are comparing it to the libraries listed below
Sorting:
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,218Updated 11 months ago
- Modern spell checking library - accurate, fast, multi-language☆648Updated last year
- Fast BPE☆676Updated last year
- A list of pretrained Transformer models for the Russian language.☆174Updated 5 years ago
- Tools for shrinking fastText models (in gensim format)☆180Updated last year
- Fast topic modeling platform☆669Updated 3 months ago
- ☆36Updated 2 years ago
- Web-ify your word2vec: framework to serve distributional semantic models online☆201Updated 7 months ago
- ☆56Updated 7 years ago
- Language-Agnostic SEntence Representations☆3,645Updated last year
- Models for automatic abstractive summarization☆172Updated 3 years ago
- Deep NLP Course☆630Updated 6 years ago
- ☆84Updated 2 years ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆155Updated last year
- FastFormers - highly efficient transformer models for NLU☆707Updated 5 months ago
- Taking together Stanford cs224n course with support of iPavlov team.☆97Updated 6 years ago
- GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors☆510Updated 5 years ago
- ☆521Updated last year
- Rule-based token, sentence segmentation for Russian language☆271Updated 2 years ago
- Links to Russian corpora + Python functions for loading and parsing☆302Updated 2 years ago
- NLP course @ CS Faculty, HSE☆15Updated 5 years ago
- Super easy library for BERT based NLP models☆1,903Updated last year
- NeuSpell: A Neural Spelling Correction Toolkit☆696Updated 2 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,923Updated 2 years ago
- XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 ty…☆647Updated 2 years ago
- UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files☆386Updated last month
- Russian language models for spaCy☆240Updated 4 years ago
- 🔬 Очистка датасетов от мусора (нормализация, препроцессинг)☆40Updated 4 years ago
- 💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy☆739Updated last year
- AWD-LSTM language model trained on newspaper corpora with fast.ai☆27Updated 5 years ago