VKCOM / YouTokenToMeLinks
Unsupervised text tokenizer focused on computational efficiency
☆971Updated last year
Alternatives and similar repositories for YouTokenToMe
Users that are interested in YouTokenToMe are comparing it to the libraries listed below
Sorting:
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,216Updated last year
- Tools for shrinking fastText models (in gensim format)☆179Updated last year
- A list of pretrained Transformer models for the Russian language.☆174Updated 5 years ago
- ☆36Updated 2 years ago
- Modern spell checking library - accurate, fast, multi-language☆648Updated last year
- Fast BPE☆677Updated last year
- Fast topic modeling platform☆669Updated 3 months ago
- Web-ify your word2vec: framework to serve distributional semantic models online☆202Updated 7 months ago
- Models for automatic abstractive summarization☆173Updated 3 years ago
- ☆56Updated 7 years ago
- ☆84Updated 2 years ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆155Updated last year
- FastFormers - highly efficient transformer models for NLU☆707Updated 6 months ago
- Rule-based token, sentence segmentation for Russian language☆273Updated 2 years ago
- Language-Agnostic SEntence Representations☆3,647Updated last year
- Taking together Stanford cs224n course with support of iPavlov team.☆97Updated 6 years ago
- LASER multilingual sentence embeddings as a pip package☆224Updated 2 years ago
- BSNLP 2021☆33Updated 11 months ago
- Python port of Moses tokenizer, truecaser and normalizer☆495Updated last year
- Deep NLP Course☆631Updated 6 years ago
- Links to Russian corpora + Python functions for loading and parsing☆307Updated 2 years ago
- NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations☆787Updated last year
- A fast, efficient universal vector embedding utility package.☆1,653Updated 2 years ago
- Transformer language model (GPT-2) with sentencepiece tokenizer☆165Updated 4 years ago
- ☆522Updated last year
- Russian RoBERTa☆29Updated 5 years ago
- Shared BERT model for 4 languages of Bulgarian, Czech, Polish and Russian. Slavic NER model.☆76Updated 3 years ago
- NBoost is a scalable, search-api-boosting platform for deploying transformer models to improve the relevance of search results on differe…☆675Updated 5 years ago
- GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors☆512Updated 5 years ago
- A python tool for evaluating the quality of sentence embeddings.☆2,108Updated last year