VKCOM / YouTokenToMeLinks
Unsupervised text tokenizer focused on computational efficiency
☆975Updated last year
Alternatives and similar repositories for YouTokenToMe
Users that are interested in YouTokenToMe are comparing it to the libraries listed below
Sorting:
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,221Updated last year
- Tools for shrinking fastText models (in gensim format)☆181Updated last year
- A list of pretrained Transformer models for the Russian language.☆176Updated 5 years ago
- Fast BPE☆678Updated last year
- ☆36Updated 3 years ago
- Fast topic modeling platform☆672Updated 7 months ago
- ☆56Updated 7 years ago
- Models for automatic abstractive summarization☆174Updated 3 years ago
- Modern spell checking library - accurate, fast, multi-language☆657Updated last year
- Web-ify your word2vec: framework to serve distributional semantic models online☆204Updated 11 months ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆156Updated last year
- ☆86Updated 3 years ago
- Taking together Stanford cs224n course with support of iPavlov team.☆97Updated 6 years ago
- FastFormers - highly efficient transformer models for NLU☆709Updated 10 months ago
- Language-Agnostic SEntence Representations☆3,660Updated last year
- Rule-based token, sentence segmentation for Russian language☆276Updated 2 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆495Updated last year
- Russian RoBERTa☆29Updated 6 years ago
- Russian Corpus of Linguistic Acceptability☆47Updated last year
- Russian dialog datasets parsers and crawlers.☆15Updated 4 years ago
- LASER multilingual sentence embeddings as a pip package☆224Updated 2 years ago
- Links to Russian corpora + Python functions for loading and parsing☆309Updated 2 years ago
- Deep NLP Course☆631Updated 6 years ago
- A Russian data set for question answering over Wikidata☆49Updated 4 years ago
- BSNLP 2021☆33Updated last year
- Russian language models for spaCy☆241Updated 4 years ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,123Updated 3 years ago
- ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.☆589Updated 2 years ago
- jiant is an nlp toolkit☆1,675Updated 2 years ago
- AWD-LSTM language model trained on newspaper corpora with fast.ai☆27Updated 5 years ago