VKCOM / YouTokenToMeLinks
Unsupervised text tokenizer focused on computational efficiency
☆972Updated last year
Alternatives and similar repositories for YouTokenToMe
Users that are interested in YouTokenToMe are comparing it to the libraries listed below
Sorting:
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,217Updated last year
- A list of pretrained Transformer models for the Russian language.☆176Updated 5 years ago
- Fast BPE☆678Updated last year
- Tools for shrinking fastText models (in gensim format)☆181Updated last year
- Modern spell checking library - accurate, fast, multi-language☆654Updated last year
- ☆36Updated 2 years ago
- Fast topic modeling platform☆671Updated 5 months ago
- Models for automatic abstractive summarization☆174Updated 3 years ago
- ☆56Updated 7 years ago
- Language-Agnostic SEntence Representations☆3,658Updated last year
- Web-ify your word2vec: framework to serve distributional semantic models online☆203Updated 9 months ago
- ☆84Updated 3 years ago
- Morphological analyzer for Russian and English languages based on neural networks and dictionary-lookup systems.☆156Updated last year
- FastFormers - highly efficient transformer models for NLU☆707Updated 8 months ago
- Taking together Stanford cs224n course with support of iPavlov team.☆97Updated 6 years ago
- Rule-based token, sentence segmentation for Russian language☆277Updated 2 years ago
- Deep NLP Course☆630Updated 6 years ago
- BSNLP 2021☆33Updated last year
- Links to Russian corpora + Python functions for loading and parsing☆308Updated 2 years ago
- LASER multilingual sentence embeddings as a pip package☆225Updated 2 years ago
- GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors☆515Updated 5 years ago
- Transformer language model (GPT-2) with sentencepiece tokenizer☆165Updated 4 years ago
- NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations☆786Updated last year
- ☆528Updated last year
- 🔬 Очистка датасетов от мусора (нормализация, препроцессинг)☆41Updated 4 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,193Updated 3 months ago
- Named Entity Recognition☆336Updated 2 years ago
- Russian RoBERTa☆29Updated 6 years ago
- UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files☆389Updated this week
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,117Updated 3 years ago