kootenpv / tokLinks
Fast and customizable tokenization
β65Updated 6 years ago
Alternatives and similar repositories for tok
Users that are interested in tok are comparing it to the libraries listed below
Sorting:
- Find strings/words in text; convenience and C speedβ127Updated 2 years ago
- Lightning Fast Language Prediction πβ167Updated 6 years ago
- ALMa (Active Learning Manager) Keeps track of labeled and unlabeled data for active learningβ42Updated 5 years ago
- An easy to use open-source library for advanced Deep Learning and Natural Language Processingβ112Updated last year
- Textpipe: clean and extract metadata from textβ302Updated 4 years ago
- A Lightweight NLP Data Loader for All Deep Learning Frameworks in Pythonβ181Updated last year
- Text Mining and Topic Modeling Toolkit for Python with parallel processing powerβ190Updated 2 years ago
- A word2vec negative sampling implementation with correct CBOW update.β260Updated 3 years ago
- Deep learning with text doesn't have to be scary.β276Updated 2 years ago
- A python module for word inflections designed for use with spaCy.β92Updated 5 years ago
- β123Updated 2 years ago
- A fast and memory-optimized string library for heavy-text manipulation in Pythonβ250Updated 5 years ago
- Segtok v2 is here: https://github.com/fnl/syntok -- A rule-based sentence segmenter (splitter) and a word tokenizer using orthographic feβ¦β170Updated 3 years ago
- spaCy + UDPipeβ162Updated 3 years ago
- Enso: An Open Source Library for Benchmarking Embeddings + Transfer Learning Methodsβ95Updated 4 years ago
- Misspelling Oblivious Word Embeddingsβ201Updated 6 years ago
- Jupyter Widget for data annotationβ140Updated 2 years ago
- A Domain Specific Language (DSL) for building language patterns. These can be later compiled into spaCy patterns, pure regex, or any otheβ¦β68Updated 2 years ago
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and β¦β51Updated 8 months ago
- Code and data accompanying the paper "Approaching nested named entity recognition with parallel LSTM-CRFs."β27Updated 2 years ago
- β99Updated 5 years ago
- NER, syntax markup visualizationsβ139Updated 2 years ago
- Polyglot skipgram embeddings, and their many health benefitsβ12Updated 5 years ago
- Python stream processing for humansβ185Updated 6 months ago
- Abydos NLP/IR library for Pythonβ188Updated 2 years ago
- Create interactive textual heat maps for Jupiter notebooksβ196Updated last year
- Hunspell extension for spaCy 2.0.β94Updated last year
- β70Updated 2 years ago
- β30Updated 3 years ago
- Text tokenization and sentence segmentation (segtok v2)β205Updated 3 years ago