kootenpv / tokLinks
Fast and customizable tokenization
☆66Updated 6 years ago
Alternatives and similar repositories for tok
Users that are interested in tok are comparing it to the libraries listed below
Sorting:
- Find strings/words in text; convenience and C speed☆127Updated 3 years ago
- An easy to use open-source library for advanced Deep Learning and Natural Language Processing☆113Updated last year
- Lightning Fast Language Prediction 🚀☆167Updated 3 months ago
- Textpipe: clean and extract metadata from text☆302Updated 4 years ago
- A word2vec negative sampling implementation with correct CBOW update.☆261Updated 4 years ago
- A Lightweight NLP Data Loader for All Deep Learning Frameworks in Python☆181Updated last year
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- Code and data accompanying the paper "Approaching nested named entity recognition with parallel LSTM-CRFs."☆27Updated 2 years ago
- ALMa (Active Learning Manager) Keeps track of labeled and unlabeled data for active learning☆42Updated 5 years ago
- Segtok v2 is here: https://github.com/fnl/syntok -- A rule-based sentence segmenter (splitter) and a word tokenizer using orthographic fe…☆170Updated 3 years ago
- Enso: An Open Source Library for Benchmarking Embeddings + Transfer Learning Methods☆96Updated 4 years ago
- Text Mining and Topic Modeling Toolkit for Python with parallel processing power☆191Updated 2 years ago
- spaCy + UDPipe☆163Updated 3 years ago
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆51Updated 11 months ago
- Deep learning with text doesn't have to be scary.☆275Updated 2 years ago
- Abydos NLP/IR library for Python☆192Updated 3 years ago
- An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.☆86Updated 4 years ago
- A fast and memory-optimized string library for heavy-text manipulation in Python☆251Updated 5 years ago
- Custom Natural Language Processing with big and small models 🌲🌱☆66Updated 4 years ago
- Parse natural language time expressions in python☆131Updated 3 years ago
- Natural Language Data Augmentation Tool for Conversational Systems☆115Updated 2 years ago
- 🏖 Easy training and deployment of seq2seq models.☆228Updated 4 years ago
- allennlp + streamlit demo☆21Updated 6 years ago
- Text tokenization and sentence segmentation (segtok v2)☆207Updated 3 years ago
- ☆99Updated 5 years ago
- Hunspell extension for spaCy 2.0.☆94Updated last year
- A fully customisable language detection pipeline for spaCy☆93Updated 6 years ago
- Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings☆77Updated 3 years ago
- ☆30Updated 3 years ago
- NER, syntax markup visualizations☆140Updated 2 years ago