kootenpv / tok
Fast and customizable tokenization
☆64Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for tok
- Find strings/words in text; convenience and C speed☆126Updated 2 years ago
- ALMa (Active Learning Manager) Keeps track of labeled and unlabeled data for active learning☆42Updated 4 years ago
- Code and data accompanying the paper "Approaching nested named entity recognition with parallel LSTM-CRFs."☆26Updated last year
- Enso: An Open Source Library for Benchmarking Embeddings + Transfer Learning Methods☆96Updated 3 years ago
- An easy to use open-source library for advanced Deep Learning and Natural Language Processing☆112Updated 3 months ago
- A fast and memory-optimized string library for heavy-text manipulation in Python☆250Updated 4 years ago
- ☆70Updated last year
- Textpipe: clean and extract metadata from text☆300Updated 3 years ago
- A Lightweight NLP Data Loader for All Deep Learning Frameworks in Python☆180Updated 9 months ago
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆49Updated 4 years ago
- Lightning Fast Language Prediction 🚀☆165Updated 5 years ago
- scikit-learn wrappers for Python fastText.☆234Updated 2 years ago
- Easy-to-use text representations extraction library based on the Transformers library.☆32Updated 2 years ago
- allennlp + streamlit demo☆22Updated 5 years ago
- Example using Polyaxon to experiment with pre-training spaCy☆65Updated 3 years ago
- ☆29Updated 2 years ago
- Official details for: [1803.08493] Context is Everything: Finding Meaning Statistically in Semantic Spaces☆39Updated 5 years ago
- numeric fused-head identification and resolution☆33Updated 5 years ago
- Super lightweight function registries for your library☆173Updated 5 months ago
- ☆123Updated last year
- Use ML-Annotate to label data for machine learning purposes☆104Updated 4 years ago
- Python stream processing for humans☆184Updated 2 weeks ago
- Python search module for fast approximate string matching☆53Updated last year
- Text Mining and Topic Modeling Toolkit for Python with parallel processing power☆193Updated last year
- Learning BPE embeddings by first learning a segmentation model and then training word2vec☆19Updated last year
- Parse natural language time expressions in python☆131Updated last year
- interactive explorer for language models☆132Updated 2 years ago
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆22Updated last year