kootenpv / tok
Fast and customizable tokenization
☆64Updated 5 years ago
Alternatives and similar repositories for tok:
Users that are interested in tok are comparing it to the libraries listed below
- Find strings/words in text; convenience and C speed☆126Updated 2 years ago
- Textpipe: clean and extract metadata from text☆302Updated 3 years ago
- Lightning Fast Language Prediction 🚀☆166Updated 6 years ago
- ALMa (Active Learning Manager) Keeps track of labeled and unlabeled data for active learning☆41Updated 4 years ago
- A fast and memory-optimized string library for heavy-text manipulation in Python☆250Updated 4 years ago
- A Lightweight NLP Data Loader for All Deep Learning Frameworks in Python☆181Updated last year
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆51Updated 3 months ago
- An easy to use open-source library for advanced Deep Learning and Natural Language Processing☆112Updated 7 months ago
- numeric fused-head identification and resolution☆33Updated 5 years ago
- Code and data accompanying the paper "Approaching nested named entity recognition with parallel LSTM-CRFs."☆26Updated 2 years ago
- Example using Polyaxon to experiment with pre-training spaCy☆65Updated 3 years ago
- Enso: An Open Source Library for Benchmarking Embeddings + Transfer Learning Methods☆95Updated 4 years ago
- Official details for: [1803.08493] Context is Everything: Finding Meaning Statistically in Semantic Spaces☆39Updated 5 years ago
- A python module for word inflections designed for use with spaCy.☆92Updated 5 years ago
- allennlp + streamlit demo☆22Updated 5 years ago
- This repository contains code to replicate the no-longer publicly available Toronto BookCorpus dataset☆49Updated 2 years ago
- Jupyter extension to visualize dependency structures☆28Updated 6 years ago
- ☆70Updated 2 years ago
- spaCy + UDPipe☆161Updated 2 years ago
- Easy-to-use text representations extraction library based on the Transformers library.☆32Updated 2 years ago
- An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.☆86Updated 3 years ago
- A Domain Specific Language (DSL) for building language patterns. These can be later compiled into spaCy patterns, pure regex, or any othe…☆67Updated 2 years ago
- Polyglot skipgram embeddings, and their many health benefits☆12Updated 5 years ago
- A fully customisable language detection pipeline for spaCy☆92Updated 5 years ago
- Hunspell extension for spaCy 2.0.☆94Updated 7 months ago
- Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings☆77Updated 2 years ago
- Scripts as a service. Builds on systemd (for Linux)☆20Updated last year
- NER, syntax markup visualizations☆138Updated last year
- Python stream processing for humans☆185Updated last month
- Language detection extension for spaCy 2.0+☆112Updated 6 years ago