Alternatives and similar repositories for tok

Users that are interested in tok are comparing it to the libraries listed below

• applicaai / poleval-2018
  Code and data accompanying the paper "Approaching nested named entity recognition with parallel LSTM-CRFs."
  ☆26Updated 2 years ago
• kootenpv / textsearch
  Find strings/words in text; convenience and C speed
  ☆126Updated 2 years ago
• hiredscorelabs / tamnun-ml
  An easy to use open-source library for advanced Deep Learning and Natural Language Processing
  ☆112Updated 11 months ago
• LightTag / ALMa
  ALMa (Active Learning Manager) Keeps track of labeled and unlabeled data for active learning
  ☆41Updated 5 years ago
• btwael / superstring.py
  A fast and memory-optimized string library for heavy-text manipulation in Python
  ☆250Updated 5 years ago
• indix / whatthelang
  Lightning Fast Language Prediction 🚀
  ☆167Updated 6 years ago
• pmbaumgartner / spacy-setfit-textcat
  ☆30Updated 3 years ago
• omegaml / minibatch
  Python stream processing for humans
  ☆185Updated 4 months ago
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆92Updated 5 years ago
• yanaiela / num_fh
  numeric fused-head identification and resolution
  ☆33Updated 5 years ago
• textpipe / textpipe
  Textpipe: clean and extract metadata from text
  ☆302Updated 4 years ago
• tofunlp / lineflow
  A Lightweight NLP Data Loader for All Deep Learning Frameworks in Python
  ☆181Updated last year
• IndicoDataSolutions / Enso
  Enso: An Open Source Library for Benchmarking Embeddings + Transfer Learning Methods
  ☆95Updated 4 years ago
• natasha / ipymarkup
  NER, syntax markup visualizations
  ☆139Updated last year
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated 6 months ago
• ezelikman / Context-Is-Everything
  Official details for: [1803.08493] Context is Everything: Finding Meaning Statistically in Semantic Spaces
  ☆39Updated 5 years ago
• babylonhealth / hmrb
  ☆70Updated 2 years ago
• fnl / segtok
  Segtok v2 is here: https://github.com/fnl/syntok -- A rule-based sentence segmenter (splitter) and a word tokenizer using orthographic fe…
  ☆170Updated 3 years ago
• HazyResearch / epoxy
  Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings
  ☆77Updated 2 years ago
• sgraaf / Replicate-Toronto-BookCorpus
  This repository contains code to replicate the no-longer publicly available Toronto BookCorpus dataset
  ☆49Updated 3 years ago
• TakeLab / spacy-udpipe
  spaCy + UDPipe
  ☆161Updated 3 years ago
• honnibal / spacy-pretrain-polyaxon
  Example using Polyaxon to experiment with pre-training spaCy
  ☆65Updated 3 years ago
• hiredscorelabs / seqtolang
  Multi-Langauge Identification
  ☆28Updated 11 months ago
• facebookresearch / moe
  Misspelling Oblivious Word Embeddings
  ☆201Updated 5 years ago
• ddelange / retrie
  Efficient Trie-based regex unions for blacklist/whitelist filtering and one-pass mapping-based string replacing
  ☆73Updated last month
• argilla-io / biome-text
  Custom Natural Language Processing with big and small models 🌲🌱
  ☆68Updated 3 years ago
• stephantul / piecelearn
  Learning BPE embeddings by first learning a segmentation model and then training word2vec
  ☆19Updated 2 years ago
• stephantul / reach
  Load embeddings and featurize your sentences.
  ☆30Updated 8 months ago
• bloomberg / koan
  A word2vec negative sampling implementation with correct CBOW update.
  ☆261Updated 3 years ago
• Abhijit-2592 / spacy-langdetect
  A fully customisable language detection pipeline for spaCy
  ☆93Updated 6 years ago