Alternatives and similar repositories for tokenizer

Users that are interested in tokenizer are comparing it to the libraries listed below

• ikekonglp / TweeboParser
  A Dependency Parser for Tweets
  ☆78Updated 6 years ago
• myleott / ark-twokenize-py
  Python port of the Twokenize class of ark-tweet-nlp
  ☆142Updated 7 years ago
• Noahs-ARK / idea_relations
  A framework to identify relations between ideas in temporal text corpora.
  ☆28Updated 7 years ago
• slanglab / phrasemachine
  Quickly extract multi-word phrases from a corpus
  ☆194Updated 5 years ago
• jacobeisenstein / SAGE
  Sparse Additive Generative Model of Text
  ☆87Updated 9 years ago
• UCSM-DUE / IWG_hatespeech_public
  public repository of the interdisciplinary working group 'Hatespeech' of the research training group UCSM
  ☆17Updated 6 years ago
• NLPrinceton / ALaCarte
  ☆105Updated 7 years ago
• jhlau / topic_interpretability
  Computation of the semantic interpretability of topics produced by topic models.
  ☆179Updated 8 years ago
• sean-chester / generalised-brown
  C++ implementation of Generalised Brown clustering and python scripts for feature generation
  ☆41Updated 9 years ago
• williamleif / socialsent
  Code and data for inducing domain-specific sentiment lexicons.
  ☆196Updated last year
• GateNLP / broad_twitter_corpus
  The Broad Twitter Corpus, an NER dataset in English stratified for time, location, social media genre, socioeconomic factors (COLING 2016…
  ☆68Updated 3 years ago
• minimalparts / nonce2vec
  Incremental learning of word embeddings with context informativeness.
  ☆94Updated 2 years ago
• GateNLP / semeval2019-hyperpartisan-bertha-von-suttner
  SemEval 2019 Hyperpartisan News Detection - team Bertha von Suttner contribution
  ☆23Updated 6 years ago
• vene / marseille
  Mining Argument Structures with Expressive Inference (Linear and LSTM Engines)
  ☆67Updated 8 years ago
• jac2130 / semaphore-python
  A python wrapper for Semaphore, a Shallow Semantic Parser that identifies roles in a text.
  ☆12Updated 12 years ago
• vered1986 / Chirps
  A Large Automatically-Constructed Resource of Predicate Paraphrases
  ☆45Updated 5 years ago
• epfl-dlab / quootstrap
  Unsupervised method for extracting quotation-speaker pairs from large news corpora.
  ☆29Updated 7 years ago
• davidjurgens / equilid
  Socially-Equitable Language Identification
  ☆78Updated 2 years ago
• napsternxg / TwitterNER
  Twitter named entity extraction for WNUT 2016 http://noisy-text.github.io/2016/ner-shared-task.html
  ☆140Updated 3 years ago
• vered1986 / PythonUtils
  Utility scripts in Python
  ☆37Updated 5 months ago
• dirkhovy / MACE
  Multi-Annotator Competence Estimation tool
  ☆63Updated 6 years ago
• vered1986 / LexNET
  LexNET: Integrated Path-based and Distributional Method for Lexical Semantic Relation Classification
  ☆62Updated 7 years ago
• xiaohan2012 / chowmein
  Automatic labeling for topic model
  ☆57Updated 10 years ago
• harkous / embeddingsviz
  Visualize word embeddings of a vocabulary in TensorBoard, including the neighbors
  ☆46Updated 8 years ago
• uhh-lt / sensegram
  Making sense embedding out of word embeddings using graph-based word sense induction
  ☆213Updated 4 years ago
• felipebravom / AffectiveTweets
  A WEKA package for analyzing emotion and sentiment of tweets.
  ☆81Updated 5 months ago
• mfaruqui / non-distributional
  Non-distributional linguistic word vector representations.
  ☆62Updated 8 years ago
• ewulczyn / wiki-detox
  See https://meta.wikimedia.org/wiki/Research:Modeling_Talk_Page_Abuse
  ☆150Updated 5 years ago
• cslu-nlp / DetectorMorse
  Fast supervised sentence boundary detection using the averaged perceptron
  ☆91Updated 6 years ago
• tca19 / dict2vec
  Dict2vec is a framework to learn word embeddings using lexical dictionaries.
  ☆116Updated 4 years ago