Alternatives and similar repositories for tokenizer

Users that are interested in tokenizer are comparing it to the libraries listed below

• ikekonglp / TweeboParser
  A Dependency Parser for Tweets
  ☆78Updated 5 years ago
• jjessyli / speciteller
  Sentence specificity prediction
  ☆25Updated 6 years ago
• sean-chester / generalised-brown
  C++ implementation of Generalised Brown clustering and python scripts for feature generation
  ☆41Updated 9 years ago
• tdszyman / twapy
  Temporal Word Analogies in Python
  ☆18Updated 7 years ago
• Noahs-ARK / idea_relations
  A framework to identify relations between ideas in temporal text corpora.
  ☆28Updated 7 years ago
• NLPrinceton / ALaCarte
  ☆104Updated 6 years ago
• epfl-dlab / Cr5
  Code and data for the WSDM '19 paper "Crosslingual Document Embedding as Reduced-Rank Ridge Regression (Cr5)"
  ☆30Updated 5 years ago
• UCSM-DUE / IWG_hatespeech_public
  public repository of the interdisciplinary working group 'Hatespeech' of the research training group UCSM
  ☆17Updated 6 years ago
• mlukasik / rumour-classification
  Code to reproduce experiments from the EMNLP 2015 paper about Rumour Stance Classification with Gaussian Processes.
  ☆37Updated 9 years ago
• xiaohan2012 / chowmein
  Automatic labeling for topic model
  ☆57Updated 9 years ago
• boudinfl / sume
  Sume is an implementation of the concept-based ILP model for summarization.
  ☆37Updated 6 years ago
• myleott / ark-twokenize-py
  Python port of the Twokenize class of ark-tweet-nlp
  ☆142Updated 7 years ago
• jacobeisenstein / SAGE
  Sparse Additive Generative Model of Text
  ☆87Updated 8 years ago
• marcocor / bat-framework
  A framework to compare entity linking systems.
  ☆37Updated 6 years ago
• spinningbytes / deep-mlsa
  Code for WWW 2017 conference paper "Leveraging large amounts of weakly supervised data for multi-language sentiment classification"
  ☆36Updated 6 years ago
• ahoho / SentiVAE
  ☆16Updated 6 years ago
• valedica / twec
  Training Temporal Word Embeddings with a Compass
  ☆64Updated 2 years ago
• minimalparts / nonce2vec
  Incremental learning of word embeddings with context informativeness.
  ☆94Updated last year
• GateNLP / broad_twitter_corpus
  The Broad Twitter Corpus, an NER dataset in English stratified for time, location, social media genre, socioeconomic factors (COLING 2016…
  ☆68Updated 3 years ago
• vered1986 / LexNET
  LexNET: Integrated Path-based and Distributional Method for Lexical Semantic Relation Classification
  ☆62Updated 6 years ago
• nmrksic / attract-repel
  The Attract-Repel algorithm presented in (Mrkšić et al., TACL 2017), with accompanying resources.
  ☆63Updated 7 years ago
• notnews / nytimes-corpus-extractor
  Extract all the fields from the NY Times Corpus to a csv
  ☆27Updated 2 years ago
• mfaruqui / crosslingual-cca
  ☆56Updated 6 years ago
• vered1986 / Chirps
  A Large Automatically-Constructed Resource of Predicate Paraphrases
  ☆45Updated 5 years ago
• sronnqvist / doc2topic
  Neural topic modeling
  ☆29Updated 4 years ago
• vered1986 / PythonUtils
  Utility scripts in Python
  ☆37Updated 9 months ago
• krzysiekfonal / grammaregex
  Regex like pattern tree matching but on sentence's tree instead of Strings
  ☆42Updated 7 years ago
• azpoliak / eco
  Code and data related to "Efficient, Compositional, Order-Sensitive n-gram Embeddings" (EACL 2017)
  ☆14Updated 8 years ago
• rpryzant / deconfounded_lexicon_induction
  ☆21Updated 2 years ago
• dirkhovy / MACE
  Multi-Annotator Competence Estimation tool
  ☆63Updated 5 years ago