Alternatives and similar repositories for tokenizer

Users that are interested in tokenizer are comparing it to the libraries listed below

• ikekonglp / TweeboParser
  A Dependency Parser for Tweets
  ☆78Updated 5 years ago
• myleott / ark-twokenize-py
  Python port of the Twokenize class of ark-tweet-nlp
  ☆142Updated 7 years ago
• NLPrinceton / ALaCarte
  ☆103Updated 6 years ago
• GateNLP / broad_twitter_corpus
  The Broad Twitter Corpus, an NER dataset in English stratified for time, location, social media genre, socioeconomic factors (COLING 2016…
  ☆68Updated 3 years ago
• UCSM-DUE / IWG_hatespeech_public
  public repository of the interdisciplinary working group 'Hatespeech' of the research training group UCSM
  ☆17Updated 6 years ago
• Noahs-ARK / idea_relations
  A framework to identify relations between ideas in temporal text corpora.
  ☆28Updated 7 years ago
• vered1986 / Chirps
  A Large Automatically-Constructed Resource of Predicate Paraphrases
  ☆45Updated 5 years ago
• minimalparts / nonce2vec
  Incremental learning of word embeddings with context informativeness.
  ☆94Updated 2 years ago
• slanglab / phrasemachine
  Quickly extract multi-word phrases from a corpus
  ☆192Updated 5 years ago
• vecto-ai / vecto
  Doing things with embeddings
  ☆66Updated 2 years ago
• jacobeisenstein / SAGE
  Sparse Additive Generative Model of Text
  ☆87Updated 8 years ago
• jhlau / topic_interpretability
  Computation of the semantic interpretability of topics produced by topic models.
  ☆180Updated 8 years ago
• clips / hades
  Repository for the CLiPS HAte speech DEtection System [HADES].
  ☆24Updated 7 years ago
• vered1986 / PythonUtils
  Utility scripts in Python
  ☆37Updated last month
• williamleif / socialsent
  Code and data for inducing domain-specific sentiment lexicons.
  ☆196Updated last year
• vene / marseille
  Mining Argument Structures with Expressive Inference (Linear and LSTM Engines)
  ☆66Updated 8 years ago
• ddemszky / framing-twitter
  Code for the paper "Analyzing Polarization in Social Media: Method and Application to Tweets on 21 Mass Shootings"
  ☆69Updated 2 years ago
• adalmia96 / Cluster-Analysis
  ☆54Updated 3 years ago
• dirkhovy / MACE
  Multi-Annotator Competence Estimation tool
  ☆63Updated 6 years ago
• jaredks / tweetokenize
  Tokenization and pre-processing for Twitter data used to train classifiers.
  ☆72Updated 8 years ago
• jacobeisenstein / language-change-tutorial
  Tutorial on computational models of language change
  ☆115Updated 6 years ago
• Mrezvan94 / Harassment-Corpus
  Harassment Lexicon and Corpus
  ☆30Updated 7 years ago
• valedica / twec
  Training Temporal Word Embeddings with a Compass
  ☆64Updated 2 years ago
• jjessyli / speciteller
  Sentence specificity prediction
  ☆25Updated 6 years ago
• HKUST-KnowComp / MLMA_hate_speech
  Dataset and code of our EMNLP 2019 paper "Multilingual and Multi-Aspect Hate Speech Analysis"
  ☆57Updated 8 months ago
• dallascard / media_frames_corpus
  A set of media framing annotations, along with scripts for obtaining the corresponding news articles
  ☆52Updated 6 years ago
• yuvalpinter / Mimick
  Code for Mimicking Word Embeddings using Subword RNNs (EMNLP 2017)
  ☆153Updated 5 years ago
• sean-chester / generalised-brown
  C++ implementation of Generalised Brown clustering and python scripts for feature generation
  ☆41Updated 9 years ago
• dbamman / geoSGLM
  Code for learning geographically-informed word embeddings
  ☆22Updated 3 years ago
• epfl-dlab / quootstrap
  Unsupervised method for extracting quotation-speaker pairs from large news corpora.
  ☆29Updated 7 years ago