jonsafari / tok-tokLinks
A fast, simple, multilingual tokenizer
☆29Updated 8 years ago
Alternatives and similar repositories for tok-tok
Users that are interested in tok-tok are comparing it to the libraries listed below
Sorting:
- Fast supervised sentence boundary detection using the averaged perceptron☆90Updated 6 years ago
- Fast Word Clustering Software☆78Updated 6 months ago
- Code for EMNLP 2016 paper: Morphological Priors for Probabilistic Word Embeddings☆53Updated 8 years ago
- C++ implementation of Generalised Brown clustering and python scripts for feature generation☆41Updated 9 years ago
- Dependency parse tree visualization with D3 library.☆43Updated 2 years ago
- Normalizes lexically ill-formed text to its most likely clean text, e.g. "c u thr 2nite!" -> "see you there tonight!".☆63Updated 9 years ago
- Open-source implementation of the BilBOWA (Bilingual Bag-of-Words without Alignments) word embedding model.☆69Updated 4 years ago
- Command-line corpus tools☆9Updated 8 years ago
- Distributed infrastructure for Machine Translation web services (using Moses, Python, JSON-RPC/web interface)☆34Updated 3 years ago
- A web demo for visualizing Semafor parses☆29Updated 7 years ago
- A compound splitter based on the semantic regularities in the vector space of word embeddings.☆16Updated 8 years ago
- Incremental learning of word embeddings with context informativeness.☆94Updated 2 years ago
- Easy language identification of 380 languages☆17Updated 5 years ago
- ☆21Updated 10 years ago
- A web application tagging and retrieval of arguments in text☆29Updated 2 years ago
- Graph-based Dependency Parser☆46Updated 9 years ago
- Non-distributional linguistic word vector representations.☆62Updated 7 years ago
- Code for morphological transformations☆29Updated 8 years ago
- Implicit relation extractor using a natural language model.☆24Updated 7 years ago
- Code accompanying our EMNLP paper Learning Language Representations for Typology Prediction☆71Updated 7 years ago
- framework for doing NER and other types of entity recognition, in Python☆68Updated 3 years ago
- A series of challenge problems for students learning about machine translation☆3Updated 5 years ago
- Open-source tools for morphological tagging, segmentation and stemming.☆40Updated 6 years ago
- Simple CORPORA list crawler☆10Updated 8 years ago
- ☆97Updated 4 years ago
- Thot toolkit for statistical machine translation☆53Updated 2 years ago
- Course on Language Technologies and NLP☆15Updated 8 years ago
- Socially-Equitable Language Identification☆78Updated 2 years ago
- ☆56Updated 10 years ago
- Bidirectional Long-Short Term Memory tagger (bi-LSTM) (in DyNet) -- hierarchical (with word and character embeddings)☆122Updated 2 years ago