jonsafari / tok-tok
A fast, simple, multilingual tokenizer
☆29Updated 7 years ago
Alternatives and similar repositories for tok-tok:
Users that are interested in tok-tok are comparing it to the libraries listed below
- ☆21Updated 10 years ago
- Command-line corpus tools☆9Updated 7 years ago
- A web demo for visualizing Semafor parses☆30Updated 7 years ago
- Dependency parse tree visualization with D3 library.☆42Updated last year
- C++ implementation of Generalised Brown clustering and python scripts for feature generation☆41Updated 9 years ago
- Simple CORPORA list crawler☆10Updated 8 years ago
- A re-implementation of redpony/cdec's tokenize-anything.pl script in python☆8Updated 9 years ago
- A compound splitter based on the semantic regularities in the vector space of word embeddings.☆16Updated 8 years ago
- Hierarchical phrase-based machine translation system☆32Updated 10 years ago
- A model for unsupervised morphological analysis that integrates orthographic and semantic views of words.☆13Updated last year
- Search back-end for dependency tree search. See the docs at https://fginter.github.io/dep_search/☆17Updated 7 years ago
- Code for EMNLP 2016 paper: Morphological Priors for Probabilistic Word Embeddings☆52Updated 8 years ago
- Modularizing Unsupervised Sense Embedding☆29Updated 7 years ago
- Utility scripts in Python☆37Updated 8 months ago
- SMOR (Stuttgart Morphology) with alternative lemmatization component☆12Updated last year
- Implementation of a simple frame identification approach (SimpleFrameId) described in the paper "Out-of-domain FrameNet Semantic Role Lab…☆15Updated 8 years ago
- Code for morphological transformations☆29Updated 7 years ago
- A python wrapper for Semaphore, a Shallow Semantic Parser that identifies roles in a text.☆12Updated 11 years ago
- A web application tagging and retrieval of arguments in text☆28Updated last year
- Python evaluation scripts for AIDA-formatted CoNLL data☆20Updated 10 years ago
- ☆54Updated 9 years ago
- Fast Word Clustering Software☆78Updated 2 months ago
- Normalizes lexically ill-formed text to its most likely clean text, e.g. "c u thr 2nite!" -> "see you there tonight!".☆63Updated 9 years ago
- Easy language identification of 380 languages☆17Updated 5 years ago
- ☆15Updated 6 years ago
- Extractors whose input is a chunked sentence. Includes Relnoun, Nesty, and a scala interface for ReVerb.☆28Updated 7 years ago
- ☆43Updated 9 years ago
- Graph-based Dependency Parser☆46Updated 9 years ago
- Open-source tools for morphological tagging, segmentation and stemming.☆41Updated 5 years ago
- python interface for mate tools☆16Updated 7 years ago