soshial / text-normalizationLinks
Python tool for normilizing text and text canonicalization (DISCONTINUED)
☆41Updated 11 years ago
Alternatives and similar repositories for text-normalization
Users that are interested in text-normalization are comparing it to the libraries listed below
Sorting:
- Normalizes lexically ill-formed text to its most likely clean text, e.g. "c u thr 2nite!" -> "see you there tonight!".☆63Updated 9 years ago
- An extremely simple Python wrapper for the SRI Language Modeling toolkit☆70Updated 10 years ago
- Fast supervised sentence boundary detection using the averaged perceptron☆90Updated 6 years ago
- Collects all tweets from the sample Public stream using Twitter's streaming API, and saves them to a file for later use as a corpus.☆45Updated 4 years ago
- SWIG Wrapper for the SRILM toolkit☆33Updated 4 years ago
- A program to correct non-word spelling error in sentences using ngram MAP Language Models, Noisy Channel Model, Error Confusion Matrix an…☆53Updated 5 years ago
- Fast Word Clustering Software☆78Updated 5 months ago
- A Python package to facilitate research on building and evaluating automated scoring models.☆68Updated 6 months ago
- ☆21Updated 10 years ago
- Deep-learning based sentence auto-segmentation from unstructured text w/o punctuation☆36Updated 8 years ago
- maximum entropy based part-of-speech tagger for NLTK☆45Updated 8 years ago
- Demonstration of the results in "Text Normalization using Memory Augmented Neural Networks", Authors: Subhojeet Pramanik, Aman Hussain☆60Updated 6 years ago
- WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…☆48Updated 3 years ago
- A scikit-learn style implementation of NBSVM☆17Updated 9 years ago
- LSTM Language Model with Subword Units Input Representations☆42Updated 4 years ago
- CS224S Course Project☆14Updated 11 years ago
- An LSTM RNN for restoring missing punctuation in unsegmented text.☆78Updated 8 years ago
- NLTK Contrib☆166Updated last year
- Tokenize English sentences using neural networks.☆63Updated 7 years ago
- Modularizing Unsupervised Sense Embedding☆29Updated 7 years ago
- Thot toolkit for statistical machine translation☆53Updated 2 years ago
- Query-Document Relevance☆42Updated 10 years ago
- A toolkit for producing n-gram language models. The highlights are the implementation of Kneser-Ney growing and revised Kneser pruning me…☆40Updated 10 months ago
- MIT Language Modeling Toolkit☆117Updated 5 years ago
- Labeled examples from wiki dumps in Python☆67Updated 8 years ago
- simple text preprocessing tool☆18Updated 8 years ago
- Unofficial implementation of the paper "Bag of Tricks for Efficient Text Classification" by Joulin et al.☆60Updated 8 years ago
- English text corrector by using deep neural networks in Pytorch☆47Updated 7 years ago
- Language modeling scripts based on TensorFlow☆58Updated 5 years ago
- TheanoLM is a recurrent neural network language modeling tool implemented using Theano☆81Updated last year