soshial / text-normalization
Python tool for normilizing text and text canonicalization (DISCONTINUED)
☆41Updated 11 years ago
Related projects ⓘ
Alternatives and complementary repositories for text-normalization
- An extremely simple Python wrapper for the SRI Language Modeling toolkit☆70Updated 10 years ago
- Normalizes lexically ill-formed text to its most likely clean text, e.g. "c u thr 2nite!" -> "see you there tonight!".☆63Updated 9 years ago
- Links to data used in Sproat & Jaitly (https://arxiv.org/abs/1611.00068) experiments.☆76Updated 3 years ago
- simple text preprocessing tool☆18Updated 7 years ago
- LSTM Language Model with Subword Units Input Representations☆43Updated 3 years ago
- Code for EMNLP 2016 paper: Morphological Priors for Probabilistic Word Embeddings☆52Updated 7 years ago
- English text corrector by using deep neural networks in Pytorch☆47Updated 7 years ago
- ☆21Updated 9 years ago
- A program to correct non-word spelling error in sentences using ngram MAP Language Models, Noisy Channel Model, Error Confusion Matrix an…☆53Updated 4 years ago
- Demonstration of the results in "Text Normalization using Memory Augmented Neural Networks", Authors: Subhojeet Pramanik, Aman Hussain☆60Updated 5 years ago
- An LSTM RNN for restoring missing punctuation in unsegmented text.☆79Updated 8 years ago
- Pitman-Yor processes in python☆25Updated 10 years ago
- SWIG Wrapper for the SRILM toolkit☆33Updated 4 years ago
- Utility scripts in Python☆37Updated 3 months ago
- Code for morphological transformations☆29Updated 7 years ago
- Collects all tweets from the sample Public stream using Twitter's streaming API, and saves them to a file for later use as a corpus.☆46Updated 3 years ago
- Hadoop MapReduce training of modified Kneser-Ney smoothed language models☆30Updated 6 years ago
- Fast Word Clustering Software☆74Updated 3 months ago
- Fast supervised sentence boundary detection using the averaged perceptron☆90Updated 5 years ago
- Labeled examples from wiki dumps in Python☆68Updated 8 years ago
- ☆27Updated 7 years ago
- maximum entropy based part-of-speech tagger for NLTK☆45Updated 7 years ago
- A Python package to facilitate research on building and evaluating automated scoring models.☆66Updated last month
- An implementation of a HMM Ngram language model.☆11Updated 9 years ago
- ☆14Updated 8 years ago
- Python bindings for libwapiti☆66Updated 4 years ago
- Language modeling scripts based on TensorFlow☆59Updated 5 years ago
- RNNs for Text Normalization☆38Updated 6 years ago