mjansche / pynini
Read-only unofficial mirror of Pynini
☆16Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for pynini
- finite-state toolkit, EM and Bayesian (Gibbs sampling) training for FST and context-free derivation forests☆41Updated 2 years ago
- Simple, standalone python classes for training statistical language models using several popular smoothing methods.☆25Updated 12 years ago
- C++ implementation of Generalised Brown clustering and python scripts for feature generation☆41Updated 8 years ago
- ☆21Updated 9 years ago
- Fast Word Clustering Software☆74Updated 2 months ago
- Hierarchical phrase-based machine translation system☆32Updated 9 years ago
- A Python interface to OpenFst☆89Updated 5 years ago
- A compound splitter based on the semantic regularities in the vector space of word embeddings.☆16Updated 7 years ago
- ☆12Updated 8 years ago
- Offline extractor of synchronous context-free grammars for machine translation.☆31Updated 8 years ago
- LSTM Language Model with Subword Units Input Representations☆43Updated 3 years ago
- Open-source tools for morphological tagging, segmentation and stemming.☆41Updated 5 years ago
- SMOR (Stuttgart Morphology) with alternative lemmatization component☆12Updated last year
- Corpus preprocessing☆95Updated 7 months ago
- Self-contained Python package for OpenFst☆50Updated last year
- Utilities for manipulating finite state transducers with the OpenFst library.☆30Updated 7 years ago
- Sense Disambiguation of Connectives for PDTB-Style Discourse Parsing☆14Updated 7 years ago
- ☆27Updated 7 years ago
- A toolkit for producing n-gram language models. The highlights are the implementation of Kneser-Ney growing and revised Kneser pruning me…☆40Updated 2 months ago
- Links to data used in Sproat & Jaitly (https://arxiv.org/abs/1611.00068) experiments.☆76Updated 3 years ago
- Machine translation for the real world☆23Updated 4 years ago
- Code for morphological transformations☆29Updated 7 years ago
- A tool for automatic spelling normalization☆20Updated 3 years ago
- Symmetrized word alignment models, based on mgizapp and GIZA++☆15Updated 10 years ago
- Morfessor is a tool for unsupervised and semi-supervised morphological segmentation☆185Updated 4 years ago
- Hierarchical word clustering, following "Brown clustering" (Brown et al., 1992)☆69Updated 9 years ago
- Graph-based Dependency Parser☆46Updated 8 years ago
- Fork of http://nlg.isi.edu/software/nplm/ with some efficiency tweaks and adaptation for use in mosesdecoder.☆14Updated 9 years ago
- Zero-Resource Speech Discovery, Search, and Evaluation Tools☆29Updated 9 years ago
- Simple CORPORA list crawler☆10Updated 7 years ago