mjansche / pynini
Read-only unofficial mirror of Pynini
☆17Updated 5 years ago
Alternatives and similar repositories for pynini:
Users that are interested in pynini are comparing it to the libraries listed below
- finite-state toolkit, EM and Bayesian (Gibbs sampling) training for FST and context-free derivation forests☆41Updated 2 years ago
- C++ implementation of Generalised Brown clustering and python scripts for feature generation☆41Updated 8 years ago
- A Python interface to OpenFst☆89Updated 5 years ago
- ☆12Updated 9 years ago
- Morfessor is a tool for unsupervised and semi-supervised morphological segmentation☆189Updated 4 years ago
- Hierarchical phrase-based machine translation system☆32Updated 10 years ago
- Python library for n-gram models in ARPA format☆40Updated 2 years ago
- Simple, standalone python classes for training statistical language models using several popular smoothing methods.☆25Updated 12 years ago
- Python framework for processing Universal Dependencies data☆55Updated 2 weeks ago
- SMOR (Stuttgart Morphology) with alternative lemmatization component☆12Updated last year
- A compound splitter based on the semantic regularities in the vector space of word embeddings.☆16Updated 7 years ago
- ☆21Updated 9 years ago
- Fast Word Clustering Software☆78Updated 2 weeks ago
- Offline extractor of synchronous context-free grammars for machine translation.☆31Updated 9 years ago
- Hadoop-based tool for extraction of large scale synchronous grammars for paraphrasing and machine translation☆15Updated 8 years ago
- bin files☆13Updated 3 weeks ago
- Open-source tools for morphological tagging, segmentation and stemming.☆41Updated 5 years ago
- Corpus preprocessing☆95Updated 11 months ago
- Tools for extracting parallel corpora from article titles across languages in Wikipedia☆72Updated 9 years ago
- A Python package to facilitate research on building and evaluating automated scoring models.☆67Updated last month
- A toolkit for producing n-gram language models. The highlights are the implementation of Kneser-Ney growing and revised Kneser pruning me…☆40Updated 5 months ago
- Appraise evaluation system for manual evaluation of machine translation output☆74Updated 3 years ago
- Code for morphological transformations☆29Updated 7 years ago
- Utilities for manipulating finite state transducers with the OpenFst library.☆30Updated 7 years ago
- ☆23Updated 7 years ago
- Featurize words into orthographic and phonological vectors.☆40Updated last year
- Search back-end for dependency tree search. See the docs at https://fginter.github.io/dep_search/☆17Updated 6 years ago
- Microsoft Speech Language Translation (MSLT) Corpus☆19Updated 7 years ago
- Unicode Standard tokenization routines and orthography profile segmentation☆35Updated this week
- FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…☆111Updated 3 weeks ago