vsiivola / variKN
A toolkit for producing n-gram language models. The highlights are the implementation of Kneser-Ney growing and revised Kneser pruning methods.
☆40Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for variKN
- Python library for n-gram models in ARPA format☆40Updated last year
- Self-contained Python package for OpenFst☆50Updated last year
- This repository contains data used in the NAACL 2021 Paper - Proteno: Text Normalization with Limited Data for Fast Deployment in Text to…☆42Updated 3 years ago
- SIGMORPHON 2020 Shared Task: Grapheme-to-Phoneme, Unsupervised Induction of Morphology, and Typologically Diverse Morphological Inflectio…☆35Updated 3 years ago
- The Fisher and CALLHOME Spanish–English Speech Translation Corpus☆38Updated 2 years ago
- Links to data used in Sproat & Jaitly (https://arxiv.org/abs/1611.00068) experiments.☆76Updated 3 years ago
- Kaldi style neural network training in pytorch for use in place of nnet3 in Kaldi.☆26Updated 3 months ago
- phone inventory library☆15Updated last year
- Covering grammars for English and Russian text normalization☆60Updated 5 years ago
- Large scale (>200h) and publicly available read audio book corpus. This corpus is an augmentation of LibriSpeech ASR Corpus (1000h) and c…☆43Updated 2 years ago
- Bi-directional Lattice Recurrent Neural Networks for Confidence Estimation☆16Updated 4 years ago
- Unicode Standard tokenization routines and orthography profile segmentation☆33Updated 2 years ago
- An adaptation of Fairseq to (End-to-end) speech translation.☆22Updated 2 years ago
- ☆56Updated last year
- Repository for sharing the data in the Tamasheq language, one of the target languages for the low-resource speech translation track at IW…☆15Updated last year
- ☆32Updated 2 months ago
- Labeled data for homograph disambiguation☆53Updated last year
- Convert words to numbers☆20Updated 2 years ago
- Grapheme to phoneme model for PyTorch☆40Updated 2 years ago
- Source code for ASRU 2019 paper "Adapting Pretrained Transformer to Lattices for Spoken Language Understanding"☆11Updated 4 years ago
- ☆22Updated 2 years ago
- Training an n-gram based Language Model using KenLM toolkit for Deep Speech 2☆112Updated 5 years ago
- readers that enable reading kaldi ark in tensorflow☆17Updated 6 years ago
- ☆77Updated last year
- XenC: open-source data selection tool for NLP☆60Updated 8 years ago
- Support tools for punctuation and boundary detection for ASR output.☆57Updated last year
- Deep Learning systems for training and testing disfluency detection and related tasks on speech data.☆57Updated 5 years ago
- RNNs for Text Normalization☆38Updated 6 years ago
- Read-only mirror of Pynini☆122Updated 4 months ago
- A bunch of scripts exploiting several tools to perform inverse text normalization (ITN)☆21Updated 7 years ago