jermp / tongrams_estimationLinks
A C++ library implementing fast language models estimation using the 1-Sort algorithm.
☆17Updated 2 years ago
Alternatives and similar repositories for tongrams_estimation
Users that are interested in tongrams_estimation are comparing it to the libraries listed below
Sorting:
- Utilities for manipulating finite state transducers with the OpenFst library.☆32Updated 8 years ago
- A C++ library providing fast language model queries in compressed space.☆132Updated 2 years ago
- finite-state toolkit, EM and Bayesian (Gibbs sampling) training for FST and context-free derivation forests☆41Updated 3 years ago
- Deep learning model of machine translation using attentional and structural biases☆13Updated 8 years ago
- An Efficient Language Model Using Double-Array Structures☆17Updated 5 years ago
- Supporting example for "A Rust SentencePiece implementation"☆20Updated 5 years ago
- A database of number names for 186 languages, locales, and scripts☆67Updated 2 years ago
- zero-vocab or low-vocab embeddings☆18Updated 3 years ago
- Highly concurrent and fast content processing for Mighty Inference Server☆10Updated 2 years ago
- Compute the most likely permutation of a lattice given an LM☆10Updated 12 years ago
- MozoLM: A language model (LM) serving library☆46Updated last month
- A framework for graph-based dependency parsing.☆17Updated 3 years ago
- A Translation Task using TurboTransformers☆11Updated 4 years ago
- Attentional Neural Network that translates text to phones.☆11Updated 7 years ago
- Code for the paper 'Weighting Finite State Transductions with Neural Context', Pushpendre Rastogi, Ryan Cotterell, Jason Eisner☆29Updated 6 years ago
- UniParse: A universal graph-based parsing toolkit☆10Updated 6 years ago
- A full-text error corrector for English based on transformers and deep learning☆10Updated 2 years ago
- ☆13Updated 5 years ago
- Unicode Standard tokenization routines and orthography profile segmentation☆38Updated 9 months ago
- Converter from UD-trees to BART representation☆36Updated last year
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆39Updated 2 months ago
- ☆28Updated 4 years ago
- Read-only unofficial mirror of OpenFst☆44Updated 3 years ago
- Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.☆50Updated 7 months ago
- PyTorch speech2text inference script for the NVidia openseq2seq wav2letter model variant☆10Updated 6 years ago
- Official details for: [1803.08493] Context is Everything: Finding Meaning Statistically in Semantic Spaces☆39Updated 6 years ago
- Deep learning spelling patterns with a recurrent neural network☆12Updated 8 years ago
- Implementation of Monte Carlo Word Movers Distance in Python with TensorFlow☆12Updated 9 years ago
- Rust library providing fast language model queries in compressed space☆25Updated 3 years ago
- ADS Project☆14Updated 9 years ago