kpu / kenlmLinks
KenLM: Faster and Smaller Language Model Queries
☆2,702Updated 8 months ago
Alternatives and similar repositories for kenlm
Users that are interested in kenlm are comparing it to the libraries listed below
Sorting:
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,260Updated last year
- Moses, the machine translation system☆1,618Updated 8 months ago
- Neural machine translation and sequence learning using TensorFlow☆1,488Updated 2 years ago
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,217Updated last year
- Language-Agnostic SEntence Representations☆3,660Updated last year
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,921Updated 2 years ago
- Simple, fast unsupervised word aligner☆763Updated 3 years ago
- Fast Neural Machine Translation in C++☆1,406Updated 2 years ago
- A python tool for evaluating the quality of sentence embeddings.☆2,108Updated last year
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,203Updated last week
- A library for Multilingual Unsupervised or Supervised word Embeddings☆3,233Updated 3 years ago
- Open-Source Neural Machine Translation in Tensorflow☆803Updated 3 years ago
- Tensorflow implementation of contextualized word representations from bi-directional language models☆1,613Updated 2 years ago
- ☆1,291Updated 3 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,366Updated last year
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,122Updated 3 years ago
- Pre-trained ELMo Representations for Many Languages☆1,463Updated 4 years ago
- Open Source Neural Machine Translation and (Large) Language Models in PyTorch☆6,978Updated 2 months ago
- NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character …☆1,897Updated 3 years ago
- Fast BPE☆678Updated last year
- Speech Recognition using DeepSpeech2.☆2,136Updated 3 years ago
- A tool for extracting plain text from Wikipedia dumps☆3,957Updated last year
- An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group☆707Updated 3 years ago
- Code for the ACL 2017 paper "Get To The Point: Summarization with Pointer-Generator Networks"☆2,194Updated 3 years ago
- General purpose unsupervised sentence representations☆1,207Updated 3 years ago
- InferSent sentence embeddings☆2,279Updated 4 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,179Updated 2 years ago
- PyTorch CTC Decoder bindings☆854Updated last year
- Phrase-Based & Neural Unsupervised Machine Translation☆1,503Updated 4 years ago
- Basic Utilities for PyTorch Natural Language Processing (NLP)☆2,227Updated 2 years ago