kpu / kenlmLinks
KenLM: Faster and Smaller Language Model Queries
☆2,734Updated 10 months ago
Alternatives and similar repositories for kenlm
Users that are interested in kenlm are comparing it to the libraries listed below
Sorting:
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,263Updated last year
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,222Updated last year
- Moses, the machine translation system☆1,621Updated 10 months ago
- Language-Agnostic SEntence Representations☆3,657Updated last year
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,924Updated 2 years ago
- Neural machine translation and sequence learning using TensorFlow☆1,486Updated 2 years ago
- A python tool for evaluating the quality of sentence embeddings.☆2,106Updated last year
- Simple, fast unsupervised word aligner☆766Updated 3 years ago
- Pre-trained ELMo Representations for Many Languages☆1,460Updated 4 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,370Updated last year
- A library for Multilingual Unsupervised or Supervised word Embeddings☆3,236Updated 3 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,224Updated 3 weeks ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,123Updated 3 years ago
- NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character …☆1,896Updated 3 years ago
- Tensorflow implementation of contextualized word representations from bi-directional language models☆1,613Updated 2 years ago
- InferSent sentence embeddings☆2,278Updated 4 years ago
- An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group☆706Updated 3 years ago
- Fast BPE☆679Updated last year
- A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text☆684Updated 4 years ago
- Open-Source Neural Machine Translation in Tensorflow☆802Updated 3 years ago
- A datasets and methods survey about task-oriented dialogue, including recent datasets and SOTA leaderboards.☆1,244Updated 3 years ago
- A tool for extracting plain text from Wikipedia dumps☆3,967Updated last year
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,257Updated last year
- Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagg…☆949Updated last year
- High-accuracy NLP parser with models for 11 languages.☆903Updated 4 years ago
- A Python framework for sequence labeling evaluation(named-entity recognition, pos tagging, etc...)☆1,175Updated last year
- Fast Neural Machine Translation in C++☆1,418Updated 2 years ago
- ☆1,296Updated 3 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,175Updated 2 years ago
- Attempt at tracking states of the arts and recent results (bibliography) on speech recognition.☆1,868Updated 3 years ago