Alternatives and similar repositories for kenlm:

Users that are interested in kenlm are comparing it to the libraries listed below

• rsennrich / subword-nmt
  Unsupervised Word Segmentation for Neural Machine Translation and Text Generation
  ☆2,227Updated 7 months ago
• facebookresearch / XLM
  PyTorch original implementation of Cross-lingual Language Model Pretraining.
  ☆2,903Updated 2 years ago
• facebookresearch / LASER
  Language-Agnostic SEntence Representations
  ☆3,629Updated 10 months ago
• facebookresearch / SentEval
  A python tool for evaluating the quality of sentence embeddings.
  ☆2,100Updated last year
• bheinzerling / bpemb
  Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
  ☆1,205Updated 5 months ago
• google-research / electra
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆2,350Updated last year
• microsoft / MASS
  MASS: Masked Sequence to Sequence Pre-training for Language Generation
  ☆1,117Updated 2 years ago
• zihangdai / xlnet
  XLNet: Generalized Autoregressive Pretraining for Language Understanding
  ☆6,183Updated last year
• OpenNMT / OpenNMT-tf
  Neural machine translation and sequence learning using TensorFlow
  ☆1,467Updated last year
• kimiyoung / transformer-xl
  ☆3,640Updated 2 years ago
• moses-smt / mosesdecoder
  Moses, the machine translation system
  ☆1,598Updated last month
• HIT-SCIR / ELMoForManyLangs
  Pre-trained ELMo Representations for Many Languages
  ☆1,461Updated 3 years ago
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆749Updated 2 years ago
• facebookresearch / MUSE
  A library for Multilingual Unsupervised or Supervised word Embeddings
  ☆3,210Updated 2 years ago
• EdinburghNLP / nematus
  Open-Source Neural Machine Translation in Tensorflow
  ☆797Updated 2 years ago
• nlpyang / BertSum
  Code for paper Fine-tune BERT for Extractive Summarization
  ☆1,481Updated 3 years ago
• attardi / wikiextractor
  A tool for extracting plain text from Wikipedia dumps
  ☆3,830Updated 10 months ago
• allenai / bilm-tf
  Tensorflow implementation of contextualized word representations from bi-directional language models
  ☆1,619Updated 2 years ago
• SeanNaren / deepspeech.pytorch
  Speech Recognition using DeepSpeech2.
  ☆2,114Updated 2 years ago
• OpenNMT / OpenNMT-py
  Open Source Neural Machine Translation and (Large) Language Models in PyTorch
  ☆6,850Updated 2 weeks ago
• mravanelli / pytorch-kaldi
  pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch,…
  ☆2,383Updated 3 years ago
• jiesutd / NCRFpp
  NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character …
  ☆1,895Updated 2 years ago
• PetrochukM / PyTorch-NLP
  Basic Utilities for PyTorch Natural Language Processing (NLP)
  ☆2,222Updated last year
• facebookresearch / InferSent
  InferSent sentence embeddings
  ☆2,284Updated 3 years ago
• abisee / pointer-generator
  Code for the ACL 2017 paper "Get To The Point: Summarization with Pointer-Generator Networks"
  ☆2,189Updated 2 years ago
• parlance / ctcdecode
  PyTorch CTC Decoder bindings
  ☆835Updated 11 months ago
• allenai / bi-att-flow
  Bi-directional Attention Flow (BiDAF) network is a multi-stage hierarchical process that represents context at different levels of granul…
  ☆1,536Updated last year
• google-research / albert
  ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
  ☆3,268Updated last year
• huggingface / neuralcoref
  ✨Fast Coreference Resolution in spaCy with Neural Networks
  ☆2,868Updated last year
• epfml / sent2vec
  General purpose unsupervised sentence representations
  ☆1,201Updated 2 years ago