Alternatives and similar repositories for kenlm:

Users that are interested in kenlm are comparing it to the libraries listed below

• rsennrich / subword-nmt
  Unsupervised Word Segmentation for Neural Machine Translation and Text Generation
  ☆2,229Updated 8 months ago
• facebookresearch / LASER
  Language-Agnostic SEntence Representations
  ☆3,632Updated 11 months ago
• bheinzerling / bpemb
  Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
  ☆1,211Updated 6 months ago
• facebookresearch / SentEval
  A python tool for evaluating the quality of sentence embeddings.
  ☆2,104Updated last year
• facebookresearch / XLM
  PyTorch original implementation of Cross-lingual Language Model Pretraining.
  ☆2,905Updated 2 years ago
• OpenNMT / OpenNMT-tf
  Neural machine translation and sequence learning using TensorFlow
  ☆1,469Updated last year
• facebookresearch / MUSE
  A library for Multilingual Unsupervised or Supervised word Embeddings
  ☆3,211Updated 2 years ago
• HIT-SCIR / ELMoForManyLangs
  Pre-trained ELMo Representations for Many Languages
  ☆1,461Updated 3 years ago
• zihangdai / xlnet
  XLNet: Generalized Autoregressive Pretraining for Language Understanding
  ☆6,187Updated last year
• facebookresearch / InferSent
  InferSent sentence embeddings
  ☆2,284Updated 3 years ago
• microsoft / MASS
  MASS: Masked Sequence to Sequence Pre-training for Language Generation
  ☆1,118Updated 2 years ago
• moses-smt / mosesdecoder
  Moses, the machine translation system
  ☆1,601Updated 2 weeks ago
• allenai / bilm-tf
  Tensorflow implementation of contextualized word representations from bi-directional language models
  ☆1,619Updated 2 years ago
• huggingface / neuralcoref
  ✨Fast Coreference Resolution in spaCy with Neural Networks
  ☆2,873Updated 2 years ago
• google-research / electra
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆2,351Updated last year
• makcedward / nlpaug
  Data augmentation for NLP
  ☆4,539Updated 9 months ago
• namisan / mt-dnn
  Multi-Task Deep Neural Networks for Natural Language Understanding
  ☆2,251Updated last year
• PetrochukM / PyTorch-NLP
  Basic Utilities for PyTorch Natural Language Processing (NLP)
  ☆2,222Updated last year
• Separius / awesome-sentence-embedding
  A curated list of pretrained sentence and word embedding models
  ☆2,258Updated 3 years ago
• nikitakit / self-attentive-parser
  High-accuracy NLP parser with models for 11 languages.
  ☆880Updated 3 years ago
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆751Updated 2 years ago
• mjpost / sacrebleu
  Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
  ☆1,121Updated last month
• syhw / wer_are_we
  Attempt at tracking states of the arts and recent results (bibliography) on speech recognition.
  ☆1,864Updated 2 years ago
• OpenNMT / OpenNMT-py
  Open Source Neural Machine Translation and (Large) Language Models in PyTorch
  ☆6,859Updated last month
• chakki-works / seqeval
  A Python framework for sequence labeling evaluation(named-entity recognition, pos tagging, etc...)
  ☆1,125Updated 7 months ago
• THUNLP-MT / THUMT
  An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group
  ☆709Updated 2 years ago
• jiesutd / NCRFpp
  NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character …
  ☆1,895Updated 2 years ago
• NTMC-Community / MatchZoo
  Facilitating the design, comparison and sharing of deep text matching models.
  ☆3,854Updated 8 months ago
• google-research / albert
  ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
  ☆3,268Updated 2 years ago
• allenai / allennlp
  An open-source NLP research library, built on PyTorch.
  ☆11,837Updated 2 years ago