Alternatives and similar repositories for kenlm:

Users that are interested in kenlm are comparing it to the libraries listed below

• rsennrich / subword-nmt
  Unsupervised Word Segmentation for Neural Machine Translation and Text Generation
  ☆2,218Updated 6 months ago
• facebookresearch / SentEval
  A python tool for evaluating the quality of sentence embeddings.
  ☆2,093Updated 11 months ago
• google-research / electra
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆2,347Updated 10 months ago
• EdinburghNLP / nematus
  Open-Source Neural Machine Translation in Tensorflow
  ☆795Updated 2 years ago
• moses-smt / mosesdecoder
  Moses, the machine translation system
  ☆1,591Updated 2 weeks ago
• microsoft / MASS
  MASS: Masked Sequence to Sequence Pre-training for Language Generation
  ☆1,118Updated 2 years ago
• THUNLP-MT / THUMT
  An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group
  ☆705Updated 2 years ago
• facebookresearch / LASER
  Language-Agnostic SEntence Representations
  ☆3,617Updated 9 months ago
• bheinzerling / bpemb
  Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
  ☆1,194Updated 4 months ago
• facebookresearch / XLM
  PyTorch original implementation of Cross-lingual Language Model Pretraining.
  ☆2,900Updated 2 years ago
• OpenNMT / OpenNMT-tf
  Neural machine translation and sequence learning using TensorFlow
  ☆1,460Updated last year
• HIT-SCIR / ELMoForManyLangs
  Pre-trained ELMo Representations for Many Languages
  ☆1,462Updated 3 years ago
• OpenNMT / OpenNMT-py
  Open Source Neural Machine Translation and (Large) Language Models in PyTorch
  ☆6,827Updated last month
• nlpyang / BertSum
  Code for paper Fine-tune BERT for Extractive Summarization
  ☆1,476Updated 3 years ago
• facebookresearch / InferSent
  InferSent sentence embeddings
  ☆2,286Updated 3 years ago
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆744Updated 2 years ago
• utterworks / fast-bert
  Super easy library for BERT based NLP models
  ☆1,881Updated 6 months ago
• parlance / ctcdecode
  PyTorch CTC Decoder bindings
  ☆831Updated 10 months ago
• allenai / bilm-tf
  Tensorflow implementation of contextualized word representations from bi-directional language models
  ☆1,618Updated last year
• jiesutd / NCRFpp
  NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character …
  ☆1,892Updated 2 years ago
• PetrochukM / PyTorch-NLP
  Basic Utilities for PyTorch Natural Language Processing (NLP)
  ☆2,215Updated last year
• SeanNaren / deepspeech.pytorch
  Speech Recognition using DeepSpeech2.
  ☆2,113Updated 2 years ago
• nyu-mll / jiant
  jiant is an nlp toolkit
  ☆1,661Updated last year
• zihangdai / xlnet
  XLNet: Generalized Autoregressive Pretraining for Language Understanding
  ☆6,182Updated last year
• Jiakui / awesome-bert
  bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目
  ☆1,850Updated 3 years ago
• glample / fastBPE
  Fast BPE
  ☆662Updated 8 months ago
• makcedward / nlpaug
  Data augmentation for NLP
  ☆4,507Updated 7 months ago
• AtmaHou / Task-Oriented-Dialogue-Research-Progress-Survey
  A datasets and methods survey about task-oriented dialogue, including recent datasets and SOTA leaderboards.
  ☆1,245Updated 2 years ago
• namisan / mt-dnn
  Multi-Task Deep Neural Networks for Natural Language Understanding
  ☆2,245Updated 11 months ago
• facebookresearch / MUSE
  A library for Multilingual Unsupervised or Supervised word Embeddings
  ☆3,204Updated 2 years ago