Alternatives and similar repositories for sentencepiece-jni:

Users that are interested in sentencepiece-jni are comparing it to the libraries listed below

• lovit / WordPieceModel
  Word Piece Model python light version with functions tokenize/save/load
  ☆66Updated 4 years ago
• kpu / preprocess
  Corpus preprocessing
  ☆95Updated last year
• clovaai / subword-qac
  Subword Language Model for Query Auto-Completion
  ☆66Updated 5 years ago
• perezjln / dstc6-goal-oriented-end-to-end
  Dialog State Tracking Challenge 6 (DSTC6)
  ☆54Updated 7 years ago
• transducens / LASERtrain
  ☆21Updated 5 years ago
• prajjwal1 / language-modelling
  LM, ULMFit et al.
  ☆46Updated 5 years ago
• datquocnguyen / jPTDP
  Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)
  ☆158Updated 5 years ago
• akzaidi / fine-lm
  Fine Tuning Language Models for Multilabel Prediction
  ☆61Updated 2 years ago
• rwsproat / text-normalization-data
  Links to data used in Sproat & Jaitly (https://arxiv.org/abs/1611.00068) experiments.
  ☆76Updated 3 years ago
• huggingface / bert-syntax
  Assessing syntactic abilities of BERT
  ☆39Updated 5 years ago
• hainan-xv / zipporah
  ☆42Updated 6 years ago
• dsindex / iclassifier
  reference pytorch code for intent classification
  ☆44Updated 5 months ago
• neulab / word-embeddings-for-nmt
  Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018
  ☆122Updated 4 years ago
• minwoo / TriCRF
  Triangular-chain CRF
  ☆25Updated 9 years ago
• dstc8-track2 / NOESIS-II
  Webpage for the DSTC8 - NOESIS II: Predicting Responses
  ☆48Updated 2 years ago
• DomHudson / bert-in-production
  A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.
  ☆96Updated 3 years ago
• jojonki / NLP-Corpora
  List of NLP (Natural Language Processing) Corpora.
  ☆64Updated 6 years ago
• sonos / spoken-language-understanding-research-datasets
  ☆49Updated 3 years ago
• lverwimp / tf-lm
  Language modeling scripts based on TensorFlow
  ☆58Updated 5 years ago
• sz128 / Natural-language-understanding-papers
  NLU: domain-intent-slot; text2SQL
  ☆75Updated 4 years ago
• ChenghaoMou / pytorch-pQRNN
  Implementation of pQRNN in PyTorch
  ☆46Updated 3 years ago
• jiali-ms / JLM
  A fast LSTM Language Model for large vocabulary language like Japanese and Chinese
  ☆109Updated 5 years ago
• alexa / alexa-dataset-contextual-query-rewrite
  This repo includes extensions to the Stanford Dialogue Corpus. It contains crowd-sourced rewrites to facilitate research in dialogue stat…
  ☆89Updated 5 years ago
• IBM / dstc-noesis
  dstc7-noesis
  ☆46Updated 5 years ago
• rdspring1 / PyTorch_GBW_LM
  PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset
  ☆123Updated 5 years ago
• neubig / rapid-adaptation
  Reproduction instructions for "Rapid Adaptation of Neural Machine Translation to New Languages"
  ☆40Updated 6 years ago
• seominjoon / piqa
  Phrase-Indexed Question Answering (PIQA)
  ☆94Updated 5 years ago
• jojonki / MultiWOZ-Parser
  A parser of the Multi-Domain Wizard-of-Oz dataset (MultiWOZ)
  ☆67Updated 6 years ago
• kawine / usif
  Implementation of unsupervised smoothed inverse frequency (Best Paper, Repl4NLP @ ACL 2018)
  ☆77Updated 5 years ago
• OpenNMT / Hackathon
  Resources for the OpenNMT hackathon
  ☆51Updated 5 years ago