Alternatives and similar repositories for sentencepiece-jni

Users that are interested in sentencepiece-jni are comparing it to the libraries listed below

• zphang / bert_on_stilts
  Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs
  ☆106Updated 2 years ago
• neulab / word-embeddings-for-nmt
  Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018
  ☆124Updated 5 years ago
• bojone / labse
  Language-agnostic BERT Sentence Embedding (LaBSE)
  ☆153Updated 5 years ago
• kpu / preprocess
  Corpus preprocessing
  ☆99Updated last year
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆136Updated 5 years ago
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆309Updated 4 years ago
• OpenNMT / nmt-wizard-docker
  Dockerized NMT frameworks for nmt-wizard
  ☆39Updated 2 years ago
• datquocnguyen / jPTDP
  Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)
  ☆156Updated 6 years ago
• nyu-dl / bert-gen
  ☆324Updated 2 years ago
• ucam-smt / sgnmt
  Decoding platform for machine translation research
  ☆55Updated 6 years ago
• EdinburghNLP / opus-100-corpus
  ☆94Updated last year
• google-research-datasets / wiki-split
  One million English sentences, each split into two sentences that together preserve the original meaning, extracted from Wikipedia edits.
  ☆122Updated 6 years ago
• twadada / multilingual-nlm
  Code for "Unsupervised Multilingual Word Embedding with Limited Resources using Neural Language Models" and "Learning Contextualised Cros…
  ☆31Updated 2 years ago
• leondz / emerging_entities_17
  Dataset for the Emerging & Novel Entity NER task (WNUT '17)
  ☆111Updated 3 years ago
• moses-smt / mgiza
  A word alignment tool based on famous GIZA++, extended to support multi-threading, resume training and incremental training.
  ☆165Updated 4 years ago
• rdspring1 / PyTorch_GBW_LM
  PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset
  ☆123Updated 6 years ago
• soaxelbrooke / python-bpe
  Byte Pair Encoding for Python!
  ☆231Updated 3 years ago
• microsoft / MPNet
  MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf
  ☆292Updated 4 years ago
• sgraaf / Replicate-Toronto-BookCorpus
  This repository contains code to replicate the no-longer publicly available Toronto BookCorpus dataset
  ☆49Updated 3 years ago
• seominjoon / denspi
  Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index (DenSPI)
  ☆201Updated 2 years ago
• rubythonode / joint-many-task-model
  Multiple Different Natural Language Processing Tasks in a Single Deep Model
  ☆48Updated 6 years ago
• grammatical / neural-naacl2018
  Neural models and instructions on how to reproduce our results for our neural grammatical error correction systems from M. Junczys-Dowmun…
  ☆88Updated 6 years ago
• mtreviso / linear-chain-crf
  Implementation of a linear-chain CRF in PyTorch
  ☆97Updated 4 years ago
• JudeLee19 / HMNet-End-to-End-Abstractive-Summarization-for-Meetings
  "End-to-End Abstractive Summarization for Meetings" paper - Unofficial PyTorch Implementation
  ☆53Updated 2 years ago
• oaqa / FlexNeuART
  Flexible classic and NeurAl Retrieval Toolkit
  ☆220Updated 2 months ago
• facebookresearch / TreeNLG
  A novel method of constrained decoding for neural NLG (NNLG) models
  ☆84Updated 5 years ago
• facebookresearch / MLDoc
  A Corpus for Multilingual Document Classification in Eight Languages.
  ☆151Updated 3 years ago
• huntzhan / pytorch-fast-elmo
  A Fast ELMo Implementation. (NOT MAINTAIN ANYMORE)
  ☆38Updated 2 years ago
• neulab / xnmt
  eXtensible Neural Machine Translation
  ☆187Updated 5 years ago
• laiguokun / Funnel-Transformer
  ☆219Updated 5 years ago