Alternatives and similar repositories for sentencepiece-jni

Users that are interested in sentencepiece-jni are comparing it to the libraries listed below

• alexa / alexa-dataset-contextual-query-rewrite
  This repo includes extensions to the Stanford Dialogue Corpus. It contains crowd-sourced rewrites to facilitate research in dialogue stat…
  ☆92Updated 6 years ago
• datquocnguyen / jPTDP
  Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)
  ☆156Updated 6 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆137Updated 6 years ago
• zphang / bert_on_stilts
  Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs
  ☆106Updated 3 years ago
• eaplatanios / symphony-mt
  Symphony Machine Translation
  ☆38Updated 5 years ago
• oaqa / FlexNeuART
  Flexible classic and NeurAl Retrieval Toolkit
  ☆221Updated 7 months ago
• ucam-smt / sgnmt
  Decoding platform for machine translation research
  ☆54Updated 6 years ago
• google-research-datasets / wiki-split
  One million English sentences, each split into two sentences that together preserve the original meaning, extracted from Wikipedia edits.
  ☆123Updated 6 years ago
• rdspring1 / PyTorch_GBW_LM
  PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset
  ☆123Updated 6 years ago
• OpenNMT / Hackathon
  Resources for the OpenNMT hackathon
  ☆51Updated 6 years ago
• alexa / bort
  Repository for the paper "Optimal Subarchitecture Extraction for BERT"
  ☆470Updated 3 years ago
• hamed-zamani / snrm
  Standalone Neural Ranking Model (SNRM)
  ☆76Updated 7 years ago
• kawine / usif
  Implementation of unsupervised smoothed inverse frequency (Best Paper, Repl4NLP @ ACL 2018)
  ☆79Updated 6 years ago
• seominjoon / denspi
  Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index (DenSPI)
  ☆200Updated 2 years ago
• facebookresearch / TreeNLG
  A novel method of constrained decoding for neural NLG (NNLG) models
  ☆84Updated 5 years ago
• sgraaf / Replicate-Toronto-BookCorpus
  This repository contains code to replicate the no-longer publicly available Toronto BookCorpus dataset
  ☆49Updated 3 years ago
• neulab / word-embeddings-for-nmt
  Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018
  ☆123Updated 4 months ago
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆310Updated 4 years ago
• zomux / neuralcompressor
  Embedding Quantization (Compress Word Embeddings)
  ☆85Updated 6 years ago
• DomHudson / bert-in-production
  A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.
  ☆96Updated 4 years ago
• lajanugen / S2V
  ICLR 2018 Quick-Thought vectors
  ☆204Updated 6 years ago
• sszuev / fastText_java
  Java port of c++ version of facebook fasttext
  ☆15Updated 6 years ago
• rubythonode / joint-many-task-model
  Multiple Different Natural Language Processing Tasks in a Single Deep Model
  ☆48Updated 7 years ago
• google-research-datasets / simulated-dialogue
  ☆228Updated 7 years ago
• perezjln / dstc6-goal-oriented-end-to-end
  Dialog State Tracking Challenge 6 (DSTC6)
  ☆54Updated 8 years ago
• nyu-dl / dl4ir-doc2query
  ☆162Updated 5 years ago
• OpenNMT / nmt-wizard-docker
  Dockerized NMT frameworks for nmt-wizard
  ☆39Updated 2 years ago
• microsoft / task_oriented_dialogue_as_dataflow_synthesis
  Code to reproduce experiments in the paper "Task-Oriented Dialogue as Dataflow Synthesis" (TACL 2020).
  ☆308Updated last year
• leondz / emerging_entities_17
  Dataset for the Emerging & Novel Entity NER task (WNUT '17)
  ☆112Updated 3 years ago
• linkfluence / fastText4j
  Facebook's FastText for Java
  ☆82Updated 7 years ago