levyfan / sentencepiece-jniLinks
Java JNI wrapper for SentencePiece: unsupervised text tokenizer for Neural Network-based text generation.
☆38Updated 2 years ago
Alternatives and similar repositories for sentencepiece-jni
Users that are interested in sentencepiece-jni are comparing it to the libraries listed below
Sorting:
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 3 years ago
- Short Text Similarity as described in https://dl.acm.org/citation.cfm?id=2806475☆17Updated 6 years ago
- LM Pretraining with PyTorch/TPU☆137Updated 6 years ago
- A novel method of constrained decoding for neural NLG (NNLG) models☆84Updated 5 years ago
- Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)☆156Updated 6 years ago
- Resources for the OpenNMT hackathon☆51Updated 6 years ago
- This repo includes extensions to the Stanford Dialogue Corpus. It contains crowd-sourced rewrites to facilitate research in dialogue stat…☆92Updated 6 years ago
- Symphony Machine Translation☆38Updated 5 years ago
- Java port of c++ version of facebook fasttext☆15Updated 6 years ago
- This is an implementation of electra according to the paper {ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators…☆13Updated 5 years ago
- Dataset for the Emerging & Novel Entity NER task (WNUT '17)☆112Updated 3 years ago
- Subword Language Model for Query Auto-Completion☆67Updated 6 years ago
- ☆219Updated 5 years ago
- Embedding Quantization (Compress Word Embeddings)☆85Updated 6 years ago
- A word alignment tool based on famous GIZA++, extended to support multi-threading, resume training and incremental training.☆165Updated 4 years ago
- Corpus preprocessing☆99Updated last year
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Updated 7 years ago
- Neural macine translation soft alignment visualisations for web and command line☆72Updated 4 years ago
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines☆137Updated 2 years ago
- Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018☆123Updated 2 months ago
- Phrase-Indexed Question Answering (PIQA)☆94Updated 6 years ago
- dstc7-noesis☆45Updated 6 years ago
- ☆42Updated 7 years ago
- Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index (DenSPI)☆200Updated 2 years ago
- Language-agnostic BERT Sentence Embedding (LaBSE)☆153Updated 5 years ago
- A Corpus for Multilingual Document Classification in Eight Languages.☆152Updated 3 years ago
- Code for "Unsupervised Multilingual Word Embedding with Limited Resources using Neural Language Models" and "Learning Contextualised Cros…☆31Updated 3 years ago
- Neural models and instructions on how to reproduce our results for our neural grammatical error correction systems from M. Junczys-Dowmun…☆88Updated 6 years ago
- A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.☆96Updated 4 years ago
- ☆22Updated 5 years ago