levyfan / sentencepiece-jniLinks
Java JNI wrapper for SentencePiece: unsupervised text tokenizer for Neural Network-based text generation.
☆38Updated 2 years ago
Alternatives and similar repositories for sentencepiece-jni
Users that are interested in sentencepiece-jni are comparing it to the libraries listed below
Sorting:
- Embedding Quantization (Compress Word Embeddings)☆85Updated 6 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 3 years ago
- Java port of c++ version of facebook fasttext☆15Updated 6 years ago
- Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)☆156Updated 6 years ago
- Flexible classic and NeurAl Retrieval Toolkit☆221Updated 6 months ago
- ☆22Updated 6 years ago
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines☆137Updated 2 years ago
- Standalone Neural Ranking Model (SNRM)☆76Updated 7 years ago
- Symphony Machine Translation☆38Updated 5 years ago
- LM Pretraining with PyTorch/TPU☆137Updated 6 years ago
- Language-agnostic BERT Sentence Embedding (LaBSE)☆152Updated 5 years ago
- A Corpus for Multilingual Document Classification in Eight Languages.☆152Updated 3 years ago
- PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset☆123Updated 6 years ago
- ☆12Updated 7 years ago
- Facebook's FastText for Java☆81Updated 7 years ago
- A novel method of constrained decoding for neural NLG (NNLG) models☆84Updated 5 years ago
- A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.☆96Updated 4 years ago
- ☆162Updated 5 years ago
- reference pytorch code for intent classification☆44Updated last year
- Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index (DenSPI)☆200Updated 2 years ago
- Implementation of pQRNN in PyTorch☆46Updated 4 years ago
- Decoding platform for machine translation research☆54Updated 6 years ago
- Code for "Unsupervised Multilingual Word Embedding with Limited Resources using Neural Language Models" and "Learning Contextualised Cros…☆31Updated 3 years ago
- ☆220Updated 5 years ago
- ICLR 2018 Quick-Thought vectors☆204Updated 6 years ago
- Fine-tuned Transformers compatible BERT models for Sequence Tagging☆40Updated 5 years ago
- Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)☆228Updated 4 years ago
- This repo includes extensions to the Stanford Dialogue Corpus. It contains crowd-sourced rewrites to facilitate research in dialogue stat…☆92Updated 6 years ago
- dstc7-noesis☆45Updated 6 years ago
- Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018☆123Updated 3 months ago