levyfan / sentencepiece-jni
Java JNI wrapper for SentencePiece: unsupervised text tokenizer for Neural Network-based text generation.
☆37Updated 2 years ago
Alternatives and similar repositories for sentencepiece-jni:
Users that are interested in sentencepiece-jni are comparing it to the libraries listed below
- Subword Language Model for Query Auto-Completion☆66Updated 5 years ago
- ☆21Updated 5 years ago
- Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)☆158Updated 5 years ago
- Phrase-Indexed Question Answering (PIQA)☆94Updated 5 years ago
- Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018☆121Updated 4 years ago
- Corpus preprocessing☆95Updated 11 months ago
- Symphony Machine Translation☆37Updated 4 years ago
- Decoding platform for machine translation research☆54Updated 5 years ago
- Word Piece Model python light version with functions tokenize/save/load☆67Updated 4 years ago
- This project attempts to maintain the SOTA performance in machine translation☆108Updated 4 years ago
- ☆42Updated 6 years ago
- Resources for the OpenNMT hackathon☆51Updated 5 years ago
- BERT models for many languages created from Wikipedia texts☆33Updated 4 years ago
- ☆33Updated 7 years ago
- ☆12Updated 6 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 2 years ago
- Uncovering divergent linguistic information in word embeddings with lessons for intrinsic and extrinsic evaluation☆63Updated 6 years ago
- Embedding Quantization (Compress Word Embeddings)☆86Updated 5 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- NLP research experiments, built on PyTorch within the AllenNLP framework.☆91Updated 11 months ago
- Fine Tuning Language Models for Multilabel Prediction☆61Updated 2 years ago
- Code and datasets of "Multilingual Extractive Reading Comprehension by Runtime Machine Translation"☆40Updated 6 years ago
- Source code for the paper "Multilingual Neural Machine Translation with Soft Decoupled Encoding"☆29Updated 3 years ago
- Reproduction instructions for "Rapid Adaptation of Neural Machine Translation to New Languages"☆40Updated 6 years ago
- ☆32Updated 3 years ago
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Updated 6 years ago
- Pre-trained models and code and data to train and use models from "Pushing the Limits of Paraphrastic Sentence Embeddings with Millions o…☆101Updated last year
- This is kinda convoluted re-implementation of ELECTRA☆24Updated 5 years ago
- ☆91Updated last year
- Webpage for the DSTC8 - NOESIS II: Predicting Responses☆48Updated last year