vincentzlt / textprep
Textprep is an analyzing tool for both parallel and non-parallel corpus and its down-stream Natural Language Processing and Machine Translation tasks. It is designed especially for logographic languages such as Chinese and Japanese.
☆32Updated 5 years ago
Alternatives and similar repositories for textprep:
Users that are interested in textprep are comparing it to the libraries listed below
- Universal segmenter based on the Universal Dependency framework, written by Y. Shao, Uppsala University☆34Updated 5 years ago
- Very Deep Pairwise Word Interaction Neural Networks for modeling textual similarity (He and Lin, NAACL/HLT 2016)☆18Updated 6 years ago
- Automatically exported from code.google.com/p/jacana☆37Updated 9 years ago
- Training scripts for paper Miceli Barone et al. 2017 "Deep Architectures for Neural Machine Translation"☆11Updated 7 years ago
- LSTM Language Model with Subword Units Input Representations☆42Updated 3 years ago
- Reproduction instructions for "Rapid Adaptation of Neural Machine Translation to New Languages"☆40Updated 6 years ago
- Code for the paper "Extreme Adaptation for Personalized Neural Machine Translation"☆42Updated 3 years ago
- An attentional NMT model in Dynet☆26Updated 6 years ago
- A BiRNN framework implemented in Python and TensorFlow to extract parallel sentences from aligned comparable corpora.☆33Updated 6 years ago
- Implementation of "Controlling Output Length in Neural Encoder-Decoders"☆42Updated 7 years ago
- MT/IE: Cross-lingual Open Information Extraction with Neural Sequence-to-Sequence Models☆23Updated 6 years ago
- Uncovering divergent linguistic information in word embeddings with lessons for intrinsic and extrinsic evaluation☆63Updated 6 years ago
- Easy-first dependency parser based on Hierarchical Tree LSTMs☆33Updated 8 years ago
- An implementation of the Globally Normalized Reader☆58Updated 2 years ago
- Hierarchical Encoder Decoder for Dialog Modelling☆15Updated 9 years ago
- Code for upcoming TACL paper w/ Graham Neubig, "Neural Lattice Language Models".☆48Updated 7 years ago
- ☆66Updated 2 years ago
- Cross-lingual Dependency Parsing Based on Distributed Representations☆20Updated 6 years ago
- ☆28Updated 8 years ago
- ReVal: A Simple and Effective Machine Translation Evaluation Metric Based on Recurrent Neural Networks☆9Updated 6 years ago
- Dynamic data selection for neural machine translation☆20Updated 7 years ago
- Document context language models☆22Updated 9 years ago
- An example of DyNet autobatching for the NIPS "how to code a paper" workshop☆12Updated 7 years ago
- Context Aware Language Models☆28Updated 6 years ago
- Slides/code for the Lisbon machine learning school 2017☆28Updated 7 years ago
- ☆44Updated 7 years ago
- ☆25Updated 8 years ago
- ☆47Updated 7 years ago
- Language modeling scripts based on TensorFlow☆58Updated 5 years ago
- Dynamic Entity Representation (Kobayashi et al., 2016)☆20Updated 8 years ago