clab / fast_align
Simple, fast unsupervised word aligner
☆744Updated 2 years ago
Alternatives and similar repositories for fast_align:
Users that are interested in fast_align are comparing it to the libraries listed below
- Fast BPE☆662Updated 8 months ago
- A framework to learn cross-lingual word embedding mappings☆648Updated last year
- GIZA++ is a statistical machine translation toolkit that is used to train IBM Models 1-5 and an HMM word alignment model. This package al…☆265Updated last year
- ☆361Updated 2 years ago
- A tool for holistic analysis of language generations systems☆467Updated 2 years ago
- A neural word aligner based on multilingual BERT☆338Updated 2 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆489Updated 8 months ago
- Evaluating Cross-lingual Sentence Representations☆449Updated 3 years ago
- ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.☆441Updated 10 months ago
- Source code for paper: Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data☆247Updated 4 years ago
- scripts and configuration files for Edinburgh neural MT submission to WMT 16 shared translation task☆138Updated 4 years ago
- Open-Source Neural Machine Translation in Tensorflow☆795Updated 2 years ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,218Updated 6 months ago
- Unsupervised Statistical Machine Translation☆229Updated 4 years ago
- A list of Neural MT implementations☆359Updated 2 years ago
- TED parallel Corpora is growing collection of Bilingual parallel corpora, Multilingual parallel corpora and Monolingual corpora extracted…☆246Updated 9 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆357Updated last year
- eXtensible Neural Machine Translation☆185Updated 5 years ago
- Bitextor generates translation memories from multilingual websites☆293Updated 3 months ago
- Improved Sentence Alignment in Linear Time and Space☆165Updated last year
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆154Updated 8 months ago
- Code and model files for the paper: "A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction" (AAAI-18…☆184Updated 6 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,101Updated last month
- An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group☆705Updated 2 years ago
- JFLEG (JHU FLuency-Extended GUG) corpus for Grammatical Error Correction Evaluation☆113Updated last year
- A word alignment tool based on famous GIZA++, extended to support multi-threading, resume training and incremental training.☆161Updated 3 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,118Updated 2 years ago
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,194Updated 4 months ago
- BERT as language model, fork from https://github.com/google-research/bert☆247Updated 11 months ago
- Machine-Translation-based sentence alignment tool for parallel text☆306Updated 3 years ago