clab / fast_align
Simple, fast unsupervised word aligner
☆742Updated 2 years ago
Alternatives and similar repositories for fast_align:
Users that are interested in fast_align are comparing it to the libraries listed below
- ☆360Updated 2 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆490Updated 7 months ago
- Fast BPE☆659Updated 6 months ago
- A framework to learn cross-lingual word embedding mappings☆648Updated last year
- A neural word aligner based on multilingual BERT☆336Updated 2 years ago
- ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.☆440Updated 9 months ago
- A tool for holistic analysis of language generations systems☆467Updated 2 years ago
- GIZA++ is a statistical machine translation toolkit that is used to train IBM Models 1-5 and an HMM word alignment model. This package al…☆266Updated last year
- Open-Source Neural Machine Translation in Tensorflow☆797Updated 2 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,091Updated last week
- Source code for paper: Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data☆246Updated 4 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆353Updated last year
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,192Updated 3 months ago
- Unsupervised Statistical Machine Translation☆229Updated 4 years ago
- Bitextor generates translation memories from multilingual websites☆293Updated 2 months ago
- Moses, the machine translation system☆1,585Updated this week
- scripts and configuration files for Edinburgh neural MT submission to WMT 16 shared translation task☆139Updated 4 years ago
- Evaluating Cross-lingual Sentence Representations☆448Updated 3 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆152Updated 7 months ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,213Updated 5 months ago
- NMT for chinese-english using fairseq☆210Updated 7 years ago
- A list of Neural MT implementations☆359Updated 2 years ago
- A full Python Implementation of the ROUGE Metric (not a wrapper)☆682Updated last month
- TED parallel Corpora is growing collection of Bilingual parallel corpora, Multilingual parallel corpora and Monolingual corpora extracted…☆246Updated 9 years ago
- Open-Source Machine Translation Quality Estimation in PyTorch☆228Updated 2 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,120Updated 2 years ago
- JFLEG (JHU FLuency-Extended GUG) corpus for Grammatical Error Correction Evaluation☆112Updated last year
- A word alignment tool based on famous GIZA++, extended to support multi-threading, resume training and incremental training.☆162Updated 3 years ago
- Machine-Translation-based sentence alignment tool for parallel text☆304Updated 3 years ago
- Code and model files for the paper: "A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction" (AAAI-18…☆185Updated 6 years ago