clab / fast_align
Simple, fast unsupervised word aligner
☆752Updated 2 years ago
Alternatives and similar repositories for fast_align:
Users that are interested in fast_align are comparing it to the libraries listed below
- A tool for holistic analysis of language generations systems☆468Updated 3 years ago
- GIZA++ is a statistical machine translation toolkit that is used to train IBM Models 1-5 and an HMM word alignment model. This package al…☆266Updated 2 years ago
- A neural word aligner based on multilingual BERT☆346Updated 3 years ago
- Fast BPE☆670Updated 10 months ago
- A framework to learn cross-lingual word embedding mappings☆647Updated 2 years ago
- ☆363Updated 2 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆495Updated 11 months ago
- Open-Source Neural Machine Translation in Tensorflow☆797Updated 2 years ago
- A word alignment tool based on famous GIZA++, extended to support multi-threading, resume training and incremental training.☆162Updated 3 years ago
- Source code for paper: Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data☆250Updated 4 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆360Updated last year
- Open-Source Machine Translation Quality Estimation in PyTorch☆229Updated 2 years ago
- Bitextor generates translation memories from multilingual websites☆292Updated 5 months ago
- A list of Neural MT implementations☆363Updated 2 years ago
- scripts and configuration files for Edinburgh neural MT submission to WMT 16 shared translation task☆138Updated 4 years ago
- TED parallel Corpora is growing collection of Bilingual parallel corpora, Multilingual parallel corpora and Monolingual corpora extracted…☆250Updated 9 years ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,232Updated 8 months ago
- Machine-Translation-based sentence alignment tool for parallel text☆309Updated 4 years ago
- Evaluating Cross-lingual Sentence Representations☆452Updated 3 years ago
- Efficient Low-Memory Aligner☆143Updated 3 months ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,119Updated 2 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆157Updated 10 months ago
- Improved Sentence Alignment in Linear Time and Space☆170Updated 2 years ago
- High-accuracy NLP parser with models for 11 languages.☆883Updated 3 years ago
- ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.☆444Updated last year
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,212Updated 7 months ago
- Easy Bootstrap Resampling and Approximate Randomization for BLEU, METEOR, and TER using Multiple Optimizer Runs. This implements "Better …☆204Updated 2 years ago
- eXtensible Neural Machine Translation☆186Updated 5 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,128Updated last month
- Unsupervised Statistical Machine Translation☆229Updated 4 years ago