clab / fast_align
Simple, fast unsupervised word aligner
☆749Updated 2 years ago
Alternatives and similar repositories for fast_align:
Users that are interested in fast_align are comparing it to the libraries listed below
- Python port of Moses tokenizer, truecaser and normalizer☆492Updated 9 months ago
- A neural word aligner based on multilingual BERT☆342Updated 3 years ago
- ☆362Updated 2 years ago
- GIZA++ is a statistical machine translation toolkit that is used to train IBM Models 1-5 and an HMM word alignment model. This package al…☆265Updated last year
- Source code for paper: Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data☆250Updated 4 years ago
- A framework to learn cross-lingual word embedding mappings☆647Updated last year
- A tool for holistic analysis of language generations systems☆467Updated 3 years ago
- Fast BPE☆666Updated 9 months ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆361Updated last year
- ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.☆443Updated 11 months ago
- Machine-Translation-based sentence alignment tool for parallel text☆308Updated 4 years ago
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,205Updated 5 months ago
- Open-Source Neural Machine Translation in Tensorflow☆797Updated 2 years ago
- Unsupervised Statistical Machine Translation☆229Updated 4 years ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,227Updated 7 months ago
- Moses, the machine translation system☆1,598Updated last month
- Open-Source Machine Translation Quality Estimation in PyTorch☆230Updated 2 years ago
- scripts and configuration files for Edinburgh neural MT submission to WMT 16 shared translation task☆138Updated 4 years ago
- Improved Sentence Alignment in Linear Time and Space☆169Updated 2 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,113Updated last week
- High-accuracy NLP parser with models for 11 languages.☆880Updated 3 years ago
- A full Python Implementation of the ROUGE Metric (not a wrapper)☆687Updated 4 months ago
- Evaluating Cross-lingual Sentence Representations☆450Updated 3 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆155Updated 9 months ago
- Easy Bootstrap Resampling and Approximate Randomization for BLEU, METEOR, and TER using Multiple Optimizer Runs. This implements "Better …☆203Updated 2 years ago
- Bitextor generates translation memories from multilingual websites☆291Updated 4 months ago
- Deep neural models for core NLP tasks (Pytorch version)☆440Updated 3 years ago
- A list of Neural MT implementations☆362Updated 2 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,117Updated 2 years ago
- A tool that locates, downloads, and extracts machine translation corpora☆154Updated this week