clab / fast_align
Simple, fast unsupervised word aligner
☆732Updated 2 years ago
Related projects: ⓘ
- Fast BPE☆652Updated 3 months ago
- A framework to learn cross-lingual word embedding mappings☆642Updated last year
- ☆358Updated last year
- A tool for holistic analysis of language generations systems☆465Updated 2 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆486Updated 3 months ago
- A neural word aligner based on multilingual BERT☆321Updated 2 years ago
- ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.☆432Updated 5 months ago
- GIZA++ is a statistical machine translation toolkit that is used to train IBM Models 1-5 and an HMM word alignment model. This package al…☆264Updated last year
- Open-Source Neural Machine Translation in Tensorflow☆797Updated last year
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,040Updated last month
- High-accuracy NLP parser with models for 11 languages.☆858Updated 2 years ago
- Evaluating Cross-lingual Sentence Representations☆440Updated 3 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆347Updated 10 months ago
- Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)☆1,177Updated 6 months ago
- Unsupervised Statistical Machine Translation☆227Updated 4 years ago
- Source code for paper: Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data☆245Updated 4 years ago
- End-to-end Neural Coreference Resolution☆524Updated 2 years ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,181Updated last month
- A full Python Implementation of the ROUGE Metric (not a wrapper)☆665Updated last year
- Open-Source Machine Translation Quality Estimation in PyTorch☆229Updated 2 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,116Updated last year
- Bitextor generates translation memories from multilingual websites☆287Updated 3 months ago
- Deep neural models for core NLP tasks (Pytorch version)☆440Updated 2 years ago
- BERT for Coreference Resolution☆441Updated last year
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆220Updated last year
- Moses, the machine translation system☆1,575Updated 3 months ago
- A list of Neural MT implementations☆358Updated 2 years ago
- Easy Bootstrap Resampling and Approximate Randomization for BLEU, METEOR, and TER using Multiple Optimizer Runs. This implements "Better …☆202Updated last year
- Builds wordpiece(subword) vocabulary compatible for Google Research's BERT☆226Updated 3 years ago
- eXtensible Neural Machine Translation☆185Updated 4 years ago