Scripts to preprocess training and test data and to run fast_align and giza
☆107Nov 2, 2021Updated 5 years ago
Alternatives and similar repositories for alignment-scripts
Users that are interested in alignment-scripts are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for our paper "Mask-Align: Self-Supervised Neural Word Alignment" in ACL 2021☆59May 10, 2021Updated 5 years ago
- Neural macine translation soft alignment visualisations for web and command line☆72Aug 19, 2021Updated 5 years ago
- A neural word aligner based on multilingual BERT☆388Mar 10, 2022Updated 4 years ago
- Simple, fast unsupervised word aligner☆769Jul 19, 2022Updated 4 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆159Jun 18, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Efficient Low-Memory Aligner☆148Jan 15, 2025Updated last year
- OpusFilter - Parallel corpus processing toolkit☆116Nov 11, 2026Updated last week
- [EMNLP 2020] Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆397Nov 7, 2023Updated 3 years ago
- ☆23Nov 15, 2022Updated 4 years ago
- Lexically Constrained Neural Machine Translation with Levenshtein Transformer☆40Jul 14, 2020Updated 6 years ago
- We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…☆81Aug 31, 2021Updated 5 years ago
- A word alignment tool based on famous GIZA++, extended to support multi-threading, resume training and incremental training.☆168May 12, 2021Updated 5 years ago
- A tool for holistic analysis of language generations systems☆472Sep 22, 2025Updated last year
- Sampling-Based Minimum Bayes-Risk Decoding for Neural Machine Translation☆16Oct 14, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Joint Source-Target Self Attention with Locality Constraints☆20May 9, 2020Updated 6 years ago
- ☆42Jul 17, 2018Updated 8 years ago
- ☆36Aug 25, 2022Updated 4 years ago
- Code for AAAI 2021 paper "Lexically Constrained Neural Machine Translation with Explicit Alignment Guidance"☆25Dec 14, 2022Updated 3 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆498Sep 7, 2026Updated 2 months ago
- Bilingual sentence similarity classifier using Tensorflow☆24Sep 26, 2019Updated 7 years ago
- Open-Source Machine Translation Quality Estimation in PyTorch☆236Jun 23, 2022Updated 4 years ago
- This repository contains additional reference translations for the WMT'14 En-De (newstest2014) and WMT'19 En-Ru (newstest2019) test sets …☆15Aug 31, 2021Updated 5 years ago
- ☆26Oct 22, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python package to augment multilingual data☆15Feb 15, 2023Updated 3 years ago
- ☆20Aug 17, 2021Updated 5 years ago
- Framework for neural-based Quality Estimation☆41Sep 23, 2020Updated 6 years ago
- Improved Sentence Alignment in Linear Time and Space☆204Jul 4, 2026Updated 4 months ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆141Apr 23, 2026Updated 6 months ago
- Word sense disambiguation test sets for NMT☆21Dec 3, 2020Updated 5 years ago
- NJUNMT for docNMT☆16Sep 9, 2020Updated 6 years ago
- EMNLP2022 "Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment"☆20Feb 19, 2023Updated 3 years ago
- ☆13Aug 23, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,265Aug 20, 2026Updated 2 months ago
- Scripts and noise data for Belinkov & Bisk 2018☆29Apr 27, 2018Updated 8 years ago
- Japanese--Russian--English News Commentary Parallel Data☆18Jul 9, 2019Updated 7 years ago
- A High-Quality Multilingual Dataset for Structured Documentation Translation☆39May 1, 2025Updated last year
- ☆28Oct 6, 2020Updated 6 years ago
- ☆20Dec 31, 2020Updated 5 years ago
- Dynamic data selection for neural machine translation☆20Jan 28, 2018Updated 8 years ago
Are these results useful?