YerevaNN / PARASITE
🪱 PARASITE || A parallel sentence data preprocessing toolkit. Originally developed as a part of the `en-ru` winner submission of WMT20 Biomedical Translation Task.
☆11Updated 3 years ago
Alternatives and similar repositories for PARASITE:
Users that are interested in PARASITE are comparing it to the libraries listed below
- The 14th Machine Translation Marathon 2019 in Edinburgh☆13Updated 2 years ago
- Code and data for: Low Resource Grammatical Error Correction Using Wikipedia Edits (WNUT 2018)☆16Updated 8 months ago
- Japanese--Russian--English News Commentary Parallel Data☆18Updated 5 years ago
- ☆28Updated 9 months ago
- Analyzing mBERT's multilinguality in a small laboratory setting☆13Updated last year
- Python source code for EMNLP 2020 paper "Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT".☆35Updated 3 years ago
- Witwicky: An implementation of Transformer in PyTorch.☆22Updated 4 years ago
- c++ mosestokenizer☆17Updated last year
- A framework for evaluating Machine Translation models.☆9Updated 3 weeks ago
- A program to choose transfer languages for cross-lingual learning☆72Updated last year
- The implementation of "Neural Machine Translation without Embeddings", NAACL 2021☆33Updated 3 years ago
- Sampling-Based Minimum Bayes-Risk Decoding for Neural Machine Translation☆16Updated 2 years ago
- Project OCELoT: an Open, Collaborative Evaluation Leaderboard of Translations☆20Updated 8 months ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated 9 months ago
- ☆92Updated last year
- Scripts for re-building NTT neural machine translation systems for WAT 2017☆9Updated 7 years ago
- ☆23Updated 5 years ago
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆26Updated 3 years ago
- ☆14Updated 4 years ago
- YiSi: A Semantic Machine Translation Evaluation Metric for Evaluating Languages with Different Levels of Available Resources☆25Updated 5 years ago
- codebase for the Text-based NP Enrichment (TNE) paper☆20Updated last year
- Code and Data for Evaluation WG☆41Updated 2 years ago
- Statistics on multilingual datasets☆17Updated 2 years ago
- ☆23Updated 8 months ago
- PyTorch implementation of NAACL 2021 paper "Multi-view Subword Regularization"☆25Updated 3 years ago
- UFSAC is a resource containing all WordNet Sense Annotated Corpora, and a Java library for manipulating them☆37Updated 2 years ago
- ☆75Updated 3 years ago
- Word sense disambiguation test sets for NMT☆19Updated 4 years ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated last year
- This repo is containing notes and implementations for cherry-picked publications of my particular interest☆12Updated 4 years ago