facebookresearch / bitext-lexind

Bilingual lexicons map words in one language to their translations in another, and are typically induced by learning linear projections to align monolingual word embedding spaces. In this paper, we show it is possible to produce much higher quality lexicons with methods that combine (1) unsupervised bitext mining and (2) unsuper…

☆16

Alternatives and similar repositories for bitext-lexind

Users that are interested in bitext-lexind are comparing it to the libraries listed below

Sorting:

wmt-conference / wmt21-news-systems
☆24Updated 2 years ago
raymondhs / constrained-levt
Lexically Constrained Neural Machine Translation with Levenshtein Transformer
☆39Updated 4 years ago
roeeaharoni / unsupervised-domain-clusters
Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".
☆58Updated 4 years ago
ghchen18 / cdalign
Code for AAAI 2021 paper "Lexically Constrained Neural Machine Translation with Explicit Alignment Guidance"
☆25Updated 2 years ago
mtresearcher / terminology_dataset
Terminology Dataset
☆23Updated 5 years ago
longyuewangdcu / tvsub
TVsub: DCU-Tencent Chinese-English Dialogue Corpus
☆47Updated 7 years ago
yhy1117 / DA4NMT
NMT domain adaptation papers (updating...)
☆17Updated 5 years ago
cindyxinyiwang / multiDDS
Code for the paper "Balancing Training for Multilingual Neural Machine Translation, ACL 2020"
☆23Updated 3 years ago
CZWin32768 / XLM-Align
☆36Updated 2 years ago
lena-voita / good-translation-wrong-in-context
This is a repository with the data and code for the ACL 2019 paper "When a Good Translation is Wrong in Context: ..." and the EMNLP 2019 …
☆97Updated 5 years ago
ShannonAI / fast-knn-nmt
☆33Updated 3 years ago
rbawden / discourse-mt-test-sets
☆28Updated 11 months ago
chrishokamp / constrained_decoding
Lexically constrained decoding for sequence generation using Grid Beam Search
☆91Updated 6 years ago
urvashik / knnmt
☆44Updated 3 years ago
bozheng-hit / xTune
☆50Updated 3 years ago
LeslieOverfitting / selective_distillation
☆37Updated 3 years ago
freesunshine0316 / RaST-plus
☆21Updated 2 years ago
jcyk / copyisallyouneed
Code for our ACL2021 paper Neural Machine Translation with Monolingual Translation Memory
☆82Updated last year
Oneplus / tamr
☆22Updated 6 years ago
weijia-xu / fairseq-editor
EDITOR: an Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraints
☆29Updated 3 years ago
nxphi47 / data_diversification
Instruction to data diversification
☆25Updated 4 years ago
SUDA-LA / wist
[ACL'21] Data for "An In-depth Study on Internal Structure of Chinese Words".
☆14Updated 3 years ago
fandongmeng / DTMT_InDec
Implementation of DTMT with incremental decoding
☆13Updated 4 years ago
shuo-git / InfECE
☆20Updated 4 years ago
hsing-wang / WMT2020_BioMedical
☆15Updated 3 years ago
TenTrans / TenTrans
Universal End2End Training Platform, including pre-training, classification tasks, machine translation, and etc.
☆45Updated 2 years ago
wmt-conference / wmt22-news-systems
☆20Updated 2 years ago
lilt / alignment-scripts
Scripts to preprocess training and test data and to run fast_align and giza
☆108Updated 3 years ago
microsoft / glge
Code for ACL2021 paper: "GLGE: A New General Language Generation Evaluation Benchmark"
☆57Updated 2 years ago
wxjiao / Data-Rejuvenation
Implementation of our paper "Data Rejuvenation: Exploiting Inactive Training Examples for Neural Machine Translation" in EMNLP-2020.
☆23Updated 3 years ago