Alternatives and similar repositories for machine-learning-data-pipeline

Users that are interested in machine-learning-data-pipeline are comparing it to the libraries listed below

• SunbowLiu / PTvsBT

  View on GitHub
  On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation (Findings of EMNLP 2021))
  ☆13Nov 21, 2021Updated 4 years ago
• MaxyLee / 3AM

  View on GitHub
  Official code and data of "3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset"
  ☆12Dec 8, 2024Updated last year
• bzhangGo / transformer-aan

  View on GitHub
  souce code for "Accelerating Neural Transformer via an Average Attention Network"
  ☆78Jul 3, 2019Updated 6 years ago
• facebookresearch / evaluation-of-nmt-bt

  View on GitHub
  This repository contains additional reference translations for the WMT'14 En-De (newstest2014) and WMT'19 En-Ru (newstest2019) test sets …
  ☆15Aug 31, 2021Updated 4 years ago
• zhuohan123 / hint-nart

  View on GitHub
  ☆10Feb 12, 2020Updated 6 years ago
• zhangkaixu / isan

  View on GitHub
  Chinese processing
  ☆36Jan 29, 2014Updated 12 years ago
• zhengzx-nlp / REDER

  View on GitHub
  [NeurIPS 2021] Duplex Sequence-to-Sequence Learning for Reversible Machine Translation
  ☆15Jun 7, 2022Updated 3 years ago
• MultiPath / Efficient-Neural-Machine-Translation

  View on GitHub
  PhD thesis (updating) of Jiatao Gu from HKU
  ☆19Aug 10, 2018Updated 7 years ago
• marliesvanderwees / dds-nmt

  View on GitHub
  Dynamic data selection for neural machine translation
  ☆20Jan 28, 2018Updated 8 years ago
• MultiPath / Squirrel

  View on GitHub
  PyTorch implementation of Transformer-based Neural Machine Translation
  ☆78Dec 14, 2022Updated 3 years ago
• longyuewangdcu / tvsub

  View on GitHub
  TVsub: DCU-Tencent Chinese-English Dialogue Corpus
  ☆46Feb 14, 2018Updated 7 years ago
• nxphi47 / data_diversification

  View on GitHub
  Instruction to data diversification
  ☆24Nov 24, 2020Updated 5 years ago
• hfxunlp / transformer

  View on GitHub
  Neutron: A pytorch based implementation of Transformer and its variants.
  ☆64Aug 10, 2023Updated 2 years ago
• yzh119 / segtree-transformer-v0

  View on GitHub
  Code for SegTree Transformer (ICLR-RLGM 2019).
  ☆27Nov 12, 2019Updated 6 years ago
• nyu-dl / dl4mt-nonauto

  View on GitHub
  ☆120Feb 20, 2019Updated 6 years ago
• ybisk / charNMT-noise

  View on GitHub
  Scripts and noise data for Belinkov & Bisk 2018
  ☆29Apr 27, 2018Updated 7 years ago
• M4t1ss / SoftAlignments

  View on GitHub
  Neural macine translation soft alignment visualisations for web and command line
  ☆72Aug 19, 2021Updated 4 years ago
• izumi-h / ccgcomp

  View on GitHub
  Logical inference system based on event semantics and degree semantics in formal semantics
  ☆11Jan 22, 2023Updated 3 years ago
• uos / transparent_object_reconstruction

  View on GitHub
  Detect and reconstruct transparent objects from scan shadows
  ☆10Sep 22, 2017Updated 8 years ago
• SAP / software-documentation-data-set-for-machine-translation

  View on GitHub
  A parallel evaluation data set of SAP software documentation with document structure annotation
  ☆14Jul 30, 2025Updated 6 months ago
• nklein23 / mxnet-with-R

  View on GitHub
  ☆13Dec 28, 2018Updated 7 years ago
• RayeRen / multilingual-kd-pytorch

  View on GitHub
  ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation
  ☆70Oct 7, 2020Updated 5 years ago
• biasinrecsys / wsdm2021

  View on GitHub
  WSDM 2021 Tutorial on Advances in Bias-aware Recommendation on the Web
  ☆11Mar 8, 2021Updated 4 years ago
• Coldmist-Lu / MQM_APE

  View on GitHub
  [MQM-APE] Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation Evaluators.
  ☆11Sep 24, 2024Updated last year
• tastyminerals / ccrawl

  View on GitHub
  Simple CORPORA list crawler
  ☆10Dec 2, 2016Updated 9 years ago
• zinengtang / ContinuousFlowNLG

  View on GitHub
  Pytorch version of Continuous Language Generative Flow (ACL 2021)
  ☆11Sep 14, 2021Updated 4 years ago
• ChuanMeng / RLT4Reranking

  View on GitHub
  ☆12Nov 22, 2024Updated last year
• langtech-bsc / mt-evaluation

  View on GitHub
  A framework for evaluating Machine Translation models.
  ☆12May 26, 2025Updated 8 months ago
• informagi / mmead

  View on GitHub
  MS Marco Entity Annotations Disambiguation
  ☆13May 19, 2023Updated 2 years ago
• ySalaun / deblur_denoise

  View on GitHub
  College project about article http://www.cs.ust.hk/~quan/publications/yuan-deblur-siggraph07.pdf
  ☆10Jan 25, 2013Updated 13 years ago
• xuyuting45 / DSB2018-mx-unet

  View on GitHub
  An implement of U-net using MXNet gluon
  ☆11Apr 3, 2018Updated 7 years ago
• bzhangGo / zero

  View on GitHub
  Zero -- A neural machine translation system
  ☆153May 8, 2023Updated 2 years ago
• yokusama / NMT_Papers

  View on GitHub
  Some good(maybe) papers about NMT (Neural Machine Translation).
  ☆85Jan 15, 2020Updated 6 years ago
• wangqiangneu / MT-PaperReading

  View on GitHub
  Record my paper reading about Machine Translation and other related works.
  ☆36Nov 19, 2021Updated 4 years ago
• SakanaAI / L2D

  View on GitHub
  Large language models to diffusion finetuning code
  ☆23Jun 2, 2025Updated 8 months ago
• demelin / transformer_lexical_shortcuts

  View on GitHub
  Codebase accompanying the paper 'Widening the Representation Bottleneck in Neural Machine Translation with Lexical Shortcuts', (Emelin, D…
  ☆11Feb 14, 2023Updated 2 years ago
• macenpav / vutbr-fit-waldboost-detector

  View on GitHub
  A GPU (CUDA) accelerated set of tools for object detection using waldboost/LBP.
  ☆10May 25, 2015Updated 10 years ago
• clavicule / BBTag

  View on GitHub
  Stand alone tool to annotate/label bounding box on images
  ☆10Jan 30, 2017Updated 9 years ago
• pbailis / bolton-sigmod2013-code

  View on GitHub
  EXPERIMENTAL PROTOTYPE code for "Bolt-on Causal Consistency" appearing in SIGMOD 2013
  ☆12Nov 2, 2013Updated 12 years ago