Alternatives and similar repositories for Lightweight-Low-Resource-NMT

Users that are interested in Lightweight-Low-Resource-NMT are comparing it to the libraries listed below

• microsoft / UICaption
  We release the UICaption dataset. The dataset consists of UI images (icons and screenshots) and associated text descriptions. This datase…
  ☆41Updated 2 years ago
• microsoft / gpt-MT
  ☆84Updated 2 years ago
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆282Updated 8 months ago
• facebookresearch / EditEval
  An instruction-based benchmark for text improvements.
  ☆142Updated 2 years ago
• shayne-longpre / a-pretrainers-guide
  ☆72Updated 2 years ago
• microsoft / deepnmt
  ☆31Updated 3 years ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated 2 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆85Updated last year
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆73Updated last year
• google-research-datasets / Hinglish-TOP-Dataset
  Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…
  ☆41Updated 2 years ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• xplip / pixel
  Research code for pixel-based encoders of language (PIXEL)
  ☆339Updated 2 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆95Updated 2 years ago
• martiansideofthemoon / hurdles-longform-qa
  Official repository with code and data accompanying the NAACL 2021 paper "Hurdles to Progress in Long-form Question Answering" (https://a…
  ☆46Updated 3 years ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆156Updated last year
• huggingface / that_is_good_data
  ☆65Updated 2 years ago
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆118Updated 4 years ago
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆115Updated 6 months ago
• google-research / xtreme-up
  ☆51Updated 2 years ago
• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆77Updated last year
• google-research / url-nlp
  ☆218Updated last month
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆104Updated last year
• applicaai / CCpdf
  Index of URLs to pdf files all over the internet and scripts
  ☆24Updated 2 years ago
• LAION-AI / Big-Interleaved-Dataset
  Big-Interleaved-Dataset
  ☆58Updated 2 years ago
• apple / ml-mkqa
  We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically …
  ☆186Updated 3 years ago
• google-research / t5x_retrieval
  ☆101Updated 2 years ago
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆83Updated last month
• google-research / metricx
  ☆110Updated 9 months ago
• sgugger / torchdynamo-tests
  ☆19Updated 2 years ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 3 years ago