Alternatives and similar repositories for 1000Langs:

Users that are interested in 1000Langs are comparing it to the libraries listed below

• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆37Updated 2 years ago
• neulab / langrank
  A program to choose transfer languages for cross-lingual learning
  ☆72Updated last year
• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• shijie-wu / neural-transducer
  This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.
  ☆74Updated last year
• AmericasNLP / americasnlp2021
  ☆45Updated 2 years ago
• besacier / AMMIcourse
  ☆42Updated 3 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆81Updated 9 months ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 4 years ago
• M4t1ss / parallel-corpora-tools
  Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.
  ☆41Updated last year
• nyu-dl / AMMI-2019-NLP-Part2
  ☆17Updated 2 years ago
• alexandra-chron / relm_unmt
  Python source code for EMNLP 2020 paper "Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT".
  ☆35Updated 3 years ago
• cisnlp / parcoure
  ParCourE - Parallel Corpus Explorer
  ☆12Updated 3 years ago
• ahmetustun / udapter
  UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…
  ☆30Updated 2 years ago
• sebastianruder / emnlp2021-multiqa-tutorial
  EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering
  ☆38Updated 3 years ago
• Helsinki-NLP / MuCoW
  Automatically harvested multilingual contrastive word sense disambiguation test sets for machine translation
  ☆17Updated 4 years ago
• rewicks / ersatz
  ☆46Updated 8 months ago
• dykang / PASTEL
  Data and code for Kang et al., EMNLP 2019's paper titled "(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Ann…
  ☆29Updated 5 years ago
• jwieting / beyond-bleu
  Python code for training models in the ACL paper, "Beyond BLEU:Training Neural Machine Translation with Semantic Similarity".
  ☆52Updated 5 years ago
• lanwuwei / GigaBERT
  Zero-shot Transfer Learning from English to Arabic
  ☆29Updated 2 years ago
• pdufter / minimult
  Analyzing mBERT's multilinguality in a small laboratory setting
  ☆13Updated last year
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆30Updated last month
• antonisa / embeddings
  Data and scripts for the proper evaluation of cross-lingual embeddings in multiple languages
  ☆14Updated 4 years ago
• facebookresearch / mlqe
  We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…
  ☆81Updated 3 years ago
• rknaebel / discopy
  End-to-end shallow discourse parser
  ☆20Updated last year
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated last year
• google-research-datasets / discofuse
  ☆32Updated 3 years ago
• adrianeboyd / boyd-wnut2018
  Code and data for: Low Resource Grammatical Error Correction Using Wikipedia Edits (WNUT 2018)
  ☆15Updated 8 months ago
• ZurichNLP / nmtscore
  A library of translation-based text similarity measures
  ☆25Updated last year
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆104Updated this week
• UBC-NLP / aoc_id
  Arabic Dialect Identification on AOC data.
  ☆24Updated 6 years ago