Alternatives and similar repositories for InterdialectCorpus

Users that are interested in InterdialectCorpus are comparing it to the libraries listed below

• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆74Updated 10 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆57Updated last week
• Caucasus-Rosetta / Lingua-Corpus
  Caucasus languages focused multilingual and monolingual corpuses for Natural Language Processing(NLP)
  ☆35Updated last year
• kbatsuren / MorphyNet
  MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)
  ☆54Updated 2 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆115Updated this week
• alirezamshi-zz / small100
  Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…
  ☆25Updated 3 years ago
• fajri91 / minangNLP
  Minangkabau NLP corpus. PACLIC 2020
  ☆10Updated 4 years ago
• project-anuvaad / anuvaad-parallel-corpus
  ☆22Updated 3 years ago
• Helsinki-NLP / OpusTools
  ☆81Updated last week
• asmelashteka / HornMT
  Machine translation (MT) benchmark dataset for languages in the Horn of Africa.
  ☆40Updated 3 years ago
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆41Updated 3 years ago
• ehsanasgari / 1000Langs
  Creating super-parallel corpora of more than 1500+ unique languages for NLP research
  ☆34Updated 3 years ago
• hetpandya / paraphrase-datasets-pretrained-models
  A collection of preprocessed datasets and pretrained models for generating paraphrases.
  ☆32Updated 4 years ago
• machinetranslate / machinetranslate.org
  Open information and community for machine translation
  ☆80Updated last week
• neulab / newlang-tech
  A guide to building language technology in new languages.
  ☆59Updated 4 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆88Updated last year
• mikahama / uralicNLP
  An NLP library for Uralic languages such as Finnish, Skolt Sami, Moksha and so on. Also supporting some non-Uralic languages such as Span…
  ☆90Updated 3 months ago
• bitextor / bicleaner-ai
  Bicleaner fork that uses neural networks
  ☆40Updated last week
• UBC-NLP / afrolid
  AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
  ☆35Updated this week
• kbatsuren / wiktra
  Wiktra - Python tool of Wiktionary Transliteration modules for 514 languages and its 102 different scripts (orthographies)
  ☆34Updated 7 months ago
• sinaahmadi / KurdishHunspell
  A morphological analyzer and spell checker for Kurdish in Hunspell
  ☆32Updated last month
• rnd2110 / MorphAGram
  A Language-Independent Unsupervised Morphological Segmentation Framework based on Adaptor Grammars
  ☆17Updated last year
• masakhane-io / afriqa
  Crosslingual Question Answering for African Languages
  ☆30Updated last year
• sigmorphon / 2022SegmentationST
  SIGMORPHON 2022 Shared Task on Morpheme Segmentation
  ☆31Updated 2 years ago
• sinaahmadi / wergor
  Rule-based Kurdish Transliterator
  ☆10Updated last year
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆110Updated last year
• maidis / awesome-machine-translation
  A list of awesome Machine Translation frameworks, libraries, software and papers
  ☆197Updated last year
• matbahasa / TALPCo
  TUFS Asian Language Parallel Corpus
  ☆52Updated 2 years ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆255Updated 3 years ago
• google-research / url-nlp
  ☆263Updated 6 months ago