Alternatives and similar repositories for DISC:

Users that are interested in DISC are comparing it to the libraries listed below

• bitextor / bicleaner-ai
  Bicleaner fork that uses neural networks
  ☆39Updated 6 months ago
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆35Updated 2 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆104Updated 3 weeks ago
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆141Updated last month
• kbatsuren / MorphyNet
  MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)
  ☆40Updated last year
• hlt-mt / TMOP
  Translation Memory Open-source Purifier
  ☆33Updated 2 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆81Updated 8 months ago
• nert-nlp / streusle
  STREUSLE: a corpus with comprehensive lexical semantic annotation (multiword expressions, supersenses)
  ☆65Updated 2 years ago
• sortiz / tmxt
  Transform TMX to text
  ☆28Updated 2 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆29Updated 2 weeks ago
• hslh / magpie-corpus
  MAGPIE: A sense-annotated corpus of potentially idiomatic expressions
  ☆26Updated 4 years ago
• thammegowda / mtdata
  A tool that locates, downloads, and extracts machine translation corpora
  ☆150Updated 8 months ago
• anaistack / cefr-asag-corpus
  A corpus of short answers written by learners of English and graded with CEFR levels
  ☆10Updated 3 years ago
• ghpaetzold / massalign
  Alignment and annotation for comparable documents.
  ☆22Updated 6 years ago
• hplt-project / OpusTrainer
  Curriculum training
  ☆16Updated last month
• robertostling / efmaral
  Efficient Markov Chain word alignment
  ☆53Updated 3 years ago
• spraakbanken / multiged-2023
  ☆15Updated last year
• udapi / udapi-python
  Python framework for processing Universal Dependencies data
  ☆55Updated 2 weeks ago
• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• sigmorphon / 2022InflectionST
  A repository for the 2022 Inflection Shared Task
  ☆9Updated 2 years ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated last year
• m-popovic / chrF
  a tool for calcualting character n-gram F score
  ☆69Updated 2 years ago
• Helsinki-NLP / subalign
  ☆15Updated last year
• thompsonb / prism
  MT Evaluation in Many Languages via Zero-Shot Paraphrasing
  ☆101Updated 6 months ago
• Helsinki-NLP / OpusTools
  ☆71Updated 2 weeks ago
• ufal / multilexnorm2021
  MultiLexNorm 2021 competition system from ÚFAL
  ☆15Updated 3 years ago
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆108Updated 3 months ago
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆22Updated 3 years ago
• sigmorphon / 2022SegmentationST
  SIGMORPHON 2022 Shared Task on Morpheme Segmentation
  ☆24Updated last year
• facebookresearch / asset
  A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations
  ☆55Updated 2 years ago