Alternatives and similar repositories for marian-dev

Users that are interested in marian-dev are comparing it to the libraries listed below

• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆54Updated 2 years ago
• machinetranslate / machinetranslate.org
  Open information and community for machine translation
  ☆80Updated 2 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆57Updated 3 months ago
• Helsinki-NLP / OPUS-translator
  Translation demonstrator
  ☆37Updated 5 years ago
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated last year
• marian-nmt / marian-dev
  Fast Neural Machine Translation in C++ - development repository
  ☆284Updated 6 months ago
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆300Updated last year
• oscar-project / goclassy
  An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
  ☆86Updated 4 years ago
• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆60Updated last year
• SYSTRAN / fuzzy-match
  Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.
  ☆51Updated 9 months ago
• SYSTRAN / similarity
  Bilingual sentence similarity classifier using Tensorflow
  ☆24Updated 6 years ago
• Helsinki-NLP / OPUS
  The Open Parallel Corpus
  ☆82Updated 2 weeks ago
• currentslab / fastlangid
  fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-ha…
  ☆43Updated 3 years ago
• nicolay-r / AREkit
  Document level Attitude and Relation Extraction toolkit (AREkit) for sampling and processing large text collections with ML and for ML
  ☆65Updated last year
• proycon / flat
  FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…
  ☆113Updated last year
• LibreTranslate / Locomotive
  Toolkit for training/converting LibreTranslate compatible language models 🚂
  ☆77Updated 7 months ago
• argosopentech / argos-train
  Training scripts for Argos Translate
  ☆153Updated last week
• EleutherAI / openwebtext2
  ☆93Updated 3 years ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated 2 years ago
• sortiz / tmxt
  Transform TMX to text
  ☆28Updated 3 years ago
• LuminosoInsight / exquisite-corpus
  Put together a multilingual corpus from a variety of sources. Used for wordfreq and word embeddings.
  ☆57Updated 4 years ago
• viig99 / SymSpellCppPy
  Fast SymSpell written in c++ and exposes to python via pybind11
  ☆44Updated 10 months ago
• TurkuNLP / Turku-neural-parser-pipeline
  A neural parsing pipeline for segmentation, morphological tagging, dependency parsing and lemmatization with pre-trained models for more …
  ☆115Updated last year
• daormar / thot
  Thot toolkit for statistical machine translation
  ☆53Updated 3 years ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆23Updated 3 months ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 4 months ago
• Helsinki-NLP / mammoth
  MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki
  ☆30Updated this week
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆38Updated 4 months ago
• OpenNMT / Tokenizer
  Fast and customizable text tokenization library with BPE and SentencePiece support
  ☆328Updated 2 weeks ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆160Updated last year