Alternatives and similar repositories for marian-dev

Users that are interested in marian-dev are comparing it to the libraries listed below

• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆54Updated 2 years ago
• Helsinki-NLP / OPUS-translator
  Translation demonstrator
  ☆37Updated 5 years ago
• marian-nmt / marian-dev
  Fast Neural Machine Translation in C++ - development repository
  ☆284Updated 6 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆57Updated 4 months ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆23Updated 4 months ago
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated last year
• SYSTRAN / fuzzy-match
  Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.
  ☆51Updated 9 months ago
• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆60Updated last year
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆38Updated 5 months ago
• viig99 / SymSpellCppPy
  Fast SymSpell written in c++ and exposes to python via pybind11
  ☆44Updated 11 months ago
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆300Updated last year
• wikimedia / sentencex
  A sentence segmentation library with wide language support optimized for speed and utility.
  ☆86Updated 2 weeks ago
• argosopentech / argos-train
  Training scripts for Argos Translate
  ☆154Updated 2 weeks ago
• EleutherAI / openwebtext2
  ☆94Updated 3 years ago
• oscar-project / goclassy
  An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
  ☆86Updated 4 years ago
• sortiz / tmxt
  Transform TMX to text
  ☆28Updated 3 years ago
• Marcnuth / deduplication
  Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.
  ☆19Updated 2 years ago
• browsermt / mts
  Marian Translation Service
  ☆25Updated 4 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 5 months ago
• SYSTRAN / similarity
  Bilingual sentence similarity classifier using Tensorflow
  ☆24Updated 6 years ago
• kpu / preprocess
  Corpus preprocessing
  ☆99Updated last year
• Helsinki-NLP / OPUS
  The Open Parallel Corpus
  ☆82Updated 3 weeks ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated 2 years ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆160Updated last year
• Helsinki-NLP / OpusTools
  ☆81Updated last week
• machinetranslate / machinetranslate.org
  Open information and community for machine translation
  ☆80Updated last week
• sfu-natlang / Kriya
  Hierarchical phrase-based machine translation system
  ☆32Updated 11 years ago
• currentslab / fastlangid
  fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-ha…
  ☆43Updated 3 years ago
• Ighina / DeepTiling
  A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive sum…
  ☆51Updated 2 years ago