Alternatives and similar repositories for marian-dev:

Users that are interested in marian-dev are comparing it to the libraries listed below

• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆50Updated last year
• searxng / fasttext-predict
  fasttext with wheels and no external dependency, but only the predict method (<1MB)
  ☆13Updated 3 months ago
• Helsinki-NLP / OPUS-translator
  Translation demonstrator
  ☆32Updated 4 years ago
• explosion / wikid
  Generate a SQLite database from Wikipedia & Wikidata dumps.
  ☆33Updated 11 months ago
• wikimedia / sentencex
  A sentence segmentation library with wide language support optimized for speed and utility.
  ☆58Updated 6 months ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆21Updated last week
• ngoyal2707 / Megatron-LM
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆18Updated 2 years ago
• Marcnuth / deduplication
  Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.
  ☆18Updated last year
• SYSTRAN / similarity
  Bilingual sentence similarity classifier using Tensorflow
  ☆20Updated 5 years ago
• SYSTRAN / fuzzy-match
  Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.
  ☆48Updated 2 months ago
• marian-nmt / amun
  Fast stand-alone C++ decoder for RNN-based NMT models
  ☆25Updated 4 years ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆50Updated last month
• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated last year
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆33Updated 3 years ago
• LibreTranslate / Locomotive
  Toolkit for training/converting LibreTranslate compatible language models 🚂
  ☆51Updated 4 months ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆54Updated last year
• LuminosoInsight / exquisite-corpus
  Put together a multilingual corpus from a variety of sources. Used for wordfreq and word embeddings.
  ☆51Updated 3 years ago
• LanguageMachines / LuigiNLP
  A workflow system for Natural Language Processing.
  ☆21Updated 5 years ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆19Updated 5 months ago
• epfml / Bi-Sent2Vec
  Robust Cross-lingual Embeddings from Parallel Sentences
  ☆22Updated 4 years ago
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆32Updated 3 years ago
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆30Updated 4 months ago
• allenai / meta-eval
  Tools to evaluate accuracies of various (research papers') metadata extraction libraries
  ☆11Updated 9 years ago
• microsoft / msmarco
  website for MS Marco
  ☆28Updated last week
• emarkou / Text-Similarity
  A text similarity computation using minhashing and Jaccard distance on reuters dataset
  ☆16Updated 6 years ago
• daormar / thot
  Thot toolkit for statistical machine translation
  ☆53Updated 2 years ago
• lemurproject / Lucindri
  Indri search implementation on top of Lucene search engine
  ☆34Updated last year
• BramVanroy / spacy-extreme
  An example of how to use spaCy for extremely large files without running into memory issues
  ☆36Updated 2 years ago