Alternatives and similar repositories for marian-dev

Users that are interested in marian-dev are comparing it to the libraries listed below

• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆51Updated last year
• KorAP / Tokenizer-Evaluation
  Benchmark scripts for comparing different tokenizers and sentence segmenters of German
  ☆11Updated 2 years ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆22Updated 3 months ago
• ngoyal2707 / Megatron-LM
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆18Updated 2 years ago
• Helsinki-NLP / OPUS-translator
  Translation demonstrator
  ☆34Updated 5 years ago
• SYSTRAN / fuzzy-match
  Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.
  ☆50Updated 2 months ago
• loretoparisi / hf-experiments
  Experiments with Hugging Face 🔬 🤗
  ☆44Updated 10 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• sfu-natlang / Kriya
  Hierarchical phrase-based machine translation system
  ☆32Updated 10 years ago
• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆56Updated 7 months ago
• jermp / tongrams_estimation
  A C++ library implementing fast language models estimation using the 1-Sort algorithm.
  ☆17Updated 2 years ago
• jerinphilip / slimt
  Inference slice of marian for bergamot's tiny11 models. Faster to compile, and wield. Fewer model-archs than bergamot-translator.
  ☆11Updated 8 months ago
• karlb / sqlite-spellfix
  Loadable spellfix1 extension for sqlite as python package
  ☆26Updated last year
• SYSTRAN / similarity
  Bilingual sentence similarity classifier using Tensorflow
  ☆22Updated 5 years ago
• sortiz / tmxt
  Transform TMX to text
  ☆27Updated 2 years ago
• allenai / meta-eval
  Tools to evaluate accuracies of various (research papers') metadata extraction libraries
  ☆11Updated 9 years ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated 2 years ago
• LuminosoInsight / exquisite-corpus
  Put together a multilingual corpus from a variety of sources. Used for wordfreq and word embeddings.
  ☆52Updated 3 years ago
• benob / openfst-utils
  Utilities for manipulating finite state transducers with the OpenFst library.
  ☆31Updated 7 years ago
• andrewmcwattersandco / github-statistics
  GitHub statistics
  ☆12Updated 2 years ago
• daveshap / GibberishDetector
  Detecting gibberish as a type of sentiment analysis with GPT2
  ☆24Updated 4 years ago
• epfml / Bi-Sent2Vec
  Robust Cross-lingual Embeddings from Parallel Sentences
  ☆22Updated 4 years ago
• daormar / thot
  Thot toolkit for statistical machine translation
  ☆53Updated 2 years ago
• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated last year
• google-research / mozolm
  MozoLM: A language model (LM) serving library
  ☆45Updated 4 months ago
• onfido / faiss_prebuilt
  Prebuilt .whl files for MacOS + Linux of the Facebook FAISS library
  ☆56Updated 3 years ago
• huggingface / spm_precompiled
  Highly specialized crate to parse and use `google/sentencepiece` 's precompiled_charsmap in `tokenizers`
  ☆18Updated 3 years ago
• Helsinki-NLP / OpusTools
  ☆74Updated 2 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆51Updated this week
• google-research-datasets / uninum
  A database of number names for 186 languages, locales, and scripts
  ☆67Updated 2 years ago