Alternatives and similar repositories for cld3

Users that are interested in cld3 are comparing it to the libraries listed below

• CLD2Owners / cld2
  Compact Language Detector 2
  ☆890Updated 4 years ago
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆300Updated last year
• bakwc / JamSpell
  Modern spell checking library - accurate, fast, multi-language
  ☆657Updated last year
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆811Updated 11 months ago
• modernmt / modernmt
  Neural Adaptive Machine Translation that adapts to context and learns from corrections.
  ☆350Updated 3 years ago
• ufal / udpipe
  UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files
  ☆393Updated last week
• marian-nmt / marian
  Fast Neural Machine Translation in C++
  ☆1,418Updated 2 years ago
• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆901Updated last year
• OpenNMT / Tokenizer
  Fast and customizable text tokenization library with BPE and SentencePiece support
  ☆329Updated 3 weeks ago
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆395Updated 2 weeks ago
• danielvarga / hunalign
  Sentence aligner
  ☆124Updated 4 years ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆255Updated 3 years ago
• facebookresearch / flores
  Facebook Low Resource (FLoRes) MT Benchmark
  ☆762Updated 2 years ago
• thompsonb / vecalign
  Improved Sentence Alignment in Linear Time and Space
  ☆188Updated 2 years ago
• mhagiwara / github-typo-corpus
  GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors
  ☆516Updated 6 years ago
• facebookresearch / LASER
  Language-Agnostic SEntence Representations
  ☆3,657Updated last year
• hplt-project / sacremoses
  Python port of Moses tokenizer, truecaser and normalizer
  ☆495Updated last year
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆386Updated 2 years ago
• mammothb / symspellpy
  Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm…
  ☆856Updated 2 weeks ago
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆769Updated this week
• aboSamoor / pycld2
  ☆178Updated 10 months ago
• bheinzerling / bpemb
  Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
  ☆1,222Updated last year
• snowballstem / snowball
  Snowball compiler and stemming algorithms
  ☆834Updated last month
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆155Updated 2 years ago
• google-research / byt5
  ☆533Updated last year
• bjascob / LemmInflect
  A python module for English lemmatization and inflection.
  ☆274Updated 2 years ago
• shuyo / language-detection
  This is a language detection library implemented in plain Java. (aliases: language identification, language guessing)
  ☆761Updated 6 years ago
• grantjenks / python-wordsegment
  English word segmentation, written in pure-Python, and based on a trillion-word corpus.
  ☆378Updated 3 years ago
• mjpost / sacrebleu
  Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
  ☆1,222Updated 3 weeks ago
• google-research / multilingual-t5
  ☆1,296Updated 3 years ago