Alternatives and similar repositories for iso639

Users that are interested in iso639 are comparing it to the libraries listed below

• currentslab / fastlangid
  fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-ha…
  ☆39Updated 2 years ago
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆56Updated 3 weeks ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆30Updated 5 months ago
• zaemyung / sentsplit
  A flexible sentence segmentation library using CRF model and regex rules
  ☆29Updated last year
• allo-media / text2num
  Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.
  ☆107Updated last month
• nitotm / efficient-language-detector-py
  Fast and accurate natural language detection. Detector written in Python. Nito-ELD, ELD.
  ☆17Updated last year
• rspeer / langcodes
  A Python library for working with and comparing language codes.
  ☆345Updated 2 months ago
• bootphon / pygamma-agreement
  Gamma Agreement in Python
  ☆44Updated last year
• aboSamoor / pycld2
  ☆170Updated 3 months ago
• alea-institute / nupunkt
  Next-generation Punkt sentence boundary detection with zero dependencies
  ☆17Updated 3 months ago
• wikimedia / sentencex
  A sentence segmentation library with wide language support optimized for speed and utility.
  ☆65Updated 3 weeks ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆51Updated last week
• zoho-labs / symspell
  Rust python bindings for symspell
  ☆19Updated last year
• ddelange / retrie
  Efficient Trie-based regex unions for blacklist/whitelist filtering and one-pass mapping-based string replacing
  ☆73Updated 2 weeks ago
• zouharvi / pwesuite
  Suite for phonetic word embeddings, especially their evaluation and baseline models.
  ☆30Updated 4 months ago
• sloev / spacy-syllables
  Multilingual syllable annotation pipeline component for spacy
  ☆39Updated 2 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 9 months ago
• ranvijaykumar / typo
  A python package to simulate typographical errors.
  ☆35Updated last year
• Helsinki-NLP / mammoth
  MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki
  ☆23Updated 2 weeks ago
• kevin91nl / text-highlighter
  A Streamlit component for annotating text by text selecting.
  ☆40Updated last year
• alirezamshi / small100
  Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…
  ☆27Updated 2 years ago
• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆56Updated 7 months ago
• Helsinki-NLP / OpusTools
  ☆74Updated 3 months ago
• abuccts / wikt2pron
  A Python toolkit converting pronunciation in enwiktionary xml dump to cmudict format
  ☆33Updated 6 years ago
• adbar / simplemma
  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
  ☆166Updated last month
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆82Updated 10 months ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆89Updated 2 years ago
• mammothb / editdistpy
  Fast edit distance Python extension written in Cython/C++. Supports Levenshtein distance and Damerau Optimal String Alignment (OSA) dista…
  ☆24Updated last month
• bsolomon1124 / demoji
  Accurately find/replace/remove emojis in text strings
  ☆163Updated last year
• noumar / iso639
  ISO 639 library for Python
  ☆33Updated 10 months ago