Alternatives and similar repositories for utoken

Users that are interested in utoken are comparing it to the libraries listed below

• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆92Updated 5 years ago
• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆50Updated last year
• unimorph / analyzers
  Runnable morphological analysis tools from the UniMorph project
  ☆15Updated 6 years ago
• zseder / hundict
  bilingual dictionary extractor from parallel corpora
  ☆22Updated 10 years ago
• delph-in / erg
  English Resource Grammar
  ☆21Updated 9 months ago
• sortiz / tmxt
  Transform TMX to text
  ☆28Updated 2 years ago
• Helsinki-NLP / OpusTools
  ☆72Updated last month
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆143Updated 3 months ago
• rug-compling / Alpino
  Alpino parser and related tools for Dutch
  ☆24Updated this week
• SYSTRAN / fuzzy-match
  Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.
  ☆50Updated 2 weeks ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆104Updated last month
• udapi / udapi-python
  Python framework for processing Universal Dependencies data
  ☆57Updated last week
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆22Updated 3 years ago
• SYSTRAN / similarity
  Bilingual sentence similarity classifier using Tensorflow
  ☆21Updated 5 years ago
• unimorph / wiktionary-tools
  Tools for scraping, annotating, and parsing morphological information from Wiktionary
  ☆13Updated 5 years ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆83Updated 3 years ago
• revuel / PatternOmatic
  Finds linguistic patterns effortlessly
  ☆36Updated last year
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆54Updated 2 months ago
• ufal / treex
  Treex NLP framework
  ☆32Updated this week
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆24Updated 5 months ago
• amir-zeldes / DepEdit
  A simple configurable tool for manipulating dependency trees.
  ☆13Updated 4 months ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆30Updated 3 months ago
• kbatsuren / MorphyNet
  MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)
  ☆44Updated 2 years ago
• ghpaetzold / massalign
  Alignment and annotation for comparable documents.
  ☆22Updated 6 years ago
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆38Updated 3 years ago
• amir-zeldes / gum
  Repository for the Georgetown University Multilayer Corpus (GUM)
  ☆94Updated last week
• juditacs / wikt2dict
  Wiktionary parser tool for many language editions.
  ☆54Updated 2 years ago
• SapienzaNLP / ewiser
  A Word Sense Disambiguation system integrating implicit and explicit external knowledge.
  ☆69Updated 3 years ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆21Updated 2 months ago
• explosion / spacy-alignments
  💫 A spaCy package for Yohei Tamura's Rust tokenizations library
  ☆29Updated last year