uhermjakob / utoken

Related projects ⓘ

Alternatives and complementary repositories for utoken

• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆48Updated 11 months ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆22Updated this week
• SYSTRAN / similarity
  Bilingual sentence similarity classifier using Tensorflow
  ☆19Updated 5 years ago
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆21Updated 2 years ago
• zseder / hundict
  bilingual dictionary extractor from parallel corpora
  ☆22Updated 10 years ago
• sortiz / tmxt
  Transform TMX to text
  ☆29Updated last year
• Helsinki-NLP / OPUS-translator
  Translation demonstrator
  ☆27Updated 4 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆29Updated last month
• bltlab / mot
  Multilingual Open Text
  ☆25Updated 3 weeks ago
• KWARC / llamapun
  common language and mathematics processing algorithms, in Rust
  ☆25Updated 7 months ago
• SYSTRAN / fuzzy-match
  Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.
  ☆45Updated 6 months ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆20Updated 3 months ago
• vered1986 / panic
  PANiC - PAraphrasing Noun-Compounds
  ☆15Updated 6 years ago
• kwchurch / JSALT_Better_Together
  ☆16Updated this week
• bltlab / paranames
  ParaNames: A multilingual resource for parallel names
  ☆30Updated 6 months ago
• delph-in / erg
  English Resource Grammar
  ☆18Updated 3 months ago
• revuel / PatternOmatic
  Finds linguistic patterns effortlessly
  ☆33Updated last year
• akb89 / pyfn
  A python module to process data for Frame Semantic Parsing
  ☆23Updated 4 years ago
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆45Updated last week
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆15Updated last month
• Helsinki-NLP / OpusTools
  ☆67Updated 3 months ago
• explosion / spacy-alignments
  💫 A spaCy package for Yohei Tamura's Rust tokenizations library
  ☆27Updated last year
• unicode-org / unilex
  Lexical data at Unicode
  ☆66Updated 2 months ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated 10 months ago
• frankier / wikiparse
  Scrapes some Finnish word definitions from English Wiktionary.
  ☆7Updated last year
• neocl / speach
  🐍🍑 Python 3 library for managing, annotating, and converting natural language corpuses using popular formats (CoNLL, ELAN, Praat, CSV, …
  ☆18Updated 4 months ago
• codogogo / towerparse
  Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection
  ☆15Updated 3 years ago
• Helsinki-NLP / mammoth
  MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki
  ☆22Updated this week
• KGCP / MEL-TNNT
  Metadata Extractor & Loader (MEL) ■ The NLP-NER Toolkit (TNNT)
  ☆22Updated last year
• ldtoolkit / conceptnet-rocks
  Python library to work with ConceptNet offline
  ☆10Updated last year