uhermjakob / utoken

Related projects: ⓘ

• Helsinki-NLP / OpusTools
  ☆67Updated last month
• zseder / hundict
  bilingual dictionary extractor from parallel corpora
  ☆21Updated 10 years ago
• sortiz / tmxt
  Transform TMX to text
  ☆29Updated last year
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆19Updated 2 years ago
• udapi / udapi-python
  Python framework for processing Universal Dependencies data
  ☆55Updated last week
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆90Updated 4 years ago
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆39Updated last month
• SYSTRAN / similarity
  Bilingual sentence similarity classifier using Tensorflow
  ☆19Updated 4 years ago
• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆48Updated 9 months ago
• explosion / spacy-alignments
  💫 A spaCy package for Yohei Tamura's Rust tokenizations library
  ☆27Updated 10 months ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆20Updated last month
• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated 8 months ago
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆135Updated 2 weeks ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆29Updated last month
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆101Updated last month
• Helsinki-NLP / mammoth
  MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki
  ☆21Updated this week
• cu-clear / semlink
  Official repository for Semlink resources
  ☆32Updated 2 years ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆21Updated this week
• rali-udem / gophi
  GOPHI: an AMR-to-English Verbalizer
  ☆11Updated 4 years ago
• Helsinki-NLP / OPUS-translator
  Translation demonstrator
  ☆27Updated 4 years ago
• getalp / UFSAC
  UFSAC is a resource containing all WordNet Sense Annotated Corpora, and a Java library for manipulating them
  ☆37Updated 2 years ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆80Updated 2 years ago
• bltlab / mot
  Multilingual Open Text
  ☆25Updated 5 months ago
• unimorph / analyzers
  Runnable morphological analysis tools from the UniMorph project
  ☆14Updated 5 years ago
• delph-in / erg
  English Resource Grammar
  ☆18Updated last month
• SYSTRAN / fuzzy-match
  Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.
  ☆45Updated 4 months ago
• nert-nlp / streusle
  STREUSLE: a corpus with comprehensive lexical semantic annotation (multiword expressions, supersenses)
  ☆63Updated last year
• mpsilfve / finer-data
  ☆24Updated 4 years ago
• clab / wikipedia-parallel-titles
  Tools for extracting parallel corpora from article titles across languages in Wikipedia
  ☆72Updated 9 years ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆65Updated 4 months ago