uhermjakob / utoken
universal tokenizer
☆17Updated 3 years ago
Alternatives and similar repositories for utoken:
Users that are interested in utoken are comparing it to the libraries listed below
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆22Updated 3 years ago
- Bilingual sentence similarity classifier using Tensorflow☆21Updated 5 years ago
- bilingual dictionary extractor from parallel corpora☆22Updated 10 years ago
- A python module for word inflections designed for use with spaCy.☆92Updated 5 years ago
- Efficient Low-Memory Aligner☆143Updated 3 months ago
- Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.☆50Updated 3 months ago
- Efficient teacher-student models and scripts to make them☆50Updated last year
- ☆72Updated 3 weeks ago
- This packages up data for the Open Multilingual Wordnet☆48Updated last month
- Python framework for processing Universal Dependencies data☆56Updated this week
- English Resource Grammar☆20Updated 8 months ago
- A Word Sense Disambiguation system integrating implicit and explicit external knowledge.☆68Updated 3 years ago
- Finds linguistic patterns effortlessly☆36Updated last year
- Official repository for Semlink resources☆34Updated 3 years ago
- Code for SaGe subword tokenizer (EACL 2023)☆24Updated 4 months ago
- UFSAC is a resource containing all WordNet Sense Annotated Corpora, and a Java library for manipulating them☆37Updated 2 years ago
- Scripts investigate, repair and normalize a wide range of text file problems at the character level.☆19Updated 2 years ago
- A python library / model for creating co-references between AMR graph nodes.☆9Updated 2 years ago
- Multilingual Open Text☆25Updated 5 months ago
- Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. Fo…☆97Updated this week
- Runnable morphological analysis tools from the UniMorph project☆15Updated 6 years ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆223Updated 2 years ago
- Python Finite-State Toolkit☆54Updated last month
- OpusFilter - Parallel corpus processing toolkit☆104Updated 3 weeks ago
- Python Multilingual Ucrel Semantic Analysis System☆31Updated 8 months ago
- Alignment and annotation for comparable documents.☆22Updated 6 years ago
- Translation demonstrator☆32Updated 4 years ago
- Multilingual syllable annotation pipeline component for spacy☆39Updated 2 years ago
- Translation Memory Open-source Purifier☆34Updated 2 years ago
- Sentence aligner☆112Updated 3 years ago