wikimedia / sentencexLinks
A sentence segmentation library with wide language support optimized for speed and utility.
☆65Updated 9 months ago
Alternatives and similar repositories for sentencex
Users that are interested in sentencex are comparing it to the libraries listed below
Sorting:
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆52Updated last month
- Seed Machine Translation Data☆32Updated 6 months ago
- Multilingual sentence alignment using sentence embeddings☆118Updated 7 months ago
- ☆73Updated 2 months ago
- Sentence aligner☆113Updated 4 years ago
- Targetted language identifier, based on FastText and Hunspell.☆34Updated 3 months ago
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆157Updated 11 months ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated 6 months ago
- Efficient Low-Memory Aligner☆144Updated 4 months ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 2 months ago
- Python Finite-State Toolkit☆55Updated last week
- OpusFilter - Parallel corpus processing toolkit☆104Updated 2 months ago
- Tool to fix bitexts and tag near-duplicates for removal☆30Updated 4 months ago
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki☆23Updated 3 months ago
- MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)☆47Updated 2 years ago
- MAGPIE: A sense-annotated corpus of potentially idiomatic expressions☆27Updated 5 years ago
- A python true casing utility that restores case information for texts☆88Updated 2 years ago
- Transform TMX to text☆28Updated 2 years ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆160Updated this week
- Bitextor generates translation memories from multilingual websites☆293Updated 6 months ago
- ☆27Updated last year
- Library for fast text representation and classification.☆30Updated last year
- ☆29Updated 2 months ago
- Text tokenization and sentence segmentation (segtok v2)☆205Updated 3 years ago
- FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…☆112Updated 4 months ago
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆22Updated 3 years ago
- Faster, modernized fork of the language identification tool langid.py☆56Updated 6 months ago
- Download and load spaCy models on-the-fly☆15Updated 2 years ago
- Multilingual syllable annotation pipeline component for spacy☆39Updated 2 years ago