wikimedia / sentencexLinks
A sentence segmentation library with wide language support optimized for speed and utility.
☆82Updated last month
Alternatives and similar repositories for sentencex
Users that are interested in sentencex are comparing it to the libraries listed below
Sorting:
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆182Updated 7 months ago
- Seed Machine Translation Data☆33Updated last year
- Faster, modernized fork of the language identification tool langid.py☆60Updated last year
- 80x faster and 95% accurate language identification with Fasttext☆164Updated last year
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 9 months ago
- A modern, interlingual wordnet interface for Python☆278Updated this week
- Aksharamukha Python Library☆56Updated 11 months ago
- The Open Parallel Corpus☆82Updated last week
- Next-generation Punkt sentence boundary detection with zero dependencies☆27Updated 2 months ago
- Library for fast text representation and classification.☆31Updated 2 years ago
- Extracts plain text, language identification and more metadata from WARC records☆23Updated 3 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆57Updated 3 months ago
- Targetted language identifier, based on FastText and Hunspell.☆38Updated 4 months ago
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- SpaCyEx allows the creation of spaCy Matcher patterns with RegEx like syntax.☆59Updated last year
- Efficient teacher-student models and scripts to make them☆54Updated 2 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆256Updated 3 years ago
- Multilingual sentence alignment using sentence embeddings☆137Updated last year
- Small python package to measure OCR quality and other related metrics.☆25Updated last year
- A polite and user-friendly downloader for Common Crawl data☆67Updated 5 months ago
- ☆34Updated 2 years ago
- Text tokenization and sentence segmentation (segtok v2)☆208Updated 3 years ago
- an experimental implementation of Burrow's delta in Python 3☆21Updated 4 years ago
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- ☆81Updated this week
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆35Updated 10 months ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆155Updated 2 years ago
- Python module that identifies Chinese text as being Simplified or Traditional☆105Updated last year
- A python true casing utility that restores case information for texts☆88Updated 3 years ago
- A project about benchmarking and evaluating existing PDF extraction tools on their semantic abilities to extract the body texts from PDF …☆69Updated 5 years ago