adbar / py3langidLinks
Faster, modernized fork of the language identification tool langid.py
☆59Updated 11 months ago
Alternatives and similar repositories for py3langid
Users that are interested in py3langid are comparing it to the libraries listed below
Sorting:
- Fast and robust date extraction from web pages, with Python or on the command-line☆141Updated 2 months ago
- A sentence segmentation library with wide language support optimized for speed and utility.☆68Updated last week
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆177Updated 4 months ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆154Updated 2 years ago
- 80x faster and 95% accurate language identification with Fasttext☆161Updated last year
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.☆109Updated 5 months ago
- Targetted language identifier, based on FastText and Hunspell.☆37Updated last month
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆255Updated 2 years ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆75Updated 6 months ago
- ☆174Updated 7 months ago
- Extracts plain text, language identification and more metadata from WARC records☆23Updated 3 weeks ago
- A modern, interlingual wordnet interface for Python☆266Updated last month
- Boolean text search in Python☆46Updated 4 months ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated 10 months ago
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- Fast syllable estimation library based on pattern matching.☆40Updated 2 weeks ago
- A python true casing utility that restores case information for texts☆89Updated 2 years ago
- Asent is a python library for performing efficient and transparent sentiment analysis using spaCy.☆120Updated last week
- The pipeline for the OSCAR corpus☆173Updated last year
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- Fast and accurate natural language detection. Detector written in Python. Nito-ELD, ELD.☆19Updated 2 years ago
- Text tokenization and sentence segmentation (segtok v2)☆206Updated 3 years ago
- The Open Parallel Corpus☆76Updated 2 months ago
- A Python 3 phonetics library.☆134Updated 5 years ago
- 📝An easy-to-use package to restore punctuation of the text.☆119Updated 2 years ago
- Cython wrapper on Hunspell Dictionary☆66Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆52Updated 3 weeks ago
- Seed Machine Translation Data☆33Updated 11 months ago
- A polite and user-friendly downloader for Common Crawl data☆57Updated 2 months ago
- Source code for the Apple reproduction☆32Updated 4 years ago