adbar / py3langidLinks
Faster, modernized fork of the language identification tool langid.py
☆61Updated last year
Alternatives and similar repositories for py3langid
Users that are interested in py3langid are comparing it to the libraries listed below
Sorting:
- Targetted language identifier, based on FastText and Hunspell.☆38Updated 3 months ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆142Updated last month
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆155Updated 2 years ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆180Updated 6 months ago
- 80x faster and 95% accurate language identification with Fasttext☆163Updated last year
- A sentence segmentation library with wide language support optimized for speed and utility.☆73Updated 3 weeks ago
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.☆111Updated 6 months ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated last year
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 8 months ago
- fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-ha…☆41Updated 3 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆255Updated 3 years ago
- ☆176Updated 8 months ago
- Extracts plain text, language identification and more metadata from WARC records☆23Updated 2 months ago
- ☆141Updated last year
- Cython wrapper on Hunspell Dictionary☆66Updated last year
- Text tokenization and sentence segmentation (segtok v2)☆208Updated 3 years ago
- Extract dates from text☆66Updated 4 years ago
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidata☆169Updated 3 years ago
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- Tool to fix bitexts and tag near-duplicates for removal☆34Updated 3 months ago
- Generate a SQLite database from Wikipedia & Wikidata dumps.☆35Updated last year
- an experimental implementation of Burrow's delta in Python 3☆21Updated 4 years ago
- Python 3 library for processing historical English☆67Updated last year
- ✔️Contextual word checker for better suggestions (not actively maintained)☆418Updated 10 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆53Updated 2 months ago
- This is a neural spelling checker☆69Updated 3 years ago
- The Open Parallel Corpus☆79Updated last week
- A python true casing utility that restores case information for texts☆89Updated 3 years ago
- Translate HTML using Argos Translate☆54Updated 2 years ago
- Correction of spaces with character-based neural language models.☆13Updated 3 years ago