adbar / py3langidLinks
Faster, modernized fork of the language identification tool langid.py
☆60Updated last year
Alternatives and similar repositories for py3langid
Users that are interested in py3langid are comparing it to the libraries listed below
Sorting:
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆155Updated 2 years ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆182Updated 7 months ago
- Targetted language identifier, based on FastText and Hunspell.☆38Updated 4 months ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆143Updated 2 months ago
- A sentence segmentation library with wide language support optimized for speed and utility.☆82Updated last month
- 80x faster and 95% accurate language identification with Fasttext☆164Updated last year
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆256Updated 3 years ago
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.☆112Updated last week
- ☆177Updated 9 months ago
- fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-ha…☆43Updated 3 years ago
- Seed Machine Translation Data☆33Updated last year
- Boolean text search in Python☆46Updated 6 months ago
- Extract dates from text☆66Updated 4 years ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated last year
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 9 months ago
- Next-generation Punkt sentence boundary detection with zero dependencies☆27Updated 2 months ago
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidata☆170Updated 3 years ago
- 📜 Dehyphenation of broken text (mainly German), i.e., extracted from a PDF☆39Updated 3 years ago
- 🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.☆17Updated 5 months ago
- Efficient Trie-based regex unions for blacklist/whitelist filtering and one-pass mapping-based string replacing☆76Updated 2 weeks ago
- 📂 Additional lookup tables and data resources for spaCy☆113Updated 7 months ago
- Lightning Fast Language Prediction 🚀☆167Updated 4 months ago
- A modern, interlingual wordnet interface for Python☆278Updated this week
- Python port of Boilerpipe library☆96Updated last year
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- A python true casing utility that restores case information for texts☆88Updated 3 years ago
- Extracts plain text, language identification and more metadata from WARC records☆23Updated 3 months ago
- Abydos NLP/IR library for Python☆194Updated 3 years ago
- The Open Parallel Corpus☆82Updated last week