adbar / py3langidLinks
Faster, modernized fork of the language identification tool langid.py
☆56Updated 8 months ago
Alternatives and similar repositories for py3langid
Users that are interested in py3langid are comparing it to the libraries listed below
Sorting:
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆168Updated 2 months ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆250Updated 2 years ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆154Updated 2 years ago
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.☆107Updated 2 months ago
- A sentence segmentation library with wide language support optimized for speed and utility.☆66Updated last month
- Fast and robust date extraction from web pages, with Python or on the command-line☆136Updated this week
- Targetted language identifier, based on FastText and Hunspell.☆36Updated 5 months ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated 8 months ago
- Boolean text search in Python☆45Updated last month
- Seed Machine Translation Data☆32Updated 8 months ago
- An advanced, extensible web front-end for the Manatee-open corpus search engine☆72Updated last week
- 📜 Dehyphenation of broken text (mainly German), i.e., extracted from a PDF☆39Updated 3 years ago
- Extract dates from text☆64Updated 4 years ago
- ☆171Updated 4 months ago
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- This packages up data for the Open Multilingual Wordnet☆50Updated 2 months ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 4 months ago
- Text tokenization and sentence segmentation (segtok v2)☆205Updated 3 years ago
- A modern, interlingual wordnet interface for Python☆255Updated 3 weeks ago
- 80x faster and 95% accurate language identification with Fasttext☆160Updated last year
- A python true casing utility that restores case information for texts☆89Updated 2 years ago
- Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. Fo…☆105Updated last week
- This is a neural spelling checker☆67Updated 2 years ago
- The Open Parallel Corpus☆75Updated 2 weeks ago
- Abydos NLP/IR library for Python☆188Updated 2 years ago
- A tokenizer and sentence splitter for German and English web and social media texts.☆147Updated 7 months ago
- Cython wrapper on Hunspell Dictionary☆66Updated last year
- 📂 Additional lookup tables and data resources for spaCy☆107Updated 2 months ago
- In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.☆71Updated 2 years ago
- Multilingual sentence alignment using sentence embeddings☆121Updated 9 months ago