adbar / py3langidLinks
Faster, modernized fork of the language identification tool langid.py
☆61Updated last year
Alternatives and similar repositories for py3langid
Users that are interested in py3langid are comparing it to the libraries listed below
Sorting:
- Targetted language identifier, based on FastText and Hunspell.☆38Updated 3 months ago
- A sentence segmentation library with wide language support optimized for speed and utility.☆73Updated 3 weeks ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆180Updated 6 months ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆155Updated 2 years ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated last year
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆255Updated 3 years ago
- 80x faster and 95% accurate language identification with Fasttext☆163Updated last year
- Fast and robust date extraction from web pages, with Python or on the command-line☆142Updated last month
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.☆111Updated 6 months ago
- Seed Machine Translation Data☆33Updated last year
- ☆176Updated 8 months ago
- Text tokenization and sentence segmentation (segtok v2)☆208Updated 3 years ago
- fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-ha…☆41Updated 3 years ago
- Cython wrapper on Hunspell Dictionary☆66Updated last year
- Source code for the Apple reproduction☆32Updated 4 years ago
- Multi-Langauge Identification☆28Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆53Updated 2 months ago
- A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text☆34Updated 5 years ago
- Next-generation Punkt sentence boundary detection with zero dependencies☆24Updated 3 weeks ago
- ☆141Updated last year
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- A python true casing utility that restores case information for texts☆89Updated 3 years ago
- In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.☆71Updated 2 years ago
- The Open Parallel Corpus☆79Updated last week
- 📝An easy-to-use package to restore punctuation of the text.☆119Updated 2 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆34Updated 3 months ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 8 months ago
- A modern, interlingual wordnet interface for Python☆276Updated this week
- Multilingual sentence alignment using sentence embeddings☆131Updated last year
- Fast syllable estimation library based on pattern matching.☆40Updated last week