adbar / py3langidLinks
Faster, modernized fork of the language identification tool langid.py
☆56Updated 9 months ago
Alternatives and similar repositories for py3langid
Users that are interested in py3langid are comparing it to the libraries listed below
Sorting:
- A sentence segmentation library with wide language support optimized for speed and utility.☆67Updated 2 months ago
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.☆108Updated 3 months ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆172Updated 3 months ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated 9 months ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆154Updated 2 years ago
- Seed Machine Translation Data☆33Updated 10 months ago
- Targetted language identifier, based on FastText and Hunspell.☆37Updated last week
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆253Updated 2 years ago
- A versioned python wrapper package for cmudict (https://github.com/cmusphinx/cmudict).☆64Updated this week
- 80x faster and 95% accurate language identification with Fasttext☆162Updated last year
- Fast and robust date extraction from web pages, with Python or on the command-line☆140Updated last month
- ☆173Updated 5 months ago
- The Open Parallel Corpus☆76Updated 3 weeks ago
- fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-ha…☆40Updated 2 years ago
- An advanced, extensible web front-end for the Manatee-open corpus search engine☆73Updated this week
- Text tokenization and sentence segmentation (segtok v2)☆206Updated 3 years ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 5 months ago
- Multilingual syllable annotation pipeline component for spacy☆39Updated 2 years ago
- Next-generation Punkt sentence boundary detection with zero dependencies☆17Updated last month
- Extracts plain text, language identification and more metadata from WARC records☆23Updated last week
- 🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.☆14Updated last month
- A modern, interlingual wordnet interface for Python☆259Updated last week
- This packages up data for the Open Multilingual Wordnet☆52Updated 3 months ago
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- The pipeline for the OSCAR corpus☆171Updated last year
- an experimental implementation of Burrow's delta in Python 3☆21Updated 3 years ago
- A python true casing utility that restores case information for texts☆89Updated 2 years ago
- Cython wrapper on Hunspell Dictionary☆66Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆51Updated 2 months ago
- A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text☆34Updated 5 years ago