mbanon / fastspellLinks
Targetted language identifier, based on FastText and Hunspell.
โ37Updated 2 weeks ago
Alternatives and similar repositories for fastspell
Users that are interested in fastspell are comparing it to the libraries listed below
Sorting:
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)โ74Updated 5 months ago
- ๐ธ GlotWeb: Web Indexing for Low-Resource Languages -- under construction.โ14Updated last month
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.โ32Updated 6 months ago
- Python Finite-State Toolkitโ58Updated last week
- Faster, modernized fork of the language identification tool langid.pyโ57Updated 9 months ago
- Sentence transformers models for SpaCyโ107Updated 2 years ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiencyโ173Updated 3 months ago
- ๐ Resource and Tool for Writing System Identification -- LREC 2024โ19Updated last year
- 80x faster and 95% accurate language identification with Fasttextโ162Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.โ51Updated 2 months ago
- โ75Updated 3 weeks ago
- OpusFilter - Parallel corpus processing toolkitโ109Updated last month
- These are lists for a variety of languages containing words that are distinctive to each language.โ38Updated 3 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.โ254Updated 2 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.โ156Updated last year
- A python true casing utility that restores case information for textsโ89Updated 2 years ago
- Tool to fix bitexts and tag near-duplicates for removalโ31Updated 2 weeks ago
- Extracts plain text, language identification and more metadata from WARC recordsโ23Updated 2 weeks ago
- ๐ฅ Use Hugging Face text and token classification pipelines directly in spaCyโ63Updated last year
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.โ157Updated last year
- ๐งช Cutting-edge experimental spaCy components and featuresโ101Updated last year
- Cython wrapper on Hunspell Dictionaryโ66Updated last year
- A survey of corpora for Germanic low-resource languages and dialectsโ25Updated 9 months ago
- ParaNames: A multilingual resource for parallel namesโ36Updated last year
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidataโ164Updated 2 years ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)โ154Updated 2 years ago
- Library for fast text representation and classification.โ31Updated last year
- Seed Machine Translation Dataโ33Updated 10 months ago
- Tool for parsing and converting various span encoding schemes.โ23Updated last year
- Text tokenization and sentence segmentation (segtok v2)โ206Updated 3 years ago