mbanon / fastspellLinks
Targetted language identifier, based on FastText and Hunspell.
β37Updated 2 months ago
Alternatives and similar repositories for fastspell
Users that are interested in fastspell are comparing it to the libraries listed below
Sorting:
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)β75Updated 7 months ago
- πΈ GlotWeb: Web Indexing for Low-Resource Languages -- under construction.β15Updated 3 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.β52Updated last month
- Faster, modernized fork of the language identification tool langid.pyβ61Updated last year
- Python Finite-State Toolkitβ60Updated last week
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.β34Updated 8 months ago
- β78Updated 3 months ago
- These are lists for a variety of languages containing words that are distinctive to each language.β38Updated 3 years ago
- OpusFilter - Parallel corpus processing toolkitβ112Updated last week
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiencyβ179Updated 5 months ago
- Sentence transformers models for SpaCyβ109Updated 2 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.β160Updated last year
- Augmenty is an augmentation library based on spaCy for augmenting texts.β156Updated last year
- A python true casing utility that restores case information for textsβ89Updated 3 years ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)β154Updated 2 years ago
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Doβ¦β80Updated last year
- β50Updated last year
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.β255Updated 3 years ago
- π₯ Use Hugging Face text and token classification pipelines directly in spaCyβ63Updated last year
- π§ͺ Cutting-edge experimental spaCy components and featuresβ103Updated last year
- Transform TMX to textβ28Updated 2 years ago
- Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2β¦β69Updated 2 years ago
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.β98Updated 2 years ago
- Extracts plain text, language identification and more metadata from WARC recordsβ23Updated last month
- A multi-lingual approach to AllenNLP CoReference Resolution along with a wrapper for spaCy.β108Updated last year
- Text tokenization and sentence segmentation (segtok v2)β207Updated 3 years ago
- π Resource and Tool for Writing System Identification -- LREC 2024β20Updated last year
- Searching in-memory corpus with Corpus Query Language (CQL)β19Updated 11 months ago
- Tool to fix bitexts and tag near-duplicates for removalβ34Updated 2 months ago
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further langβ¦β197Updated 2 years ago