mbanon / fastspellLinks
Targetted language identifier, based on FastText and Hunspell.
β36Updated 5 months ago
Alternatives and similar repositories for fastspell
Users that are interested in fastspell are comparing it to the libraries listed below
Sorting:
- πΈ GlotWeb: Web Indexing for Low-Resource Languages -- under construction.β14Updated 4 months ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiencyβ168Updated 2 months ago
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)β74Updated 4 months ago
- Faster, modernized fork of the language identification tool langid.pyβ56Updated 8 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.β51Updated last month
- π₯ Use Hugging Face text and token classification pipelines directly in spaCyβ63Updated last year
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.β31Updated 4 months ago
- 80x faster and 95% accurate language identification with Fasttextβ160Updated last year
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidataβ164Updated 2 years ago
- Sentence transformers models for SpaCyβ107Updated 2 years ago
- π§ͺ Cutting-edge experimental spaCy components and featuresβ100Updated last year
- Extracts plain text, language identification and more metadata from WARC recordsβ23Updated last week
- A sentence segmentation library with wide language support optimized for speed and utility.β66Updated last month
- Augmenty is an augmentation library based on spaCy for augmenting texts.β156Updated last year
- Python Finite-State Toolkitβ57Updated this week
- π Resource and Tool for Writing System Identification -- LREC 2024β19Updated last year
- Python3 bindings for the Compact Language Detector v3 (CLD3)β154Updated 2 years ago
- Tool to fix bitexts and tag near-duplicates for removalβ31Updated 6 months ago
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further langβ¦β125Updated last year
- Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2β¦β69Updated 2 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.β250Updated 2 years ago
- Language detection using Spacy and Fasttextβ57Updated last year
- These are lists for a variety of languages containing words that are distinctive to each language.β38Updated 3 years ago
- OpusFilter - Parallel corpus processing toolkitβ109Updated this week
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.β158Updated last year
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.β107Updated 2 months ago
- Simply, faster, sentence-transformersβ143Updated 11 months ago
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.β97Updated last year
- A High-level Library for Named Entity Recognition in Python.β24Updated last year
- In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.β71Updated 2 years ago