mbanon / fastspellLinks
Targetted language identifier, based on FastText and Hunspell.
☆38Updated 4 months ago
Alternatives and similar repositories for fastspell
Users that are interested in fastspell are comparing it to the libraries listed below
Sorting:
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 9 months ago
- Extracts plain text, language identification and more metadata from WARC records☆23Updated 3 months ago
- 🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.☆17Updated 5 months ago
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆35Updated 10 months ago
- Faster, modernized fork of the language identification tool langid.py☆60Updated last year
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆182Updated 7 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆57Updated 3 months ago
- OpusFilter - Parallel corpus processing toolkit☆115Updated this week
- Python Finite-State Toolkit☆60Updated last month
- 🖋 Resource and Tool for Writing System Identification -- LREC 2024☆21Updated 3 weeks ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆160Updated last year
- Tool to fix bitexts and tag near-duplicates for removal☆34Updated 4 months ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆40Updated 3 years ago
- ☆50Updated last year
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.☆112Updated 2 weeks ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated last year
- Sentence transformers models for SpaCy☆109Updated 2 years ago
- Seed Machine Translation Data☆33Updated last year
- 80x faster and 95% accurate language identification with Fasttext☆164Updated 2 years ago
- Library for fast text representation and classification.☆31Updated 2 years ago
- ☆81Updated last week
- Cython wrapper on Hunspell Dictionary☆66Updated last year
- Text tokenization and sentence segmentation (segtok v2)☆208Updated 3 years ago
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidata☆170Updated 3 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆256Updated 3 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆156Updated last year
- A python true casing utility that restores case information for texts☆88Updated 3 years ago
- NTREX -- News Test References for MT Evaluation☆87Updated last year
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- A multi-lingual approach to AllenNLP CoReference Resolution along with a wrapper for spaCy.☆110Updated last year