mbanon / fastspellLinks
Targetted language identifier, based on FastText and Hunspell.
☆37Updated last month
Alternatives and similar repositories for fastspell
Users that are interested in fastspell are comparing it to the libraries listed below
Sorting:
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 6 months ago
- 🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.☆15Updated last month
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆52Updated last week
- Python Finite-State Toolkit☆58Updated 2 weeks ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆38Updated 3 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆33Updated last month
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆176Updated 4 months ago
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆32Updated 7 months ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆158Updated last year
- Extracts plain text, language identification and more metadata from WARC records☆23Updated last week
- A sentence segmentation library with wide language support optimized for speed and utility.☆67Updated 3 months ago
- OpusFilter - Parallel corpus processing toolkit☆110Updated last week
- Library for fast text representation and classification.☆31Updated last year
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- ☆76Updated last month
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.☆109Updated 4 months ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆154Updated 2 years ago
- 🖋 Resource and Tool for Writing System Identification -- LREC 2024☆20Updated last year
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Updated 10 months ago
- A python true casing utility that restores case information for texts☆89Updated 2 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆156Updated last year
- Faster, modernized fork of the language identification tool langid.py☆59Updated 10 months ago
- Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…☆68Updated 2 years ago
- Sentence transformers models for SpaCy☆107Updated 2 years ago
- Transform TMX to text☆27Updated 2 years ago
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆97Updated 2 years ago
- Seed Machine Translation Data☆33Updated 10 months ago
- 80x faster and 95% accurate language identification with Fasttext☆162Updated last year
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆254Updated 2 years ago
- A tiny BERT for low-resource monolingual models☆31Updated last week