mbanon / fastspellLinks
Targetted language identifier, based on FastText and Hunspell.
☆38Updated 5 months ago
Alternatives and similar repositories for fastspell
Users that are interested in fastspell are comparing it to the libraries listed below
Sorting:
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆74Updated 10 months ago
- 🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.☆17Updated 5 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆57Updated this week
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆184Updated 8 months ago
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆35Updated this week
- Python Finite-State Toolkit☆60Updated last month
- Sentence transformers models for SpaCy☆108Updated 2 years ago
- 80x faster and 95% accurate language identification with Fasttext☆164Updated 2 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆156Updated last year
- Faster, modernized fork of the language identification tool langid.py☆60Updated last year
- Seed Machine Translation Data☆33Updated last year
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆155Updated 2 years ago
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.☆112Updated 3 weeks ago
- Tool to fix bitexts and tag near-duplicates for removal☆34Updated 5 months ago
- 🧪 Cutting-edge experimental spaCy components and features☆105Updated last year
- 💥 Use Hugging Face text and token classification pipelines directly in spaCy☆63Updated last year
- ☆34Updated 2 years ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆41Updated 3 years ago
- 🖋 Resource and Tool for Writing System Identification -- LREC 2024☆21Updated last month
- ☆81Updated last week
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆160Updated last year
- Repository for the paper "MultiNERD: A Multilingual, Multi-Genre and Fine-Grained Dataset for Named Entity Recognition (and Disambiguatio…☆45Updated 2 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆255Updated 3 years ago
- OpusFilter - Parallel corpus processing toolkit☆115Updated this week
- Extracts plain text, language identification and more metadata from WARC records☆23Updated 4 months ago
- Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…☆70Updated 3 years ago
- BERT and ELECTRA models trained on Europeana Newspapers☆38Updated 4 years ago
- Language detection using Spacy and Fasttext☆57Updated 2 years ago
- A sentence segmentation library with wide language support optimized for speed and utility.☆86Updated 3 weeks ago
- spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to i…☆46Updated last year