mbanon / fastspellLinks
Targetted language identifier, based on FastText and Hunspell.
โ37Updated 6 months ago
Alternatives and similar repositories for fastspell
Users that are interested in fastspell are comparing it to the libraries listed below
Sorting:
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)โ74Updated 4 months ago
- ๐ธ GlotWeb: Web Indexing for Low-Resource Languages -- under construction.โ14Updated 2 weeks ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.โ51Updated last month
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiencyโ170Updated 2 months ago
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.โ32Updated 5 months ago
- Python Finite-State Toolkitโ58Updated this week
- OpusFilter - Parallel corpus processing toolkitโ110Updated 3 weeks ago
- Extracts plain text, language identification and more metadata from WARC recordsโ23Updated last month
- ๐ Resource and Tool for Writing System Identification -- LREC 2024โ19Updated last year
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.โ158Updated last year
- Augmenty is an augmentation library based on spaCy for augmenting texts.โ156Updated last year
- Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.โ108Updated 3 months ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.โ252Updated 2 years ago
- Library for fast text representation and classification.โ31Updated last year
- These are lists for a variety of languages containing words that are distinctive to each language.โ38Updated 3 years ago
- Tool to fix bitexts and tag near-duplicates for removalโ31Updated 6 months ago
- โ74Updated last week
- ๐ฅ Use Hugging Face text and token classification pipelines directly in spaCyโ63Updated last year
- ๐งช Cutting-edge experimental spaCy components and featuresโ101Updated last year
- Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2โฆโ69Updated 2 years ago
- In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.โ71Updated 2 years ago
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidataโ164Updated 2 years ago
- NTREX -- News Test References for MT Evaluationโ85Updated last year
- Transform TMX to textโ27Updated 2 years ago
- Seed Machine Translation Dataโ33Updated 9 months ago
- Faster, modernized fork of the language identification tool langid.pyโ56Updated 9 months ago
- Cython wrapper on Hunspell Dictionaryโ66Updated last year
- ๐ฌ Language Identification with Support for More Than 2000 Labels -- EMNLP 2023โ149Updated 2 months ago
- A High-level Library for Named Entity Recognition in Python.โ24Updated last year
- Python3 bindings for the Compact Language Detector v3 (CLD3)โ154Updated 2 years ago