Alternatives and similar repositories for py3langid:

Users that are interested in py3langid are comparing it to the libraries listed below

• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆29Updated 5 months ago
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆92Updated 4 years ago
• adbar / simplemma
  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
  ☆151Updated last month
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆33Updated 2 months ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆149Updated last year
• sortiz / tmxt
  Transform TMX to text
  ☆29Updated 2 years ago
• treble-ai / pyduckling
  Rust-based Python wrapper for duckling library in Haskell
  ☆25Updated 4 years ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆20Updated 5 months ago
• proycon / flat
  FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…
  ☆111Updated this week
• Babelscape / wikineural
  Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…
  ☆66Updated last year
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆69Updated 8 months ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆88Updated 2 years ago
• KennethEnevoldsen / spacy-wrap
  spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to i…
  ☆46Updated 9 months ago
• SYSTRAN / fuzzy-match
  Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.
  ☆46Updated 3 weeks ago
• explosion / spacy-experimental
  🧪 Cutting-edge experimental spaCy components and features
  ☆96Updated 8 months ago
• wjbmattingly / bagpipes-spacy
  Bagpipes spaCy is a collection of custom spaCy pipeline components designed to enhance text processing capabilities.
  ☆12Updated 5 months ago
• kpu / preprocess
  Corpus preprocessing
  ☆95Updated 10 months ago
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆31Updated 3 years ago
• liao961120 / concordancer
  Searching in-memory corpus with Corpus Query Language (CQL)
  ☆19Updated last month
• alvenirai / punctfix
  ☆22Updated 11 months ago
• sloev / spacy-syllables
  Multilingual syllable annotation pipeline component for spacy
  ☆39Updated last year
• nitotm / efficient-language-detector-py
  Fast and accurate natural language detection. Detector written in Python. Nito-ELD, ELD.
  ☆15Updated last year
• kermitt2 / grobid-ner
  A Named-Entity Recogniser based on Grobid.
  ☆49Updated 4 months ago
• allo-media / text2num
  Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.
  ☆104Updated 2 months ago
• wikimedia / sentencex
  A sentence segmentation library with wide language support optimized for speed and utility.
  ☆55Updated 4 months ago
• clips / wordkit
  Featurize words into orthographic and phonological vectors.
  ☆40Updated last year
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆203Updated 2 years ago
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆47Updated last week
• meertensinstituut / mtas
  Multi Tier Annotation Search
  ☆26Updated 3 years ago
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated 10 months ago