Alternatives and similar repositories for py3langid:

Users that are interested in py3langid are comparing it to the libraries listed below

• wikimedia / sentencex
  A sentence segmentation library with wide language support optimized for speed and utility.
  ☆59Updated 6 months ago
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated last year
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆151Updated last year
• adbar / simplemma
  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
  ☆154Updated 4 months ago
• LanguageMachines / ucto
  Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic pr…
  ☆68Updated last month
• prosegrinder / python-cmudict
  A versioned python wrapper package for cmudict (https://github.com/cmusphinx/cmudict).
  ☆61Updated 2 weeks ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 5 months ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆21Updated 3 weeks ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆150Updated last year
• Helsinki-NLP / OpusTools
  ☆72Updated last month
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆123Updated 2 months ago
• allo-media / text2num
  Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.
  ☆105Updated last month
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆34Updated last month
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆30Updated 4 months ago
• cophi-wue / pydelta
  an experimental implementation of Burrow's delta in Python 3
  ☆21Updated 3 years ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆70Updated 11 months ago
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆32Updated 3 years ago
• Felflare / rpunct
  📝An easy-to-use package to restore punctuation of the text.
  ☆114Updated last year
• neuml / staticvectors
  🔢 Work with static vector models
  ☆22Updated 2 months ago
• KennethEnevoldsen / spacy-wrap
  spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to i…
  ☆46Updated 11 months ago
• Babelscape / wikineural
  Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…
  ☆67Updated 2 years ago
• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆50Updated last year
• liao961120 / concordancer
  Searching in-memory corpus with Corpus Query Language (CQL)
  ☆19Updated 3 months ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆155Updated 9 months ago
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆113Updated 4 months ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆88Updated 2 years ago
• nitotm / efficient-language-detector-py
  Fast and accurate natural language detection. Detector written in Python. Nito-ELD, ELD.
  ☆16Updated last year
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆53Updated last month
• sloev / spacy-syllables
  Multilingual syllable annotation pipeline component for spacy
  ☆39Updated 2 years ago
• Helsinki-NLP / OPUS-translator
  Translation demonstrator
  ☆32Updated 4 years ago