Alternatives and similar repositories for sentencex

Users that are interested in sentencex are comparing it to the libraries listed below

• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆60Updated last year
• adbar / simplemma
  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
  ☆185Updated 8 months ago
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆38Updated 5 months ago
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated last year
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆164Updated 2 years ago
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated last year
• Helsinki-NLP / OPUS
  The Open Parallel Corpus
  ☆84Updated 3 weeks ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆74Updated 10 months ago
• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆17Updated 5 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆57Updated last week
• alea-institute / nupunkt
  Next-generation Punkt sentence boundary detection with zero dependencies
  ☆27Updated 2 months ago
• liao961120 / concordancer
  Searching in-memory corpus with Corpus Query Language (CQL)
  ☆19Updated last year
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆139Updated last year
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated 2 years ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆255Updated 3 years ago
• Helsinki-NLP / OpusTools
  ☆81Updated last week
• Babelscape / wikineural
  Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…
  ☆70Updated 3 years ago
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆23Updated 4 months ago
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆60Updated last month
• steinst / SentAlign
  ☆34Updated 2 years ago
• commoncrawl / web-languages
  Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ …
  ☆69Updated last month
• bltlab / paranames
  ParaNames: A multilingual resource for parallel names
  ☆39Updated last year
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆176Updated 3 months ago
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆208Updated 3 years ago
• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆54Updated 2 years ago
• UBC-NLP / afrolid
  AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
  ☆35Updated last week
• goodmami / wn
  A modern, interlingual wordnet interface for Python
  ☆282Updated last week
• ckorzen / pdf-text-extraction-benchmark
  A project about benchmarking and evaluating existing PDF extraction tools on their semantic abilities to extract the body texts from PDF …
  ☆69Updated 5 years ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆88Updated 3 years ago
• virtualvinodh / aksharamukha-python
  Aksharamukha Python Library
  ☆56Updated last year