Alternatives and similar repositories for sentencex

Users that are interested in sentencex are comparing it to the libraries listed below

• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆23Updated 2 months ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated last year
• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆61Updated last year
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆53Updated 2 months ago
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated last year
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆38Updated 3 months ago
• adbar / simplemma
  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
  ☆180Updated 6 months ago
• Helsinki-NLP / OPUS
  The Open Parallel Corpus
  ☆79Updated last week
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆74Updated 8 months ago
• virtualvinodh / aksharamukha-python
  Aksharamukha Python Library
  ☆55Updated 10 months ago
• proycon / analiticcl
  an approximate string matching or fuzzy-matching system for spelling correction, normalisation or post-OCR correction (mirror of https://…
  ☆37Updated 2 months ago
• commoncrawl / web-languages
  Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ …
  ☆65Updated this week
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆131Updated last year
• ckorzen / pdf-text-extraction-benchmark
  A project about benchmarking and evaluating existing PDF extraction tools on their semantic abilities to extract the body texts from PDF …
  ☆69Updated 5 years ago
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated last year
• stanfordnlp / pdf-struct
  Logical structure analysis for visually structured documents
  ☆94Updated 3 years ago
• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆16Updated 3 months ago
• maidis / awesome-machine-translation
  A list of awesome Machine Translation frameworks, libraries, software and papers
  ☆194Updated last year
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆113Updated 3 weeks ago
• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆52Updated last year
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆163Updated last year
• davidberenstein1957 / spacy-setfit
  This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.
  ☆80Updated 2 years ago
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆38Updated 3 years ago
• wjbmattingly / spacyex
  SpaCyEx allows the creation of spaCy Matcher patterns with RegEx like syntax.
  ☆59Updated last year
• goodmami / wn
  A modern, interlingual wordnet interface for Python
  ☆276Updated this week
• BramVanroy / spacy_download
  Download and load spaCy models on-the-fly
  ☆15Updated 2 years ago
• commoncrawl / cc-downloader
  A polite and user-friendly downloader for Common Crawl data
  ☆63Updated 3 months ago
• UBC-NLP / afrolid
  AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
  ☆34Updated 9 months ago
• KorAP / Tokenizer-Evaluation
  Benchmark scripts for comparing different tokenizers and sentence segmenters of German
  ☆12Updated 2 years ago
• wjbmattingly / LeetTopic
  ☆55Updated last year