Alternatives and similar repositories for sentencex

Users that are interested in sentencex are comparing it to the libraries listed below

• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated 10 months ago
• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆59Updated 10 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆52Updated last week
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆124Updated 11 months ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆74Updated 6 months ago
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆37Updated last month
• adbar / simplemma
  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
  ☆176Updated 4 months ago
• Helsinki-NLP / OPUS
  The Open Parallel Corpus
  ☆76Updated last month
• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆15Updated last month
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆33Updated last month
• Helsinki-NLP / OPUS-translator
  Translation demonstrator
  ☆34Updated 5 years ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated last year
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆93Updated 5 years ago
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆58Updated 2 weeks ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆158Updated last year
• steinst / SentAlign
  ☆31Updated last year
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆254Updated 2 years ago
• Helsinki-NLP / OpusTools
  ☆76Updated last month
• LuminosoInsight / exquisite-corpus
  Put together a multilingual corpus from a variety of sources. Used for wordfreq and word embeddings.
  ☆53Updated 4 years ago
• eole-nlp / eole
  Open language modeling toolkit based on PyTorch
  ☆147Updated 2 weeks ago
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated last year
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆108Updated 10 months ago
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆162Updated last year
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆23Updated last week
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆110Updated last week
• omwn / omw-data
  This packages up data for the Open Multilingual Wordnet
  ☆54Updated 4 months ago
• goodmami / wn
  A modern, interlingual wordnet interface for Python
  ☆263Updated last month
• browsermt / students
  Efficient teacher-student models and scripts to make them
  ☆51Updated last year
• tsroten / hanzidentifier
  Python module that identifies Chinese text as being Simplified or Traditional
  ☆101Updated 10 months ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆89Updated 2 years ago