Alternatives and similar repositories for sentencex

Users that are interested in sentencex are comparing it to the libraries listed below

• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆74Updated last month
• Helsinki-NLP / OPUS
  The Open Parallel Corpus
  ☆70Updated last month
• Helsinki-NLP / mammoth
  MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki
  ☆23Updated 3 months ago
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆117Updated 6 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆52Updated 2 weeks ago
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆31Updated 6 months ago
• Helsinki-NLP / OpusTools
  ☆72Updated last month
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆30Updated 3 months ago
• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆55Updated 5 months ago
• steinst / SentAlign
  ☆26Updated last year
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆104Updated last month
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆34Updated 3 months ago
• danielvarga / hunalign
  Sentence aligner
  ☆112Updated 3 years ago
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆143Updated 4 months ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆131Updated 5 months ago
• isi-nlp / uroman
  Universal Romanizer that can convert any unicode script to roman (latin) script
  ☆197Updated 9 months ago
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated last year
• WMT-QE-Task / wmt-qe-2023-data
  ☆9Updated last year
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆88Updated 2 years ago
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆153Updated last year
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 7 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆100Updated last year
• adbar / simplemma
  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
  ☆158Updated this week
• UBC-NLP / afrolid
  AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
  ☆31Updated 2 months ago
• hplt-project / OpusTrainer
  Curriculum training
  ☆17Updated 2 months ago
• alirezamshi-zz / small100
  Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…
  ☆21Updated 2 years ago
• hslh / magpie-corpus
  MAGPIE: A sense-annotated corpus of potentially idiomatic expressions
  ☆27Updated 4 years ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated last year
• omwn / omw-data
  This packages up data for the Open Multilingual Wordnet
  ☆48Updated 3 weeks ago
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆167Updated last year