Alternatives and similar repositories for sentencex:

Users that are interested in sentencex are comparing it to the libraries listed below

• openlanguagedata / seed
  Seed Machine Translation Data
  ☆30Updated 3 months ago
• sortiz / tmxt
  Transform TMX to text
  ☆28Updated 2 years ago
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆109Updated 4 months ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆70Updated 10 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆49Updated last month
• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated last year
• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆53Updated 3 months ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆29Updated 3 weeks ago
• danielvarga / hunalign
  Sentence aligner
  ☆110Updated 3 years ago
• steinst / SentAlign
  ☆25Updated last year
• Helsinki-NLP / OPUS
  The Open Parallel Corpus
  ☆64Updated this week
• WMT-QE-Task / wmt-qe-2023-data
  ☆9Updated last year
• MSeal / cython_hunspell
  Cython wrapper on Hunspell Dictionary
  ☆66Updated 8 months ago
• Helsinki-NLP / OpusTools
  ☆71Updated this week
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆24Updated 3 months ago
• graehl / carmel
  finite-state toolkit, EM and Bayesian (Gibbs sampling) training for FST and context-free derivation forests
  ☆41Updated 2 years ago
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆142Updated last month
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆35Updated 2 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆81Updated 8 months ago
• rewicks / ersatz
  ☆45Updated 7 months ago
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆21Updated last year
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆22Updated 3 years ago
• Helsinki-NLP / mammoth
  MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki
  ☆22Updated 2 weeks ago
• GorkaUrbizu / Coreference-Corpora-Resources
  List of corpora annotated for coreference for different languages
  ☆17Updated 6 months ago
• cisnlp / GlotLID
  Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆118Updated 3 months ago
• sloev / spacy-syllables
  Multilingual syllable annotation pipeline component for spacy
  ☆39Updated last year
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆100Updated 3 months ago
• UBC-NLP / afrolid
  AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
  ☆31Updated last year
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated 11 months ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆154Updated 8 months ago