wikimedia / sentencex

Related projects ⓘ

Alternatives and complementary repositories for sentencex

• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆67Updated 6 months ago
• adbar / py3langid
  Faster, modernized fork of the language identification tool langid.py
  ☆48Updated 5 months ago
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆92Updated 4 years ago
• sortiz / tmxt
  Transform TMX to text
  ☆29Updated last year
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆101Updated 2 weeks ago
• Helsinki-NLP / OpusTools
  ☆67Updated 3 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆48Updated 2 months ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆22Updated this week
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆30Updated last week
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆29Updated 3 months ago
• SYSTRAN / similarity
  Bilingual sentence similarity classifier using Tensorflow
  ☆19Updated 5 years ago
• adbar / simplemma
  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
  ☆144Updated this week
• Helsinki-NLP / mammoth
  MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki
  ☆22Updated this week
• jonathandunn / c2xg
  A Python package for learning, evaluating, annotating, and extracting vector representations of construction grammars
  ☆34Updated last month
• bltlab / paranames
  ParaNames: A multilingual resource for parallel names
  ☆30Updated 6 months ago
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆62Updated 8 months ago
• udapi / udapi-python
  Python framework for processing Universal Dependencies data
  ☆57Updated this week
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆139Updated 2 months ago
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆45Updated last week
• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated 10 months ago
• steinst / SentAlign
  ☆22Updated last year
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆31Updated 3 years ago
• MedKhem / grobid-dictionaries
  ☆32Updated 2 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆29Updated last month
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆102Updated 3 months ago
• LowResourceLanguages / endangered-languages
  A list of resources for conservation, development, and documentation of endangered, minority, and low or under-resourced human languages.
  ☆34Updated last year
• anlausch / ArguminSci
  Analyze Argumentation and Rhetorical Aspects in Scientific Writing.
  ☆19Updated 2 years ago
• goodmami / wn
  A modern, interlingual wordnet interface for Python
  ☆221Updated last week
• tsroten / hanzidentifier
  Python module that identifies Chinese text as being Simplified or Traditional
  ☆86Updated this week
• Helsinki-NLP / OPUS
  The Open Parallel Corpus
  ☆57Updated last week
• bitextor / warc2text
  Extracts plain text, language identification and more metadata from WARC records
  ☆20Updated 3 months ago