mediacloud / sentence-splitter

Related projects ⓘ

Alternatives and complementary repositories for sentence-splitter

• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆203Updated 2 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆102Updated 3 months ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆150Updated 5 months ago
• yannvgn / laserembeddings
  LASER multilingual sentence embeddings as a pip package
  ☆225Updated last year
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆351Updated last year
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆328Updated 2 years ago
• bjascob / LemmInflect
  A python module for English lemmatization and inflection.
  ☆261Updated last year
• adbar / simplemma
  Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
  ☆144Updated this week
• thompsonb / vecalign
  Improved Sentence Alignment in Linear Time and Space
  ☆163Updated last year
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆101Updated 2 weeks ago
• feralvam / easse
  Easier Automatic Sentence Simplification Evaluation
  ☆159Updated last year
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆139Updated 2 months ago
• dbmdz / berts
  DBMDZ BERT, DistilBERT, ELECTRA, GPT-2 and ConvBERT models
  ☆155Updated last year
• tsproisl / SoMaJo
  A tokenizer and sentence splitter for German and English web and social media texts.
  ☆135Updated 3 months ago
• danielvarga / hunalign
  Sentence aligner
  ☆108Updated 3 years ago
• Hyperparticle / udify
  A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…
  ☆220Updated last year
• aboSamoor / pycld2
  ☆165Updated 5 months ago
• R1j1t / contextualSpellCheck
  ✔️Contextual word checker for better suggestions (not actively maintained)
  ☆409Updated last month
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆291Updated last week
• crabcamp / lexrank
  LexRank algorithm for text summarization
  ☆229Updated 7 months ago
• google-research-datasets / C4_200M-synthetic-dataset-for-grammatical-error-correction
  This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences fro…
  ☆157Updated last month
• mmxgn / spacy-clausie
  Implementation of the ClausIE information extraction system for python+spacy
  ☆220Updated 2 years ago
• goodmami / wn
  A modern, interlingual wordnet interface for Python
  ☆221Updated last week
• TharinduDR / TransQuest
  Transformer based translation quality estimation
  ☆107Updated last year
• nreimers / truecaser
  Language independent truecaser in Python.
  ☆161Updated 3 years ago
• boberle / cofr
  coFR: COreference resolution tool for FRench (and singletons).
  ☆24Updated 4 years ago
• vgrabovets / multi_rake
  Multilingual Rapid Automatic Keyword Extraction (RAKE) for Python
  ☆268Updated last year
• pyconll / pyconll
  A minimal, pure Python library to interface with CoNLL-U format files.
  ☆149Updated last year
• TurkuNLP / Turku-neural-parser-pipeline
  A neural parsing pipeline for segmentation, morphological tagging, dependency parsing and lemmatization with pre-trained models for more …
  ☆112Updated 6 months ago
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆92Updated 4 years ago