mideind / Tokenizer

Related projects ⓘ

Alternatives and complementary repositories for Tokenizer

• cadia-lvl / icelandic-NLP-resources
  Overview of Icelandic NLP resources at a glance
  ☆16Updated 4 months ago
• jonfd / nefnir
  A lemmatizer for Icelandic text
  ☆16Updated 6 years ago
• TakeLab / spacy-udpipe
  spaCy + UDPipe
  ☆161Updated 2 years ago
• MSeal / cython_hunspell
  Cython wrapper on Hunspell Dictionary
  ☆65Updated 4 months ago
• tokestermw / spacy_hunspell
  Hunspell extension for spaCy 2.0.
  ☆94Updated 3 months ago
• fnl / segtok
  Segtok v2 is here: https://github.com/fnl/syntok -- A rule-based sentence segmenter (splitter) and a word tokenizer using orthographic fe…
  ☆170Updated 2 years ago
• oliverguhr / deepmultilingualpunctuation
  A python package for deep multilingual punctuation prediction.
  ☆94Updated 2 months ago
• mideind / GreynirEngine
  A fast, efficient natural language processing engine for Icelandic.
  ☆60Updated last month
• lunayach / visNER
  In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.
  ☆69Updated last year
• treble-ai / pyduckling
  Rust-based Python wrapper for duckling library in Haskell
  ☆24Updated 3 years ago
• cadia-lvl / ice-asr
  An automatic speech recognition environment for Icelandic based on Kaldi
  ☆14Updated 7 years ago
• mideind / GreynirServer
  The greynir.is Icelandic natural language processing API and website.
  ☆65Updated 3 months ago
• nreimers / truecaser
  Language independent truecaser in Python.
  ☆161Updated 3 years ago
• clips / wordkit
  Featurize words into orthographic and phonological vectors.
  ☆40Updated last year
• hiredscorelabs / seqtolang
  Multi-Langauge Identification
  ☆28Updated 3 months ago
• writer / replaCy
  spaCy match and replace, maintaining conjugation
  ☆34Updated last year
• yannvgn / laserembeddings
  LASER multilingual sentence embeddings as a pip package
  ☆225Updated last year
• allo-media / text2num
  Parse and convert numbers written in French, English, Spanish, Portuguese, German and Catalan into their digit representation.
  ☆102Updated this week
• Abhijit-2592 / spacy-langdetect
  A fully customisable language detection pipeline for spaCy
  ☆93Updated 5 years ago
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆202Updated 2 years ago
• kylebgorman / syllabify
  Python module for syllabifying English ARPABET transcriptions
  ☆64Updated 5 years ago
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆92Updated 4 years ago
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆20Updated 2 years ago
• dbmdz / deep-eos
  General-Purpose Neural Networks for Sentence Boundary Detection
  ☆73Updated last year
• OpenJarbas / simple_NER
  simple rule based named entity recognition
  ☆43Updated 2 years ago
• bootphon / pygamma-agreement
  Gamma Agreement in Python
  ☆43Updated 8 months ago
• jacksonllee / pylangacq
  Language Acquisition Research Tools
  ☆37Updated 7 months ago
• Waino / morfessor-emprune
  Morfessor EM+Prune
  ☆10Updated 4 years ago
• hlt-mt / TMOP
  Translation Memory Open-source Purifier
  ☆33Updated 2 years ago
• TimKam / compound-word-splitter
  A compound word splitter for Python
  ☆48Updated 3 years ago