Alternatives and similar repositories for corpuscrawler:

Users that are interested in corpuscrawler are comparing it to the libraries listed below

• UniversalDependencies / tools
  Various utilities for processing the data.
  ☆208Updated this week
• UniversalDependencies / docs
  Universal Dependencies online documentation
  ☆282Updated this week
• aalto-speech / morfessor
  Morfessor is a tool for unsupervised and semi-supervised morphological segmentation
  ☆191Updated 4 years ago
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆291Updated 4 months ago
• LowResourceLanguages / endangered-languages
  A list of resources for conservation, development, and documentation of endangered, minority, and low or under-resourced human languages.
  ☆34Updated last year
• unicode-org / unilex
  Lexical data at Unicode
  ☆69Updated 6 months ago
• machinetranslate / machinetranslate.org
  Open information and community for machine translation
  ☆74Updated last month
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆82Updated 3 years ago
• juditacs / wikt2dict
  Wiktionary parser tool for many language editions.
  ☆54Updated 2 years ago
• TakeLab / spacy-udpipe
  spaCy + UDPipe
  ☆161Updated 2 years ago
• lingpy / lingpy
  LingPy: Python library for quantitative tasks in historical linguistics
  ☆129Updated last week
• kbatsuren / CogNet
  CogNet: a large-scale, high-quality cognate database for 338 languages, 1.07M words, and 8.1 million cognates
  ☆47Updated last year
• argilla-io / spacy-wordnet
  spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface
  ☆254Updated 6 months ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆155Updated 9 months ago
• DuyguA / DEMorphy
  German Morphological Analyzer
  ☆47Updated 3 years ago
• EmilStenstrom / conllu
  A CoNLL-U parser that takes a CoNLL-U formatted string and turns it into a nested python dictionary.
  ☆314Updated last month
• google-research-datasets / wiki-split
  One million English sentences, each split into two sentences that together preserve the original meaning, extracted from Wikipedia edits.
  ☆123Updated 5 years ago
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆37Updated 2 years ago
• avineshpvs / indic_tagger
  Indian Language Tagger and Chunker (Hindi, Telugu, Tamil, Marathi, Punjabi, Kanada, Malayalam, Urdu, Bengali)
  ☆40Updated 2 years ago
• christos-c / bible-corpus
  A multilingual parallel corpus created from translations of the Bible.
  ☆178Updated 6 months ago
• pywirrarika / naki
  List of research and engineering of NLP for American Native/Indigenous Languages.
  ☆87Updated 4 years ago
• hlt-mt / TMOP
  Translation Memory Open-source Purifier
  ☆33Updated 2 years ago
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆53Updated 3 weeks ago
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆202Updated 3 years ago
• amir-zeldes / RFTokenizer
  A character-wise tokenizer for morphologically rich languages
  ☆27Updated 2 weeks ago
• pyconll / pyconll
  A minimal, pure Python library to interface with CoNLL-U format files.
  ☆149Updated last year
• glottolog / glottolog
  Collaborative data curation for Glottolog
  ☆159Updated last week
• danielvarga / hunalign
  Sentence aligner
  ☆112Updated 3 years ago
• tokestermw / spacy_hunspell
  Hunspell extension for spaCy 2.0.
  ☆94Updated 7 months ago
• tokestermw / spacy_grammar
  Language Tool style grammar handling with spaCy 2.0
  ☆42Updated 6 years ago