Alternatives and similar repositories for corpuscrawler

Users that are interested in corpuscrawler are comparing it to the libraries listed below

• LowResourceLanguages / endangered-languages
  A list of resources for conservation, development, and documentation of endangered, minority, and low or under-resourced human languages.
  ☆34Updated 2 years ago
• globalwordnet / cili
  The Global WordNet Association Collaborative Inter-Lingual Index
  ☆42Updated 6 months ago
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆293Updated 6 months ago
• unicode-cookbook / cookbook
  The Unicode Cookbook for Linguists
  ☆54Updated 4 years ago
• avineshpvs / indic_tagger
  Indian Language Tagger and Chunker (Hindi, Telugu, Tamil, Marathi, Punjabi, Kanada, Malayalam, Urdu, Bengali)
  ☆41Updated 2 years ago
• unicode-org / unilex
  Lexical data at Unicode
  ☆68Updated 9 months ago
• elexis-eu / lexonomy
  A cloud-based, open-source system for writing and publishing dictionaries.
  ☆91Updated last year
• danielvarga / hunalign
  Sentence aligner
  ☆113Updated 4 years ago
• amir-zeldes / RFTokenizer
  A character-wise tokenizer for morphologically rich languages
  ☆27Updated 2 months ago
• aalto-speech / morfessor
  Morfessor is a tool for unsupervised and semi-supervised morphological segmentation
  ☆193Updated 4 years ago
• pywirrarika / naki
  List of research and engineering of NLP for American Native/Indigenous Languages.
  ☆92Updated 4 years ago
• UniversalDependencies / tools
  Various utilities for processing the data.
  ☆209Updated this week
• UniversalDependencies / docs
  Universal Dependencies online documentation
  ☆284Updated this week
• machinetranslate / machinetranslate.org
  Open information and community for machine translation
  ☆77Updated last month
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆38Updated 3 years ago
• libindic / Transliteration
  Transliteration module for Indian Languages
  ☆78Updated last year
• LanguageMachines / ucto
  Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic pr…
  ☆68Updated 3 months ago
• juditacs / wikt2dict
  Wiktionary parser tool for many language editions.
  ☆54Updated 2 years ago
• DuyguA / DEMorphy
  German Morphological Analyzer
  ☆47Updated 3 years ago
• kbatsuren / CogNet
  CogNet: a large-scale, high-quality cognate database for 338 languages, 1.07M words, and 8.1 million cognates
  ☆48Updated last year
• hlt-mt / TMOP
  Translation Memory Open-source Purifier
  ☆34Updated 2 years ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆157Updated 11 months ago
• glottolog / pyglottolog
  Python API to access glottolog/glottolog
  ☆29Updated last week
• MSeal / cython_hunspell
  Cython wrapper on Hunspell Dictionary
  ☆66Updated 11 months ago
• unimorph / unimorph
  Master repo for the UniMorph project, includes the UniMorph schema and annotated data files
  ☆30Updated 5 years ago
• udapi / udapi-python
  Python framework for processing Universal Dependencies data
  ☆57Updated last week
• proycon / flat
  FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.g…
  ☆112Updated 4 months ago
• jonorthwash / ud-annotatrix
  ☆64Updated last year
• clab / wikipedia-parallel-titles
  Tools for extracting parallel corpora from article titles across languages in Wikipedia
  ☆73Updated 10 years ago
• google / transliteration
  Transliteration data and models
  ☆56Updated 8 years ago