Alternatives and similar repositories for crawl-to-the-future

Users that are interested in crawl-to-the-future are comparing it to the libraries listed below

• seomoz / mltk
  mltk - Moz Language Tool Kit
  ☆12Updated 10 years ago
• Parsely / schemato
  Modularly extensible semantic metadata validator
  ☆84Updated 10 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆35Updated 9 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated last week
• willf / segment
  A tool to segment text based on frequencies and the Viterbi algorithm "#TheBoyWhoLived" => ['#', 'The', 'Boy', 'Who', 'Lived']
  ☆81Updated 9 years ago
• frnsys / broca
  rapid nlp prototyping
  ☆71Updated 3 years ago
• pudo-attic / archivekit
  ArchiveKit manages data and documents during ETL processes, either on a local file system or on S3.
  ☆15Updated 10 years ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 4 years ago
• semanticize / st
  Semanticizest: dump parser and client
  ☆20Updated 9 years ago
• openplans / openblock
  OpenBlock is a web application and RESTful service that allows users to browse and search their local area for "hyper-local news
  ☆61Updated 4 years ago
• nasa-jpl-memex / topic_space
  Topic modeling web application
  ☆40Updated 10 years ago
• nytlabs / linguo
  a set of services that provide NLP facilities
  ☆25Updated 5 years ago
• cjdd3b / citizen-quotes
  A project to demonstrate maximum entropy models for extracting quotes from news articles in Python.
  ☆26Updated 13 years ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 10 years ago
• ShinNoNoir / twitterwebsearch
  (BROKEN, help wanted)
  ☆15Updated 9 years ago
• ayoungprogrammer / Lango
  Language Lego
  ☆143Updated 6 years ago
• kxtells / vague-places
  ☆14Updated 9 years ago
• LuminosoInsight / assoc-space
  Compute association strength over semantic networks in a dimensionality-reduced form.
  ☆32Updated 10 years ago
• adamfabish / Reduction
  Reduction is a python script which automatically summarizes a text by extracting the sentences which are deemed to be most important.
  ☆54Updated 10 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 9 years ago
• ContinuumIO / topik
  A Topic Modeling toolbox
  ☆92Updated 9 years ago
• CenterForOpenScience / scrapi
  A data processing pipeline that schedules and runs content harvesters, normalizes their data, and outputs that normalized data to a varie…
  ☆42Updated 9 years ago
• turian / pytextpreprocess
  Preprocess text for NLP (tokenizing, lowercasing, stemming, sentence splitting, etc.)
  ☆29Updated 14 years ago
• Webhose / article-date-extractor
  Automatically extracts and normalizes an online article or blog post publication date
  ☆118Updated 2 years ago
• commonsense / simplenlp
  Lightweight, multilingual natural language processing
  ☆63Updated 12 years ago
• andrewclegg / sketchy
  Simple approximate-nearest-neighbours in Python using locality sensitive hashing.
  ☆142Updated 13 years ago
• wordnik / serapis
  Serapis is a sentence identifier and modeling pipeline / built for Wordnik
  ☆24Updated 9 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 3 years ago
• clips / MBSP
  Memory-based shallow parser for Python
  ☆74Updated 6 years ago
• harshavardhana / boilerpipy
  Readability/Boilerpipe extraction in Python
  ☆55Updated 9 years ago