Alternatives and similar repositories for crawl-to-the-future

Users that are interested in crawl-to-the-future are comparing it to the libraries listed below

• seomoz / mltk
  mltk - Moz Language Tool Kit
  ☆12Updated 10 years ago
• Parsely / schemato
  Modularly extensible semantic metadata validator
  ☆84Updated 9 years ago
• harshavardhana / boilerpipy
  Readability/Boilerpipe extraction in Python
  ☆55Updated 9 years ago
• willf / segment
  A tool to segment text based on frequencies and the Viterbi algorithm "#TheBoyWhoLived" => ['#', 'The', 'Boy', 'Who', 'Lived']
  ☆81Updated 9 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆35Updated 9 years ago
• frnsys / broca
  rapid nlp prototyping
  ☆71Updated 3 years ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 3 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago
• openstates / billy
  legacy backend for Open States
  ☆87Updated 5 years ago
• tomayac / wikipedia-live-monitor
  Wikipedia Live Monitor
  ☆22Updated 9 months ago
• seomoz / mozsci
  Data science tools from Moz
  ☆23Updated 8 years ago
• semanticize / st
  Semanticizest: dump parser and client
  ☆20Updated 9 years ago
• Webhose / article-date-extractor
  Automatically extracts and normalizes an online article or blog post publication date
  ☆117Updated 2 years ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 10 years ago
• ayoungprogrammer / Lango
  Language Lego
  ☆141Updated 5 years ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆62Updated last month
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• nytlabs / linguo
  a set of services that provide NLP facilities
  ☆25Updated 4 years ago
• ContinuumIO / topik
  A Topic Modeling toolbox
  ☆92Updated 9 years ago
• nasa-jpl-memex / topic_space
  Topic modeling web application
  ☆40Updated 10 years ago
• CenterForOpenScience / scrapi
  A data processing pipeline that schedules and runs content harvesters, normalizes their data, and outputs that normalized data to a varie…
  ☆41Updated 9 years ago
• pudo-attic / archivekit
  ArchiveKit manages data and documents during ETL processes, either on a local file system or on S3.
  ☆15Updated 10 years ago
• emehrkay / rgp
  RGP -- Redis Graph via Python
  ☆30Updated 10 years ago
• scrapinghub / aduana
  Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…
  ☆55Updated last year
• OlivierBlanvillain / crawler
  Blog crawler for the blogforever project.
  ☆23Updated 11 years ago
• LuminosoInsight / assoc-space
  Compute association strength over semantic networks in a dimensionality-reduced form.
  ☆32Updated 10 years ago
• Lab41 / pythia
  Supervised learning for novelty detection in text
  ☆78Updated 8 years ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 10 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• stared / tagoverflow
  An interactive map of Stack Exchange tags for all sites.
  ☆126Updated 2 years ago