Alternatives and similar repositories for crawler-python

Users that are interested in crawler-python are comparing it to the libraries listed below

• cjdd3b / citizen-quotes
  A project to demonstrate maximum entropy models for extracting quotes from news articles in Python.
  ☆25Updated 13 years ago
• seomoz / mltk
  mltk - Moz Language Tool Kit
  ☆12Updated 10 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆35Updated 9 years ago
• chrismattmann / nutch-python
  Nutch-Python is a Python binding to the Apache Nutch™ REST services allowing Nutch to be called natively in the Python community. — Edit
  ☆39Updated 9 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago
• seomoz / g-crawl-py
  Gevent Crawling in Python, with Utilities
  ☆22Updated 10 years ago
• rohithpr / py-web-search
  A Python module to fetch and parse results from different search engines.
  ☆79Updated 7 years ago
• abhinavgupta / Extract-News-Summary
  Pure python script that takes user query and summarizes news related to it.
  ☆25Updated 3 years ago
• OlivierBlanvillain / crawler
  Blog crawler for the blogforever project.
  ☆23Updated 11 years ago
• kaflesudip / grabfeed
  Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …
  ☆21Updated 3 years ago
• sandinmyjoints / visularity
  Realtime semantic similarity visualization with gensim, d3.js, and hookbox
  ☆40Updated 11 years ago
• wdickers / Focused_Crawler
  Focused Crawler for VT's CTRNet
  ☆10Updated 12 years ago
• jarvy / jarvy
  Python Intelligent Assistant for Humans
  ☆18Updated 8 years ago
• BYU-NLP-Lab / topicalguide
  A web application for exploring documents topically.
  ☆26Updated 9 years ago
• ellisonbg / vizarray
  A Python package for visualizing 1d and 2d NumPy arrays
  ☆18Updated 9 years ago
• hardikvasa / cleoria-web-crawler
  A Python based web crawler that crawls all the web pages in a breathe-first approach from the given seed page
  ☆14Updated 10 years ago
• sachinrjoglekar / MapGeist
  Exploring Text, Graphically
  ☆12Updated 10 years ago
• hymloth / pyredise
  A simple and fast search engine
  ☆70Updated 3 years ago
• rspeer / text-as-data
  A PyData 2013 talk on straightforward, data-driven ways to handle natural language text in Python.
  ☆51Updated 10 years ago
• rodricios / crawl-to-the-future
  An attempt at creating a silver/gold standard dataset for backtesting yesterday & today's content-extractors
  ☆35Updated 10 years ago
• lugensa / scorched
  Sunburnt offspring solr client
  ☆27Updated 3 years ago
• weblyzard / ewrt
  extensible Web Retrieval Toolkit
  ☆17Updated 3 years ago
• Kitware / flow
  Full data science workflows on the web
  ☆21Updated 6 years ago
• gt-big-data / retina-clusterer
  The goal of this experiment is to take articles and certain metadata and group them by topic.
  ☆11Updated 9 years ago
• ptwobrussell / python-boilerpipe
  Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages
  ☆32Updated 9 years ago
• coastalcph / rungsted
  Fast structured perceptron sequential labeler
  ☆15Updated 9 years ago
• nasa-jpl-memex / topic_space
  Topic modeling web application
  ☆40Updated 10 years ago
• scrapy-plugins / scrapy-streaming
  ☆18Updated 8 years ago
• LuminosoInsight / assoc-space
  Compute association strength over semantic networks in a dimensionality-reduced form.
  ☆32Updated 10 years ago