theanti9 / PyCrawler

Related projects ⓘ

Alternatives and complementary repositories for PyCrawler

• yaojialyu / crawler
  a web crawler
  ☆132Updated 7 years ago
• ewa / python-webcrawler
  Simple web crawler written in Python
  ☆109Updated last year
• Diastro / Zeek
  Python distributed web scrapper and dynamic crawler
  ☆140Updated 7 years ago
• realpython / stack-spider
  ☆167Updated 6 years ago
• jmg / crawley
  Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.
  ☆187Updated last year
• bbrodriges / pholcidae
  Tiny python web crawler
  ☆170Updated 8 years ago
• renxing / quora-python
  Quora clone write in Python + Tornado + MongoDB
  ☆106Updated 3 years ago
• finiteloop / blog
  My blog, written with Tornado + AppEngine
  ☆148Updated 15 years ago
• openlabs / Microsoft-Translator-Python-API
  Not maintained here anymore. See fork
  ☆103Updated 2 years ago
• axiak / pybloomfiltermmap
  Fast Python Bloom Filter using Mmap
  ☆741Updated 5 years ago
• brandicted / scrapy-webdriver
  ☆143Updated 8 years ago
• YahooArchive / yos-social-python
  [dormant] Python SDK
  ☆62Updated 9 years ago
• andrewjw / celery-crawler
  A Django based search engine powered by CouchDB, celery and whoosh.
  ☆49Updated 8 years ago
• jjlee / mechanize
  Stateful programmatic web browsing in Python, after Andy Lester's Perl module WWW::Mechanize .
  ☆618Updated 7 years ago
• arapidhs / scry
  Web scraping engines with Python and Scrapy
  ☆33Updated 4 years ago
• limboy / chat
  a live chat built with python(flask + gevent + apscheduler) + redis
  ☆321Updated 2 years ago
• Alir3z4 / python-sanitize
  Bringing sanity to world of messed-up data
  ☆65Updated 10 years ago
• aitjcize / creepy
  Dead simple web crawler for Python
  ☆39Updated 4 years ago
• csirtfoundry / BulkWhois
  Python interfaces to popular bulk WHOIS servers such as Shadowserver and Team Cymru.
  ☆20Updated 13 years ago
• orf / cyborg
  Python web scraping framework
  ☆316Updated 7 years ago
• pkrumins / xgoogle
  Python library to Google services (google search, google sets, google translate, sponsored links)
  ☆217Updated 5 years ago
• julien-duponchelle / scrapy-mongodb
  Mongodb support for scrapy
  ☆101Updated 7 years ago
• mfenniak / pyPdf
  Pure-Python PDF Library; this repository is no longer maintained, please see https://github.com/knowah/PyPDF2/ insead.
  ☆277Updated 4 years ago
• scrapinghub / scrapylib
  Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)
  ☆32Updated 6 years ago
• ptwobrussell / Mining-the-Social-Web
  The official online compendium for Mining the Social Web (O'Reilly, 2011)
  ☆1,208Updated 11 years ago
• chriskiehl / pyrobot
  A pure python windows automation library loosely modeled after Java's Robot Class.
  ☆222Updated 5 years ago
• alexksikes / mass-scraping
  Quickly download and scrape websites on a massive scale.
  ☆63Updated 12 years ago
• xamox / pygame
  This is a github clone of the offical pygame repo, because let's face it, bitbucket sucks ass.
  ☆111Updated 9 years ago