stummjr / books_crawler

Related projects ⓘ

Alternatives and complementary repositories for books_crawler

• alephdata / offshoreleaks
  Converter for ICIJ Offshore Leaks data into FollowTheMoney format
  ☆12Updated 2 years ago
• scrapy-plugins / scrapy-headless
  ☆29Updated 3 years ago
• minimaxir / get-data-from-photos-from-instagram-tags
  Processes data from images which are tagged with the specified Instagram tag.
  ☆13Updated 10 years ago
• woxcab / scrapy_rss
  Tools to easy generate RSS feed that contains each scraped item using Scrapy framework.
  ☆31Updated this week
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆42Updated last year
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 4 years ago
• alephdata / alephclient
  API client for Aleph, supports bulk entity and document upload.
  ☆28Updated last month
• paulfitz / sheetsite
  sync a website or local spreadsheet with a google sheet
  ☆35Updated last year
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆55Updated 2 years ago
• xdevplatform / bot-profile-append
  A Python script to help you add user attributions to your Twitter bots
  ☆11Updated 4 years ago
• chuanconggao / html2json
  Lightweight library that converts a HTML webpage to JSON data using a template defined in JSON.
  ☆21Updated 4 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• santinic / htmlmatch
  Python tool for automatic data scraping from Html templates
  ☆19Updated 8 years ago
• ericfourrier / gimmeproxy-api
  A Python wrapper for the GimmeProxy API (http://gimmeproxy.com/#api)
  ☆10Updated 5 months ago
• veltzer / pyscrapers
  project to produce various useful scrapers
  ☆26Updated 2 weeks ago
• scrapy / booksbot
  A crawler for http://books.toscrape.com
  ☆40Updated last year
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated 9 months ago
• uscensusbureau / SABLE
  Scraping Assisted by Learning
  ☆35Updated this week
• scrapinghub / docker-images
  ☆32Updated 10 months ago
• INNOVINATI / microwler
  A micro-framework for asynchronous deep crawls and web scraping with Python
  ☆13Updated last year
• kashaziz / rotating-proxy-python
  Python script for rotation through Proxy Servers
  ☆30Updated 6 years ago
• pablohoffman / awesome-web-scraping
  List of libraries, tools and APIs for web scraping and data processing.
  ☆13Updated 9 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 2 years ago
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆14Updated 10 months ago
• jplusplus / statscraper
  A base library for building web scrapers for statistical data, and a helper ontology for (primarily Swedish) statistical data.
  ☆13Updated last year
• prahladyeri / siterank
  Console program to get global ranking for a given website or domain
  ☆20Updated last year
• Ghostofapacket / socialscrape-bot
  Bot for operating snscrape in #archivebot on efnet
  ☆10Updated 4 years ago