INNOVINATI / microwler

Related projects: ⓘ

• lorien / ioweb
  ☆35Updated this week
• python-ruia / awesome-ruia
  A list of awesome project for Ruia
  ☆13Updated 2 years ago
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆14Updated 8 months ago
• chuanconggao / html2json
  Lightweight library that converts a HTML webpage to JSON data using a template defined in JSON.
  ☆21Updated 3 years ago
• thombashi / sqliteschema
  sqliteschema is a Python library to dump table schema of a SQLite database file.
  ☆11Updated 9 months ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆93Updated 2 months ago
• roshanlam / SearchGar
  SearchGar - An actual Search Engine made using Python
  ☆18Updated 2 years ago
• HyperionGray / starbelly
  Streaming web crawler with WebSocket API
  ☆44Updated last year
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆55Updated 2 years ago
• scrapinghub / shublang
  Pluggable DSL that uses pipes to perform a series of linear transformations to extract data
  ☆15Updated 2 months ago
• barseghyanartur / radar
  Generate random date(time) in Python.
  ☆10Updated 6 months ago
• cheesemaafia / imgrerite
  ☆11Updated this week
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆44Updated 3 months ago
• scrapedia / scrapy-pipelines
  A collection of pipelines for Scrapy
  ☆16Updated last month
• medialab / ural
  A helper library full of URL-related heuristics.
  ☆56Updated last week
• scrapy-plugins / scrapy-headless
  ☆29Updated 3 years ago
• M4cs / jsonsty
  Free Cloud JSON Storage Written in Python
  ☆14Updated last year
• python-ruia / ruia-pyppeteer
  A Ruia plugin for loading javascript - pyppeteer
  ☆18Updated 2 years ago
• lorien / awesome-python-dev
  ☆12Updated this week
• croqaz / awesome-scrapy
  🕶 Awesome list of Scrapy tools and libraries
  ☆54Updated 4 years ago
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆42Updated 10 months ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated 2 months ago
• lorien / awesome-anti-captcha
  ☆16Updated this week
• MontFerret / pyfer
  Python wrapper for Ferret
  ☆42Updated 2 years ago
• Granitosaurus / parsel-cli
  cli for evaluating css and xpath selectors
  ☆25Updated last year
• ryo-ma / awesome-python-environment
  🐍A curated list of awesome python environment.
  ☆10Updated 4 years ago
• woxcab / scrapy_rss
  Tools to easy generate RSS feed that contains each scraped item using Scrapy framework.
  ☆30Updated 4 months ago
• fangfufu / reddit-regex-counter
  Count the number of matches for a regex string in a subreddit
  ☆11Updated 4 years ago
• stummjr / books_crawler
  A Scrapy crawler for http://books.toscrape.com
  ☆26Updated 7 years ago