Alternatives and similar repositories for crawler-demo:

Users that are interested in crawler-demo are comparing it to the libraries listed below

• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆204Updated last month
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆121Updated 2 months ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆67Updated last month
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆48Updated last month
• Luqman-Ud-Din / random_user_agent
  A package to get list of user agents based on filters such as operating system, software name etc..
  ☆97Updated 9 months ago
• jschnurr / scrapyscript
  Run a Scrapy spider programmatically from a script or a Celery task - no project required.
  ☆122Updated 10 months ago
• facelessuser / soupsieve
  A modern CSS selector implementation for BeautifulSoup
  ☆232Updated last week
• the-wondersmith / celery-aio-pool
  Celery worker pool with support for asyncio coroutines as tasks
  ☆64Updated 4 months ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆99Updated 2 months ago
• stav / wgrep
  Web grep: search all rendered resources used by a URI
  ☆87Updated 3 weeks ago
• lorien / user_agent
  Generator of User-Agent header
  ☆338Updated 10 months ago
• alecxe / scrapy-fake-useragent
  Random User-Agent middleware based on fake-useragent
  ☆696Updated last year
• jordaneremieff / aeroplane
  Example project using Django and FastAPI together.
  ☆71Updated 2 years ago
• zseta / scrapy-templates
  ☆20Updated 4 years ago
• further-reading / scrapy-gui
  A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.
  ☆109Updated 11 months ago
• jesuslosada / scrapy-xlsx
  XLSX exporter for Scrapy
  ☆28Updated 2 years ago
• ScrapeOps / scrapeops-scrapy-sdk
  Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the…
  ☆36Updated 9 months ago
• scrapinghub / spidermon
  Scrapy Extension for monitoring spiders execution.
  ☆540Updated 2 weeks ago
• matthiask / html-sanitizer
  Allowlist-based HTML cleaner
  ☆141Updated 4 months ago
• insightindustry / validator-collection
  Python library of 60+ commonly-used validator functions
  ☆130Updated 2 years ago
• EasyPi / docker-scrapyd
  🕷️ Scrapyd is an application for deploying and running Scrapy spiders.
  ☆83Updated 2 weeks ago
• jundymek / free-proxy
  Free proxy scraper written in python. It is pypi library - free to use.
  ☆273Updated 5 months ago
• adriancast / Scrapyd-Django-Template
  Basic setup to run ScrapyD + Django and save it in Django Models. You can be up and running in just a few minutes
  ☆126Updated 2 years ago
• rejoiceinhope / scrapy-proxy-pool
  ☆166Updated 5 years ago
• yhino / pipenv-poetry-migrate
  This is simple migration script, migrate pipenv to poetry
  ☆124Updated this week
• kodless / leek
  Celery Tasks Monitoring Tool
  ☆167Updated 5 months ago
• xiaowangwindow / scrapy-httpcache
  A scrapy middleware to save http cache to MongoDB
  ☆13Updated 2 years ago
• jaraco / cssutils
  ☆84Updated 2 months ago
• croqaz / awesome-scrapy
  🕶 Awesome list of Scrapy tools and libraries
  ☆59Updated 4 years ago
• TkTech / json_benchmark
  Python JSON benchmarking and "correctness".
  ☆32Updated last year