Alternatives and similar repositories for aCrawler:

Users that are interested in aCrawler are comparing it to the libraries listed below

• lopuhin / scrapy-pyppeteer
  Use pyppeteer from a Scrapy spider
  ☆60Updated 5 years ago
• goutomroy / digging_asyncio
  python 3.7 asyncio tutorial.
  ☆14Updated 5 years ago
• ClericPy / torequests
  Async wrapper for requests / aiohttp, and some crawler toolkits. Let synchronization code enjoy the performance of asynchronous programmi…
  ☆24Updated last week
• clemfromspace / scrapy-puppeteer
  Scrapy + Puppeteer
  ☆111Updated 3 years ago
• ThomasAitken / scrapy-sessions
  A session-management extension for Scrapy.
  ☆11Updated last year
• BruceDone / scrapy_demo
  all kinds of scrapy demo
  ☆164Updated 2 years ago
• rafpyprog / Mobilenium
  Mobilenium allows you to use Selenium and have access to status codes and HTTP headers, without the need for manual labor.
  ☆20Updated 5 years ago
• chuanconggao / html2json
  Lightweight library that converts a HTML webpage to JSON data using a template defined in JSON.
  ☆21Updated 4 years ago
• aaldaber / Distributed-Multi-User-Scrapy-System-with-a-Web-UI
  Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner
  ☆113Updated 6 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 6 years ago
• kadnan / ScrapeGen
  A simple python tool that generates a requests/bs4 based web scraper
  ☆26Updated 2 years ago
• EdmundMartin / Scrapio
  Asyncio web crawling framework. Work in progress.
  ☆18Updated 6 months ago
• cvibhagool / scrapy-tor
  Scrapy integration with Tor for anonymous web scraping
  ☆46Updated 9 years ago
• povilasb / scrapy-html-storage
  Scrapy downloader middleware that stores response HTMLs to disk.
  ☆18Updated 9 months ago
• scrapinghub / arche
  Analyze scraped data
  ☆46Updated 5 years ago
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆46Updated 2 weeks ago
• python-ruia / ruia-pyppeteer
  A Ruia plugin for loading javascript - pyppeteer
  ☆18Updated 2 years ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆66Updated last week
• ncouture / python-search-engine
  Search engine base (crawler, indexer and parser) using Python, Celery, RabbitMQ, CouchDB and Whoosh.
  ☆11Updated last year
• IaroslavR / scrapy-mysql-pipeline
  scrapy mysql pipeline
  ☆49Updated 3 years ago
• Relrin / sanic-mongodb-extension
  MongoDB with μMongo support for Sanic framework
  ☆27Updated last year
• yunstanford / sanic-transmute
  Easily document your Sanic API with Swagger UI, Plus param validation and model serialization.
  ☆47Updated 3 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆96Updated last week
• mmas / docker-scrapy-tor
  Scrapy environment with Tor for anonymous ip routing and Privoxy for http proxy
  ☆20Updated 8 years ago
• ispras / scrapy-puppeteer
  Library that helps use puppeteer in scrapy.
  ☆52Updated 3 weeks ago
• rangertaha / scrapy-prometheus-exporter
  Scrapy stats exporter for prometheus
  ☆19Updated 3 months ago
• croqaz / awesome-scrapy
  🕶 Awesome list of Scrapy tools and libraries
  ☆59Updated 4 years ago
• scrapinghub / scrapy-frontera
  More flexible and featured Frontera scheduler for Scrapy
  ☆36Updated 2 months ago
• frostming / flask-crontab
  Simple Flask scheduled tasks without extra daemons
  ☆101Updated 3 years ago
• strongbugman / ant_nest
  Simple, clear and fast Web Crawler framework build on python3.6+, powered by asyncio.
  ☆95Updated 2 years ago