Alternatives and similar repositories for aCrawler

Users that are interested in aCrawler are comparing it to the libraries listed below

• ClericPy / torequests
  Async wrapper for requests / aiohttp, and some crawler toolkits. Let synchronization code enjoy the performance of asynchronous programmi…
  ☆24Updated 11 months ago
• elacuesta / scrapy-pyppeteer
  Pyppeteer integration for Scrapy
  ☆58Updated 4 years ago
• python-ruia / ruia-pyppeteer
  A Ruia plugin for loading javascript - pyppeteer
  ☆18Updated 3 years ago
• zytedata / zyte-smartproxy-headless-proxy
  A complimentary proxy to help to use SPM with headless browsers
  ☆108Updated 2 years ago
• chuanconggao / html2json
  Lightweight library that converts a HTML webpage to JSON data using a template defined in JSON.
  ☆23Updated 8 months ago
• clemfromspace / scrapy-puppeteer
  Scrapy + Puppeteer
  ☆110Updated 4 years ago
• lopuhin / scrapy-pyppeteer
  Use pyppeteer from a Scrapy spider
  ☆59Updated 6 years ago
• roycehaynes / scrapy-rabbitmq
  A RabbitMQ Scheduler for Scrapy
  ☆87Updated 3 years ago
• rafpyprog / Mobilenium
  Mobilenium allows you to use Selenium and have access to status codes and HTTP headers, without the need for manual labor.
  ☆20Updated 6 years ago
• okumy / aiohttp-tus
  tus.io protocol implementation for aiohttp.web applications
  ☆17Updated 3 years ago
• scrapy-plugins / scrapy-dotpersistence
  A scrapy extension to sync `.scrapy` folder to an S3 bucket
  ☆18Updated 3 years ago
• timofurrer / observable
  minimalist event system for Python
  ☆85Updated 6 years ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆134Updated 2 weeks ago
• aaldaber / Distributed-Multi-User-Scrapy-System-with-a-Web-UI
  Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner
  ☆112Updated 7 years ago
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆193Updated 3 years ago
• mowshon / bounded_pool_executor
  Bounded Process&Thread Pool Executor
  ☆63Updated last year
• gbnk0 / simple-image-classifier
  Simple image classifier microservice using tensorflow and sanic
  ☆25Updated 7 years ago
• rmax / scrapydo
  Crochet-based blocking API for Scrapy.
  ☆46Updated 8 years ago
• alttch / atasker
  Python library for modern thread / multiprocessing pooling and task processing via asyncio
  ☆15Updated 5 years ago
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆45Updated 4 years ago
• EdmundMartin / Scrapio
  Asyncio web crawling framework. Work in progress.
  ☆19Updated last year
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆50Updated 7 years ago
• yunstanford / sanic-transmute
  Easily document your Sanic API with Swagger UI, Plus param validation and model serialization.
  ☆47Updated 4 years ago
• jawah / kiss-headers
  Python package for HTTP/1.1 style headers. Parse headers to objects. Most advanced available structure for http headers.
  ☆122Updated last month
• ThomasAitken / scrapy-sessions
  A session-management extension for Scrapy.
  ☆10Updated 2 years ago
• lixxu / sanic-motor
  simple motor wrapper for sanic
  ☆57Updated 3 years ago
• scrapy / queuelib
  Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python
  ☆291Updated last week
• goutomroy / digging_asyncio
  python 3.7 asyncio tutorial.
  ☆14Updated 6 years ago
• dcoles / pycurl-requests
  A Requests-compatible interface for PycURL.
  ☆71Updated 4 months ago
• linw1995 / data_extractor
  Combine XPath, CSS Selectors and JSONPath for Web data extracting.
  ☆29Updated last year