wind2sing / aCrawler

Related projects: ⓘ

• elacuesta / scrapy-pyppeteer
  Pyppeteer integration for Scrapy
  ☆60Updated 3 years ago
• lopuhin / scrapy-pyppeteer
  Use pyppeteer from a Scrapy spider
  ☆60Updated 4 years ago
• goutomroy / digging_asyncio
  python 3.7 asyncio tutorial.
  ☆14Updated 5 years ago
• ClericPy / torequests
  Async wrapper for requests / aiohttp, and some crawler toolkits. Let synchronization code enjoy the performance of asynchronous programmi…
  ☆24Updated last year
• sumitsk20 / fastapi-uvicorn-gunicorn-nginx-supervisor-boilerplate
  Production ready boilerplate to start with Fastapi
  ☆26Updated 3 years ago
• python-ruia / ruia-pyppeteer
  A Ruia plugin for loading javascript - pyppeteer
  ☆18Updated 2 years ago
• chuanconggao / html2json
  Lightweight library that converts a HTML webpage to JSON data using a template defined in JSON.
  ☆21Updated 3 years ago
• yunstanford / sanic-transmute
  Easily document your Sanic API with Swagger UI, Plus param validation and model serialization.
  ☆48Updated 2 years ago
• my8100 / logparser
  A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
  ☆88Updated 2 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆49Updated 6 years ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• lorien / ioweb
  ☆35Updated this week
• rmax / scrapydo
  Crochet-based blocking API for Scrapy.
  ☆46Updated 7 years ago
• clemfromspace / scrapy-puppeteer
  Scrapy + Puppeteer
  ☆110Updated 3 years ago
• elliott-maguire / apodo
  A cancelled Python web server project.
  ☆39Updated 4 years ago
• lixxu / sanic-motor
  simple motor wrapper for sanic
  ☆58Updated last year
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆44Updated 3 years ago
• ThomasAitken / scrapy-sessions
  A session-management extension for Scrapy.
  ☆11Updated 8 months ago
• Relrin / sanic-mongodb-extension
  MongoDB with μMongo support for Sanic framework
  ☆27Updated last year
• fkromer / awesome-fastapi
  ☆76Updated 4 years ago
• EdmundMartin / Scrapio
  Asyncio web crawling framework. Work in progress.
  ☆18Updated last month
• scrapinghub / scrapy-frontera
  More flexible and featured Frontera scheduler for Scrapy
  ☆35Updated 8 months ago
• scrapy-plugins / scrapy-headless
  ☆29Updated 3 years ago
• rmax / scrapy-inline-requests
  A decorator to write coroutine-like spider callbacks.
  ☆111Updated last year
• scrapinghub / arche
  Analyze scraped data
  ☆47Updated 4 years ago
• ycd / universities
  Free & open source API service for obtaining information about +9600 universities worldwide.
  ☆61Updated 3 years ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated 2 months ago
• kylin1020 / aiocrawler
  ☆11Updated this week
• ssfdust / full-stack-flask-smorest
  Full Stack Flask Rest Api with JWT, Celery , Swagger and Admin backend manager.
  ☆38Updated 4 months ago
• roycehaynes / scrapy-rabbitmq
  A RabbitMQ Scheduler for Scrapy
  ☆85Updated 2 years ago