Alternatives and similar repositories for python_scrapy_airflow_pipeline:

Users that are interested in python_scrapy_airflow_pipeline are comparing it to the libraries listed below

• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆28Updated this week
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆99Updated last month
• file-validator / file-validator
  The first Python validation package uses type, mime, extension, magic numbers, and size to validate files. ✅
  ☆68Updated 3 weeks ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆121Updated last month
• D4rkwat3r / aiohttp-ip-rotator
  Asynchronous alternative to the requests-ip-rotator library
  ☆40Updated 2 months ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆203Updated 3 weeks ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆67Updated last week
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆13Updated last year
• barseghyanartur / faker-file
  Create files with fake data. In many formats. With no efforts.
  ☆91Updated 2 weeks ago
• croqaz / awesome-scrapy
  🕶 Awesome list of Scrapy tools and libraries
  ☆59Updated 4 years ago
• scrapy-plugins / scrapy-zyte-api
  Zyte API integration for Scrapy
  ☆38Updated 2 weeks ago
• danclaudiupop / robox
  Simple library for exploring/scraping the web or testing a website you’re developing
  ☆127Updated 2 years ago
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆48Updated last week
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• scrapinghub / shublang
  Pluggable DSL that uses pipes to perform a series of linear transformations to extract data
  ☆16Updated 8 months ago
• richardpenman / builtwith
  ☆62Updated last year
• Privex / python-helpers
  Various Python 3.6+ helper classes/functions amalgamated into a single package: privex-helpers
  ☆16Updated 5 months ago
• scrapy / protego
  A pure-Python robots.txt parser with support for modern conventions.
  ☆64Updated last week
• florimondmanca / arel
  Lightweight browser hot reload for Python ASGI web apps
  ☆151Updated 11 months ago
• tfpgh / fastapi-microservice-template
  A template for a FastAPI based Serverless Framework microservice running on AWS Lambda
  ☆92Updated 9 months ago
• Miksus / red-bird
  Repository Patterns for Python
  ☆176Updated last year
• earlgreyness / aio-celery
  Celery worker for running asyncio coroutine tasks
  ☆37Updated 5 months ago
• dymmond / mongoz
  ODM with Pydantic made it simple
  ☆24Updated this week
• saadmk11 / redis-search-django
  Django package that provides auto indexing and searching capabilities for Django model instances using RediSearch.
  ☆93Updated this week
• ScrapeOps / scrapeops-scrapy-sdk
  Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the…
  ☆36Updated 8 months ago
• mirumee / saleor-app-framework-python
  Python Saleor App/Extension boilerplate. Batteries included.
  ☆53Updated last year
• TeamHG-Memex / autopager
  Detect and classify pagination links
  ☆102Updated 4 years ago
• jschnurr / scrapyscript
  Run a Scrapy spider programmatically from a script or a Celery task - no project required.
  ☆122Updated 10 months ago
• HMaker / python-cdp
  Python client and types generator for the Chrome DevTools Protocol (CDP)
  ☆70Updated 3 weeks ago
• singhsidhukuldeep / request-boost
  A better requests and urllib. A simple package for hitting multiple URLs and performing GET/POST requests in parallel.
  ☆42Updated last year