Alternatives and similar repositories for pgpipeline

Users that are interested in pgpipeline are comparing it to the libraries listed below

• scrapinghub / scrapinghub-stack-scrapy
  Software stack with latest Scrapy and updated deps
  ☆65Updated last week
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• anuragrana / scraping_tweets_celery_rabbitmq_docker_cluster
  Scraping tweets quickly using celery, RabbitMQ and Docker cluster
  ☆50Updated 2 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 7 years ago
• scrapy-plugins / scrapy-headless
  ☆29Updated 4 years ago
• ljanyst / scrapy-do
  A daemon for scheduling Scrapy spiders
  ☆66Updated 4 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• jamesturk / scrapelib
  ⛏ a library for scraping unreliable pages
  ☆212Updated 2 weeks ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• saymedia / seosuite
  Automated Search Engine Optimization Testing Tool
  ☆82Updated 6 years ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 3 years ago
• kalombos / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆22Updated 6 years ago
• scrapinghub / arche
  Analyze scraped data
  ☆46Updated 5 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆90Updated 3 years ago
• nicodjimenez / bus_catchers
  Python scripts for scraping bus ticket data from the websites of BoltBus, Greyhound, Megabus, GoBus, Amtrak, Peterpan, and EasternTravel.
  ☆38Updated 4 years ago
• rdegges / python-amazonify
  The simplest way to build Amazon Affiliate links, in Python.
  ☆106Updated 3 years ago
• osantana / quickstartup-template
  Django Boilerplate Template for SaaS applications
  ☆46Updated last year
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago
• wq / itertable
  ⇔ IterTable is a Pythonic API for iterating through tabular data formats, including CSV, XLSX, XML, and JSON.
  ☆53Updated 2 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• lethain / extraction
  A Python library for extracting titles, images, descriptions and canonical urls from HTML.
  ☆151Updated 5 years ago
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆44Updated 4 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated last year
• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆209Updated 5 months ago
• minichiello / PyOpenGraph
  PyOpenGraph is a library written in Python for parsing Open Graph protocol information from web sites.
  ☆96Updated 11 years ago
• mcfunley / etsy-python
  Python access to the Etsy API
  ☆67Updated 13 years ago
• tryolabs / daywatch
  E-commerce scraping and analytics platform.
  ☆53Updated 9 years ago
• djaodjin / djaoapp
  Web/API Gateway with user profiles, billing, and subscription-based access control
  ☆140Updated last month
• scrapinghub / shub
  Scrapinghub Command Line Client
  ☆133Updated 3 months ago
• michaelhelmick / lassie
  Web Content Retrieval for Humans™
  ☆623Updated 3 years ago