Alternatives and similar repositories for python-sitemap:

Users that are interested in python-sitemap are comparing it to the libraries listed below

• dcondrey / scrapy-spiders
  Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …
  ☆131Updated last year
• michaelhelmick / lassie
  Web Content Retrieval for Humans™
  ☆620Updated 2 years ago
• NikolaiT / se-scraper
  Javascript scraping module based on puppeteer for many different search engines...
  ☆559Updated 2 years ago
• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆206Updated 2 months ago
• Ayima / sitemap-visualization-tool
  Python scripts for extracting, categorizing and visualizing an XML sitemap
  ☆97Updated 5 years ago
• scrapinghub / scrapinghub-stack-scrapy
  Software stack with latest Scrapy and updated deps
  ☆64Updated 2 months ago
• scrapinghub / sample-projects
  Sample projects showcasing Scrapinghub tech
  ☆138Updated last year
• jayzeng / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆328Updated 2 years ago
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆863Updated 4 months ago
• GateNLP / ultimate-sitemap-parser
  Ultimate Website Sitemap Parser
  ☆202Updated this week
• alecxe / scrapy-fake-useragent
  Random User-Agent middleware based on fake-useragent
  ☆696Updated last year
• syrusakbary / validate_email
  Validate_email verify if an email address is valid and really exists
  ☆582Updated 2 years ago
• jroakes / screaming-frog-shingling
  Uses Screaming Frog Internal HTML with text extraction along with a shingling algorithm to compare content duplication across the pages o…
  ☆43Updated 5 years ago
• Haikson / sitemap-generator
  Sitemap generator
  ☆83Updated last year
• AccordBox / awesome-scrapy
  A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
  ☆547Updated 2 years ago
• cnu / scrapy-random-useragent
  Scrapy Middleware to set a random User-Agent for every Request.
  ☆202Updated 5 years ago
• victordomingos / optimize-images
  A command-line interface (CLI) utility written in pure Python to help you reduce the file size of images.
  ☆278Updated 11 months ago
• scrapy / scrapyd-client
  Command line client for Scrapyd server
  ☆772Updated last month
• skynetbinary / major-scrapy-spiders
  Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon
  ☆287Updated 7 years ago
• adamlwgriffiths / amazon_scraper
  Provides content not accessible through the standard Amazon API
  ☆234Updated 7 years ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 5 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 6 years ago
• ecoron / SerpScrap
  SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …
  ☆262Updated 2 years ago
• reisepass / email-verifier
  SOCKS proxy enabled Email Verifier
  ☆108Updated last year
• scrapy-plugins / scrapy-deltafetch
  Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls
  ☆271Updated last month
• samwize / python-email-crawler
  Search on Google, and crawls for emails related to the result
  ☆294Updated 4 years ago
• scrapy / scrapely
  A pure-python HTML screen-scraping library
  ☆1,871Updated 3 years ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆121Updated 2 months ago
• lorien / user_agent
  Generator of User-Agent header
  ☆338Updated 10 months ago
• seomoz / reppy
  Modern robots.txt Parser for Python
  ☆194Updated last year