richardpenman / builtwith

Related projects ⓘ

Alternatives and complementary repositories for builtwith

• scrapehero / selectorlib
  A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them
  ☆66Updated last year
• GateNLP / ultimate-sitemap-parser
  Ultimate Website Sitemap Parser
  ☆181Updated last year
• scrapy-plugins / scrapy-zyte-api
  Zyte API integration for Scrapy
  ☆36Updated this week
• richardpenman / whois
  ☆382Updated this week
• scrapinghub / price-parser
  Extract price amount and currency symbol from a raw text string
  ☆316Updated 2 weeks ago
• ecoron / SerpScrap
  SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …
  ☆257Updated 2 years ago
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆24Updated this week
• deedy5 / requests_tor
  Multithreading requests via TOR with automatic TOR new identity
  ☆52Updated last year
• fhightower / html-to-json
  Convert HTML to JSON. Can also (intelligently) convert HTML tables to JSON (using table headers (if available) as keys in the resulting J…
  ☆49Updated last year
• michaelherold / pyIsEmail
  Simple, robust email validation
  ☆126Updated 2 years ago
• mboot-github / WhoisDomain
  lookup whois data and format the response in a standarized way
  ☆46Updated 7 months ago
• wiejakp / python-sitemap-generator
  Crawl any Web page and generate XML sitemap compatible with Google's indexing robots.
  ☆37Updated last month
• johnbumgarner / newspaper3_usage_overview
  This repository provides usage examples for the Python module Newspaper3k.
  ☆142Updated 10 months ago
• lipoja / URLExtract
  URLExtract is python class for collecting (extracting) URLs from given text based on locating TLD.
  ☆246Updated 8 months ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆95Updated last month
• scrapy / itemadapter
  Common interface for data container classes
  ☆62Updated this week
• joshcarty / google-searchconsole
  A wrapper for the Google Search Console API.
  ☆223Updated 6 months ago
• scrapy-plugins / scrapy-headless
  ☆29Updated 3 years ago
• mboot-github / python-whois
  Python module/library for retrieving domain WHOIS information (only domain)
  ☆289Updated 9 months ago
• Gardener-gg / email-verifier
  SOCKS proxy enabled Email Verifier
  ☆102Updated 7 months ago
• scrapinghub / scrapinghub-stack-scrapy
  Software stack with latest Scrapy and updated deps
  ☆62Updated this week
• ogun / uule_grabber
  Generates UULE codes for Google Search
  ☆21Updated last year
• anthonyhseb / googlesearch
  Python library for scraping google search results
  ☆115Updated last week
• ultrafunkamsterdam / toraio
  toraio - a pool of proxies, shifting on each request [not maintained, please use https://github.com/ultrafunkamsterdam/aionion]
  ☆45Updated last year
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆119Updated this week
• scrapy / protego
  A pure-Python robots.txt parser with support for modern conventions.
  ☆55Updated this week
• eliasdabbas / advertools_crawler_ui
  advertools crawler UI
  ☆28Updated 2 years ago
• nlpcloud / nlpcloud-python
  NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, paraphrasing, …
  ☆76Updated 8 months ago
• stav / wgrep
  Web grep: search all rendered resources used by a URI
  ☆86Updated 4 months ago
• zytedata / python-zyte-api
  Python client for Zyte API
  ☆21Updated last month