Alternatives and similar repositories for web_scraping

Users that are interested in web_scraping are comparing it to the libraries listed below

• produvia / kryptos
  Kryptos AI is a virtual investment assistant that manages your cryptocurrency portfolio
  ☆50Updated 4 years ago
• upwork / python-upwork-oauth2
  Python bindings for Upwork API (OAuth2)
  ☆44Updated last year
• saadmanrafat / twitivity
  Twitter Accounts Activity API Client Library for Python
  ☆57Updated 8 months ago
• xdevplatform / twitter-python-ads-sdk
  A Twitter supported and maintained Ads API SDK for Python.
  ☆198Updated 3 years ago
• scrapy-plugins / scrapy-headless
  ☆29Updated 4 years ago
• AprilXiaoyanLiu / Business_Intelligence_Machine_Learning
  leverage predictive models, machine learning, data mining to solve marketing, business problems
  ☆13Updated 8 years ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆41Updated 4 years ago
• firmai / scrapers
  Scrapers from a project in 2018. Yelp, Spyfu, Similarweb, Morningstar, Linkedin, Instagram, Inside, Glassdoor, Facebook, Eat24, Doordash,…
  ☆98Updated 6 years ago
• xdevplatform / tweet_parser
  Reliably parse Tweets delivered by Twitter Data products in both the activity-streams and original formats.
  ☆61Updated 6 years ago
• orangain / scrapy-s3pipeline
  Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.
  ☆76Updated 3 years ago
• ggravlingen / pygleif
  Query the API of GLEIF.org using Python.
  ☆20Updated last week
• RicardoMoya / Scraping_Proxy_Tor
  Python, Tor, Stem, Privoxy: with this tools, allow requests new connections via Tor for obtain new IP addresses.
  ☆24Updated 7 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 4 years ago
• eliasdabbas / trending-twitter
  Simple dashboard for getting currently trending hashtags and topics on Twitter
  ☆25Updated 2 years ago
• ScrapingBee / scrapingbee-python
  A Python library to interact with ScrapingBee's API for headless browsers and proxy rotation
  ☆29Updated this week
• bsnacks000 / IPySigma-Demo
  Demo version of IPySigma jupyter/node.js application
  ☆17Updated 8 years ago
• singer-io / tap-facebook
  Singer.io tap for Facebook Marketing API
  ☆116Updated last month
• SadeghHayeri / Twitter-Friend-Connections
  Visualizing Twitter Friend Connections
  ☆16Updated 4 years ago
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 2 weeks ago
• mwouts / papermill_jupytext
  Parametrize and run scripts as notebooks with jupytext and papermill
  ☆18Updated 6 years ago
• edent / Twitter-Networks
  Create a directed network of Twitter followers.
  ☆71Updated 4 years ago
• TeamHG-Memex / domain-discovery-crawler
  Broad crawler for domain discovery
  ☆19Updated this week
• minimaxir / facebook-ad-library-scraper
  A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.
  ☆129Updated 6 years ago
• brandonrobertz / autoscrape-py
  An automated, programming-free web scraper for interactive sites
  ☆111Updated 2 years ago
• xdevplatform / do_more_with_twitter_data
  Tutorials for getting the most out of Twitter data.
  ☆106Updated 3 years ago
• uscensusbureau / SABLE
  Scraping Assisted by Learning
  ☆36Updated 4 months ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 5 years ago
• denadai2 / real-estate-neighborhood-prediction
  Code to repeat the experiments of "The economic value of neighborhoods: Predicting real estate prices from the urban environment"
  ☆77Updated 3 years ago
• danwagnerco / similarweb
  Python client for the SimilarWeb API
  ☆50Updated 8 years ago
• umihico / selenium-lambda-layer
  selenium with required binaries as one AWS Lambda Layer
  ☆15Updated 4 years ago