cassidoo / scrapers
A list of scrapers from around the web.
☆671Updated 3 months ago
Alternatives and similar repositories for scrapers
Users that are interested in scrapers are comparing it to the libraries listed below
Sorting:
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆430Updated 2 years ago
- Javascript scraping module based on puppeteer for many different search engines...☆560Updated 2 years ago
- Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆604Updated 4 years ago
- Crawler for LinkedIn full profiles 2019☆215Updated 4 years ago
- LinkedIn Scraper (currently working 2020)☆606Updated 2 years ago
- Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy☆888Updated this week
- A collection of awesome web scaper, crawler.☆273Updated last year
- Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.☆77Updated 4 years ago
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆386Updated 6 years ago
- Simple web scraping for Google Chrome.☆343Updated 14 years ago
- The Zipru scraper developed in the Advanced Web Scraping Tutorial.☆429Updated 8 years ago
- A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆447Updated last year
- Awesome Links about bots.☆446Updated 6 years ago
- Web data extraction tool implemented as chrome extension☆1,331Updated 6 years ago
- An unofficial API for Quora.☆299Updated 8 years ago
- 🕊TwitPy - Follow/Unfollow Automation☆104Updated 4 years ago
- Scrape Instagram's API with Puppeteer☆402Updated 2 years ago
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆445Updated 3 months ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆263Updated 2 years ago
- Universal Reddit Scraper - A comprehensive Reddit scraping/archival command-line tool.☆894Updated last year
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆287Updated 7 years ago
- This is a dataset of the all-time top 1,000 posts, from the top 2,500 subreddits by subscribers, pulled from reddit between August 15–20,…☆620Updated 5 years ago
- Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …☆131Updated last year
- A curated list of backlink, social signal opportunities, link building strategies and tactics, along with educational opportunities to he…☆229Updated this week
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆119Updated 5 years ago
- Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt☆81Updated last year
- This is a complete profile scraper that returns a JSON file.☆53Updated 7 years ago
- Awesome List of Landing Pages and Other Marketing Resources☆352Updated 3 years ago
- A library that scrapes Linkedin for user data☆2,480Updated 5 months ago
- Awesome Growth Hacking resources☆484Updated last year