cassidoo / scrapers
A list of scrapers from around the web.
☆658Updated 3 weeks ago
Alternatives and similar repositories for scrapers:
Users that are interested in scrapers are comparing it to the libraries listed below
- The Zipru scraper developed in the Advanced Web Scraping Tutorial.☆429Updated 7 years ago
- A collection of awesome web scaper, crawler.☆266Updated 10 months ago
- Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆576Updated 4 years ago
- Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy☆843Updated this week
- A curated list of resources related to internet marketing.☆213Updated 4 months ago
- Javascript scraping module based on puppeteer for many different search engines...☆554Updated 2 years ago
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆380Updated 6 years ago
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆439Updated last month
- Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …☆131Updated last year
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆423Updated 2 years ago
- Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Ana…☆2,118Updated 5 years ago
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆284Updated 7 years ago
- Save in a CSV file threads with their comments of a Facebook group.☆27Updated 7 years ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆260Updated 2 years ago
- HTTP API for Scrapy spiders☆849Updated 8 months ago
- Take the hassle out of web scraping☆465Updated 2 years ago
- Scrapes the public profile of the linkedin page☆554Updated 10 months ago
- A curated list of awesome twitter tools☆216Updated last year
- next generation web crawling using machine intelligence☆331Updated last year
- A curated list of SEO (Search Engine Optimization) links.☆679Updated 2 weeks ago
- Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt☆80Updated 11 months ago
- An unofficial API for Quora.☆297Updated 8 years ago
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆544Updated 2 years ago
- Rotating TOR proxy with Docker☆1,160Updated 10 months ago
- Scrape Instagram's API with Puppeteer☆398Updated 2 years ago
- Extract embedded metadata from HTML markup☆892Updated 3 weeks ago
- Job scraper and applier for indeed.com☆374Updated 3 years ago
- A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.☆2,675Updated 3 years ago
- use multiple proxies with Scrapy☆751Updated 2 years ago
- 🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.☆600Updated 10 months ago