cassidoo / scrapers
A list of scrapers from around the web.
☆603Updated last month
Related projects: ⓘ
- A collection of awesome web scaper, crawler.☆244Updated 5 months ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆411Updated last year
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆426Updated this week
- Javascript scraping module based on puppeteer for many different search engines...☆543Updated last year
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆251Updated 2 years ago
- The Zipru scraper developed in the Advanced Web Scraping Tutorial.☆426Updated 7 years ago
- An unofficial API for Quora.☆294Updated 7 years ago
- Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …☆127Updated last year
- Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆546Updated 4 years ago
- Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy☆748Updated this week
- ☆91Updated this week
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆532Updated last year
- Track prices on Amazon and receive email alerts for price drops☆328Updated 7 years ago
- Web data extraction tool implemented as chrome extension☆1,303Updated 5 years ago
- next generation web crawling using machine intelligence☆328Updated last year
- A Curated Collection of the Best Twitter Bots 🤖☆111Updated 5 years ago
- A curated list of backlink, social signal opportunities, link building strategies and tactics, along with educational opportunities to he…☆192Updated last week
- Curated list of awesome browser automation tools and resources☆365Updated 10 months ago
- People also ask Google scraper. Get as many questions as you need to optimize your site for voice or new content ideas or answering quest…☆118Updated 2 months ago
- Creates github index for similar repositories discovery☆192Updated 8 years ago
- Scrape Instagram's API with Puppeteer☆399Updated last year
- Python scripts to download Quora answers and convert them into a more portable form☆125Updated 3 years ago
- ☆63Updated this week
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆283Updated 7 years ago
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆360Updated 5 years ago
- A pure-python HTML screen-scraping library☆1,858Updated 2 years ago
- Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)☆501Updated 4 years ago
- `scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into struct…☆455Updated last year
- A curated list of SEO (Search Engine Optimization) links.☆655Updated 2 months ago
- A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆415Updated 6 months ago