dcondrey / scrapy-spiders
Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect email addresses and post URLs
☆131Updated last year
Alternatives and similar repositories for scrapy-spiders:
Users that are interested in scrapy-spiders are comparing it to the libraries listed below
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆287Updated 7 years ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆262Updated 2 years ago
- Automated Search Engine Optimization Testing Tool☆82Updated 6 years ago
- Scrapy examples crawling Craigslist☆199Updated 9 years ago
- Scraper that searches Google based on a query and scrapes all emails found on each page.☆105Updated 5 years ago
- A browser extension that lets you find email addresses for any domain with a single click.☆71Updated 7 years ago
- Monitors prices of Amazon products via Product Advertising API☆156Updated 6 years ago
- Scrapinghub Learning Center. Report issues in Jira: Report issues in Jira: https://scrapinghub.atlassian.net/projects/WEB☆55Updated 5 years ago
- Python distributed web scrapper and dynamic crawler☆141Updated 8 years ago
- The Zipru scraper developed in the Advanced Web Scraping Tutorial.☆430Updated 8 years ago
- Scrape the Google search result with Scrapy.☆98Updated 5 years ago
- Easy extraction of keywords and engines from search engine results pages (SERPs).☆90Updated 3 years ago
- Provides content not accessible through the standard Amazon API☆234Updated 7 years ago
- Scrapy Training companion code☆174Updated 6 years ago
- Scrapes sites. Gets news. Eventually events.☆86Updated 9 years ago
- A client interface for Scrapinghub's API☆206Updated 2 months ago
- Some Python scripts I use for auditing, research and lead generation.☆30Updated 8 years ago
- Get notified when new job is available at upwork.com☆34Updated 7 years ago
- Python code to scrape and collect data from the RSS feeds Facebook uses to augment its Trending Section☆57Updated 6 years ago
- Search on Google, and crawls for emails related to the result☆295Updated 4 years ago
- Scrape data from Google.com, Bing.com, Baidu.com, Ask.com, Yahoo.com, Yandex.com☆56Updated 3 years ago
- Some scrapy and web.py exmaples☆79Updated 7 years ago
- An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site☆127Updated 6 years ago
- A simple twilio django sms application☆31Updated 11 years ago
- Send text when a new Craigslist posting matches a given keyword or phrase☆96Updated 10 years ago
- A Pintrest Bot using selenium☆35Updated 3 years ago
- Web Scraping Craigslist's Engineering Jobs in NY with Scrapy☆66Updated 7 years ago
- ☆50Updated 3 years ago
- This is a very large social media bot framework for internet marketers, social media marketers , Blackhat guys, Whitehat Guys, Brown , Gr…☆48Updated 5 years ago
- Sample projects showcasing Scrapinghub tech☆138Updated last year