dcondrey / scrapy-spiders
Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect email addresses and post URLs
☆131Updated last year
Alternatives and similar repositories for scrapy-spiders:
Users that are interested in scrapy-spiders are comparing it to the libraries listed below
- A browser extension that lets you find email addresses for any domain with a single click.☆71Updated 7 years ago
- Provides content not accessible through the standard Amazon API☆234Updated 7 years ago
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆286Updated 7 years ago
- Scrapes sites. Gets news. Eventually events.☆85Updated 9 years ago
- Search on Google, and crawls for emails related to the result☆293Updated 4 years ago
- Scraper that searches Google based on a query and scrapes all emails found on each page.☆105Updated 5 years ago
- Monitors prices of Amazon products via Product Advertising API☆156Updated 5 years ago
- The Zipru scraper developed in the Advanced Web Scraping Tutorial.☆430Updated 8 years ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆261Updated 2 years ago
- Checks if an email address is real☆104Updated 3 years ago
- Scrape the best sellers on amazon to find optimal products to dropship. Scrapy☆61Updated 9 years ago
- Python distributed web scrapper and dynamic crawler☆141Updated 7 years ago
- Scrapy examples crawling Craigslist☆199Updated 8 years ago
- Quickly download and scrape websites on a massive scale.☆64Updated 12 years ago
- Simple email pixel tracking written in Python & Flask☆31Updated 8 years ago
- Scrapinghub Learning Center. Report issues in Jira: Report issues in Jira: https://scrapinghub.atlassian.net/projects/WEB☆55Updated 5 years ago
- Automated Search Engine Optimization Testing Tool☆82Updated 6 years ago
- 👨👩👦 Social account detection and extraction in Python, e.g. for crawling/scraping.☆46Updated 2 years ago
- Unsupervised learning approach to building an article spinner to automatically generate content☆74Updated 7 years ago
- Send text when a new Craigslist posting matches a given keyword or phrase☆96Updated 10 years ago
- A Scrapy project for scraping restaurant information from zomato.com☆45Updated 9 years ago
- A library to interface with the Linkscape API.☆40Updated 6 years ago
- A simple AliExpress spider to crawl all products with Scrapy.☆17Updated 7 years ago
- (Abandonware) SEO tools, Python style. Check keyword competition, PageRank, etc.☆55Updated 12 years ago
- Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends☆56Updated last year
- Social media research and promotion, semi-autonomous CLI bot☆144Updated 5 years ago
- This is a project crawling backpack information and images from Amazon using python scrapy and store data to sqlite database.☆34Updated 9 years ago
- Basic setup with random user agents and IP addresses for Python Scrapy Framework.☆58Updated 7 years ago
- ☆38Updated 7 years ago
- A Pintrest Bot using selenium☆35Updated 3 years ago