dcondrey / scrapy-spiders
Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect email addresses and post URLs
☆127Updated last year
Related projects: ⓘ
- Scrapy examples crawling Craigslist☆198Updated 8 years ago
- Automated Search Engine Optimization Testing Tool☆81Updated 5 years ago
- A Scrapy project for scraping restaurant information from zomato.com☆44Updated 8 years ago
- Python distributed web scrapper and dynamic crawler☆139Updated 7 years ago
- A Pintrest Bot using selenium☆35Updated 2 years ago
- Get notified when new job is available at upwork.com☆34Updated 6 years ago
- Simple analytics platform for Instagram.☆85Updated last year
- Monitors prices of Amazon products via Product Advertising API☆156Updated 5 years ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆251Updated 2 years ago
- This is a project crawling backpack information and images from Amazon using python scrapy and store data to sqlite database.☆34Updated 8 years ago
- (Abandonware) SEO tools, Python style. Check keyword competition, PageRank, etc.☆51Updated 12 years ago
- A library to interface with the Linkscape API.☆41Updated 5 years ago
- Basic setup with random user agents and IP addresses for Python Scrapy Framework.☆58Updated 6 years ago
- Scrape the best sellers on amazon to find optimal products to dropship. Scrapy☆58Updated 9 years ago
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆283Updated 7 years ago
- A simple AliExpress spider to crawl all products with Scrapy.☆17Updated 6 years ago
- Scrape the Google search result with Scrapy.☆97Updated 4 years ago
- Bulk email validation. Deploy on server with Redis or as serverless webapp with AWS.☆12Updated 5 years ago
- A Python bot to increase your popularity on LinkedIn☆63Updated 7 years ago
- Checks if an email address is real☆103Updated 2 years ago
- ☆53Updated this week
- Sample projects showcasing Scrapinghub tech☆137Updated 7 months ago
- Easy extraction of keywords and engines from search engine results pages (SERPs).☆90Updated 2 years ago
- Scrapinghub Learning Center. Report issues in Jira: Report issues in Jira: https://scrapinghub.atlassian.net/projects/WEB☆55Updated 4 years ago
- A client interface for Scrapinghub's API☆202Updated 8 months ago
- ☆137Updated this week
- Scrapy Training companion code☆171Updated 5 years ago
- Provides content not accessible through the standard Amazon API☆235Updated 6 years ago
- Scrapy (Python Framework) Example using reddit.com☆56Updated 5 years ago
- A browser extension that lets you find email addresses for any domain with a single click.☆67Updated 7 years ago