Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect email addresses and post URLs
☆142Sep 12, 2026Updated 2 weeks ago
Alternatives and similar repositories for scrapy-spiders
Users that are interested in scrapy-spiders are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A LinkedIn lead generation web-scraper script. This project uses Selenium to automate the Chrome Browser & Beautiful Soup to parse the da…☆11Jan 9, 2025Updated last year
- A Scrapy script to spider a website and scrape all emails using a regex.☆12Dec 21, 2016Updated 9 years ago
- A program to find keywords in the source code of websites.☆18May 26, 2016Updated 10 years ago
- A python script that generates leads by scrapping business data from Google maps, LinkedIn and Yelp .☆21Jan 1, 2020Updated 6 years ago
- Enter the your skills , bot will place your proposal automatically . It decide amount by itself to place. Add your classification algorit…☆16Mar 10, 2016Updated 10 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Keywords enrichment by autocompletion (AWS, PM, RDC, CDS, ...), google suggestion scraping Heavy multithreaded semantic corpus crawler S…☆12May 22, 2015Updated 11 years ago
- A simple tool that makes it easy for marketers to extract emails and phone numbers (leads) from google search results.☆75Aug 14, 2022Updated 4 years ago
- JustDial Scraper to scrap all the requested data which includes their name, address, email address and phone number.☆22Nov 24, 2020Updated 5 years ago
- Pull list of leads from a Twitter Ads Lead Generation Card☆12Feb 7, 2017Updated 9 years ago
- This API is built for lead generation and provides users with a streamlined platform for capturing and tracking leads, which integrates w…☆20Jul 15, 2024Updated 2 years ago
- Get notified when new job is available at upwork.com☆35Nov 5, 2017Updated 8 years ago
- Pure python script that takes user query and summarizes news related to it.☆25Jul 6, 2022Updated 4 years ago
- EstateMatch is a mobile application that uses a web-scraper to find Real Estate, sort it using AI, and display it to the user based on th…☆15Oct 27, 2023Updated 2 years ago
- Scrapes upwork.com using BeautifulSoup and Selenium☆12Jul 5, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Search on Google, and crawls for emails related to the result☆296Oct 22, 2020Updated 5 years ago
- UpWork scraping☆51Oct 29, 2018Updated 7 years ago
- upwork jobs scraper☆20May 2, 2023Updated 3 years ago
- selenium based linkedin scraper that pulls users from a sales-nav search and gets their email domain by scraping google☆54Jan 9, 2019Updated 7 years ago
- SEO Tool to track ranking of keywords on search engines (google app engine application)☆53Aug 26, 2012Updated 14 years ago
- Scrape emails, phone numbers and social media accounts from a website. You can use the found information to gather more information or ju…☆18Dec 6, 2021Updated 4 years ago
- Create affiliate accounts with unique referrer URLs to track membership checkouts for Paid Memberships Pro☆25Mar 19, 2026Updated 6 months ago
- A browser extension that lets you find email addresses for any domain with a single click.☆80May 17, 2017Updated 9 years ago
- A LLM based agent that interacts with user calls as a receptionist for scheduling bookings integrated with Gmail, Calendar etc☆12Sep 6, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Very simple bash script to crawl email addresses from a specific website.☆33Jul 1, 2017Updated 9 years ago
- OnlyFans AI Browser Extension☆31Oct 3, 2023Updated 2 years ago
- Scrapy examples crawling Craigslist☆199Apr 20, 2016Updated 10 years ago
- Some scrapy and web.py exmaples☆79May 20, 2017Updated 9 years ago
- Solana Arbitrage Bot on pump.fun, Meteora, Raydium and Orca using Jito bundling, RPC and gRPC. Solana Arbitrage Bot Solana Arbitrage Bot …☆518Mar 17, 2026Updated 6 months ago
- A scrapy pipeline which send items to Elastic Search server☆97Jan 2, 2018Updated 8 years ago
- The open-source content aggregation platform.☆14Jun 12, 2017Updated 9 years ago
- A library to make it easier to load input URLs to start scrapy processes☆14Feb 21, 2021Updated 5 years ago
- Helping you automate your desktop experience. Powered by Python.☆42Mar 8, 2013Updated 13 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Blog crawler for the blogforever project.☆23Jan 31, 2014Updated 12 years ago
- HTTP API for Scrapy spiders☆884Jun 29, 2026Updated 2 months ago
- Speed up your Localization / Internationalization efforts by automating translation with a single script☆26Feb 18, 2017Updated 9 years ago
- LeadGenPy is a tool for lead generation that extracts Google Maps business details using Selenium, processes the data, stores it in a dat…☆30Feb 19, 2024Updated 2 years ago
- A crawler for web PTT (PTT文章爬蟲) on python☆18Jul 26, 2026Updated 2 months ago
- A Python package which lists trending repositories and developers from Github☆20Aug 14, 2016Updated 10 years ago
- Scraper built with Scrapy.☆18Jun 25, 2026Updated 3 months ago