Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect email addresses and post URLs
☆135Aug 26, 2023Updated 2 years ago
Alternatives and similar repositories for scrapy-spiders
Users that are interested in scrapy-spiders are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A LinkedIn lead generation web-scraper script. This project uses Selenium to automate the Chrome Browser & Beautiful Soup to parse the da…☆11Jan 9, 2025Updated last year
- This platform is a tool to generate consumer interest or inquiry into a specified products or services of a business. In this case I’d li…☆15Jul 25, 2011Updated 14 years ago
- A Scrapy script to spider a website and scrape all emails using a regex.☆12Dec 21, 2016Updated 9 years ago
- A python script that generates leads by scrapping business data from Google maps, LinkedIn and Yelp .☆17Jan 1, 2020Updated 6 years ago
- Generate potential email addresses from LinkedIn☆16Jun 18, 2021Updated 4 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Enter the your skills , bot will place your proposal automatically . It decide amount by itself to place. Add your classification algorit…☆16Mar 10, 2016Updated 10 years ago
- Some Python scripts I use for auditing, research and lead generation.☆32Jan 13, 2017Updated 9 years ago
- Keywords enrichment by autocompletion (AWS, PM, RDC, CDS, ...), google suggestion scraping Heavy multithreaded semantic corpus crawler S…☆12May 22, 2015Updated 10 years ago
- Automate Your LinkedIn Lead Generation with Python and Selenium. Scrape Email Address Also☆36Feb 13, 2024Updated 2 years ago
- Simple tool for scraping millions (billions?) of email addresses from the Internet®☆11Aug 6, 2017Updated 8 years ago
- JustDial Scraper to scrap all the requested data which includes their name, address, email address and phone number.☆21Nov 24, 2020Updated 5 years ago
- Pull list of leads from a Twitter Ads Lead Generation Card☆12Feb 7, 2017Updated 9 years ago
- Get notified when new job is available at upwork.com☆34Nov 5, 2017Updated 8 years ago
- Blog crawler for the blogforever project.☆23Jan 31, 2014Updated 12 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Search on Google, and crawls for emails related to the result☆296Oct 22, 2020Updated 5 years ago
- Scrapes upwork.com using BeautifulSoup and Selenium☆12Jul 5, 2017Updated 8 years ago
- Keyword generator providing multiple commands in order to manage keyphrases for SEO monitoring tools such as AWRCloud☆52Sep 25, 2017Updated 8 years ago
- Python script that periodically probes the Craigslist RSS feeds for new listings.☆39Aug 24, 2011Updated 14 years ago
- 🔬 A Shiny app for N-gram Analysis of AdWords data☆11Aug 4, 2019Updated 6 years ago
- upwork jobs scraper☆20May 2, 2023Updated 3 years ago
- A chatbot that can be used by businesses to communicate with customers via Whatsapp SMS using the Twilio API and OpenAI's GPT-3 language …☆33Aug 25, 2024Updated last year
- selenium based linkedin scraper that pulls users from a sales-nav search and gets their email domain by scraping google☆47Jan 9, 2019Updated 7 years ago
- SEO Tool to track ranking of keywords on search engines (google app engine application)☆52Aug 26, 2012Updated 13 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Very simple bash script to crawl email addresses from a specific website.☆33Jul 1, 2017Updated 8 years ago
- A browser extension that lets you find email addresses for any domain with a single click.☆76May 17, 2017Updated 8 years ago
- A LLM based agent that interacts with user calls as a receptionist for scheduling bookings integrated with Gmail, Calendar etc☆12Sep 6, 2023Updated 2 years ago
- Find which links on a web page are pagination links☆29Jan 12, 2017Updated 9 years ago
- yellow pages email harvester☆15Jun 2, 2017Updated 8 years ago
- Some scrapy and web.py exmaples☆79May 20, 2017Updated 8 years ago
- Solana Arbitrage Bot on pump.fun, Meteora, Raydium and Orca using Jito bundling, RPC and gRPC. Solana Arbitrage Bot Solana Arbitrage Bot …☆504Mar 17, 2026Updated last month
- Scrapy examples crawling Craigslist☆199Apr 20, 2016Updated 10 years ago
- "Scrape Easy" - an extension of the Scrapy framework.☆185Aug 13, 2016Updated 9 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This app is my submission to the visualization contest held by Revolution Analytics.☆20Aug 29, 2014Updated 11 years ago
- OnlyFans AI Browser Extension☆28Oct 3, 2023Updated 2 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Dec 15, 2012Updated 13 years ago
- The open-source content aggregation platform.☆14Jun 12, 2017Updated 8 years ago
- common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text☆35Sep 30, 2016Updated 9 years ago
- A library to make it easier to load input URLs to start scrapy processes☆14Feb 21, 2021Updated 5 years ago
- Create affiliate accounts with unique referrer URLs to track membership checkouts for Paid Memberships Pro☆24Mar 19, 2026Updated last month