yennanliu / web_scrapingLinks
Collect/process data via various data sources : website / js website / API. Run scrapping pipeline via Celery, and Travis cron task. Dump the scraped data to slack
☆13Updated 11 months ago
Alternatives and similar repositories for web_scraping
Users that are interested in web_scraping are comparing it to the libraries listed below
Sorting:
- Get data about companies from advanced search without the use of API☆63Updated 5 years ago
- A LinkedIn lead generation web-scraper script. This project uses Selenium to automate the Chrome Browser & Beautiful Soup to parse the da…☆11Updated 5 months ago
- selenium based linkedin scraper that pulls users from a sales-nav search and gets their email domain by scraping google☆37Updated 6 years ago
- ShopifyIQ is an e-commerce spy tool to monitor products your competitors scale☆27Updated 6 years ago
- Lead Scoring: Optimizing SaaS Marketing-Sales Funnel by Extracting the Best Leads with Applied Machine Learning☆42Updated last year
- Monetize.ai is a web-based chatbot that provides personalized investment advice using GPT-3.5 and Yahoo Finance API. It's built using Fla…☆15Updated last year
- A python script that generates leads by scrapping business data from Google maps, LinkedIn and Yelp .☆16Updated 5 years ago
- This project experiments with the Google NLP Algorithm to evaluate e-commerce product descriptions from an SEO perspective.☆17Updated 4 years ago
- 🎉 40+ Online FREE Competitive Intelligence Tools List☆20Updated 7 years ago
- Send follow-ups in the same email thread for any A/B test variation☆21Updated 2 years ago
- This demo compares products from Walmart and eBay to find a profit. Sponsored by SerpApi.☆22Updated 2 years ago
- Lead Scoring is such a powerful metric when it comes to quantifying the lead & it is nowadays used by every CRM. In this repository, we a…☆57Updated 4 years ago
- Introducing AmazonMe, a Python-based web scraper designed to extract data from amazon.com using the requests and beautifulSoup libraries.…☆64Updated last year
- sales navigator is a part of linkedin services used for lead generation.Using selenium and beautifulsoup libraries with python,details of…☆25Updated 5 years ago
- Scrape resumes off Indeed.com. Selenium-based Python script.☆24Updated 4 years ago
- JobDescription-Keywords-Extractor aims to extract important keywords (topics) from any given job description posted online for better sea…☆34Updated 6 years ago
- Extracts the email from the user's description using Python & Google Custom Search Engine Api☆63Updated 7 years ago
- With Linked Social Toolkit [LST] you can like posts & comments, send birthday wishes, work anniversary wishes & new job wishes, send mess…☆88Updated 2 years ago
- Google Search Results Pages Dashboard☆37Updated 2 years ago
- The Upwork Screener App is a tool for searching and filtering job listings on Upwork. It allows users to easily find jobs that match thei…☆11Updated 2 years ago
- A chatbot that can be used by businesses to communicate with customers via Whatsapp SMS using the Twilio API and OpenAI's GPT-3 language …☆28Updated 10 months ago
- A Python library to interact with ScrapingBee's API for headless browsers and proxy rotation☆28Updated 9 months ago
- Ailyn is a simple but powerful open-source virtual sales agent that uses Retrieval Augmented Generation (RAG) techniques to provide custo…☆12Updated last year
- AI models for automatic job application pipeline (user CV, job description analysis (customized NER/SpaCy) and artificial cover letter ge…☆36Updated last year
- Browsing jobs on upwork is time-consuming!!! How about checking them out right from your terminal? 🤩☆35Updated 3 years ago
- Simple tool for recursively scraping/validating emails and phone numbers from web pages.☆11Updated 3 years ago
- Automation Solutions for various Google AdWords tasks such as Bids Optimizations, Reporting, Campaign Create, Budgeting etc☆26Updated 7 years ago
- A Selenium based automated program that scrapes profiles data,stores in CSV,follows them and saves their profile in PDF.☆33Updated last year
- An AI-powered marketing campaign generator using OpenAI's gpt-4o-mini, FastAPI for the backend, and Streamlit for the user interface. Con…☆26Updated 10 months ago
- Automate listing in FB, ETSY and EBAY Marketplaces☆31Updated 2 weeks ago