chandrasekharan98 / Multisite-Python-Crawler
An almost generic web crawler built using Scrapy and Python 3.7 to recursively crawl entire websites.
☆17Updated 2 years ago
Alternatives and similar repositories for Multisite-Python-Crawler:
Users that are interested in Multisite-Python-Crawler are comparing it to the libraries listed below
- PHP tool to grab urls of a specific site.☆10Updated 5 years ago
- A Minimal Yet Powerful Crawler for Extracting all The Internal/External/Fuzz-able Links from a website☆32Updated 6 years ago
- Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots an…☆76Updated 7 months ago
- This Python code scrapes Google search results then applies sentiment analysis, generates text summaries, and ranks keywords.☆27Updated 4 years ago
- Cross Site Scripting Cheat sheet.☆12Updated 3 years ago
- ShopifyIQ is an e-commerce spy tool to monitor products your competitors scale☆26Updated 6 years ago
- A simple script to automate a youtube chanel☆16Updated 2 years ago
- Streamlit README file generator, powered by AI.☆13Updated 2 months ago
- One-afternoon side project to play around with 🤗 Transformers & Streamlit☆28Updated 2 years ago
- GNewsScraper is a TypeScript package that scrapes article data from Google News based on a keyword or phrase. It returns the results as a…☆10Updated last year
- Scrapping facebook marketplace products☆13Updated 6 years ago
- This project is to do auto post in the marketplace of Facebook☆52Updated 6 months ago
- Quick script to check for plagiarism between two documents☆16Updated 4 years ago
- Used by my reseller friend to filp cars more effeciently.☆15Updated 2 years ago
- Instant Data Scraper packed Chrome extension v0.1.7 (WITH LinkedIn scraping functionality)☆60Updated 6 years ago
- Find a person's email address via permutation and validation☆31Updated 3 years ago
- Get trails tool: Get all urls indexed of target☆22Updated 3 years ago
- Resources for independent web-workers: SEO, Publishing, Git, Jamstack\SSGs, Linux, etc.☆13Updated 4 months ago
- Auto updating archive of my Twitter lists.☆15Updated 2 months ago
- Collections of Tools, Bookmarks, and other guides created to aid in OSINT collection☆17Updated 3 years ago
- A python wrapper around selenium that makes web automation anonymous through proxy rotation☆42Updated 3 years ago
- project to produce various useful scrapers☆30Updated last week
- Amazon Deals Page Scraper☆16Updated 7 years ago
- Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt☆16Updated 9 months ago
- Scripts to automate Open Source Intelligence (OSINT)☆15Updated 5 years ago
- Easily scrape 10,000+ email messages in one hour, helping you quickly increase your customers Extracts data from (LinkedIn, Facebook, In…☆28Updated 8 months ago
- Spin Rewriter is a revolutionary article spinner that uses ENL Semantic Spinning to understand the meaning of the text. It produces high …☆21Updated last year
- 👨👩👧👦 (Rest) API to extract social media profiles from websites or specific URLs☆19Updated 2 years ago
- Threat hunting tool for scraping latest scrapes from Pastebin☆32Updated 4 years ago
- Automate the world of LinkedIn!☆86Updated 10 months ago