chandrasekharan98 / Multisite-Python-Crawler
An almost generic web crawler built using Scrapy and Python 3.7 to recursively crawl entire websites.
☆18Updated 3 years ago
Alternatives and similar repositories for Multisite-Python-Crawler:
Users that are interested in Multisite-Python-Crawler are comparing it to the libraries listed below
- Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots an…☆78Updated 8 months ago
- ShopifyIQ is an e-commerce spy tool to monitor products your competitors scale☆28Updated 6 years ago
- Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt☆16Updated 10 months ago
- Keyword suggest tool is a simple tool that provides you keyword suggestion from multiple search engines like google, bing, yahoo, ebay, a…☆22Updated 2 years ago
- Streamlit README file generator, powered by AI.☆12Updated 4 months ago
- Deviant Spy is a native advertising (RevContent) spy tool☆31Updated 6 years ago
- Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of result…☆56Updated last year
- Search google, bing, yahoo, and other search engines with python☆57Updated 3 years ago
- Extract all internal and external links from a URL in Python.☆13Updated last year
- Spin Rewriter is a revolutionary article spinner that uses ENL Semantic Spinning to understand the meaning of the text. It produces high …☆21Updated 2 years ago
- Gathering data of likes on Tinder within the past 7 days☆29Updated 3 years ago
- Python script designed to simplify the process of submitting URLs to Google's Indexing API for faster and more efficient website indexing…☆10Updated last year
- This GitHub project is a scraper specifically designed to extract all Facebook ads from the Facebook Ads Library. The scraper is capable …☆20Updated last year
- AI-driven Python application that scrapes your Upwork job applications, fine-tunes OpenAI GPT-3 models using your application data, and g…☆12Updated last year
- Free Python client, that utilizes the digitalowl.org NLP API.☆9Updated 2 years ago
- Use this project to create your own random prompts for Stable Diffusion! Besides, you'll be able to add your own adjectives, objects and …☆12Updated last year
- A free social media automation platform that organically grows your online presence and gets you more followers.☆37Updated this week
- 🗄️💧 Find exposed and unsecured databases from a list of hosts. 🗄️💧☆11Updated 3 years ago
- Automated script to list products on facebook marketplace using python and selenium.☆29Updated 2 years ago
- Collect email addresses by crawling search engine results.☆29Updated 2 years ago
- SuperEZ-GPT Builder: jQuery/GPT AI Content Building Assistant☆12Updated last year
- A Minimal Yet Powerful Crawler for Extracting all The Internal/External/Fuzz-able Links from a website☆32Updated 6 years ago
- Load your SEO Data from Google Search Console into your Big Query Datawarehouse.☆11Updated 2 years ago
- A simple DuckDuckGo URL scraper.☆25Updated last year
- Zénith is a multi-lingual cybersecurity AI NLP security verification chatbot in development that references the MITRE ATT&CK Framework, O…☆5Updated 2 years ago
- Resources for independent web-workers: SEO, Publishing, Git, Jamstack\SSGs, Linux, etc.☆12Updated 5 months ago
- A Python script that automatically scrapes email addresses found on websites that are on the Google search results for a specific query.☆13Updated 4 years ago
- Easily scrape 10,000+ email messages in one hour, helping you quickly increase your customers Extracts data from (LinkedIn, Facebook, In…☆28Updated 10 months ago
- Chrome Extension for creating customizable AI prompt snippets to automate your interactions.☆12Updated 2 weeks ago
- Bunyip is a Chrome Extension, which allows us to detect AI generated text, it helps users detect fake news articles which might be genera…☆14Updated 4 years ago