sayonetech / automated-scraper
A complete system including scrapy,database and Django-REST API.
☆8Updated 8 years ago
Alternatives and similar repositories for automated-scraper:
Users that are interested in automated-scraper are comparing it to the libraries listed below
- A Scrapy pipeline module to persist items to a postgres table automatically.☆21Updated 7 years ago
- A Selenium based automated program that scrapes profiles data,stores in CSV,follows them and saves their profile in PDF.☆33Updated last year
- Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords☆44Updated last year
- Asyncio web crawling framework. Work in progress.☆18Updated 8 months ago
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- Web Crawlers orchestration framework that lets you create datasets from multiple web sources using yaml configurations.☆34Updated last year
- API - extract a list of keywords from a text.☆18Updated 7 years ago
- ProxyCrawl Python library for scraping and crawling☆59Updated last year
- A Python script to gain some insights from a domain and list of keywords.☆49Updated last year
- ☆38Updated 7 years ago
- This tool provide a "Bert Score" for first max 30 pages responding to a question in Google☆13Updated 5 years ago
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- Scrape and parse Google search results in Python☆31Updated last year
- ☆12Updated 6 years ago
- Developed various python scripts using Scrapy Framework for scraping various E-Commerce Sites like AliExpress, Flipkart, Amazon and Ebay …☆41Updated 7 years ago
- 🤩 Python Package for Scraping Amazon Product Reviews ✨☆36Updated 2 years ago
- Sample projects showcasing Scrapinghub tech☆138Updated last year
- Analyze scraped data☆46Updated 5 years ago
- Rotating proxy crawler in Python☆82Updated 3 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆51Updated 6 years ago
- An amazon price tracker using Python and MongoDB☆18Updated 5 years ago
- Flask based UI for displaying & segmenting a single database table☆15Updated 2 years ago
- Pyppeteer integration for Scrapy☆58Updated 4 years ago
- Simple RSS feed reader for HackerNews.☆28Updated 2 years ago
- ☆62Updated 11 months ago
- A middleware layer for Scrapy that detects CAPTCHA tests and solves them☆45Updated last year
- OLX Scraper in Python Scrapy☆97Updated 3 years ago
- Since facebook blocked all APIs to post on pages, we need to use selenium to post it automatically☆17Updated 4 years ago
- FBLYZE is a Facebook scraping system and analysis system.☆64Updated 4 years ago
- Highly scalable webcrawler for towardsdatascience.com by using Python, Selenium, Docker, Kubernetes and the infrastructure of the Google …☆25Updated 3 years ago