canyousayyes / scrapy-web-crawler-by-rest-api
Example Scrapy project to crawl the web using the site's REST API
☆15Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for scrapy-web-crawler-by-rest-api
- Scraping tweets quickly using celery, RabbitMQ and Docker cluster☆47Updated last year
- Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner☆113Updated 6 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆50Updated 6 years ago
- boilerplate code to start with celery and rabbitmq in docker cluster☆19Updated last year
- Creates a pipeline Airflow and Scrapy to output an average image composition of everyone's face in a given website☆42Updated 7 years ago
- Flask Boilerplate - Built with Automation Tools | AppSeed App Generator☆18Updated 3 years ago
- ☆29Updated 3 years ago
- Read the guide on https://kirr.co/zm6ri8 to see how to implement these.☆15Updated 7 years ago
- A Docker implementation of Celery running on Flask, managed with supervisord.☆36Updated 6 years ago
- Software stack with latest Scrapy and updated deps☆62Updated 3 weeks ago
- A web application to process receipt images by Deep learning based OCR☆12Updated 3 years ago
- Command Line Application for Job Search☆13Updated 7 years ago
- A Django GraphQL API example with Django Graphene☆23Updated 6 years ago
- Django seed project using postgres as primary database and elasticsearch as secondary db☆15Updated last year
- Adding Social Authentication to Django☆18Updated 10 years ago
- Using django user with async frameworks like aiohttp, starlette, etc.☆11Updated 4 years ago
- Use the React CDN as well as Babel to make a Standalone React app without running `npx create-react-app`☆14Updated 5 years ago
- Pyppeteer integration for Scrapy☆60Updated 3 years ago
- Learn how to integrate a minimal FastAPI project with Airtable as our data store.☆25Updated 3 years ago
- ☆32Updated 10 months ago
- Scrape websites asynchronously with Python 3.8+, Asyncio, & arsenic (aka Selenium for Async).☆56Updated 3 years ago
- Techcrunch Incremental Scrapy Spider With MongoDB☆16Updated 5 years ago
- Django Boilerplate - Open-Source App coded in Django | AppSeed☆18Updated 4 years ago
- Newsletter management app for Django☆66Updated last year
- Scrapy integration with Tor for anonymous web scraping☆46Updated 8 years ago
- web scraping in parallel with Selenium Grid and Docker☆35Updated last year
- A scrapy pipeline which send items to Elastic Search server☆98Updated 6 years ago
- Streaming web crawler with WebSocket API☆44Updated last year
- Building Serverless Python Web Services with Zappa, published by Packt☆43Updated last year
- Scrapy + Puppeteer☆111Updated 3 years ago