rdcprojects / scrapy-mq-redisLinks
A RabbitMQ/Redis tool for Scrapy
☆13Updated 8 years ago
Alternatives and similar repositories for scrapy-mq-redis
Users that are interested in scrapy-mq-redis are comparing it to the libraries listed below
Sorting:
- Restrict crawl and scraping scope using matchers.☆26Updated 9 years ago
- MongoDB extensions for Scrapy☆44Updated 10 years ago
- Python dict-like interface for merging dicts with add to set property☆14Updated 6 years ago
- Detect and classify pagination links☆15Updated 4 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Updated 12 years ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Store e run queries on database to help system manager of a Django website☆11Updated 8 years ago
- A scrapy extension to store requests and responses information in storage service☆26Updated 3 years ago
- Cassandra Migration Tool☆11Updated 7 years ago
- Supervisor On/Off: an alternative web interface for supervisor☆50Updated 8 years ago
- Business Intelligence (BI) in Python (Pandas web interface) - Frontend☆10Updated 9 years ago
- ☆21Updated 12 years ago
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 7 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 9 years ago
- [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.☆11Updated 10 years ago
- Adds the ability to manually run a periodic celery task from the Django Admin☆24Updated 10 years ago
- INACTIVE - http://mzl.la/ghe-archive - Yet another configuration object☆33Updated 6 years ago
- Efficient serialization of Django Models for use in Celery that ensure the state of the world.☆12Updated 3 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated last year
- Step-by-step introduction to the traditional data warehousing with examples.☆11Updated 7 years ago
- A pastebin for tables.☆34Updated 11 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆44Updated 4 years ago
- Rest admin-like endpoints for django☆13Updated 8 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Updated 3 years ago
- extendable field for use in Django Models☆29Updated 2 years ago
- ☆33Updated last year
- A bot framework for the Facebook Messenger platform, built on asyncio and aiohttp☆30Updated 8 years ago
- 📑⚙️ Python/Django reference implementation of the ERAV data model☆21Updated 6 years ago
- Data Schemas for Django Models and Dictionaries☆13Updated last year
- Django application to display on the frontend the list of notifications and run some basic actions such as "view all notifications", "del…☆30Updated 9 years ago