RockyZ / Scrapy-sqlite-item-exporter
Export items to sqlite3 database crawled by scrapy 1.4
☆32Updated 11 years ago
Alternatives and similar repositories for Scrapy-sqlite-item-exporter:
Users that are interested in Scrapy-sqlite-item-exporter are comparing it to the libraries listed below
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 7 years ago
- Python 3 AsyncIO powered scraping framework with batteries included☆20Updated 8 years ago
- MongoDB extensions for Scrapy☆44Updated 10 years ago
- This application demonstrates how to use PostgreSQL as a full-text search engine.☆63Updated 6 years ago
- Scrapy spider middleware to clean up query parameters in request URLs☆25Updated 8 years ago
- A scrapy extension to store requests and responses information in storage service☆26Updated 3 years ago
- SQLAlchemy->Datatables☆54Updated 10 months ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated 10 months ago
- ☆143Updated 9 years ago
- Crochet-based blocking API for Scrapy.☆46Updated 8 years ago
- ☆12Updated 3 years ago
- Two-tiered Kanban☆20Updated 2 years ago
- Python bindings to the Tesseract API☆66Updated 8 years ago
- Simple HTTP cache for Python Requests☆98Updated 8 years ago
- Python module for RESTful resource representation using MIME Media-Types and the Flask Microframework☆70Updated 11 years ago
- Short URL generator for Flask.☆33Updated 8 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Updated 3 years ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Scrapy entrypoint for Scrapinghub job runner☆26Updated 2 weeks ago
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 9 years ago
- SQLA backend for Nefertari☆9Updated 7 years ago
- A component that tries to avoid downloading duplicate content☆27Updated 6 years ago
- Asynchronous requests in Python without thinking about it☆21Updated 3 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- Scrapinghub Command Line Client☆132Updated 3 weeks ago
- Tornado Web Crawler☆66Updated 12 years ago
- A set of standard command line arguments for Flask applications☆40Updated 2 years ago
- Nefertari is a REST API framework sitting on top of Pyramid and ElasticSearch☆53Updated 5 years ago
- Turn your IPython console into a cross-database SQL client☆31Updated 8 years ago
- Module to align code with thoughts of users and designers. Also magically handles navigation and permissions.☆40Updated 9 years ago