Mongodb support for scrapy
☆101Mar 9, 2017Updated 9 years ago
Alternatives and similar repositories for scrapy-mongodb
Users that are interested in scrapy-mongodb are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Export a graph of link between crawled items by scrapy in dot file format.☆26Sep 24, 2011Updated 15 years ago
- MongoDB pipeline for Scrapy. It allows to update existing entries (set new values or add elements to array) when item values are spread o…☆10Jan 6, 2013Updated 13 years ago
- Output scrapy statistics to graphite/carbon☆54Mar 9, 2013Updated 13 years ago
- MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…☆356Apr 6, 2021Updated 5 years ago
- A scrapy pipeline for couchdb☆17Sep 10, 2011Updated 15 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Adds the ability to use as a storage memcache☆18Jan 25, 2018Updated 8 years ago
- A scrapy pipeline which send items to Elastic Search server☆98Jan 2, 2018Updated 8 years ago
- auto tagging application☆31Jun 9, 2015Updated 11 years ago
- Use scrapy with mongodb to store the request queues (FIFO or LIFO)☆13Dec 25, 2012Updated 13 years ago
- Kel cluster management Python library☆11Apr 3, 2018Updated 8 years ago
- Unmaintained: A horridly implemented scrapy app that will scrape all (?) of Delicious' bookmarks.☆26Jun 16, 2011Updated 15 years ago
- Some scrapy and web.py exmaples☆79May 20, 2017Updated 9 years ago
- Useful test spiders for Scrapy☆184Jan 20, 2020Updated 6 years ago
- Z task queue, a redis based async task queue for python. Moved to : http://github.com/easydo-cn/ztq/☆139May 11, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Framework for rapid development of XBMC video plugins.☆12Dec 13, 2020Updated 5 years ago
- ☆223Apr 27, 2015Updated 11 years ago
- Utility scripts for a Tornado site☆134Oct 28, 2015Updated 11 years ago
- A crawling spider gathering all blogposts from http://isbullsh.it, using Scrapy☆31Jul 7, 2013Updated 13 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- simple & versatile survey application for django☆11Aug 4, 2011Updated 15 years ago
- HTTP proxy logging daemon: a tcpdump-like, at HTTP level :)☆13Nov 9, 2011Updated 15 years ago
- A scrapy-based Hacker News crawler.☆151May 21, 2013Updated 13 years ago
- Universal remote system indexing River Plugin for Elasticsearch☆12Apr 17, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- spider framework and utils written by python☆47Jul 2, 2013Updated 13 years ago
- JS/Python - rudimentary Python-Interpreter in JavaScript☆10Jul 5, 2011Updated 15 years ago
- Python bindings for the Sophia database library☆10Sep 10, 2015Updated 11 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆50Jul 24, 2015Updated 11 years ago
- redis web manager☆98Apr 20, 2012Updated 14 years ago
- Crawls a site to find every unique page URL. In Python & Django.☆10Sep 22, 2011Updated 15 years ago
- WTForms integration for peewee☆113Nov 5, 2026Updated 2 weeks ago
- The Brighton and Hove Python User Group website☆27Oct 1, 2020Updated 6 years ago
- Python queue implemented on top of Redis☆43Apr 1, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- django buddy, a chat bot use django as server, python aiml as backend.☆20Feb 27, 2014Updated 12 years ago
- ZeroRPC StatsD Middleware☆20Jan 7, 2013Updated 13 years ago
- The Python client for LedisDB☆10Jun 25, 2016Updated 10 years ago
- In Python, read the .80 file format, for 80legs web crawl results.☆12Jun 28, 2010Updated 16 years ago
- Pythonic Info☆10Aug 8, 2013Updated 13 years ago
- Redis-backed autocomplete for Django models☆17Nov 8, 2022Updated 4 years ago
- ☆29Mar 23, 2012Updated 14 years ago
Are these results useful?