Mongodb support for scrapy
☆101Mar 9, 2017Updated 9 years ago
Alternatives and similar repositories for scrapy-mongodb
Users that are interested in scrapy-mongodb are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Export a graph of link between crawled items by scrapy in dot file format.☆26Sep 24, 2011Updated 15 years ago
- MongoDB pipeline for Scrapy. It allows to update existing entries (set new values or add elements to array) when item values are spread o…☆10Jan 6, 2013Updated 13 years ago
- Output scrapy statistics to graphite/carbon☆54Mar 9, 2013Updated 13 years ago
- MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…☆356Apr 6, 2021Updated 5 years ago
- Adds the ability to use as a storage memcache☆18Jan 25, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A scrapy pipeline which send items to Elastic Search server☆98Jan 2, 2018Updated 8 years ago
- auto tagging application☆31Jun 9, 2015Updated 11 years ago
- Use scrapy with mongodb to store the request queues (FIFO or LIFO)☆13Dec 25, 2012Updated 13 years ago
- Kel cluster management Python library☆11Apr 3, 2018Updated 8 years ago
- Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)☆33Feb 22, 2018Updated 8 years ago
- Unmaintained: A horridly implemented scrapy app that will scrape all (?) of Delicious' bookmarks.☆26Jun 16, 2011Updated 15 years ago
- This package read events from MySQL binlog and send to blinker's signal.☆17May 21, 2024Updated 2 years ago
- Useful test spiders for Scrapy☆184Jan 20, 2020Updated 6 years ago
- Z task queue, a redis based async task queue for python. Moved to : http://github.com/easydo-cn/ztq/☆139May 11, 2018Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆223Apr 27, 2015Updated 11 years ago
- Utility scripts for a Tornado site☆134Oct 28, 2015Updated 11 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- A crawling spider gathering all blogposts from http://isbullsh.it, using Scrapy☆31Jul 7, 2013Updated 13 years ago
- simple & versatile survey application for django☆11Aug 4, 2011Updated 15 years ago
- Python bindings for the Sophia database library☆10Sep 10, 2015Updated 11 years ago
- Scrapy project based on dirbot to show how to use Twisted's adbapi to store the scraped data in MySQL.☆117Oct 24, 2013Updated 13 years ago
- HTTP proxy logging daemon: a tcpdump-like, at HTTP level :)☆14Nov 9, 2011Updated 14 years ago
- Simple and concise state management library for Node.js and browser☆10Mar 3, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A scrapy-based Hacker News crawler.☆151May 21, 2013Updated 13 years ago
- pipe stdout to a redis pubsub channel☆13Aug 9, 2013Updated 13 years ago
- spider framework and utils written by python☆47Jul 2, 2013Updated 13 years ago
- redis web manager☆98Apr 20, 2012Updated 14 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆50Jul 24, 2015Updated 11 years ago
- WTForms integration for peewee☆113Sep 8, 2026Updated last month
- Python queue implemented on top of Redis☆43Apr 1, 2024Updated 2 years ago
- Chip in Code is an open source app for create crowdfunding websites☆14Mar 17, 2014Updated 12 years ago
- django buddy, a chat bot use django as server, python aiml as backend.☆20Feb 27, 2014Updated 12 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The Python client for LedisDB☆10Jun 25, 2016Updated 10 years ago
- Scrapy examples crawling Craigslist☆199Apr 20, 2016Updated 10 years ago
- ☆29Mar 23, 2012Updated 14 years ago
- Babel based i18n & l10n for Tornado☆12Sep 6, 2017Updated 9 years ago
- Model data exports for Django☆38Nov 23, 2021Updated 4 years ago
- vdisk.me (vdisk.weibo.com) api & client implementation in Python☆13Aug 25, 2013Updated 13 years ago
- Advanced web browsing, scraping and automation☆32Mar 15, 2019Updated 7 years ago