Use scrapy with mongodb to store the request queues (FIFO or LIFO)
☆13Dec 25, 2012Updated 13 years ago
Alternatives and similar repositories for scrapy-mongodb-queue
Users that are interested in scrapy-mongodb-queue are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MongoDB pipeline for Scrapy. It allows to update existing entries (set new values or add elements to array) when item values are spread o…☆10Jan 6, 2013Updated 13 years ago
- Paginating the web☆36Feb 11, 2014Updated 12 years ago
- Autolink emails for your Jekyll☆15Mar 30, 2022Updated 4 years ago
- Beaker caching / session plugin for MongoDB☆21Jan 21, 2011Updated 15 years ago
- C Driver for MongoDB☆10Jan 15, 2013Updated 13 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Youtube Uploader with FIRST Robotics Competition in mind. Download it at https://pypi.org/project/FRCUploader/☆12Jul 20, 2023Updated 3 years ago
- Alpine Linux container with PhantomJS☆12May 9, 2017Updated 9 years ago
- Translate your Jekyll templates.☆12Jul 10, 2018Updated 8 years ago
- my greasemonkey scripts☆18May 13, 2022Updated 4 years ago
- ElasticSearch 5 Indexer for Apache Nutch 2.3☆15Jan 9, 2018Updated 8 years ago
- A Flask extention that provide user navigation tracking☆18Dec 4, 2011Updated 14 years ago
- Command line utility for dumping/restoring etcd☆36Jul 1, 2015Updated 11 years ago
- Scrapy Item Pipeline to send items to RabbitMQ. From https://medium.com/python4you/rabbitmq-scrapy-item-publisher-in-python-4c66a985e3cb☆13Jan 7, 2022Updated 4 years ago
- A Collectd plugin to monitor MongoDB (Collectd 4.x)☆34Jul 3, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Provider-agnostic cloud provisioning and Docker orchestration☆31Mar 25, 2021Updated 5 years ago
- 一键部署 L2TP/IPSec 预共享密钥方式的 IPSec VPN（基于 StrongSwan 和 xl2tpd 实现）☆12Dec 13, 2021Updated 4 years ago
- Docker image for creating a single Apache Nutch server, with mongodb as crawl storage and Elasticsearch for indexing☆17Nov 16, 2015Updated 10 years ago
- Reference for https://int21.io/post/50-million-points/index.html☆20Oct 2, 2018Updated 8 years ago
- 这是一款登录页面，自动填充密码chrome浏览器插件☆18Jun 25, 2021Updated 5 years ago
- repository for multishot system builder prototype☆17Jul 21, 2022Updated 4 years ago
- Deprecated HubStorage client library - please use python-scrapinghub>=1.9.0 instead☆16Dec 5, 2016Updated 9 years ago
- One Player Sleep Data Pack for Minecraft 1.13 to 1.16☆21Mar 20, 2020Updated 6 years ago
- Parsing and generation of 3D geometries for robot mechanisms in Julia☆13Dec 4, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- tkinterEditor☆13Dec 18, 2020Updated 5 years ago
- Chinese as a foreign language.☆14May 6, 2026Updated 5 months ago
- ☆21Feb 17, 2019Updated 7 years ago
- dijkstra is a native Python implementation of famous Dijkstra's shortest path algorithm. The implemented algorithm can be used to analyze…☆20May 20, 2020Updated 6 years ago
- ☆33Oct 20, 2025Updated 11 months ago
- The hofa package contains an extensive toolkit for factor analysis based on higher-order multi-cumulant in R. The package is complementar…☆11Mar 4, 2026Updated 7 months ago
- Utilities for working with LEGO Universe file formats and network packets.☆21Jan 6, 2025Updated last year
- Easy multi-container testing with Docker☆13Sep 15, 2017Updated 9 years ago
- 针对3个语料库，玻森数据 (https://bosonnlp.com) 、1998年人民日报标注数据、MSRA微软亚洲研究院开源数据，在前人的基础上，重新升级换代，达到更高的精确率。☆13Jun 11, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆11Dec 7, 2022Updated 3 years ago
- the class time table iOS app in China. for iPad now. with 50K user from appStore 2013.01☆24Feb 16, 2013Updated 13 years ago
- Discord: https://discord.opcrux.org/☆20Jan 29, 2024Updated 2 years ago
- Python API for Various DB-Backed Simhash Clusters☆64Mar 16, 2017Updated 9 years ago
- Generates a fancy Web page from a folder with movies files.☆10May 4, 2012Updated 14 years ago
- Sequence-to-Sequence Generative Model for Sequential Recommender System☆19Mar 25, 2024Updated 2 years ago
- Dionis predictors blender☆10Oct 21, 2015Updated 10 years ago