Use scrapy with mongodb to store the request queues (FIFO or LIFO)
☆13Dec 25, 2012Updated 13 years ago
Alternatives and similar repositories for scrapy-mongodb-queue
Users that are interested in scrapy-mongodb-queue are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MongoDB pipeline for Scrapy. It allows to update existing entries (set new values or add elements to array) when item values are spread o…☆10Jan 6, 2013Updated 13 years ago
- Use scrapy with a list of proxies generated from proxynova.com☆40Jan 3, 2013Updated 13 years ago
- Provider-agnostic cloud provisioning and Docker orchestration☆31Mar 25, 2021Updated 5 years ago
- A Flask extention that provide user navigation tracking☆18Dec 4, 2011Updated 14 years ago
- ☆12Oct 28, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Parsing and generation of 3D geometries for robot mechanisms in Julia☆13Dec 4, 2024Updated last year
- Scripts for generating graphs in various formats.☆11Oct 24, 2013Updated 13 years ago
- Deprecated HubStorage client library - please use python-scrapinghub>=1.9.0 instead☆16Dec 5, 2016Updated 9 years ago
- Events manager for a docker cluster☆13Oct 12, 2014Updated 12 years ago
- ☆33Oct 20, 2025Updated last year
- The hofa package contains an extensive toolkit for factor analysis based on higher-order multi-cumulant in R. The package is complementar…☆11Mar 4, 2026Updated 8 months ago
- Discord bot that will transcribe audio using OpenAI Whisper☆12Jun 6, 2023Updated 3 years ago
- Pricing European and American options with jump models using CUDA on the GPU☆12Apr 12, 2016Updated 10 years ago
- Summarize URLs using the Kagi Universal Summarizer and Read Out Loud☆11Feb 11, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A very simple way to let users edit content on the front end of a website when you don't quite need a full CMS.☆25Jun 15, 2016Updated 10 years ago
- The simple, fast, visual testing framework for web applications.☆13Nov 3, 2015Updated 11 years ago
- Code and materials for the talk "Set practice: coding & using sets in Go"☆11Aug 30, 2026Updated 2 months ago
- Programmatic building of JSON schemas (document and field mappings) with validation.☆30Mar 29, 2021Updated 5 years ago
- Generates a fancy Web page from a folder with movies files.☆10May 4, 2012Updated 14 years ago
- Simple notifications implementation with RabbitMQ using pika.☆19Feb 11, 2015Updated 11 years ago
- ☆14Feb 22, 2015Updated 11 years ago
- ASIO Cooperative Task for await-based coroutine☆17Sep 8, 2018Updated 8 years ago
- Javascript URL Builder and Manipulator☆12Jan 12, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ODAS: Open embeddeD Audition System☆11Mar 20, 2021Updated 5 years ago
- ElasticSearch support for django-tastypie☆28Nov 2, 2013Updated 13 years ago
- Chronicle memory-mapped message journal in Python☆14Oct 23, 2025Updated last year
- React Native credit card scanning in mobile apps using Card.io☆11Aug 31, 2018Updated 8 years ago
- The implementation of DDP server based on EventEmitter.☆15Aug 15, 2015Updated 11 years ago
- Fetch commits from a GitHub repository periodically☆17Jul 17, 2014Updated 12 years ago
- A library of nice to have things not found in the current mojo stdlib☆16Updated this week
- a mutux network lock based on etcd☆10May 14, 2018Updated 8 years ago
- elb-dance makes it easy to register and deregister instances with AWS ELB☆10Feb 10, 2014Updated 12 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sync to Google Drive with concurrent transfers☆12Mar 4, 2014Updated 12 years ago
- Bidirectional voice MCP server for Claude Code — listen (STT) and speak (TTS) on Apple Silicon via mlx-audio☆16Feb 10, 2026Updated 8 months ago
- Vuetify with the markdown editor☆10Sep 22, 2019Updated 7 years ago
- OpenPix/Woovi PHP SDK☆13Aug 16, 2026Updated 2 months ago
- Router for React Native with declarative configuration similar to React Router.☆12Sep 16, 2016Updated 10 years ago
- Amazon S3 Cordova plug-in☆11Oct 24, 2017Updated 9 years ago
- Trigram inverted search index generator/client in Ruby + JS client☆12May 25, 2011Updated 15 years ago
Are these results useful?