Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management
☆17Sep 2, 2017Updated 8 years ago
Alternatives and similar repositories for scrapyd-mongodb
Users that are interested in scrapyd-mongodb are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A RabbitMQ/Redis tool for Scrapy☆13Oct 7, 2016Updated 9 years ago
- Restrict crawl and scraping scope using matchers.☆26Jun 8, 2016Updated 9 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 7 years ago
- ☆68Sep 7, 2018Updated 7 years ago
- Esse é o modelo de curso a ser seguido pela Webschool,☆10Aug 26, 2015Updated 10 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- a 4MB alpine based nginx docker image, but carried with a configurable cache among other features☆15Feb 7, 2018Updated 8 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 5 years ago
- A collection of pipelines for Scrapy☆16Apr 27, 2026Updated last week
- ☆14Sep 18, 2012Updated 13 years ago
- Exemplos de programação concorrente em Python☆12Jan 27, 2015Updated 11 years ago
- Simple way to build a new dict based on fields declaration☆15May 7, 2019Updated 7 years ago
- This is an API for a todo list application implemented using API Star☆12Dec 26, 2022Updated 3 years ago
- Distributed Upload STorage for Django. A file backend that mirrors all incoming media files to several servers☆67Jan 31, 2012Updated 14 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆57Mar 16, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A scrapy extension to store requests and responses information in storage service☆27Mar 11, 2022Updated 4 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Dec 15, 2012Updated 13 years ago
- Twitter API wrapper using tapioca☆16Dec 5, 2017Updated 8 years ago
- An example of how to use full text search on Django using database back-ends☆15Jan 10, 2016Updated 10 years ago
- A library and command line tool utility to organise your media ( Photos and videos ) better☆16Nov 15, 2018Updated 7 years ago
- FIWARE 507: Cloud-Edge Processing☆13May 1, 2026Updated last week
- A cookiecutter template for a basic Django Web API project.☆15Apr 21, 2016Updated 10 years ago
- Scraper de registro de visitas online. Usa Scrapy.☆22Apr 15, 2024Updated 2 years ago
- COVID-19 India (React.js/Frontend) | Refined stats from COVID-19 Official Website☆11Jan 5, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- mongo docker with auth☆12Jul 24, 2018Updated 7 years ago
- The awful code behind the most beautiful torrent site to ever exist.☆11Jan 28, 2016Updated 10 years ago
- GraphQL Middleware for container interop☆13Jun 18, 2019Updated 6 years ago
- FINN (Fire INventory from NCAR)☆11Jan 28, 2025Updated last year
- TensorFlow implementation of the Dissimilarity Mixture Autoencoder: https://arxiv.org/abs/2006.08177☆13Dec 8, 2022Updated 3 years ago
- Example on how to use Kubernetes Dynamic Informers☆11Mar 11, 2021Updated 5 years ago
- Prevents users from doing concurrent editing in Django. Works out of the box in the admin interface, or you can integrate it with your ow…☆109Sep 15, 2019Updated 6 years ago
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 11 years ago
- Abstraction of various SASL mechanism responses☆11Dec 21, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …☆21Oct 21, 2021Updated 4 years ago
- A simple walk-through guide for how to integrate `Kubernetes` with `Dex` + `LDAP`.☆11Aug 21, 2023Updated 2 years ago
- This is a GraphQL sample app usign Vue Apollo from the ProgramWithErik YouTube channel erik.video☆11May 17, 2019Updated 6 years ago
- A simple money Pooling and Managing Dapp built on top of Ethereum Blockchain using DAI stablecoin.☆10Feb 14, 2026Updated 2 months ago
- Archiving tool for Google Photos☆16Apr 22, 2026Updated 2 weeks ago
- A Scrapy extension to log items coverage when the spider shuts down☆19Apr 11, 2020Updated 6 years ago
- ☆10Aug 6, 2018Updated 7 years ago