Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management
☆17Sep 2, 2017Updated 8 years ago
Alternatives and similar repositories for scrapyd-mongodb
Users that are interested in scrapyd-mongodb are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A RabbitMQ/Redis tool for Scrapy☆13Oct 7, 2016Updated 9 years ago
- Minimizes Django templates so that html is served up already minimized. Minimizes django templates and the html, in-line javascript, and…☆27Dec 6, 2015Updated 10 years ago
- Restrict crawl and scraping scope using matchers.☆26Jun 8, 2016Updated 9 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 7 years ago
- ☆68Sep 7, 2018Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 5 years ago
- A collection of pipelines for Scrapy☆16Mar 13, 2026Updated 2 weeks ago
- ☆14Sep 18, 2012Updated 13 years ago
- A utility for easily creating and releasing Python packages☆50Oct 1, 2020Updated 5 years ago
- Exemplos de programação concorrente em Python☆12Jan 27, 2015Updated 11 years ago
- Simple way to build a new dict based on fields declaration☆15May 7, 2019Updated 6 years ago
- This is an API for a todo list application implemented using API Star☆12Dec 26, 2022Updated 3 years ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆57Mar 16, 2022Updated 4 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Dec 15, 2012Updated 13 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Adds RethinkDB support to Flask http://rethinkdb.com☆27Jun 22, 2021Updated 4 years ago
- Enhanment Scrapping API for six hotel booking website from Expedia.com, Booking.com, Bookhotelbeds.com. Hotels.com, Bestday.com, despegar…☆11May 7, 2018Updated 7 years ago
- FIWARE 507: Cloud-Edge Processing☆13Jan 27, 2026Updated 2 months ago
- a tor socks proxy docker image☆12Feb 10, 2026Updated last month
- A cookiecutter template for a basic Django Web API project.☆15Apr 21, 2016Updated 9 years ago
- Scraper de registro de visitas online. Usa Scrapy.☆22Apr 15, 2024Updated last year
- mongo docker with auth☆12Jul 24, 2018Updated 7 years ago
- The awful code behind the most beautiful torrent site to ever exist.☆11Jan 28, 2016Updated 10 years ago
- TensorFlow implementation of the Dissimilarity Mixture Autoencoder: https://arxiv.org/abs/2006.08177☆13Dec 8, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Prevents users from doing concurrent editing in Django. Works out of the box in the admin interface, or you can integrate it with your ow…☆109Sep 15, 2019Updated 6 years ago
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 11 years ago
- Simulation and analysis of cloud computing architectures and algorithms using CloudSim Plus☆12Sep 9, 2019Updated 6 years ago
- Scrapy extension to write items using sqlalchemy models☆37Apr 24, 2017Updated 8 years ago
- Archiving tool for Google Photos☆16Mar 19, 2026Updated last week
- A Scrapy extension to log items coverage when the spider shuts down☆19Apr 11, 2020Updated 5 years ago
- A helper to create web scrapers using scrapy selector in a Model based structure☆57Dec 26, 2022Updated 3 years ago
- Scrapes a given Facebook user's feed for messages, tags, likes, and datetimes of submissions.☆10Jul 3, 2013Updated 12 years ago
- The Landing page for xypnox.com☆12Mar 19, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- DEPRECATED Export Members of a Facebook Group to a CSV☆13Jun 30, 2020Updated 5 years ago
- Python code for reproducing the results of Understanding Regularized Spectral Clustering via Graph Conductance☆14Oct 15, 2019Updated 6 years ago
- A rotating socks proxy using Tor, Delegate and Haproxy☆14Feb 10, 2026Updated last month
- Resizing and cropping images via Nginx, as well as caching the result☆64Sep 30, 2016Updated 9 years ago
- Proxy-list management application for Django☆23Mar 5, 2018Updated 8 years ago
- ☆44Aug 7, 2014Updated 11 years ago
- Hacktoberfest tracker for your community.☆11Nov 20, 2023Updated 2 years ago