Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management
☆17Sep 2, 2017Updated 8 years ago
Alternatives and similar repositories for scrapyd-mongodb
Users that are interested in scrapyd-mongodb are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scrapyd web application for managing projects, spiders and visualize jobs logs and items☆14Jan 19, 2016Updated 10 years ago
- A RabbitMQ/Redis tool for Scrapy☆13Oct 7, 2016Updated 9 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 8 years ago
- Restrict crawl and scraping scope using matchers.☆26Jun 8, 2016Updated 10 years ago
- Minimizes Django templates so that html is served up already minimized. Minimizes django templates and the html, in-line javascript, and…☆27Dec 6, 2015Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆68Sep 7, 2018Updated 7 years ago
- a 4MB alpine based nginx docker image, but carried with a configurable cache among other features☆15Feb 7, 2018Updated 8 years ago
- A collection of pipelines for Scrapy☆16Apr 27, 2026Updated 3 months ago
- Esse é o modelo de curso a ser seguido pela Webschool,☆10Aug 26, 2015Updated 10 years ago
- ☆14Sep 18, 2012Updated 13 years ago
- Enhanment Scrapping API for six hotel booking website from Expedia.com, Booking.com, Bookhotelbeds.com. Hotels.com, Bestday.com, despegar…☆11May 7, 2018Updated 8 years ago
- Exemplos de programação concorrente em Python☆12Jan 27, 2015Updated 11 years ago
- Simple way to build a new dict based on fields declaration☆15May 7, 2019Updated 7 years ago
- This is an API for a todo list application implemented using API Star☆12Dec 26, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- An extension for pymongo that adds json schema validation and index management☆13Oct 19, 2019Updated 6 years ago
- Tooling for profiling Django applications, inspired by David Cramer☆20Mar 19, 2013Updated 13 years ago
- In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framewor…☆12Feb 2, 2020Updated 6 years ago
- Simulation and analysis of cloud computing architectures and algorithms using CloudSim Plus☆12Sep 9, 2019Updated 6 years ago
- A scrapy extension to store requests and responses information in storage service☆27Mar 11, 2022Updated 4 years ago
- A library and command line tool utility to organise your media ( Photos and videos ) better☆16Nov 15, 2018Updated 7 years ago
- a tor socks proxy docker image☆12Apr 8, 2026Updated 3 months ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆56Mar 16, 2022Updated 4 years ago
- An example of how to use full text search on Django using database back-ends☆15Jan 10, 2016Updated 10 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A collection of patterns to solve problems in Django. Makes up the site DjangoPatterns.com. Fork, contribute, and issue a pull request.☆16Dec 17, 2022Updated 3 years ago
- Twitter API wrapper using tapioca☆16Dec 5, 2017Updated 8 years ago
- BPF examples for Kubernetes☆14May 25, 2019Updated 7 years ago
- Diagrams to visually learn Falco and its eBPF probe☆15Jun 24, 2021Updated 5 years ago
- COVID-19 India (React.js/Frontend) | Refined stats from COVID-19 Official Website☆11Jan 5, 2023Updated 3 years ago
- mongo docker with auth☆12Jul 24, 2018Updated 8 years ago
- FINN (Fire INventory from NCAR)☆12Jun 29, 2026Updated 3 weeks ago
- The awful code behind the most beautiful torrent site to ever exist.☆11Jan 28, 2016Updated 10 years ago
- Scraper de registro de visitas online. Usa Scrapy.☆23Apr 15, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A declarative data-migration package☆16Dec 7, 2024Updated last year
- A cookiecutter template for a basic Django Web API project.☆15Apr 21, 2016Updated 10 years ago
- Example on how to use Kubernetes Dynamic Informers☆11Mar 11, 2021Updated 5 years ago
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 11 years ago
- This is a public Repo Open to all KGEC students feel free to pull a request for your awesome project that we want to share☆10Oct 21, 2020Updated 5 years ago
- A utility for easily creating and releasing Python packages☆50Oct 1, 2020Updated 5 years ago
- a privileges app☆19Jun 10, 2021Updated 5 years ago