Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management
☆17Sep 2, 2017Updated 9 years ago
Alternatives and similar repositories for scrapyd-mongodb
Users that are interested in scrapyd-mongodb are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A RabbitMQ/Redis tool for Scrapy☆13Oct 7, 2016Updated 9 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 8 years ago
- Restrict crawl and scraping scope using matchers.☆26Jun 8, 2016Updated 10 years ago
- a 4MB alpine based nginx docker image, but carried with a configurable cache among other features☆15Feb 7, 2018Updated 8 years ago
- System for anomaly detection in mass generic data☆16Jul 19, 2012Updated 14 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 5 years ago
- Esse é o modelo de curso a ser seguido pela Webschool,☆10Aug 26, 2015Updated 11 years ago
- ☆14Sep 18, 2012Updated 13 years ago
- Simple way to build a new dict based on fields declaration☆15May 7, 2019Updated 7 years ago
- Code for our paper in ACL 2017☆13Dec 14, 2017Updated 8 years ago
- Tooling for profiling Django applications, inspired by David Cramer☆20Mar 19, 2013Updated 13 years ago
- In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framewor…☆12Feb 2, 2020Updated 6 years ago
- Simulation and analysis of cloud computing architectures and algorithms using CloudSim Plus☆12Sep 9, 2019Updated 6 years ago
- a tor socks proxy docker image☆12Apr 8, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- FIWARE 507: Cloud-Edge Processing☆13Updated this week
- A collection of patterns to solve problems in Django. Makes up the site DjangoPatterns.com. Fork, contribute, and issue a pull request.☆16Dec 17, 2022Updated 3 years ago
- re-implementation of ecs-deploy in Golang☆34Jan 13, 2026Updated 7 months ago
- Track torrent-trackers☆26Aug 31, 2026Updated last week
- [abandoned] statistical HTML content extraction in python☆18Jan 12, 2011Updated 15 years ago
- Twitter API wrapper using tapioca☆16Dec 5, 2017Updated 8 years ago
- COVID-19 India (React.js/Frontend) | Refined stats from COVID-19 Official Website☆11Jan 5, 2023Updated 3 years ago
- A declarative data-migration package☆16Dec 7, 2024Updated last year
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- TensorFlow implementation of the Dissimilarity Mixture Autoencoder: https://arxiv.org/abs/2006.08177☆13Dec 8, 2022Updated 3 years ago
- mongo docker with auth☆12Jul 24, 2018Updated 8 years ago
- Scraper de registro de visitas online. Usa Scrapy.☆23Apr 15, 2024Updated 2 years ago
- A cookiecutter template for a basic Django Web API project.☆15Apr 21, 2016Updated 10 years ago
- This is a GraphQL sample app usign Vue Apollo from the ProgramWithErik YouTube channel erik.video☆11May 17, 2019Updated 7 years ago
- a privileges app☆19Jun 10, 2021Updated 5 years ago
- A Scrapy extension to log items coverage when the spider shuts down☆18Apr 11, 2020Updated 6 years ago
- MOOC Project for software design and development taught at Clarkson University☆16Feb 11, 2022Updated 4 years ago
- ☆18Jun 10, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The Landing page for xypnox.com☆12Mar 19, 2026Updated 5 months ago
- 🎀 A Chrome extension written using Vue and Async/Await. Uses a popup display and changes badge counts.☆14Oct 28, 2024Updated last year
- Scrapes a given Facebook user's feed for messages, tags, likes, and datetimes of submissions.☆10Jul 3, 2013Updated 13 years ago
- DEPRECATED Export Members of a Facebook Group to a CSV☆13Jun 30, 2020Updated 6 years ago
- ☆24Mar 5, 2018Updated 8 years ago
- Mission - scraping the planet, one website at a time☆10Dec 7, 2022Updated 3 years ago
- Scrapy spider middleware to split an item into multiple items using a multi-valued key☆21Feb 8, 2017Updated 9 years ago