Tiago-Lira / scrapyd-mongodbView external linksLinks
Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management
☆17Sep 2, 2017Updated 8 years ago
Alternatives and similar repositories for scrapyd-mongodb
Users that are interested in scrapyd-mongodb are comparing it to the libraries listed below
Sorting:
- A RabbitMQ/Redis tool for Scrapy☆13Oct 7, 2016Updated 9 years ago
- Scrapyd web application for managing projects, spiders and visualize jobs logs and items☆14Jan 19, 2016Updated 10 years ago
- Restrict crawl and scraping scope using matchers.☆26Jun 8, 2016Updated 9 years ago
- Esse é o modelo de curso a ser seguido pela Webschool,☆10Aug 26, 2015Updated 10 years ago
- Exemplos de programação concorrente em Python☆12Jan 27, 2015Updated 11 years ago
- This is an API for a todo list application implemented using API Star☆12Dec 26, 2022Updated 3 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- A utility for easily creating and releasing Python packages☆50Oct 1, 2020Updated 5 years ago
- Distributed Upload STorage for Django. A file backend that mirrors all incoming media files to several servers☆66Jan 31, 2012Updated 14 years ago
- Minimizes Django templates so that html is served up already minimized. Minimizes django templates and the html, in-line javascript, and…☆27Dec 6, 2015Updated 10 years ago
- ☆68Sep 7, 2018Updated 7 years ago
- Simple way to build a new dict based on fields declaration☆15May 7, 2019Updated 6 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Dec 15, 2012Updated 13 years ago
- Twitter API wrapper using tapioca☆16Dec 5, 2017Updated 8 years ago
- A cookiecutter template for a basic Django Web API project.☆15Apr 21, 2016Updated 9 years ago
- Prevents users from doing concurrent editing in Django. Works out of the box in the admin interface, or you can integrate it with your ow…☆109Sep 15, 2019Updated 6 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 4 years ago
- A helper to create web scrapers using scrapy selector in a Model based structure☆57Dec 26, 2022Updated 3 years ago
- Simple Web UI for Scrapy spider management via Scrapyd☆50Jun 25, 2018Updated 7 years ago
- ☆44Aug 7, 2014Updated 11 years ago
- Documentação da API do Boleto Simples - Sistema para emissão de boletos com registro☆23Apr 12, 2023Updated 2 years ago
- Scraper de registro de visitas online. Usa Scrapy.☆22Apr 15, 2024Updated last year
- Django Dahing demo application☆25Oct 10, 2016Updated 9 years ago
- A scrapy spider for R18☆16Nov 18, 2025Updated 2 months ago
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.☆57Mar 16, 2022Updated 3 years ago
- Resizing and cropping images via Nginx, as well as caching the result☆64Sep 30, 2016Updated 9 years ago
- Django ClassViews, Forms for mongoengine support☆41Dec 15, 2020Updated 5 years ago
- Dynamic Dummy Image Generator For Django!☆56Nov 29, 2012Updated 13 years ago
- COVID-19 India (React.js/Frontend) | Refined stats from COVID-19 Official Website☆11Jan 5, 2023Updated 3 years ago
- Enhanment Scrapping API for six hotel booking website from Expedia.com, Booking.com, Bookhotelbeds.com. Hotels.com, Bestday.com, despegar…☆11May 7, 2018Updated 7 years ago
- FINN (Fire INventory from NCAR)☆11Jan 28, 2025Updated last year
- KOPS instllation in aws☆11Aug 6, 2018Updated 7 years ago
- A CLI for benchmarking Scrapy.☆32Jun 28, 2025Updated 7 months ago
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 11 years ago
- The complete command-line tool for GitHub-flavored markdown☆33Nov 23, 2017Updated 8 years ago
- Exemplos do curso Python Patterns☆29Sep 27, 2015Updated 10 years ago
- Moved to a new home at https://github.com/epicserve/django-cache-url☆66Feb 7, 2020Updated 6 years ago
- ☆36Sep 7, 2015Updated 10 years ago
- Repo for the development and maintenance of the Collection+JSON media type☆61Jun 28, 2019Updated 6 years ago