MongoDB pipeline for Scrapy. It allows to update existing entries (set new values or add elements to array) when item values are spread over multiple pages
☆10Jan 6, 2013Updated 13 years ago
Alternatives and similar repositories for scrapy-mongodb-pipeline
Users that are interested in scrapy-mongodb-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Use scrapy with mongodb to store the request queues (FIFO or LIFO)☆13Dec 25, 2012Updated 13 years ago
- ☆21Sep 18, 2013Updated 13 years ago
- Google Spreadsheet 记账脚本☆10Jul 20, 2015Updated 11 years ago
- Mongodb support for scrapy☆101Mar 9, 2017Updated 9 years ago
- ☆12May 10, 2017Updated 9 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Wechat LuckyMoney Grabber☆10Feb 8, 2016Updated 10 years ago
- A simple IRC bot that responds to commands. Inspired by Hubot. Implemented in Python.☆15Mar 20, 2013Updated 13 years ago
- A scrapy pipeline for couchdb☆17Sep 10, 2011Updated 15 years ago
- Chrome Based Scraper☆22Feb 7, 2013Updated 13 years ago
- A sample elasticsearch river able to stream json data in☆38Feb 11, 2020Updated 6 years ago
- 对逻辑回归各种用法的总结,包括线性,多类,并行,分布式,在线,优化方案☆15Jul 14, 2017Updated 9 years ago
- Useful test spiders for Scrapy☆184Jan 20, 2020Updated 6 years ago
- MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…☆355Apr 6, 2021Updated 5 years ago
- Topic detection and sentiment analysis of Google Play app reviews☆11Jun 25, 2015Updated 11 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- jinja2 extensions that add django tags☆40May 23, 2024Updated 2 years ago
- 围观大神大战知乎，顺便练手做项目☆13May 31, 2015Updated 11 years ago
- Script to populate influxdb with metric from pmacct, shipped with some grafana example dashboad.☆12Sep 5, 2016Updated 10 years ago
- gTornado add greenify support to tornado☆16Jan 13, 2016Updated 10 years ago
- Sample web crawler and search engine written in Node.JS and MongoDb☆18Apr 5, 2020Updated 6 years ago
- Parsing and generation of 3D geometries for robot mechanisms in Julia☆13Dec 4, 2024Updated last year
- my quick issue tech blog (mostly in zh-cn)☆11Mar 6, 2017Updated 9 years ago
- DEPRECATED: Blink has been merged into Chromium, this repository is no longer in use.☆19Nov 26, 2015Updated 10 years ago
- Ethereum miner with CUDA and stratum support☆11Jul 13, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Small hack to draw date histogram facets as graph using nvd3.js☆54Nov 21, 2012Updated 13 years ago
- Deprecated HubStorage client library - please use python-scrapinghub>=1.9.0 instead☆16Dec 5, 2016Updated 9 years ago
- Cloud Installer (originated by Dell)☆15Jan 22, 2013Updated 13 years ago
- ☆33Oct 20, 2025Updated last year
- golang fast concurrent lru cache with thread safe☆15Dec 9, 2016Updated 9 years ago
- Use scrapy with a list of proxies generated from proxynova.com☆40Jan 3, 2013Updated 13 years ago
- Paginating the web☆36Feb 11, 2014Updated 12 years ago
- 抓取 google play store 資料 use Scrapy on python☆15Sep 15, 2025Updated last year
- A small/simple python script to back up folders and databases.☆14Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Social scraper is a Perl program that scrapes reddit, digg, stumbleupon, delicious, furl, flickr, simpy, boingboing, wired for content th…☆27Feb 26, 2010Updated 16 years ago
- Git fork of rtmplite☆14Sep 3, 2012Updated 14 years ago
- The hofa package contains an extensive toolkit for factor analysis based on higher-order multi-cumulant in R. The package is complementar…☆11Mar 4, 2026Updated 8 months ago
- Resume = Jade + YAML.☆18Feb 1, 2015Updated 11 years ago
- Pricing European and American options with jump models using CUDA on the GPU☆12Apr 12, 2016Updated 10 years ago
- A predictive model to help Uber drivers make more money☆24Apr 10, 2017Updated 9 years ago
- A very simple way to let users edit content on the front end of a website when you don't quite need a full CMS.☆25Jun 15, 2016Updated 10 years ago