MongoDB pipeline for Scrapy. It allows to update existing entries (set new values or add elements to array) when item values are spread over multiple pages
☆10Jan 6, 2013Updated 13 years ago
Alternatives and similar repositories for scrapy-mongodb-pipeline
Users that are interested in scrapy-mongodb-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Google Spreadsheet 记账脚本☆10Jul 20, 2015Updated 11 years ago
- ☆12May 10, 2017Updated 9 years ago
- Wechat LuckyMoney Grabber☆10Feb 8, 2016Updated 10 years ago
- MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…☆356Apr 6, 2021Updated 5 years ago
- A scrapy pipeline for couchdb☆17Sep 10, 2011Updated 15 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Chrome Based Scraper☆22Feb 7, 2013Updated 13 years ago
- A simple IRC bot that responds to commands. Inspired by Hubot. Implemented in Python.☆15Mar 20, 2013Updated 13 years ago
- Topic detection and sentiment analysis of Google Play app reviews☆11Jun 25, 2015Updated 11 years ago
- 对逻辑回归各种用法的总结,包括线性,多类,并行,分布式,在线,优化方案☆15Jul 14, 2017Updated 9 years ago
- A sample elasticsearch river able to stream json data in☆38Feb 11, 2020Updated 6 years ago
- Deprecated HubStorage client library - please use python-scrapinghub>=1.9.0 instead☆16Dec 5, 2016Updated 9 years ago
- DEPRECATED: Blink has been merged into Chromium, this repository is no longer in use.☆19Nov 26, 2015Updated 10 years ago
- jinja2 extensions that add django tags☆40May 23, 2024Updated 2 years ago
- 抓取 google play store 資料 use Scrapy on python☆15Sep 15, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 围观大神大战知乎，顺便练手做项目☆13May 31, 2015Updated 11 years ago
- golang fast concurrent lru cache with thread safe☆15Dec 9, 2016Updated 9 years ago
- gTornado add greenify support to tornado☆16Jan 13, 2016Updated 10 years ago
- quick start up for WPD to build modern webapp☆19Jun 7, 2017Updated 9 years ago
- Mongodb support for scrapy☆101Mar 9, 2017Updated 9 years ago
- Sample web crawler and search engine written in Node.JS and MongoDb☆18Apr 5, 2020Updated 6 years ago
- my quick issue tech blog (mostly in zh-cn)☆11Mar 6, 2017Updated 9 years ago
- Resume = Jade + YAML.☆18Feb 1, 2015Updated 11 years ago
- Paginating the web☆36Feb 11, 2014Updated 12 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆33Oct 20, 2025Updated 11 months ago
- Small hack to draw date histogram facets as graph using nvd3.js☆54Nov 21, 2012Updated 13 years ago
- Useful test spiders for Scrapy☆184Jan 20, 2020Updated 6 years ago
- 一些编码规范，包括PHP、Javascript、CSS和ThinkSNS模板编写规范☆18Oct 28, 2013Updated 12 years ago
- A predictive model to help Uber drivers make more money☆23Apr 10, 2017Updated 9 years ago
- A small/simple python script to back up folders and databases.☆14Sep 27, 2026Updated 2 weeks ago
- Examples and Icons for Generating diagrams☆19Sep 29, 2020Updated 6 years ago
- Use scrapy with a list of proxies generated from proxynova.com☆40Jan 3, 2013Updated 13 years ago
- Create an example replicated + distributed dataset using Clickhouse☆27Jun 7, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Pricing European and American options with jump models using CUDA on the GPU☆12Apr 12, 2016Updated 10 years ago
- Social scraper is a Perl program that scrapes reddit, digg, stumbleupon, delicious, furl, flickr, simpy, boingboing, wired for content th…☆27Feb 26, 2010Updated 16 years ago
- A very simple way to let users edit content on the front end of a website when you don't quite need a full CMS.☆25Jun 15, 2016Updated 10 years ago
- .files, including ~/.macos — sensible hacker defaults for macOS☆25Jan 13, 2017Updated 9 years ago
- Trading Plan description☆22Feb 10, 2020Updated 6 years ago
- ☆21Sep 18, 2013Updated 13 years ago
- example code that shows how to export a model in Python and import that model in Go☆24Mar 1, 2018Updated 8 years ago