Mongodb support for scrapy
☆101Mar 9, 2017Updated 9 years ago
Alternatives and similar repositories for scrapy-mongodb
Users that are interested in scrapy-mongodb are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)☆33Feb 22, 2018Updated 8 years ago
- Output scrapy statistics to graphite/carbon☆54Mar 9, 2013Updated 13 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Dec 15, 2012Updated 13 years ago
- MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…☆358Apr 6, 2021Updated 4 years ago
- A Chrome extension to collect the answer information on zhihu.com, show the result of it.☆17Feb 1, 2015Updated 11 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Some scrapy and web.py exmaples☆79May 20, 2017Updated 8 years ago
- Leaderboard example☆20May 25, 2022Updated 3 years ago
- A Python RFC2397 ("data url") implementation☆16Jan 3, 2012Updated 14 years ago
- Requests + futures = <3 - a grequests fork, origonal code: https://github.com/kennethreitz/grequests☆63Jun 18, 2015Updated 10 years ago
- A crawling spider gathering all blogposts from http://isbullsh.it, using Scrapy☆31Jul 7, 2013Updated 12 years ago
- presentation for nicar 2011 (an exploration into the concepts behind backbone.js)☆12Feb 24, 2011Updated 15 years ago
- a web site for beijing-open-party IT unconference.☆70Feb 15, 2023Updated 3 years ago
- Scrapy examples crawling Craigslist☆201Apr 20, 2016Updated 9 years ago
- ☆15Mar 2, 2014Updated 12 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Ruby Berkeley DB☆36Aug 29, 2011Updated 14 years ago
- Expose Kafka offset lag to prometheus☆16Nov 27, 2025Updated 4 months ago
- codeigniter based web app to map epsiodes and shows across websites☆19Sep 16, 2013Updated 12 years ago
- Backup tool for Apache Cassandra based on https://github.com/synack/tablesnap☆22Mar 26, 2013Updated 13 years ago
- 发现更美的世界☆84Aug 14, 2023Updated 2 years ago
- KISS password manager☆10Dec 4, 2020Updated 5 years ago
- Apple OSA scripts☆11Aug 15, 2018Updated 7 years ago
- Docker container for Apache Accumulo☆13Jul 25, 2017Updated 8 years ago
- Generate sortable, unique transaction or request IDs for OpenResty/nginx.☆13Apr 1, 2018Updated 7 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A scrapy pipeline which send items to Elastic Search server☆98Jan 2, 2018Updated 8 years ago
- Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration.☆98Jul 1, 2017Updated 8 years ago
- scrapy examples for crawling zhihu and github☆223Jan 11, 2023Updated 3 years ago
- ☆10Jun 4, 2020Updated 5 years ago
- GPG encryption helper for Dropbox☆12Aug 28, 2013Updated 12 years ago
- Search emails in Notmuch asynchronously with Ivy☆14Jan 30, 2020Updated 6 years ago
- Simple and minimal WebSQL and cordova SQLite ORM for ionic and angular☆10Mar 5, 2016Updated 10 years ago
- Soon a free and open source framework written in C# to MMO Server☆15Feb 17, 2017Updated 9 years ago
- This plugin enables real-time streaming of video and/or audio between two web browsers(or peers).☆70Nov 19, 2014Updated 11 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.☆155Jul 28, 2017Updated 8 years ago
- Python queue implemented on top of Redis☆43Apr 1, 2024Updated last year
- A pair of simple init scripts to run Selenium Grid as Hub or Node server instances.☆15Feb 1, 2016Updated 10 years ago
- 微信js接口后台签名sdk，python实现☆25Jul 23, 2015Updated 10 years ago
- OrqueIO main source code repository☆22Updated this week
- ☆10Jan 1, 2026Updated 2 months ago
- Simple voice to speech transcription using Google☆22Feb 22, 2014Updated 12 years ago