A scrapy pipeline which send items to Elastic Search server
☆98Jan 2, 2018Updated 8 years ago
Alternatives and similar repositories for scrapy-elasticsearch
Users that are interested in scrapy-elasticsearch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A scrapy pipeline which send items to Elastic Search server☆319Jun 10, 2022Updated 4 years ago
- Export a graph of link between crawled items by scrapy in dot file format.☆26Sep 24, 2011Updated 15 years ago
- Fast Python Bloom Filter using Mmap☆13Aug 20, 2012Updated 14 years ago
- Scrapy project to scrape public web directories (educational)☆22Mar 18, 2017Updated 9 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆50Jul 24, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆223Apr 27, 2015Updated 11 years ago
- Tool for exploring clusters of similar documents in a text corpus.☆16Apr 15, 2014Updated 12 years ago
- Output scrapy statistics to graphite/carbon☆54Mar 9, 2013Updated 13 years ago
- Mongodb support for scrapy☆101Mar 9, 2017Updated 9 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- Efficient clustering of MASSCAN results☆12Dec 26, 2016Updated 9 years ago
- A simple distribute spider based on scrapy framework.☆26Oct 22, 2015Updated 11 years ago
- Useful test spiders for Scrapy☆184Jan 20, 2020Updated 6 years ago
- MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…☆356Apr 6, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A scrapy-based Hacker News crawler.☆151May 21, 2013Updated 13 years ago
- This is the code for the tutorial titled "Writing a spider in 10 mins using Scrapy" which can be found in the Weblogs section☆16Nov 28, 2013Updated 12 years ago
- Example project for dynamically adding forms to a formset using JavaScript and Django.☆13May 8, 2011Updated 15 years ago
- A QueuedSearchIndex built with celery☆51Mar 27, 2012Updated 14 years ago
- Python client for ElasticSearch☆17Jul 14, 2015Updated 11 years ago
- simple loading bar in python☆16May 10, 2012Updated 14 years ago
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 12 years ago
- Scrapy middleware for building historical S3 cache for crawled web resources.☆10Jun 21, 2017Updated 9 years ago
- A small utility for converting Stanford GloVe vectors to HDF5 / NumPy☆12Apr 4, 2017Updated 9 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Scrapy Redis with Bloom Filter，support redis sentinel and cluster☆25Mar 31, 2023Updated 3 years ago
- ReactNativeMobileAppTest☆13May 25, 2017Updated 9 years ago
- Manage you models in command line environment☆22Jul 11, 2015Updated 11 years ago
- ☆12Feb 5, 2025Updated last year
- Some scrapy and web.py exmaples☆79May 20, 2017Updated 9 years ago
- A simple tutorial, showing how to quickly and easily use ElasticSearch as the data store for a simple application (in this case a simple …☆19May 7, 2013Updated 13 years ago
- A generic interface wrapping multiple backends to provide a consistent pubsub API☆13Oct 31, 2018Updated 7 years ago
- An online sentiment analyzer built with Flask and TextBlob☆15Sep 3, 2013Updated 13 years ago
- Use scrapy with mongodb to store the request queues (FIFO or LIFO)☆13Dec 25, 2012Updated 13 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Academic Search Engine using Scrapy, MongoDB, Lucene/Solr, Tika, Struts2, Jquery, Bootstrap, D3, CAS☆101Jun 16, 2013Updated 13 years ago
- scrapydweb, dockerfile☆13Feb 1, 2021Updated 5 years ago
- An app to provide phone confirmation via Twilio☆15Apr 11, 2019Updated 7 years ago
- A Scrapy pipeline to categorize items using MonkeyLearn☆38Apr 28, 2017Updated 9 years ago
- Load items from Scrapinghub to ElasticSearch☆11Dec 8, 2022Updated 3 years ago
- Serve Coffeescript from your Django templates☆14Nov 21, 2011Updated 14 years ago
- Scrapy examples crawling Craigslist☆199Apr 20, 2016Updated 10 years ago