Scrapy Eagle is a tool that allow us to run any Scrapy based project in a distributed fashion and monitor how it is going on and how many resources it is consuming on each server.
☆24Sep 4, 2020Updated 5 years ago
Alternatives and similar repositories for scrapy-eagle
Users that are interested in scrapy-eagle are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple python command line utility using the Vagalume API to search and show songs lyrics.☆10Dec 26, 2022Updated 3 years ago
- Scrapy extension which writes crawled items to Kafka☆31Apr 8, 2026Updated 3 weeks ago
- Provides syntax highlighting for Apptainer/Singularity definition files.☆10Dec 24, 2025Updated 4 months ago
- Datasets for CS109☆28Oct 8, 2013Updated 12 years ago
- Sistema de rotas para PHP☆11Nov 8, 2018Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- frontera的中文翻译文档☆36Mar 10, 2018Updated 8 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Feb 12, 2016Updated 10 years ago
- A chat server and client implemented with Python 3.x.☆16Jan 26, 2026Updated 3 months ago
- Its a crawler with the goal of extract offers of python jobs from websites, mostly Brazilian websites.☆21Aug 24, 2015Updated 10 years ago
- Failover AWS Spot Instances☆11Dec 8, 2017Updated 8 years ago
- A dataset of popular pages (taken from <dir.yahoo.com>) with manually marked up semantic blocks.☆15Feb 9, 2014Updated 12 years ago
- Age classification from text using PAN16, blogs, Fisher Callhome, and Cancer Forum☆18Jul 1, 2022Updated 3 years ago
- This repository offers guidance on how to use an Amazon Cognito Userpool's custom SMS sender Lambda trigger to send OTP messages on Whats…☆16Apr 10, 2025Updated last year
- 🌎 a small server that returns the location of a given IP address☆16Feb 10, 2014Updated 12 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tools for web page segmentation. In development☆17Nov 7, 2018Updated 7 years ago
- Scraper for categories and lists on ecommerce and other listing websites☆43Sep 30, 2020Updated 5 years ago
- Reactive, realtime queries supporting offline and a 👌 developer experience.☆13May 30, 2020Updated 5 years ago
- Download utility written in python☆11Aug 12, 2018Updated 7 years ago
- Legacy Snowplow website, switched off 25 April 2017☆15May 15, 2017Updated 8 years ago
- My data science curriculum☆14May 14, 2023Updated 2 years ago
- simply-scheme language bindings for Racket☆16Feb 23, 2022Updated 4 years ago
- Traptor -- A distributed Twitter feed☆26Sep 12, 2022Updated 3 years ago
- Regular Expression Mask JQuery Plugin☆21Feb 3, 2011Updated 15 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An example data processing pipeline using GenStage☆16Mar 17, 2017Updated 9 years ago
- Scrapy Splash on Taobao Product☆32Aug 6, 2017Updated 8 years ago
- Kaggle competition results☆20Jan 4, 2019Updated 7 years ago
- Introductory tutorial to write your first Django app (Python)☆12Mar 25, 2016Updated 10 years ago
- Brazilian website counting the days to the fall of Cunha☆27Apr 15, 2020Updated 6 years ago
- Common Monit configs☆21Jul 29, 2013Updated 12 years ago
- Scrapy middleware which allows to crawl only new content☆79Apr 8, 2026Updated 3 weeks ago
- A Slim-inspired IRC bot framework.☆34Feb 6, 2014Updated 12 years ago
- Python script for importing DBpedia nodes and relationships into Neo4j☆14Mar 15, 2014Updated 12 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Crochet-based blocking API for Scrapy.☆47Feb 24, 2017Updated 9 years ago
- Scrapy middleware for the autologin☆36Apr 8, 2026Updated 3 weeks ago
- Complete docker installation of Booktype 2.3.☆13Jan 18, 2022Updated 4 years ago
- 分布式爬虫框架,基于webdrvier模拟用户请求,kafka消息传递,分布式网页存储使用hbase,task异步任务多线程解析,提供基础服务如:proxy ip服务和号码验证服务等, proxy page使用H5和we版进行接入☆13Dec 18, 2015Updated 10 years ago
- Crawler that collects and extracts content of daily published news articles☆12Feb 18, 2023Updated 3 years ago
- a series of trie testing things☆21Apr 9, 2017Updated 9 years ago
- This project demonstrates the PathRAG implementation using a team of 6 AI agents at PhD level to show how PathRAG prunes graph-based RAG …☆15Feb 27, 2025Updated last year