Scrapy Eagle is a tool that allow us to run any Scrapy based project in a distributed fashion and monitor how it is going on and how many resources it is consuming on each server.
☆24Sep 4, 2020Updated 6 years ago
Alternatives and similar repositories for scrapy-eagle
Users that are interested in scrapy-eagle are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scrapy extension which writes crawled items to Kafka☆31Apr 8, 2026Updated 5 months ago
- Provides syntax highlighting for Apptainer/Singularity definition files.☆10Dec 24, 2025Updated 8 months ago
- scrapy-ui☆16Feb 21, 2014Updated 12 years ago
- frontera的中文翻译文档☆35Mar 10, 2018Updated 8 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Feb 12, 2016Updated 10 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Chat server and client - written in python with twisted☆12Aug 23, 2013Updated 13 years ago
- A dataset of popular pages (taken from <dir.yahoo.com>) with manually marked up semantic blocks.☆15Feb 9, 2014Updated 12 years ago
- Age classification from text using PAN16, blogs, Fisher Callhome, and Cancer Forum☆19Jul 1, 2022Updated 4 years ago
- 基于项目k临近的协同过滤的Hadoop实现，数据集采用MovieLens，对某一用户推荐k个预测电影。 Using the item-based collaborative filtering to predict k neighbors on dataset MovieL…☆11Mar 23, 2016Updated 10 years ago
- Python webservices (APIs) for Django, Flask and Twisted.☆23Apr 10, 2018Updated 8 years ago
- Scraper for categories and lists on ecommerce and other listing websites☆44Sep 30, 2020Updated 5 years ago
- Download utility written in python☆11Aug 12, 2018Updated 8 years ago
- Discussions on solving the 4Clojure Code challenges☆19Apr 12, 2025Updated last year
- Traptor -- A distributed Twitter feed☆26Sep 12, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Legacy Snowplow website, switched off 25 April 2017☆15May 15, 2017Updated 9 years ago
- Tools for making Prefect work better for typical data science workflows☆18Feb 24, 2022Updated 4 years ago
- Web page segmentation and noise removal☆55Feb 4, 2024Updated 2 years ago
- Scalable pattern search optimization with dask☆23Apr 12, 2017Updated 9 years ago
- simply-scheme language bindings for Racket☆16Feb 23, 2022Updated 4 years ago
- Scrapy middleware which allows to crawl only new content☆80Apr 8, 2026Updated 5 months ago
- Python script for importing DBpedia nodes and relationships into Neo4j☆14Mar 15, 2014Updated 12 years ago
- Crochet-based blocking API for Scrapy.☆47Feb 24, 2017Updated 9 years ago
- 分布式爬虫框架,基于webdrvier模拟用户请求,kafka消息传递,分布式网页存储使用hbase,task异步任务多线程解析,提供基础服务如:proxy ip服务和号码验证服务等, proxy page使用H5和we版进行接入☆13Dec 18, 2015Updated 10 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scrapy middleware for the autologin☆36Apr 8, 2026Updated 5 months ago
- a series of trie testing things☆22Apr 9, 2017Updated 9 years ago
- Remote Shutdown your PC from Android App(通过Android手机远程控制电脑关机)☆17Aug 11, 2015Updated 11 years ago
- The missing datasets manager. Like hombrew but for datasets. CLI-tool for search and discover datasets!☆41May 29, 2017Updated 9 years ago
- 基于Flask和MySQL能够帮助快速迁移微信服务号后台到自家服务器的框架(tag: Python, wechat, weixin, admin, Flask)☆48Nov 4, 2015Updated 10 years ago
- Datasets for CS109☆28Oct 8, 2013Updated 12 years ago
- Google Deployment Manager scripts for deploying DataStax Enterprise (DSE) on Google Compute Engine (GCE)☆13Aug 5, 2020Updated 6 years ago
- ☆13Dec 10, 2015Updated 10 years ago
- A Python 3 web framework☆40Jan 22, 2014Updated 12 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A minimal buildpack for Pipenv.☆11Feb 13, 2019Updated 7 years ago
- ☆21Mar 1, 2023Updated 3 years ago
- QuantCode-Bench: A Benchmark for Evaluating LLMs on Executable Algorithmic Trading Strategies☆45Jul 6, 2026Updated 2 months ago
- Google Cloud Platform solution that provides an event driven process that flattens (unnests) Google Analytics 360 data that has been expo…☆16Apr 13, 2026Updated 5 months ago
- Micro web framework around asyncio (ex tulip), similiar to the cyclone or tornado☆41Dec 16, 2014Updated 11 years ago
- The Tweets2013 Internet Archive collection☆10Aug 7, 2020Updated 6 years ago
- [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.☆12Apr 8, 2026Updated 5 months ago