Scrapy Eagle is a tool that allow us to run any Scrapy based project in a distributed fashion and monitor how it is going on and how many resources it is consuming on each server.
☆24Sep 4, 2020Updated 5 years ago
Alternatives and similar repositories for scrapy-eagle
Users that are interested in scrapy-eagle are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple python command line utility using the Vagalume API to search and show songs lyrics.☆10Dec 26, 2022Updated 3 years ago
- Scrapy extension which writes crawled items to Kafka☆31Apr 8, 2026Updated 4 months ago
- Provides syntax highlighting for Apptainer/Singularity definition files.☆10Dec 24, 2025Updated 7 months ago
- frontera的中文翻译文档☆35Mar 10, 2018Updated 8 years ago
- Its a crawler with the goal of extract offers of python jobs from websites, mostly Brazilian websites.☆21Aug 24, 2015Updated 10 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆17Jul 14, 2017Updated 9 years ago
- Failover AWS Spot Instances☆11Dec 8, 2017Updated 8 years ago
- A dataset of popular pages (taken from <dir.yahoo.com>) with manually marked up semantic blocks.☆15Feb 9, 2014Updated 12 years ago
- Tools for web page segmentation. In development☆17Nov 7, 2018Updated 7 years ago
- Scraper for categories and lists on ecommerce and other listing websites☆44Sep 30, 2020Updated 5 years ago
- Discussions on solving the 4Clojure Code challenges☆19Apr 12, 2025Updated last year
- Traptor -- A distributed Twitter feed☆26Sep 12, 2022Updated 3 years ago
- Legacy Snowplow website, switched off 25 April 2017☆15May 15, 2017Updated 9 years ago
- Data science tools from Moz☆23Jan 11, 2017Updated 9 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Web page segmentation and noise removal☆55Feb 4, 2024Updated 2 years ago
- Scalable pattern search optimization with dask☆22Apr 12, 2017Updated 9 years ago
- simply-scheme language bindings for Racket☆16Feb 23, 2022Updated 4 years ago
- Flux is your own private & lightweight CI server.☆27Nov 4, 2019Updated 6 years ago
- Scrapy Splash on Taobao Product☆33Aug 6, 2017Updated 9 years ago
- An example data processing pipeline using GenStage☆16Mar 17, 2017Updated 9 years ago
- A Clojure Sandbox for Streaming Data Platforms☆20Jan 1, 2021Updated 5 years ago
- Scrapy middleware which allows to crawl only new content☆80Apr 8, 2026Updated 4 months ago
- Python script for importing DBpedia nodes and relationships into Neo4j☆14Mar 15, 2014Updated 12 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Crochet-based blocking API for Scrapy.☆47Feb 24, 2017Updated 9 years ago
- 分布式爬虫框架,基于webdrvier模拟用户请求,kafka消息传递,分布式网页存储使用hbase,task异步任务多线程解析,提供基础服务如:proxy ip服务和号码验证服务等, proxy page使用H5和we版进行接入☆13Dec 18, 2015Updated 10 years ago
- Complete docker installation of Booktype 2.3.☆13Jan 18, 2022Updated 4 years ago
- Scrapy middleware for the autologin☆36Apr 8, 2026Updated 4 months ago
- a series of trie testing things☆22Apr 9, 2017Updated 9 years ago
- This project demonstrates the PathRAG implementation using a team of 6 AI agents at PhD level to show how PathRAG prunes graph-based RAG …☆15Feb 27, 2025Updated last year
- Crawler that collects and extracts content of daily published news articles☆14Feb 18, 2023Updated 3 years ago
- scrapy-monitor，实现爬虫可视化，监控实时状态☆109Dec 26, 2016Updated 9 years ago
- Datasets for CS109☆28Oct 8, 2013Updated 12 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Web Crawling UI and HTTP API, based on Scrapy and Tornado☆162Apr 8, 2026Updated 4 months ago
- ☆13Dec 10, 2015Updated 10 years ago
- Qt client for Lichat☆12May 17, 2026Updated 2 months ago
- Welcome to the Background Remover project! This tool allows you to effortlessly replace backgrounds in images and videos, making it perfe…☆11Feb 3, 2024Updated 2 years ago
- ☆21Mar 1, 2023Updated 3 years ago
- API Server for the official Turkish-to-turkish dictionary by TDK☆12Jan 16, 2016Updated 10 years ago
- Google Cloud Platform solution that provides an event driven process that flattens (unnests) Google Analytics 360 data that has been expo…☆16Apr 13, 2026Updated 4 months ago