Scrapy Eagle is a tool that allow us to run any Scrapy based project in a distributed fashion and monitor how it is going on and how many resources it is consuming on each server.
☆24Sep 4, 2020Updated 5 years ago
Alternatives and similar repositories for scrapy-eagle
Users that are interested in scrapy-eagle are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple python command line utility using the Vagalume API to search and show songs lyrics.☆10Dec 26, 2022Updated 3 years ago
- Scrapy extension which writes crawled items to Kafka☆31Apr 8, 2026Updated last month
- Provides syntax highlighting for Apptainer/Singularity definition files.☆10Dec 24, 2025Updated 5 months ago
- frontera的中文翻译文档☆35Mar 10, 2018Updated 8 years ago
- A distributed in-memory fabric based on shared-memory blocks and datashape. Any language can operate on the data.☆13Feb 12, 2016Updated 10 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A chat server and client implemented with Python 3.x.☆16Jan 26, 2026Updated 3 months ago
- Its a crawler with the goal of extract offers of python jobs from websites, mostly Brazilian websites.☆21Aug 24, 2015Updated 10 years ago
- A dataset of popular pages (taken from <dir.yahoo.com>) with manually marked up semantic blocks.☆15Feb 9, 2014Updated 12 years ago
- Age classification from text using PAN16, blogs, Fisher Callhome, and Cancer Forum☆18Jul 1, 2022Updated 3 years ago
- Tools for web page segmentation. In development☆17Nov 7, 2018Updated 7 years ago
- Scraper for categories and lists on ecommerce and other listing websites☆43Sep 30, 2020Updated 5 years ago
- Web page segmentation and noise removal☆55Feb 4, 2024Updated 2 years ago
- Scalable pattern search optimization with dask☆22Apr 12, 2017Updated 9 years ago
- My data science curriculum☆14May 14, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Traptor -- A distributed Twitter feed☆26Sep 12, 2022Updated 3 years ago
- An example data processing pipeline using GenStage☆16Mar 17, 2017Updated 9 years ago
- Scrapy Splash on Taobao Product☆32Aug 6, 2017Updated 8 years ago
- Kaggle competition results☆20Jan 4, 2019Updated 7 years ago
- A Clojure Sandbox for Streaming Data Platforms☆20Jan 1, 2021Updated 5 years ago
- Crochet-based blocking API for Scrapy.☆47Feb 24, 2017Updated 9 years ago
- Scrapy middleware for the autologin☆36Apr 8, 2026Updated last month
- a series of trie testing things☆21Apr 9, 2017Updated 9 years ago
- The missing datasets manager. Like hombrew but for datasets. CLI-tool for search and discover datasets!☆41May 29, 2017Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- scrapy-monitor，实现爬虫可视化，监控实时状态☆109Dec 26, 2016Updated 9 years ago
- Modularly extensible semantic metadata validator☆85Dec 10, 2015Updated 10 years ago
- Qt client for Lichat☆12May 17, 2026Updated last week
- ☆21Mar 1, 2023Updated 3 years ago
- Search engine base (crawler, indexer and parser) using Python, Celery, RabbitMQ, CouchDB and Whoosh.☆10Jun 10, 2025Updated 11 months ago
- API Server for the official Turkish-to-turkish dictionary by TDK☆12Jan 16, 2016Updated 10 years ago
- ☆20Apr 5, 2019Updated 7 years ago
- API to count unique words in german and english texts☆12Dec 8, 2022Updated 3 years ago
- [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.☆12Apr 8, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Contagion of COVID-19 in Switzerland, built with Vue☆10Jul 18, 2023Updated 2 years ago
- OpenSSL convenience scripts☆12Feb 6, 2015Updated 11 years ago
- From Dataset Labeling, Entity Extraction to production Knowledge Graph Deployment: The Power of NLP and LLMs Combined.☆12May 14, 2024Updated 2 years ago
- ☆12Jul 21, 2021Updated 4 years ago
- Remake of the classical game Sokoban in Elm☆11Dec 28, 2016Updated 9 years ago
- ☆12May 5, 2015Updated 11 years ago
- We aim to make it easier for biomedical researchers to access and customize synthetic sequence data for the purpose of sharing and testin…☆11Jul 22, 2019Updated 6 years ago