☆223Apr 27, 2015Updated 11 years ago
Alternatives and similar repositories for slybot
Users that are interested in slybot are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A pure-python HTML screen-scraping library☆1,883Apr 4, 2022Updated 4 years ago
- A python implementation of DEPTA☆84Jan 14, 2017Updated 9 years ago
- A scrapy pipeline which send items to Elastic Search server☆98Jan 2, 2018Updated 8 years ago
- Python library of web-related functions☆419Oct 26, 2026Updated last week
- Output scrapy statistics to graphite/carbon☆54Mar 9, 2013Updated 13 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fill HTML login forms automatically☆278Apr 24, 2024Updated 2 years ago
- Python implementation of the Parsley language for extracting structured data from web pages☆91Oct 26, 2017Updated 9 years ago
- Paginating the web☆36Feb 11, 2014Updated 12 years ago
- MongoDB extensions for Scrapy☆44Oct 2, 2014Updated 12 years ago
- Creating Scrapy scrapers via the Django admin interface☆1,154Feb 19, 2022Updated 4 years ago
- A scrapy-based Hacker News crawler.☆151May 21, 2013Updated 13 years ago
- Fast Python Bloom Filter using Mmap☆13Aug 20, 2012Updated 14 years ago
- A client interface for Scrapinghub's API☆204Oct 27, 2026Updated last week
- Export a graph of link between crawled items by scrapy in dot file format.☆26Sep 24, 2011Updated 15 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A python library detect and extract listing data from HTML page.☆110May 5, 2017Updated 9 years ago
- Fast Python Bloom Filter using Mmap☆744Nov 4, 2019Updated 6 years ago
- Scrapy GUI☆12Feb 26, 2021Updated 5 years ago
- Mongodb support for scrapy☆101Mar 9, 2017Updated 9 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆50Jul 24, 2015Updated 11 years ago
- Modularly extensible semantic metadata validator☆85Dec 10, 2015Updated 10 years ago
- ☆23Jun 25, 2026Updated 4 months ago
- High performance real-time search (Support Chinese), indexes store in Redis for Python☆38May 17, 2014Updated 12 years ago
- NER toolkit for HTML data☆259May 3, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Ansible-based scripts that help you quickly set up a production-ready meteor website on either a Ubuntu host or a Local Vagrant instance.☆11Apr 30, 2015Updated 11 years ago
- A Django based search engine powered by CouchDB, celery and whoosh.☆48Dec 26, 2015Updated 10 years ago
- Sentry component for Scrapy☆84Aug 21, 2023Updated 3 years ago
- django-pagebits☆13Feb 13, 2018Updated 8 years ago
- A python script for DDNS using the service of DNSPod☆11Sep 23, 2019Updated 7 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- Implements a MongoDB back-end for Spidey (https://github.com/joeyAghion/spidey), a framework for crawling and scraping web sites.☆15Nov 4, 2015Updated 11 years ago
- Generate a CommonJS module☆16Oct 31, 2025Updated last year
- 使用WebQQ接口桥接XMPP和QQ的机器人,桥接后可以实现XMPP和QQ群消息互通☆18Apr 21, 2014Updated 12 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Use scrapy with mongodb to store the request queues (FIFO or LIFO)☆13Dec 25, 2012Updated 13 years ago
- A Twisted/Fabric based centralized task-scheduler for clusters☆10Sep 9, 2011Updated 15 years ago
- A scrapy extension to invoke an aws lambda function with the scraped item☆10Apr 4, 2017Updated 9 years ago
- ☆21Nov 23, 2012Updated 13 years ago
- Management of simple newsletters☆55Aug 2, 2015Updated 11 years ago
- Useful test spiders for Scrapy☆184Jan 20, 2020Updated 6 years ago
- Visualization server based on LODSPeaKr☆20Oct 8, 2013Updated 13 years ago