☆223Apr 27, 2015Updated 11 years ago
Alternatives and similar repositories for slybot
Users that are interested in slybot are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A pure-python HTML screen-scraping library☆1,883Apr 4, 2022Updated 4 years ago
- A python implementation of DEPTA☆84Jan 14, 2017Updated 9 years ago
- Output scrapy statistics to graphite/carbon☆54Mar 9, 2013Updated 13 years ago
- Python implementation of the Parsley language for extracting structured data from web pages☆92Oct 26, 2017Updated 8 years ago
- Visual scraping for Scrapy☆9,505Jun 26, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A scrapy-based Hacker News crawler.☆151May 21, 2013Updated 13 years ago
- Fast Python Bloom Filter using Mmap☆745Nov 4, 2019Updated 6 years ago
- Scrapy GUI☆12Feb 26, 2021Updated 5 years ago
- A python library detect and extract listing data from HTML page.☆110May 5, 2017Updated 9 years ago
- Mongodb support for scrapy☆101Mar 9, 2017Updated 9 years ago
- Ansible-based scripts that help you quickly set up a production-ready meteor website on either a Ubuntu host or a Local Vagrant instance.☆11Apr 30, 2015Updated 11 years ago
- Modularly extensible semantic metadata validator☆85Dec 10, 2015Updated 10 years ago
- Automated scraping markup+CSS from a list of relevant URLs, using a variety of user-agent strings. Provides reporting on usage of CSS pro…☆22Aug 29, 2013Updated 13 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆50Jul 24, 2015Updated 11 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A Django based search engine powered by CouchDB, celery and whoosh.☆48Dec 26, 2015Updated 10 years ago
- Implements a MongoDB back-end for Spidey (https://github.com/joeyAghion/spidey), a framework for crawling and scraping web sites.☆15Nov 4, 2015Updated 10 years ago
- memcached transport plugin for elasticsearch (STOPPED)☆34Mar 15, 2023Updated 3 years ago
- Extensions for using Scrapy on Amazon AWS☆32Dec 5, 2012Updated 13 years ago
- ☆21Nov 23, 2012Updated 13 years ago
- Crawlera tools☆26Feb 9, 2016Updated 10 years ago
- Python library of web-related functions☆418Updated this week
- Convore clone using gevent-socketio☆19Jun 20, 2012Updated 14 years ago
- Management of simple newsletters☆55Aug 2, 2015Updated 11 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Headless scraperJSON scraping for Node.js☆27Sep 14, 2016Updated 9 years ago
- Webkit based scriptable web browser for python.☆2,756Feb 24, 2024Updated 2 years ago
- Narwhal is a keyword and KEY NARRATIVE manager that creates language-aware classes. Because Narhwal does not use NLP it avoids complexity…☆12Oct 16, 2018Updated 7 years ago
- Put all the messages in the postgres☆16Aug 26, 2026Updated last week
- Distributed twitter crawler in Python☆25Nov 4, 2022Updated 3 years ago
- Legos for your Django API☆20May 24, 2013Updated 13 years ago
- Tool for exploring clusters of similar documents in a text corpus.☆16Apr 15, 2014Updated 12 years ago
- Python module that allows one to easily write and run Hadoop programs.☆1,030Jan 9, 2018Updated 8 years ago
- Visualization server based on LODSPeaKr☆20Oct 8, 2013Updated 12 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆226Dec 22, 2022Updated 3 years ago
- scrapy-ui☆16Feb 21, 2014Updated 12 years ago
- KEA 5.0 (keyphrase extraction software), modified to be an XML-RPC service☆42Jun 7, 2011Updated 15 years ago
- ☆14Mar 9, 2017Updated 9 years ago
- Under heavy development now: Real time Celery monitoring with ASGI 3.0 +☆175Oct 30, 2019Updated 6 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Dec 15, 2012Updated 13 years ago
- A platform for tools that do stuff with data☆56Feb 14, 2019Updated 7 years ago