scrapinghub / scaws
Extensions for using Scrapy on Amazon AWS
☆32Updated 12 years ago
Alternatives and similar repositories for scaws:
Users that are interested in scaws are comparing it to the libraries listed below
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 9 years ago
- Automated NLP sentiment predictions- batteries included, or use your own data☆18Updated 7 years ago
- Fast Python Bloom Filter using Mmap☆13Updated 12 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated 10 months ago
- ☆32Updated last year
- Find which links on a web page are pagination links☆29Updated 8 years ago
- High Level Kafka Scanner☆19Updated 7 years ago
- ☆49Updated 2 years ago
- Data science tools from Moz☆22Updated 8 years ago
- Slides to learn a little natural language processing (NLP) with Python. Written in reST with S5/Docutils.☆28Updated 12 years ago
- Site Hound (previously THH) is a Domain Discovery Tool☆23Updated 3 years ago
- docker scrapyd scrapy boot2docker crawler - a spider Python application that can be "Dockerized".☆42Updated 9 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- A scrapy extension to store requests and responses information in storage service☆26Updated 3 years ago
- Proxy-list management application for Django☆23Updated 7 years ago
- Drop-in replacement of Django admin comes with lots of goodies, fully extensible with plugin support, pretty UI based on Twitter Bootstra…☆9Updated 10 months ago
- Paginating the web☆37Updated 11 years ago
- Keyword Extraction system using Brown Clustering - (This version is trained to extract keywords from job listings)☆17Updated 10 years ago
- Traptor -- A distributed Twitter feed☆26Updated 2 years ago
- common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text☆35Updated 8 years ago
- Some scrapy and web.py exmaples☆79Updated 7 years ago
- Scraper built with Scrapy.☆15Updated 7 months ago
- Store e run queries on database to help system manager of a Django website☆11Updated 8 years ago
- Demo of the Newspaper article extraction library.☆29Updated 10 years ago
- A web scraper in Python using Django and Celery☆16Updated 11 years ago
- A project to demonstrate maximum entropy models for extracting quotes from news articles in Python.☆25Updated 12 years ago
- 📑⚙️ Python/Django reference implementation of the ERAV data model☆21Updated 5 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Updated 3 years ago
- iCQA - Intelligent Community Question Answering Framework☆31Updated 8 years ago
- A simple Web crawler for stackshare.io using scrapy .☆9Updated 6 years ago