pudo-attic / scrapekit
Python library with common functionality for writing web scrapers
☆102Updated 9 years ago
Alternatives and similar repositories for scrapekit:
Users that are interested in scrapekit are comparing it to the libraries listed below
- ScraperWiki Python library for scraping and saving data☆159Updated 2 years ago
- Stream processing in Python of twitter searches using public APIs.☆9Updated 9 years ago
- LoadKit supports Extract, Transform, Load processes based on ArchiveKit buckets.☆11Updated 9 years ago
- Modularly extensible semantic metadata validator☆84Updated 9 years ago
- Next-gen web application for public finance data warehouses, formerly OpenSpending☆57Updated 2 years ago
- ArchiveKit manages data and documents during ETL processes, either on a local file system or on S3.☆15Updated 9 years ago
- A pastebin for tables.☆34Updated 11 years ago
- A tool to allow US addresses to be geocoded/georeferenced easily, without using Python or the command line or paid services or anything.☆17Updated 2 years ago
- Tracking my progress in doing GIS/Geospatial work in Python 3.x☆12Updated 8 years ago
- Python module to watch Twitter user pages or search-results.☆62Updated 10 years ago
- Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …☆21Updated 3 years ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- A toolkit to build pythonic web scraper libraries☆40Updated 8 years ago
- legacy backend for Open States☆87Updated 5 years ago
- ⛏ a library for scraping unreliable pages☆210Updated 7 months ago
- xmldataset: xml parsing made easy 🗃️☆78Updated 4 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- A Python version (almost a port) of ProPublica's TableFu☆231Updated 11 years ago
- Versioned domain model. Python library for revisioning/versioning of databases.☆44Updated 4 years ago
- Easily crowdsource the analysis of your documents☆102Updated 7 years ago
- Simple type converters: make ints, floats, bools and dates from your strings!☆11Updated 8 years ago
- Tweet Lake is a commandline interface to Twitter Streaming API and big data project that extracts interesting stats out of tweet corpus.☆20Updated 2 years ago
- Opinionated template for Django projects on Python 3 and PostgreSQL☆24Updated 7 years ago
- Simple to use python library for Buffer App☆23Updated 2 years ago
- csvcat☆22Updated 9 years ago
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 7 years ago
- View requests objects with style☆42Updated 8 years ago
- Python code to scrape and collect data from the RSS feeds Facebook uses to augment its Trending Section☆57Updated 6 years ago
- A python framework to generate html and JavaScript from reusable and combine-able widgets.☆23Updated 2 years ago
- Streaming newline delimited JSON I/O.☆12Updated last year