pudo-attic / scrapekit
Python library with common functionality for writing web scrapers
☆102Updated 9 years ago
Alternatives and similar repositories for scrapekit:
Users that are interested in scrapekit are comparing it to the libraries listed below
- A pastebin for tables.☆34Updated 11 years ago
- Modularly extensible semantic metadata validator☆83Updated 9 years ago
- ArchiveKit manages data and documents during ETL processes, either on a local file system or on S3.☆15Updated 9 years ago
- Next-gen web application for public finance data warehouses, formerly OpenSpending☆57Updated 2 years ago
- A tool to allow US addresses to be geocoded/georeferenced easily, without using Python or the command line or paid services or anything.☆17Updated 2 years ago
- A scrapy extension to store requests and responses information in storage service☆26Updated 2 years ago
- Utility library to turn country names into ISO two-letter codes☆66Updated this week
- A Python version (almost a port) of ProPublica's TableFu☆233Updated 11 years ago
- Tracking my progress in doing GIS/Geospatial work in Python 3.x☆12Updated 8 years ago
- A contextual news development environment.☆49Updated 10 years ago
- LoadKit supports Extract, Transform, Load processes based on ArchiveKit buckets.☆11Updated 9 years ago
- Stream processing in Python of twitter searches using public APIs.☆9Updated 9 years ago
- Python code to scrape and collect data from the RSS feeds Facebook uses to augment its Trending Section☆57Updated 6 years ago
- legacy backend for Open States☆87Updated 5 years ago
- Simple-to-use wrapper for accessing Google Spreadsheets in Python.☆24Updated 9 years ago
- Simple type converters: make ints, floats, bools and dates from your strings!☆11Updated 8 years ago
- A basic framework to scrape renting ads.☆17Updated 5 years ago
- 🌆 TouristFriend API lets you query Google Places, Yelp and Foursquare at the same time, with Bayesian rankings!☆29Updated 6 years ago
- 🕷Configuration based html scraper☆23Updated 7 months ago
- Streaming newline delimited JSON I/O.☆12Updated last year
- Opinionated template for Django projects on Python 3 and PostgreSQL☆24Updated 7 years ago
- A command-line script to get all the contributors for one or more GitHub projects.☆33Updated 3 years ago
- Utilities for working with data.☆20Updated 9 years ago
- Django API Tools is an add-on which allows developers to run RESTful APIs alongside websites using Forms/Templates.☆14Updated 10 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 9 years ago
- What lies in your email data?☆43Updated 9 years ago
- ScraperWiki Python library for scraping and saving data☆159Updated 2 years ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Versioned domain model. Python library for revisioning/versioning of databases.☆44Updated 4 years ago
- Find elements in HTML by matching them with a skeleton☆25Updated 2 years ago