jianxunio / yascrapy
A high-performance distributed web crawling & scraping framework written with golang and python.
☆30Updated 8 years ago
Alternatives and similar repositories for yascrapy:
Users that are interested in yascrapy are comparing it to the libraries listed below
- MapReduce platform in python☆34Updated 9 years ago
- ☆53Updated 9 years ago
- A very naive classifier to figure out if a sentence contains dirty words☆33Updated 9 years ago
- unofficial git mirror of http://svn.whoosh.ca svn repo☆49Updated 15 years ago
- A web server written with Python☆82Updated 9 years ago
- Modularly extensible semantic metadata validator☆83Updated 9 years ago
- Find elements in HTML by matching them with a skeleton☆25Updated 2 years ago
- A Flask web server for quickly asking someone a question☆82Updated 9 years ago
- Cassandra Migration Tool☆11Updated 7 years ago
- An extended version of the official Elasticsearch Python client.☆63Updated 9 years ago
- High Level Kafka Scanner☆19Updated 7 years ago
- A simple cron-like library for executing scheduled jobs.☆21Updated 9 years ago
- Redis cache cluster system in Python☆120Updated 8 years ago
- Python Logging for Humans☆119Updated 8 years ago
- Tornado Web Crawler☆66Updated 12 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 9 years ago
- Yet another cli library , click-like but sub-command friendly and designed for cli auto-generating.☆55Updated 7 years ago
- Python light ORM for Redis☆79Updated 6 years ago
- Django API Tools is an add-on which allows developers to run RESTful APIs alongside websites using Forms/Templates.☆14Updated 10 years ago
- A package and tutorial for turning your database into a HATEOAS ReSTful application☆59Updated 9 years ago
- Backend agnostic cache decorator☆81Updated 2 years ago
- API Wrapper in Python with polling and request callbacks.☆40Updated 9 months ago
- A simple load balancer with Vagrant + NGINX + Tornado + MySQL☆9Updated 9 years ago
- Business Intelligence (BI) in Python (Pandas web interface) - Frontend☆9Updated 9 years ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Updated 12 years ago
- Python disque client, built on redis-py☆52Updated 9 years ago
- Faster replacement for Python's urlparse module☆46Updated 6 years ago
- A collection of various Python regular expressions☆26Updated 2 years ago
- Simple CLI tool to inspect your Python modules☆20Updated 8 years ago