jianxunio / yascrapyLinks
A high-performance distributed web crawling & scraping framework written with golang and python.
☆30Updated 9 years ago
Alternatives and similar repositories for yascrapy
Users that are interested in yascrapy are comparing it to the libraries listed below
Sorting:
- MapReduce platform in python☆34Updated 10 years ago
- A very naive classifier to figure out if a sentence contains dirty words☆33Updated 10 years ago
- An extended version of the official Elasticsearch Python client.☆63Updated 9 years ago
- Modularly extensible semantic metadata validator☆84Updated 9 years ago
- ☆53Updated 10 years ago
- elegant email sending for Python☆195Updated 4 years ago
- Python data pipeline☆57Updated 2 years ago
- Python disque client, built on redis-py☆52Updated 10 years ago
- "Scrape Easy" - an extension of the Scrapy framework.☆186Updated 9 years ago
- Redis cache cluster system in Python☆120Updated 9 years ago
- Cloud ready pure-python streaming data pipeline library☆153Updated 3 months ago
- A Python library that implements a consistent hash ring for building distributed apps☆137Updated last month
- A module for querying the DOM tree and writing XPath expressions using native Python syntax.☆127Updated 7 years ago
- High Level Kafka Scanner☆19Updated 8 years ago
- Python Tree Library☆76Updated 8 years ago
- Python Logging for Humans☆119Updated 9 years ago
- A simple (Python) query builder for Elasticsearch☆80Updated 4 years ago
- Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity,…☆168Updated 6 years ago
- A persistent, full-text searchable key-value store. Powered by Flask, ElasticSearch, S3, and good intentions.☆478Updated 8 years ago
- Lightweight framework for collecting and aggregating event metrics as timeseries data☆528Updated 7 years ago
- Faster replacement for Python's urlparse module☆46Updated 7 years ago
- Async IO for Python, Simplified☆91Updated 8 years ago
- Python light ORM for Redis☆79Updated 6 years ago
- A Flask web server for quickly asking someone a question☆81Updated 9 years ago
- Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…☆55Updated last year
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 7 years ago
- Object-Key Mapper for Redis☆20Updated 4 years ago
- unofficial git mirror of http://svn.whoosh.ca svn repo☆49Updated 15 years ago
- python bindings for rlite☆70Updated 7 years ago
- Readable, simple and fast asynchronous non-blocking network apps☆117Updated 2 months ago