Alternatives and similar repositories for dpark:

Users that are interested in dpark are comparing it to the libraries listed below

• qinxuye / cola
  A high-level distributed crawling framework.
  ☆1,505Updated 2 years ago
• Thriftpy / thriftpy
  Thriftpy has been deprecated, please migrate to https://github.com/Thriftpy/thriftpy2
  ☆1,154Updated 6 years ago
• python-zk / kazoo
  Kazoo is a high-level Python library that makes it easier to use Apache Zookeeper.
  ☆1,301Updated 3 months ago
• zhihu / kids
  Kids Is Data Stream
  ☆1,224Updated 4 years ago
• douban / code
  [DEPRECATED]Douban CODE
  ☆1,812Updated 4 years ago
• baidu / CUP
  CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…
  ☆948Updated 3 months ago
• gnemoug / distribute_crawler
  使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
  ☆3,253Updated 7 years ago
• doraemonext / wechat-python-sdk
  微信公众平台 Python 开发包 [DEPRECATED]
  ☆1,359Updated 4 years ago
• jaybaird / python-bloomfilter
  Scalable Bloom Filter implemented in Python
  ☆1,620Updated 3 years ago
• MrKiven / PyZh
  一起写Python文章，一起看Python文章 - 利用readthedocs的Python技术文章的收集和翻译。
  ☆1,421Updated 6 years ago
• dropbox / PyHive
  Python interface to Hive and Presto. 🐝
  ☆1,679Updated 7 months ago
• marchtea / scrapy_doc_chs
  scrapy中文翻译文档
  ☆1,109Updated 5 years ago
• quantmind / pulsar
  Event driven concurrent framework for Python
  ☆1,857Updated 5 years ago
• rmax / scrapy-redis
  Redis-based components for Scrapy.
  ☆5,582Updated 8 months ago
• python-happybase / happybase
  A developer-friendly Python library to interact with Apache HBase
  ☆607Updated 7 months ago
• bdarnell / torndb
  A lightweight wrapper around MySQLdb. Originally part of the Tornado framework.
  ☆582Updated 7 years ago
• baidu / tera
  An Internet-Scale Database.
  ☆1,900Updated 9 months ago
• thieman / dagobah
  Simple DAG-based job scheduler in Python
  ☆762Updated 5 years ago
• ideawu / ssdb
  SSDB - A fast NoSQL database, an alternative to Redis
  ☆8,205Updated 2 years ago
• Yelp / pyleus
  Pyleus is a Python framework for developing and launching Storm topologies.
  ☆401Updated 6 years ago
• cloudera / Impala
  Real-time Query for Hadoop; mirror of Apache Impala
  ☆34Updated 2 years ago
• ngaut / builddatabase
  Build a distributed SQL database from the ground up
  ☆2,149Updated 2 years ago
• zhihu / redis-shard
  Redis sharding client library
  ☆360Updated 2 years ago
• YahooArchive / anthelion
  Anthelion is a plugin for Apache Nutch to crawl semantic annotations within HTML pages.
  ☆2,842Updated 9 years ago
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,553Updated 10 months ago
• blaze / blaze
  NumPy and Pandas interface to Big Data
  ☆3,195Updated last year
• gevent / gevent
  Coroutine-based concurrency library for Python
  ☆6,313Updated last month
• scrapy / dirbot
  Scrapy project to scrape public web directories (educational) [DEPRECATED]
  ☆1,636Updated 7 years ago
• mher / tornado-celery
  Non-blocking Celery client for Tornado
  ☆564Updated 7 years ago
• cloudera / impyla
  Python DB API 2.0 client for Impala and Hive (HiveServer2 protocol)
  ☆733Updated this week