Alternatives and similar repositories for pysparkling:

Users that are interested in pysparkling are comparing it to the libraries listed below

• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆136Updated 4 years ago
• minrk / findspark
  ☆522Updated 3 years ago
• chmp / framequery
  SQL on dataframes - pandas and dask
  ☆64Updated 7 years ago
• jcrobak / parquet-python
  python implementation of the parquet columnar file format.
  ☆350Updated 3 years ago
• sparklingpandas / sparklingpandas
  Sparkling Pandas
  ☆363Updated last year
• seahboonsiew / pyspark-csv
  An external PySpark module that works like R's read.csv or Panda's read_csv, with automatic type inference and null value handling. Parse…
  ☆90Updated 9 years ago
• mozilla / jupyter-spark
  Jupyter Notebook extension for Apache Spark integration
  ☆191Updated 4 years ago
• bolt-project / bolt
  Unified interface for local and distributed ndarrays
  ☆157Updated 6 years ago
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆143Updated last year
• mtth / hdfs
  API and command line interface for HDFS
  ☆272Updated 7 months ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• jupyter / dashboards_server
  [RETIRED] Server that runs and renders Jupyter notebooks as interactive dashboards
  ☆181Updated 7 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆196Updated 5 years ago
• pharmbio / sciluigi
  A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and mod…
  ☆336Updated 4 months ago
• apache / incubator-toree
  Mirror of Apache Toree (Incubating)
  ☆743Updated 2 months ago
• pywebhdfs / pywebhdfs
  Pure Python wrapper for the Hadoop WebHDFS Rest API
  ☆52Updated 4 years ago
• dask / dask-ec2
  Start a cluster in EC2 for dask.distributed
  ☆106Updated 4 years ago
• jkthompson / pyspark-pictures
  Learn the pyspark API through pictures and simple examples
  ☆170Updated 4 years ago
• ekampf / PySpark-Boilerplate
  A boilerplate for writing PySpark Jobs
  ☆396Updated last year
• dask / dask-searchcv
  dask-searchcv is now part of dask-ml: https://github.com/dask/dask-ml
  ☆240Updated 6 years ago
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 2 years ago
• Lab41 / ipython-spark-docker
  ☆146Updated 9 years ago
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆261Updated last year
• prestodb / presto-python-client
  Python DB-API client for Presto
  ☆238Updated last year
• laughingman7743 / PyAthenaJDBC
  PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).
  ☆95Updated last year
• modelop / hadrian
  Implementations of the Portable Format for Analytics (PFA)
  ☆128Updated 2 years ago
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• paulgb / runipy
  Run IPython notebooks as command-line scripts, generate HTML reports
  ☆450Updated 6 years ago
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆52Updated 6 years ago