Alternatives and similar repositories for pysparkling

Users that are interested in pysparkling are comparing it to the libraries listed below

• chmp / framequery
  SQL on dataframes - pandas and dask
  ☆64Updated 7 years ago
• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆136Updated 4 years ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• mozilla / jupyter-spark
  Jupyter Notebook extension for Apache Spark integration
  ☆191Updated 4 years ago
• jcrobak / parquet-python
  python implementation of the parquet columnar file format.
  ☆353Updated 3 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆196Updated 5 years ago
• dask / dask-ec2
  Start a cluster in EC2 for dask.distributed
  ☆106Updated 4 years ago
• minrk / findspark
  ☆522Updated 3 years ago
• blue-yonder / turbodbc
  Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …
  ☆637Updated last week
• seahboonsiew / pyspark-csv
  An external PySpark module that works like R's read.csv or Panda's read_csv, with automatic type inference and null value handling. Parse…
  ☆90Updated 9 years ago
• sparklingpandas / sparklingpandas
  Sparkling Pandas
  ☆363Updated last year
• bolt-project / bolt
  Unified interface for local and distributed ndarrays
  ☆157Updated 6 years ago
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆143Updated last year
• ekampf / PySpark-Boilerplate
  A boilerplate for writing PySpark Jobs
  ☆395Updated last year
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• xhochy / fletcher
  Pandas ExtensionDType/Array backed by Apache Arrow
  ☆230Updated 2 years ago
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 3 years ago
• jkthompson / pyspark-pictures
  Learn the pyspark API through pictures and simple examples
  ☆170Updated 4 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated 2 weeks ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆84Updated 9 years ago
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆52Updated 6 years ago
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆261Updated last year
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 9 months ago
• mtth / hdfs
  API and command line interface for HDFS
  ☆272Updated 8 months ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 6 years ago
• vmware-archive / sql_magic
  Magic functions for using Jupyter Notebook with Apache Spark and a variety of SQL databases.
  ☆171Updated 6 years ago
• sparklingpandas / sparklingml
  Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)
  ☆74Updated last year
• engarde-dev / engarde
  A library for defensive data analysis.
  ☆500Updated 5 years ago
• jupyter / dashboards_server
  [RETIRED] Server that runs and renders Jupyter notebooks as interactive dashboards
  ☆181Updated 7 years ago