Alternatives and similar repositories for pysparkling

Users that are interested in pysparkling are comparing it to the libraries listed below

• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆137Updated 4 years ago
• chmp / framequery
  SQL on dataframes - pandas and dask
  ☆64Updated 7 years ago
• jcrobak / parquet-python
  python implementation of the parquet columnar file format.
  ☆353Updated 3 years ago
• mozilla / jupyter-spark
  Jupyter Notebook extension for Apache Spark integration
  ☆191Updated 4 years ago
• seahboonsiew / pyspark-csv
  An external PySpark module that works like R's read.csv or Panda's read_csv, with automatic type inference and null value handling. Parse…
  ☆90Updated 9 years ago
• minrk / findspark
  ☆525Updated 2 weeks ago
• sparklingpandas / sparklingpandas
  Sparkling Pandas
  ☆364Updated 2 years ago
• bolt-project / bolt
  Unified interface for local and distributed ndarrays
  ☆157Updated 6 years ago
• adtech-labs / spylon
  Utilities to work with Scala/Java code with py4j
  ☆40Updated last year
• wrobstory / PythonToScala
  A short guide for transitioning from Python to Scala
  ☆65Updated 9 years ago
• vmware-archive / sql_magic
  Magic functions for using Jupyter Notebook with Apache Spark and a variety of SQL databases.
  ☆171Updated 6 years ago
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆144Updated last year
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆52Updated 7 years ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• dask / dask-ec2
  Start a cluster in EC2 for dask.distributed
  ☆106Updated 4 years ago
• blue-yonder / turbodbc
  Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …
  ☆639Updated this week
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆196Updated 5 years ago
• pywebhdfs / pywebhdfs
  Pure Python wrapper for the Hadoop WebHDFS Rest API
  ☆52Updated 4 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 9 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• jupyter / dashboards_server
  [RETIRED] Server that runs and renders Jupyter notebooks as interactive dashboards
  ☆181Updated 7 years ago
• jkthompson / pyspark-pictures
  Learn the pyspark API through pictures and simple examples
  ☆170Updated 4 years ago
• laughingman7743 / PyAthenaJDBC
  PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).
  ☆95Updated last year
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆84Updated 9 years ago
• crs4 / pydoop
  A Python MapReduce and HDFS API for Hadoop
  ☆240Updated 6 months ago
• hammerlab / dask-distributed-on-kubernetes
  Deploy dask-distributed on google container engine using kubernetes
  ☆40Updated 6 years ago
• dask / dask-searchcv
  dask-searchcv is now part of dask-ml: https://github.com/dask/dask-ml
  ☆239Updated 6 years ago
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 11 months ago
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 3 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 6 years ago