jupyter-incubator / sparkmagic
Jupyter magics and kernels for working with remote Spark clusters
☆1,345Updated 2 weeks ago
Alternatives and similar repositories for sparkmagic:
Users that are interested in sparkmagic are comparing it to the libraries listed below
- Mirror of Apache Toree (Incubating)☆741Updated last month
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,005Updated 2 years ago
- Essential Spark extensions and helper methods ✨😲☆758Updated 4 months ago
- MLeap: Deploy ML Pipelines to Production☆1,515Updated 3 months ago
- The Internals of Apache Spark☆1,491Updated 6 months ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆736Updated last month
- Data Lineage Tracking And Visualization Solution☆614Updated this week
- Qubole Sparklens tool for performance tuning Apache Spark☆572Updated 8 months ago
- ☆519Updated 3 years ago
- GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs☆1,027Updated last week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,379Updated 2 weeks ago
- Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.☆905Updated 4 months ago
- A curated list of awesome Apache Spark packages and resources.☆1,767Updated 4 months ago
- The Internals of Spark SQL☆463Updated 2 months ago
- Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks☆363Updated 7 years ago
- Sparkling Water provides H2O functionality inside Spark cluster☆966Updated 4 months ago
- A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.☆677Updated 2 years ago
- Examples for High Performance Spark☆506Updated 4 months ago
- A Spark plugin for reading and writing Excel files☆483Updated this week
- A simplified, lightweight ETL Framework based on Apache Spark☆584Updated last year
- PySpark + Scikit-learn = Sparkit-learn☆1,153Updated 4 years ago
- Python interface to Hive and Presto. 🐝☆1,678Updated 7 months ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,497Updated 3 months ago
- A command-line tool for launching Apache Spark clusters.☆642Updated 3 months ago
- Joblib Apache Spark Backend☆245Updated 7 months ago
- Base classes to use when writing tests with Spark☆1,525Updated 2 months ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆441Updated last week
- Python DB API 2.0 client for Impala and Hive (HiveServer2 protocol)☆734Updated last week
- A boilerplate for writing PySpark Jobs☆394Updated last year
- Spark package for checking data quality☆221Updated 5 years ago