jupyter-incubator / sparkmagicLinks
Jupyter magics and kernels for working with remote Spark clusters
☆1,355Updated this week
Alternatives and similar repositories for sparkmagic
Users that are interested in sparkmagic are comparing it to the libraries listed below
Sorting:
- Mirror of Apache Toree (Incubating)☆743Updated 3 weeks ago
- MLeap: Deploy ML Pipelines to Production☆1,516Updated 6 months ago
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,007Updated 2 years ago
- GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs☆1,054Updated this week
- The Internals of Apache Spark☆1,501Updated 8 months ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆755Updated 3 weeks ago
- A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters su…☆643Updated 10 months ago
- ☆522Updated 3 years ago
- Examples for High Performance Spark☆509Updated 6 months ago
- Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.☆913Updated last week
- Python DB API 2.0 client for Impala and Hive (HiveServer2 protocol)☆737Updated 2 months ago
- Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks☆363Updated 7 years ago
- Qubole Sparklens tool for performance tuning Apache Spark☆577Updated 11 months ago
- Jupyter kernel for scala and spark☆188Updated last year
- A command-line tool for launching Apache Spark clusters.☆642Updated 5 months ago
- Data Lineage Tracking And Visualization Solution☆626Updated this week
- PySpark + Scikit-learn = Sparkit-learn☆1,154Updated 4 years ago
- The Internals of Spark SQL☆466Updated 4 months ago
- Joblib Apache Spark Backend☆246Updated last month
- Python interface to Hive and Presto. 🐝☆1,682Updated 9 months ago
- A boilerplate for writing PySpark Jobs☆396Updated last year
- The Internals of Spark Structured Streaming☆420Updated 2 years ago
- TonY is a framework to natively run deep learning frameworks on Apache Hadoop.☆706Updated last year
- Iceberg is a table format for large, slow-moving tabular data☆479Updated 2 years ago
- Base classes to use when writing tests with Spark☆1,534Updated 4 months ago
- Create HTML profiling reports from Apache Spark DataFrames☆196Updated 5 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆585Updated last year
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,511Updated 5 months ago
- Monitor Apache Spark from Jupyter Notebook☆172Updated 3 years ago
- A scalable machine learning library on Apache Spark☆795Updated 3 years ago