swan-cern / sparkmonitor
An extension for Jupyter Lab & Jupyter Notebook to monitor Apache Spark (pyspark) from notebooks
☆50Updated last year
Alternatives and similar repositories for sparkmonitor:
Users that are interested in sparkmonitor are comparing it to the libraries listed below
- Jupyter extensions for SWAN☆58Updated this week
- JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook☆92Updated 2 years ago
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- A JupyterLab extension providing, SQL formatter, auto-completion, syntax highlighting, Spark SQL and Trino☆86Updated this week
- A tool and library for easily deploying applications on Apache YARN☆143Updated last year
- Monitor Apache Spark from Jupyter Notebook☆172Updated 2 years ago
- Asynchronous actions for PySpark☆47Updated 3 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- A Delta Lake reader for Dask☆49Updated 5 months ago
- Deploy dask on YARN clusters☆69Updated 7 months ago
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆70Updated 3 years ago
- ☆68Updated 2 months ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆58Updated last year
- Spark SQL magic command for Jupyter notebooks☆35Updated 3 years ago
- A dbt adapter for Decodable☆12Updated 3 weeks ago
- Sparglim✨ makes PySpark App Configurable and Deploy Spark Connect Server Easier!☆36Updated last week
- A library on top of either pex or conda-pack to make your Python code easily available on a cluster☆45Updated 3 months ago
- Pylint plugin for static code analysis on Airflow code☆93Updated 4 years ago
- Unity Catalog UI☆39Updated 6 months ago
- REST API for Apache Spark on K8S or YARN☆95Updated this week
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆88Updated 11 months ago
- A collection of python utility functions☆11Updated 8 months ago
- ☆55Updated last year
- Read Delta tables without any Spark☆47Updated last year
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- The Internals of Spark on Kubernetes☆70Updated 2 years ago
- Dockerized setup for testing code on realistic hadoop clusters☆27Updated 4 years ago
- Dask integration for Snowflake☆30Updated 3 months ago
- A library that provides useful extensions to Apache Spark and PySpark.☆218Updated this week
- ✨ A Pydantic to PySpark schema library☆72Updated this week