Helpers & syntactic sugar for PySpark.
☆62Dec 4, 2025Updated 3 months ago
Alternatives and similar repositories for sparkly
Users that are interested in sparkly are comparing it to the libraries listed below
Sorting:
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆29Nov 4, 2024Updated last year
- Collect and aggregate on spark events for profitz☆10Apr 22, 2022Updated 3 years ago
- Resilient data pipeline framework running on Apache Spark☆26Feb 27, 2026Updated last week
- A boilerplate for writing PySpark Jobs☆395Jan 21, 2024Updated 2 years ago
- Dynamic Conformance Engine☆32Oct 17, 2025Updated 4 months ago
- Scala API for Apache Spark SQL high-order functions☆14Aug 4, 2023Updated 2 years ago
- Apache (Py)Spark type annotations (stub files).☆118Aug 17, 2022Updated 3 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆17Jan 12, 2017Updated 9 years ago
- A low-overhead sampling profiler for PySpark, that outputs Flame Graphs☆16Dec 17, 2020Updated 5 years ago
- sparkql: Apache Spark SQL DataFrame schema management for sensible humans☆12Sep 18, 2023Updated 2 years ago
- HADOOP-CLI is an interactive command line shell that makes interacting with the Hadoop Distribted Filesystem (HDFS) simpler and more intu…☆36Updated this week
- R wrapper for ArrayFire☆22Oct 16, 2017Updated 8 years ago
- CoNLL-U format library for Python☆15Apr 7, 2015Updated 10 years ago
- A library that provides useful extensions to Apache Spark and PySpark.☆233Jan 20, 2026Updated last month
- pyspark methods to enhance developer productivity 📣 👯 🎉☆684Mar 6, 2025Updated last year
- A pyspark lib to validate data quality☆18Nov 11, 2022Updated 3 years ago
- Spark app to merge different schemas☆23Dec 21, 2020Updated 5 years ago
- Eskimo is a state of the art Big Data Infrastructure and Management Web Console to build, manage and operate Big Data 2.0 Analytics clust…☆25Sep 14, 2023Updated 2 years ago
- A Scalable Data Cleaning Library for PySpark.☆29Apr 4, 2019Updated 6 years ago
- A place to provide Coiled feedback☆29Mar 5, 2025Updated last year
- something to help you spark☆64Oct 23, 2018Updated 7 years ago
- Coding exercises for Apache Spark☆104Jun 4, 2015Updated 10 years ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Feb 8, 2023Updated 3 years ago
- Includes notes on using Apache Spark, with drill down on Spark for Physics, how to run TPCDS on PySpark, how to create histograms with S…☆459Dec 15, 2025Updated 2 months ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,540Dec 2, 2024Updated last year
- ☆10Jun 29, 2021Updated 4 years ago
- A COBOL parser and Mainframe/EBCDIC data source for Apache Spark☆159Updated this week
- C++ native client for Impala and Hive, with Python / pandas bindings☆72Aug 15, 2018Updated 7 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆73Mar 14, 2021Updated 4 years ago
- A curated list of awesome Apache Spark packages and resources.☆1,863Feb 27, 2026Updated last week
- PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2☆88Jan 3, 2020Updated 6 years ago
- ☆12Oct 18, 2022Updated 3 years ago
- A simplified version of featuretools for Spark☆31Jun 14, 2019Updated 6 years ago
- Python Package to Share/Edit Pandas/Polars DF with web interface!☆11Jun 10, 2025Updated 8 months ago
- Information relating to topics on Data Engineering, Data Infrastructure, Data Storing, Data Warehouses and Business Analysis. For those i…☆10Aug 8, 2021Updated 4 years ago
- Apache DataLab (incubating)☆152Oct 3, 2023Updated 2 years ago
- Data validation library for PySpark 3.0.0☆33Nov 11, 2022Updated 3 years ago
- Common utilities for Apache Kafka☆36Aug 7, 2023Updated 2 years ago
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆816Updated this week