mrpowers-io / spark-daria
Essential Spark extensions and helper methods β¨π²
β756Updated 3 months ago
Alternatives and similar repositories for spark-daria:
Users that are interested in spark-daria are comparing it to the libraries listed below
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)β439Updated 2 months ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spaβ¦β727Updated 2 weeks ago
- Qubole Sparklens tool for performance tuning Apache Sparkβ570Updated 7 months ago
- Spark style guideβ257Updated 4 months ago
- Base classes to use when writing tests with Sparkβ1,526Updated last month
- β306Updated 6 years ago
- A simplified, lightweight ETL Framework based on Apache Sparkβ586Updated last year
- A Spark plugin for reading and writing Excel filesβ479Updated this week
- Spark Gotchas. A subjective compilation of the Apache Spark tips and tricksβ363Updated 7 years ago
- The Internals of Spark Structured Streamingβ417Updated 2 years ago
- Examples for High Performance Sparkβ506Updated 3 months ago
- The Internals of Delta Lakeβ183Updated last month
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productiveβ185Updated 2 years ago
- Data Lineage Tracking And Visualization Solutionβ612Updated 2 weeks ago
- Avro SerDe for Apache Spark structured APIs.β231Updated 6 months ago
- A tool for monitoring and tuning Spark jobs for efficiency.β357Updated 2 years ago
- The Internals of Spark SQLβ460Updated last month
- Spark package for checking data qualityβ221Updated 4 years ago
- The Internals of Apache Sparkβ1,490Updated 5 months ago
- pyspark methods to enhance developer productivity π£ π― πβ661Updated 2 months ago
- A library that provides useful extensions to Apache Spark and PySpark.β214Updated 2 months ago
- Examples of Spark 2.0β211Updated 3 years ago
- Kinesis Connector for Structured Streamingβ136Updated 7 months ago
- A simple Spark-powered ETL framework that just works πΊβ179Updated 2 weeks ago
- Serverless proxy for Spark clusterβ325Updated 4 years ago
- Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.β901Updated 3 months ago
- Apache Sparkβ’ and Scala Workshopsβ264Updated 6 months ago
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.β386Updated last week
- Build configuration-driven ETL pipelines on Apache Sparkβ159Updated 2 years ago
- PySpark test helper methods with beautiful error messagesβ663Updated last month