SETL-Framework / setlLinks
A simple Spark-powered ETL framework that just works πΊ
β182Updated last week
Alternatives and similar repositories for setl
Users that are interested in setl are comparing it to the libraries listed below
Sorting:
- Smart Automation Tool for building modern Data Lakes and Data Pipelinesβ123Updated this week
- A library that provides useful extensions to Apache Spark and PySpark.β230Updated 2 months ago
- The Internals of Delta Lakeβ186Updated 8 months ago
- A simplified, lightweight ETL Framework based on Apache Sparkβ588Updated last year
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productiveβ184Updated this week
- Flowchart for debugging Spark applicationsβ107Updated last year
- Snowflake Data Source for Apache Spark.β230Updated last week
- Spline agent for Apache Sparkβ197Updated last month
- A library that brings useful functions from various modern database management systems to Apache Sparkβ60Updated 2 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.β346Updated last year
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are inβ¦β93Updated 4 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data piβ¦β96Updated 3 weeks ago
- DataQuality for BigDataβ144Updated last year
- Avro SerDe for Apache Spark structured APIs.β235Updated 3 months ago
- β63Updated 5 years ago
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.β76Updated last year
- ACID Data Source for Apache Spark based on Hive ACIDβ97Updated 4 years ago
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an Aβ¦β128Updated last month
- Data Lineage Tracking And Visualization Solutionβ642Updated last week
- A tool to validate data, built around Apache Spark.β100Updated this week
- Code snippets used in demos recorded for the blog.β37Updated last month
- Spark style guideβ263Updated last year
- Custom state store providers for Apache Sparkβ92Updated 7 months ago
- Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!β233Updated 8 months ago
- Magic to help Spark pipelines upgradeβ34Updated last year
- Qubole Sparklens tool for performance tuning Apache Sparkβ584Updated last year
- Spark-Radiant is Apache Spark Performance and Cost Optimizerβ26Updated 9 months ago
- Build configuration-driven ETL pipelines on Apache Sparkβ161Updated 3 years ago
- A Spark plugin for reading and writing Excel filesβ513Updated last month
- The Internals of Spark on Kubernetesβ71Updated 3 years ago