A simple Spark-powered ETL framework that just works πΊ
β186Oct 2, 2025Updated last year
Alternatives and similar repositories for setl
Users that are interested in setl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simplified, lightweight ETL Framework based on Apache Sparkβ590Sep 1, 2026Updated 2 months ago
- Generate fake data for Scala and Sparkβ16Dec 19, 2025Updated 11 months ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multipleβ¦β26Jun 7, 2021Updated 5 years ago
- Extensible streaming ingestion pipeline on top of Apache Sparkβ48Jul 17, 2025Updated last year
- Smart Automation Tool for building modern Data Lakes and Data Pipelinesβ130Nov 14, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Qubole Sparklens tool for performance tuning Apache Sparkβ593Jun 26, 2024Updated 2 years ago
- An ETL framework in Scala for Data Engineersβ23Aug 30, 2022Updated 4 years ago
- β10Feb 14, 2025Updated last year
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productiveβ192Oct 15, 2025Updated last year
- Essential Spark extensions and helper methods β¨π²β766Updated this week
- A home for LinkedIn's changes to Apache Icebergβ67Nov 5, 2026Updated 2 weeks ago
- Sample processing code using Spark 2.1+ and Scalaβ51Jun 28, 2020Updated 6 years ago
- Expressive types for Spark.β898Oct 28, 2026Updated 3 weeks ago
- Extensible Rules Engine for custom Dataframe / Dataset validationβ141May 7, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean β’ AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- All Certification and preparation, examples & othersβ11Oct 18, 2018Updated 8 years ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)β455Apr 2, 2026Updated 7 months ago
- Apache Spark based ETL Engineβ71Oct 18, 2016Updated 10 years ago
- Data Lineage Tracking And Visualization Solutionβ669Nov 4, 2026Updated 2 weeks ago
- A library that provides useful extensions to Apache Spark and PySpark.β240Sep 10, 2026Updated 2 months ago
- A Python Snowpark CLI for loading the TPC-DI dataset into Snowflake. Additional dbt models for building the data warehouse.β11Sep 4, 2025Updated last year
- A library enabling DAG structuring of data processing programs such as ETLsβ18Jul 19, 2026Updated 4 months ago
- Lab project to showcase Flink's performance differences between using a SQL query and implementing the same logic via the DataStream APIβ14Apr 15, 2020Updated 6 years ago
- Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines fromβ¦β35Jan 5, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.β3,660Oct 20, 2026Updated last month
- pyspark methods to enhance developer productivity π£ π― πβ691Oct 25, 2026Updated 3 weeks ago
- Cloud based Data Platform based on Apache Sparkβ28Jun 30, 2026Updated 4 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data piβ¦β98Nov 13, 2026Updated last week
- Scala API for Apache Spark SQL high-order functionsβ15Aug 4, 2023Updated 3 years ago
- An example pipeline that tests a Python project using pipenv for dependency management.β16Sep 29, 2026Updated last month
- A boilerplate project for Azure Big Data PaaS servicesβ14Dec 7, 2022Updated 3 years ago
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelinesβ17Jan 21, 2020Updated 6 years ago
- β64Nov 8, 2019Updated 7 years ago
- Open source password manager - Proton Pass β’ AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Serverless Apache Spark On AWS Fargateβ17Jun 1, 2019Updated 7 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.β73Mar 14, 2021Updated 5 years ago
- The dbt-spark-livy adapter allows you to use dbt along with Apache Spark, by connecting via Apache Livyβ12Mar 30, 2023Updated 3 years ago
- Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used β¦β506Oct 26, 2026Updated 3 weeks ago
- A curated list of awesome Apache Spark packages and resources.β1,903Feb 27, 2026Updated 8 months ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Sparkβ30May 13, 2026Updated 6 months ago
- Scalable CDC Pattern Implemented using PySparkβ18Oct 8, 2025Updated last year
Are these results useful?