Alternatives and similar repositories for spark-etl-framework

Users that are interested in spark-etl-framework are comparing it to the libraries listed below

• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated last month
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆194Updated last week
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated this week
• rchukh / trino-querylog
  Trino plugin for logging query events into a separate log file.
  ☆40Updated 2 years ago
• ClickHouse / spark-clickhouse-connector
  Spark ClickHouse Connector build on DataSourceV2 API
  ☆196Updated last week
• yaooqinn / spark-authorizer
  A Spark SQL extension which provides SQL Standard Authorization for Apache Spark | This repo is contributed to Apache Kyuubi | 项目已迁移至 Apa…
  ☆177Updated 3 years ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 8 months ago
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆125Updated last month
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year
• snowlift / trino-storage
  Storage connector for Trino
  ☆112Updated 2 weeks ago
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆159Updated 2 years ago
• aakashnand / trino-ranger-demo
  Tutorial on how to setup Trino and Apache Ranger using docker
  ☆41Updated 11 months ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆99Updated 2 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 2 months ago
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆267Updated this week
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆95Updated last week
• joshuarobinson / trino-on-k8s
  Setup for running Trino with Hive Metastore on Kubernetes
  ☆101Updated 2 years ago
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆236Updated 2 weeks ago
• cloudcheflabs / dataroaster
  ☆40Updated 2 years ago
• HeartSaVioR / spark-sql-kafka-offset-committer
  Kafka offset committer for structured streaming query
  ☆38Updated 4 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆89Updated last month
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 4 months ago
• hortonworks-spark / spark-atlas-connector
  A Spark Atlas connector to track data lineage in Apache Atlas
  ☆267Updated 2 years ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 5 months ago
• bitsondatadev / trino-getting-started
  ☆265Updated 8 months ago
• AbsaOSS / spline
  Data Lineage Tracking And Visualization Solution
  ☆632Updated last week
• banzaicloud / spark-metrics
  Spark metrics related custom classes and sinks (e.g. Prometheus)
  ☆183Updated 2 years ago
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆586Updated last year
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 3 years ago