Alternatives and similar repositories for flowman

Users that are interested in flowman are comparing it to the libraries listed below

• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated this week
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated last week
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆99Updated 2 years ago
• intuit / superglue
  Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …
  ☆158Updated 2 years ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆231Updated 6 months ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• TrivadisPF / platys-modern-data-platform
  Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....
  ☆75Updated this week
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆98Updated last month
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆228Updated last week
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated last year
• cuebook / cuelake
  Use SQL to build ELT pipelines on a data lakehouse.
  ☆287Updated 3 years ago
• naushadh / hive-metastore
  Apache Hive Metastore as a Standalone server in Docker
  ☆79Updated 11 months ago
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 3 months ago
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆344Updated last year
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆43Updated last month
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆29Updated last week
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆589Updated last year
• apache / incubator-datalab
  Apache DataLab (incubating)
  ☆152Updated last year
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 3 years ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated last month
• tokern / data-lineage
  Generate and Visualize Data Lineage from query history
  ☆325Updated last year
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆95Updated last year
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆75Updated 3 years ago
• starlake-ai / starlake
  Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
  ☆125Updated this week
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆196Updated last week
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated last year
• manuzhang / awesome-lakehouse
  a curated list of awesome lakehouse frameworks, applications, etc
  ☆34Updated 5 months ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 6 months ago
• databand-ai / dbnd
  DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.
  ☆266Updated 4 months ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago