Alternatives and similar repositories for spark-etl

Users that are interested in spark-etl are comparing it to the libraries listed below

• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆82Updated 3 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated last year
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆94Updated 6 months ago
• MrPowers / spark-stringmetric
  Spark functions to run popular phonetic and string matching algorithms
  ☆60Updated 3 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated last month
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 4 years ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆123Updated last week
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆222Updated 5 years ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆52Updated 5 months ago
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated 2 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated last month
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 3 years ago
• MrPowers / bebe
  Filling in the Spark function gaps across APIs
  ☆50Updated 4 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 3 years ago
• nielsbasjes / splittablegzip
  Splittable Gzip codec for Hadoop
  ☆74Updated last week
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆113Updated 5 years ago
• sutugin / spark-streaming-jdbc-source
  ☆26Updated 4 years ago
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆70Updated 3 months ago
• holdenk / sparkProjectTemplate.g8
  Template for Spark Projects
  ☆102Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆230Updated 3 weeks ago
• tillrohrmann / flink-project.g8
  Giter8 template to create a simple flink project
  ☆26Updated 5 years ago
• Radico / trino-plugins
  Simplified custom plugins for Trino
  ☆16Updated last year
• ottogroup / schedoscope
  Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…
  ☆96Updated 6 years ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆108Updated last year
• bryanyang0528 / ksql-python
  A python wrapper for the KSQL REST API.
  ☆158Updated 2 years ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆39Updated last year