Build configuration-driven ETL pipelines on Apache Spark
☆161Oct 4, 2022Updated 3 years ago
Alternatives and similar repositories for envelope
Users that are interested in envelope are comparing it to the libraries listed below
Sorting:
- Scala API for Apache Spark SQL high-order functions☆14Aug 4, 2023Updated 2 years ago
- Combination of Dockerized Hortonworks projects and other Hadoop ecosystem components☆10Oct 11, 2019Updated 6 years ago
- An Ansible collection of utilities and other resources for Cloudera Platform deployments☆13Nov 13, 2025Updated 3 months ago
- an open source dataworks platform☆21Jun 4, 2021Updated 4 years ago
- Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…☆96Nov 14, 2019Updated 6 years ago
- File compaction tool that runs on top of the Spark framework.☆59Apr 17, 2019Updated 6 years ago
- Write your Spark data to Kafka seamlessly☆174Jul 10, 2024Updated last year
- Real Time Analytics and Data Pipelines based on Spark Streaming☆531Oct 24, 2019Updated 6 years ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Nov 29, 2016Updated 9 years ago
- A library enabling DAG structuring of data processing programs such as ETLs☆17Dec 13, 2025Updated 2 months ago
- Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka☆25Oct 16, 2020Updated 5 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆587Jan 24, 2024Updated 2 years ago
- Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol☆34Sep 8, 2022Updated 3 years ago
- The Internals of Spark Structured Streaming☆422Updated this week
- Real-time analytics in Apache Flume☆51Feb 2, 2016Updated 10 years ago
- Apache Spark ETL Utilities☆39Oct 23, 2024Updated last year
- Apache NiFi Data Synthesizer☆15Aug 3, 2023Updated 2 years ago
- StreamLine - Streaming Analytics☆167Aug 27, 2023Updated 2 years ago
- Apache Spark based ETL Engine☆71Oct 18, 2016Updated 9 years ago
- Implement a complete data warehouse etl using spark SQL☆14Sep 8, 2022Updated 3 years ago
- Kafka, Spark Streaming, Kudu integration examples☆17Dec 22, 2017Updated 8 years ago
- Set of ETL utils for Spark☆15May 4, 2020Updated 5 years ago
- Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm☆104Jan 22, 2024Updated 2 years ago
- Big Spatial Data Processing using Spark☆146Mar 7, 2017Updated 8 years ago
- Sherlock is an anomaly detection service built on top of Druid☆156Dec 2, 2024Updated last year
- Presto SQL query formatter☆15Jan 1, 2024Updated 2 years ago
- Powered by Spark Streaming & Siddhi☆319Feb 11, 2020Updated 6 years ago
- JDBC driver for Apache Kafka☆87Apr 1, 2022Updated 3 years ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆29Nov 4, 2024Updated last year
- 简单易用的ETL工具☆17Mar 28, 2019Updated 6 years ago
- ☆19Jun 16, 2021Updated 4 years ago
- Kubernetes deployment of PrestoDB, Hive Metastore, and Minio S3-standard object store☆17Oct 20, 2022Updated 3 years ago
- Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model w…☆81Nov 15, 2022Updated 3 years ago
- facebook presto connectors☆49Aug 9, 2021Updated 4 years ago
- Deep Learning Pipelines for Apache Spark☆58Jan 28, 2018Updated 8 years ago
- Herd is a managed data lake for the cloud. The Herd unified data catalog helps separate storage from compute in the cloud. Manage petabyt…☆138Oct 1, 2022Updated 3 years ago
- A complete custom processor project, for your reference.☆17Sep 29, 2015Updated 10 years ago
- An Ansible collection for Cloudera Platform for cloud and Data Services☆21Updated this week
- Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…☆280Aug 3, 2018Updated 7 years ago