Renien / ETL-Starter-Kit
Extract, Transform, Load (ETL) refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL related work.
☆21Updated 7 years ago
Alternatives and similar repositories for ETL-Starter-Kit:
Users that are interested in ETL-Starter-Kit are comparing it to the libraries listed below
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 7 years ago
- Flink Examples☆39Updated 8 years ago
- ☆48Updated 4 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆23Updated 6 years ago
- Example project to show how to use Spark to read and write Avro/Parquet files☆50Updated 11 years ago
- A Real-Time Analytical Processing (RTAP) example using Spark/Shark☆51Updated 10 years ago
- High performance HBase / Spark SQL engine☆28Updated 2 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Apache Flink™ training material website☆79Updated 4 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Updated 5 years ago
- Edit code in IntelliJ, eval/run in Zeppelin notebook☆18Updated 5 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Spark with Scala example projects☆34Updated 5 years ago
- Apache Spark ETL Utilities☆40Updated 3 months ago
- Examples for Fast Data Processing with Spark☆59Updated 11 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆62Updated last year
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Updated 8 years ago
- Simple implementation of a custom parquet reader/writer☆11Updated 8 years ago
- Notes about Spark Streaming in Apache Spark☆58Updated 7 years ago
- ☆41Updated 7 years ago
- Enabling Spark Optimization through Cross-stack Monitoring and Visualization☆47Updated 7 years ago
- spark + drools☆102Updated 2 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆28Updated 4 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆49Updated last year
- HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)☆63Updated 2 years ago
- Example project showing how to use Hive UDFs in Apache Spark☆55Updated 5 years ago
- This is a simple CEP Engine leveraging the Kafka Streams platform☆16Updated 7 years ago
- A sample implementation of the Spark Datasource API☆24Updated 7 years ago
- Data-Driven Spark allows quick data exploration based on Apache Spark.☆28Updated 8 years ago