Renien / ETL-Starter-KitLinks
Extract, Transform, Load (ETL) refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL related work.
☆21Updated 8 years ago
Alternatives and similar repositories for ETL-Starter-Kit
Users that are interested in ETL-Starter-Kit are comparing it to the libraries listed below
Sorting:
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆41Updated 7 years ago
- Flink Examples☆39Updated 9 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- Sample processing code using Spark 2.1+ and Scala☆52Updated 4 years ago
- A Real-Time Analytical Processing (RTAP) example using Spark/Shark☆51Updated 11 years ago
- functionstest☆33Updated 8 years ago
- Enabling Spark Optimization through Cross-stack Monitoring and Visualization☆47Updated 7 years ago
- Edit code in IntelliJ, eval/run in Zeppelin notebook☆18Updated 6 years ago
- Apache Spark ETL Utilities☆40Updated 7 months ago
- High performance HBase / Spark SQL engine☆28Updated 2 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆61Updated 9 months ago
- ☆49Updated 5 years ago
- Utilities for writing tests that use Apache Spark.☆24Updated 6 years ago
- Example project to show how to use Spark to read and write Avro/Parquet files☆50Updated 11 years ago
- Data pipeline automation tool☆26Updated last year
- Analyzing Twitter real time feed with Spark Streaming☆32Updated 10 years ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆111Updated 5 years ago
- Get started with Apache Beam and Flink☆43Updated 8 years ago
- A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB☆94Updated 4 years ago
- Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol☆34Updated 2 years ago
- Simple implementation of a custom parquet reader/writer☆11Updated 8 years ago
- A tutorial on Apache Spark Unit Testing☆37Updated 9 years ago
- Code for Packt Publishing's Scala Data Analysis Cookbook.☆49Updated 9 years ago
- NRT Sessionization with Spark Streaming landing on HDFS and putting live stats in HBase☆51Updated 10 years ago
- This tutorial provides a quick introduction to using Spark☆57Updated 9 years ago
- Examples for Fast Data Processing with Spark☆59Updated 11 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 8 years ago
- This is a simple CEP Engine leveraging the Kafka Streams platform☆16Updated 8 years ago
- This is a datasource implementation for quick query in Kafka with Spark☆9Updated last year