werneckpaiva / spark-to-tableau
Spark to Tableau Extractor library
☆18Updated 6 years ago
Related projects: ⓘ
- Schema Registry integration for Apache Spark☆39Updated last year
- functionstest☆33Updated 7 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆86Updated 6 months ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 7 years ago
- Spark Structured Streaming State Tools☆34Updated 4 years ago
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Updated 2 years ago
- A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.☆42Updated 9 months ago
- Hadoop Data Pipeline using Falcon☆15Updated 8 years ago
- An example PySpark project with pytest☆17Updated 6 years ago
- Data pipeline automation tool☆25Updated 8 months ago
- Monitor Twitter stream for S&P 500 companies to identify & act on unexpected increases in tweet volume☆39Updated 8 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 3 years ago
- An Apache Spark app for making data movement between Apache Hive and Apache Phoenix/HBase☆14Updated 8 years ago
- File compaction tool that runs on top of the Spark framework.☆59Updated 5 years ago
- Spark cloud integration: tests, cloud committers and more☆19Updated 6 months ago
- Materials for various Hadoop & Nifi related workshops☆49Updated 5 years ago
- Spark stream from kafka(json) to s3(parquet)☆15Updated 5 years ago
- Example projects for using Spark and Cassandra With DSE Analytics☆58Updated last year
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- type-class based data cleansing library for Apache Spark SQL☆79Updated 5 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 6 years ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- Avro Schema Shredder is a REST API that enables storage of Avro Schemas in Apache Atlas. This API enables an organization to use Apache A…☆13Updated 7 years ago
- A small project to show how to add lineage to Atlas when using Spark as ETL tool☆12Updated 7 years ago
- Rocksdb state storage implementation for Structured Streaming.☆16Updated 3 years ago
- Workshop for Hadoop Operations Best Practices☆10Updated 9 years ago
- ☆63Updated 4 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆49Updated 8 months ago
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆75Updated 4 months ago
- JUnit integration for testing the Apache Hive Metastore and HiveServer2 Thrift APIs☆24Updated 6 months ago