homeaway / datapull

Related projects: ⓘ

• ExpediaGroup / shunting-yard
  Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.
  ☆20Updated 2 years ago
• aravinthsci / Spark_Delta_Lake
  Delta Lake Examples
  ☆12Updated 4 years ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆16Updated 3 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆86Updated 6 months ago
• techmonad / spark-data-pipeline
  This project describes how to write full ETL data pipeline using spark.
  ☆15Updated last year
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆50Updated 4 years ago
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 5 years ago
• airbnb / sputnik
  ☆63Updated 4 years ago
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 3 weeks ago
• sourygnahtw / hadoopUtils
  ☆26Updated 8 years ago
• phatak-dev / spark-3.0-examples
  Examples of Spark 3.0
  ☆46Updated 3 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆28Updated 5 months ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆39Updated last year
• stefcorda / sparkStreamingETL
  Project to create configurable ETL via lightbend configuration using Spark Structured Streaming
  ☆8Updated 6 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 4 months ago
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 3 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• zheyuan28 / SparkTaskMetrics
  Task Metrics Explorer
  ☆13Updated 5 years ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated last year
• avensolutions / spark-sql-etl-framework
  Multi-stage, config driven, SQL based ETL framework using PySpark
  ☆25Updated 5 years ago
• pranab / chombo
  Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm
  ☆105Updated 7 months ago
• timgent / data-flare
  Data quality control tool built on spark and deequ
  ☆24Updated this week
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆33Updated last month
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated last year
• Cargill / pipewrench
  Data pipeline automation tool
  ☆25Updated 8 months ago
• sourav-mazumder / Data-Science-Extensions
  ☆71Updated 3 years ago
• dmatrix / examples
  These are some code examples
  ☆55Updated 4 years ago
• knaufk / enrichments-with-flink
  Code Samples for my Ververica Webinar "99 Ways to Enrich Streaming Data with Apache Flink"
  ☆38Updated 2 years ago
• saikrishnapujari / Spark-Nested-Data-Parser
  Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark
  ☆15Updated 7 months ago