sourygnahtw / hadoopUtils

Related projects ⓘ

Alternatives and complementary repositories for hadoopUtils

• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• snowplow-archive / spark-example-project
  A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR
  ☆118Updated 8 years ago
• sourav-mazumder / Data-Science-Extensions
  ☆71Updated 3 years ago
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆158Updated 2 years ago
• springml / spark-sftp
  Spark connector for SFTP
  ☆100Updated last year
• phatak-dev / spark2.0-examples
  Examples of Spark 2.0
  ☆211Updated 3 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 5 years ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆141Updated 11 months ago
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆69Updated 7 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 6 months ago
• holdenk / spark-structured-streaming-ml
  Structured Streaming Machine Learning example with Spark 2.0
  ☆92Updated 7 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆86Updated 8 months ago
• mkuthan / example-spark-kafka
  Apache Spark and Apache Kafka integration example
  ☆124Updated 6 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 2 weeks ago
• hortonworks-spark / spark-llap
  ☆102Updated 4 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• groupon / sparklint
  A tool for monitoring and tuning Spark jobs for efficiency.
  ☆357Updated 2 years ago
• phatak-dev / spark-3.0-examples
  Examples of Spark 3.0
  ☆47Updated 4 years ago
• bolcom / hive_compared_bq
  hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
  ☆28Updated 6 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated last month
• vaquarkhan / Apache-Kafka-poc-and-notes
  ☆245Updated 5 years ago
• rklick-solutions / spark-tutorial
  This tutorial provides a quick introduction to using Spark
  ☆57Updated 8 years ago
• hortonworks / hive-json
  A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.
  ☆42Updated 11 months ago
• snowplow-archive / spark-streaming-example-project
  A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB
  ☆94Updated 4 years ago
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆83Updated 6 years ago
• hammerlab / yarn-logs-helpers
  Scripts for parsing / making sense of yarn logs
  ☆52Updated 8 years ago
• airawat / OozieSamples
  Oozie Samples
  ☆51Updated 10 years ago
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆185Updated 2 weeks ago
• polomarcus / Spark-Structured-Streaming-Examples
  Spark Structured Streaming / Kafka / Cassandra / Elastic
  ☆184Updated last year