Alternatives and similar repositories for cloud-integration

Users that are interested in cloud-integration are comparing it to the libraries listed below

• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆52Updated 4 years ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• ansrivas / spark-structured-streaming
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Updated 5 years ago
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 2 years ago
• SponsorPay / jaquet
  Spark stream from kafka(json) to s3(parquet)
  ☆15Updated 6 years ago
• groupon / spark-metrics
  A library to expose more of Apache Spark's metrics system
  ☆146Updated 5 years ago
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 3 months ago
• hbutani / spark-datetime
  functionstest
  ☆33Updated 8 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• streaming-analytics / Styx
  Streaming Analytics platform, built with Apache Flink and Kafka
  ☆35Updated last year
• tresata / spark-kafka
  Low level integration of Spark and Kafka
  ☆130Updated 7 years ago
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆69Updated 7 years ago
• mkuthan / example-spark-kafka
  Apache Spark and Apache Kafka integration example
  ☆124Updated 7 years ago
• bernhard-42 / Spark-ETL-Atlas
  A small project to show how to add lineage to Atlas when using Spark as ETL tool
  ☆12Updated 8 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 6 years ago
• 51zero / eel-sdk
  Big Data Toolkit for the JVM
  ☆146Updated 4 years ago
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆109Updated 7 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 6 months ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated last year
• rdblue / s3committer
  Hadoop output committers for S3
  ☆109Updated 4 years ago
• phatak-dev / flink-examples
  Flink Examples
  ☆39Updated 9 years ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆51Updated last year
• gwenshap / SparkStreamingExample
  ☆54Updated 10 years ago
• dataArtisans / cascading-flink
  Cascading on Apache Flink®
  ☆54Updated last year
• hammerlab / yarn-logs-helpers
  Scripts for parsing / making sense of yarn logs
  ☆52Updated 8 years ago
• criteo / babar
  Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.
  ☆126Updated 6 years ago