Alternatives and similar repositories for spark:

Users that are interested in spark are comparing it to the libraries listed below

• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• bloomberg / spark-flow
  Library for organizing batch processing pipelines in Apache Spark
  ☆41Updated 8 years ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 3 years ago
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 2 months ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆52Updated 4 years ago
• uber / uberscriptquery
  UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy
  ☆61Updated last year
• ExpediaGroup / beeju
  JUnit integration for testing the Apache Hive Metastore and HiveServer2 Thrift APIs
  ☆26Updated 4 months ago
• amplab / drizzle-spark
  Drizzle integration with Apache Spark
  ☆120Updated 6 years ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• squito / spark-memory
  A tool to get better debug info on spark's memory usage
  ☆42Updated 5 years ago
• holdenk / spark-validator
  A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…
  ☆109Updated 7 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• rymurr / flight-spark-source
  ☆105Updated last year
• lightcopy / parquet-index
  Spark SQL index for Parquet tables
  ☆134Updated 4 years ago
• Teradata / tpcds
  Port of TPC-DS dsdgen to Java
  ☆49Updated 9 months ago
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆159Updated 2 years ago
• apache / datafu
  Mirror of Apache DataFu
  ☆120Updated last week
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated last year
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 2 years ago
• apache / spark-website
  Apache Spark Website
  ☆126Updated 2 weeks ago
• qubole / rubix
  Cache File System optimized for columnar formats and object stores
  ☆182Updated 2 years ago
• ibm-research-ireland / sparkoscope
  Enabling Spark Optimization through Cross-stack Monitoring and Visualization
  ☆47Updated 7 years ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆225Updated last month
• cdapio / hydrator-plugins
  Cask Hydrator Plugins Repository
  ☆68Updated last week
• springnz / sparkplug
  A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.
  ☆47Updated 8 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• dataArtisans / cascading-flink
  Cascading on Apache Flink®
  ☆54Updated last year
• hortonworks-spark / cloud-integration
  Spark cloud integration: tests, cloud committers and more
  ☆19Updated 3 months ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆183Updated 3 months ago