Alternatives and similar repositories for spark:

Users that are interested in spark are comparing it to the libraries listed below

• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• uber / uberscriptquery
  UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy
  ☆62Updated last year
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 3 years ago
• peelframework / peel
  Peel is a framework that helps you to define, execute, analyze, and share experiments for distributed systems and algorithms.
  ☆27Updated 2 years ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 2 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 4 months ago
• apache / spark-website
  Apache Spark Website
  ☆125Updated this week
• ibm-research-ireland / sparkoscope
  Enabling Spark Optimization through Cross-stack Monitoring and Visualization
  ☆47Updated 7 years ago
• paypal / dione
  Dione - a Spark and HDFS indexing library
  ☆51Updated 10 months ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 9 months ago
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆159Updated 2 years ago
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆69Updated 7 years ago
• lightcopy / parquet-index
  Spark SQL index for Parquet tables
  ☆134Updated 3 years ago
• tideworks / arvo2parquet
  Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.
  ☆38Updated 2 years ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• groupon / spark-metrics
  A library to expose more of Apache Spark's metrics system
  ☆146Updated 5 years ago
• amplab / drizzle-spark
  Drizzle integration with Apache Spark
  ☆120Updated 6 years ago
• streamnative / pulsar-spark
  Spark Connector to read and write with Pulsar
  ☆113Updated 2 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• nielsbasjes / splittablegzip
  Splittable Gzip codec for Hadoop
  ☆69Updated this week
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 3 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆186Updated last year
• sparklingpandas / sparklingml
  Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)
  ☆74Updated last year
• phatak-dev / spark-3.0-examples
  Examples of Spark 3.0
  ☆46Updated 4 years ago
• qubole / rubix
  Cache File System optimized for columnar formats and object stores
  ☆182Updated 2 years ago
• rymurr / flight-spark-source
  ☆104Updated last year