Alternatives and similar repositories for spark

Users that are interested in spark are comparing it to the libraries listed below

• apache / hadoop
  Apache Hadoop
  ☆15,461Updated this week
• apache / flink
  Apache Flink
  ☆25,764Updated this week
• apache / kafka
  Mirror of Apache Kafka
  ☆31,806Updated last week
• apache / hive
  Apache Hive
  ☆6,000Updated last week
• apache / hbase
  Apache HBase
  ☆5,581Updated this week
• apache / storm
  Apache Storm
  ☆6,672Updated this week
• apache / zookeeper
  Apache ZooKeeper
  ☆12,715Updated last week
• apache / zeppelin
  Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
  ☆6,606Updated this week
• JerryLead / SparkInternals
  Notes talking about the design and implementation of Apache Spark
  ☆5,357Updated last year
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆8,569Updated this week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,928Updated last week
• akka / akka-core
  A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.
  ☆13,262Updated 2 weeks ago
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,646Updated this week
• scala / scala
  Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
  ☆14,434Updated last week
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,465Updated this week
• apache / iceberg
  Apache Iceberg
  ☆8,485Updated last week
• apache / hudi
  Upserts, Deletes And Incremental Processing on Big Data.
  ☆6,084Updated this week
• apache / kylin
  Apache Kylin
  ☆3,767Updated last month
• apache / cassandra
  Apache Cassandra®
  ☆9,603Updated last week
• apache / arrow
  Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
  ☆16,459Updated last week
• apache / pulsar
  Apache Pulsar - distributed pub-sub messaging system
  ☆15,076Updated this week
• lw-lin / CoolplaySpark
  酷玩 Spark: Spark 源代码解析、Spark 类库等
  ☆3,486Updated 3 years ago
• Alluxio / alluxio
  Alluxio, data orchestration for analytics and machine learning in the cloud
  ☆7,153Updated 9 months ago
• apache / airflow
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆44,086Updated last week
• cloudera / hue
  Open source SQL Query Assistant service for Databases/Warehouses
  ☆1,464Updated last week
• deeplearning4j / deeplearning4j
  Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and …
  ☆14,198Updated 2 weeks ago
• dmlc / xgboost
  Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…
  ☆27,966Updated this week
• apache / mahout
  Apache Mahout - an environment for quickly creating scalable, performant machine learning applications.
  ☆2,204Updated this week
• apache / parquet-java
  Apache Parquet Java
  ☆3,019Updated 2 weeks ago
• apache / mxnet
  Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Juli…
  ☆20,835Updated 2 years ago