Alternatives and similar repositories for spark

Users that are interested in spark are comparing it to the libraries listed below

• apache / hadoop
  Apache Hadoop
  ☆15,151Updated this week
• apache / flink
  Apache Flink
  ☆25,001Updated this week
• apache / storm
  Apache Storm
  ☆6,635Updated last week
• apache / kafka
  Mirror of Apache Kafka
  ☆30,379Updated this week
• apache / hive
  Apache Hive
  ☆5,734Updated this week
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,191Updated this week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,395Updated this week
• apache / hbase
  Apache HBase
  ☆5,357Updated this week
• apache / zeppelin
  Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
  ☆6,514Updated this week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,756Updated this week
• apache / kylin
  Apache Kylin
  ☆3,720Updated 3 months ago
• apache / airflow
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆40,853Updated this week
• Alluxio / alluxio
  Alluxio, data orchestration for analytics and machine learning in the cloud
  ☆7,019Updated 2 months ago
• JerryLead / SparkInternals
  Notes talking about the design and implementation of Apache Spark
  ☆5,330Updated last year
• apache / cassandra
  Apache Cassandra®
  ☆9,252Updated this week
• akka / akka
  A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.
  ☆13,179Updated last week
• deeplearning4j / deeplearning4j
  Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and …
  ☆14,037Updated this week
• apache / hudi
  Upserts, Deletes And Incremental Processing on Big Data.
  ☆5,860Updated this week
• apache / zookeeper
  Apache ZooKeeper
  ☆12,533Updated last week
• scala / scala
  Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
  ☆14,388Updated last week
• azkaban / azkaban
  Azkaban workflow manager.
  ☆4,503Updated last year
• scrapy / scrapy
  Scrapy, a fast high-level web crawling & scraping framework for Python.
  ☆57,440Updated this week
• keras-team / keras
  Deep Learning for humans
  ☆63,194Updated this week
• lw-lin / CoolplaySpark
  酷玩 Spark: Spark 源代码解析、Spark 类库等
  ☆3,486Updated 3 years ago
• jupyter / notebook
  Jupyter Interactive Notebook
  ☆12,395Updated last week
• spark-notebook / spark-notebook
  Interactive and Reactive Data Science using Scala and Spark.
  ☆3,151Updated 2 years ago
• pytorch / pytorch
  Tensors and Dynamic neural networks in Python with strong GPU acceleration
  ☆91,292Updated this week
• ray-project / ray
  Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
  ☆37,845Updated this week
• dmlc / xgboost
  Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…
  ☆27,082Updated this week
• yahoo / TensorFlowOnSpark
  TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
  ☆3,870Updated last year