apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
☆40,516Updated this week
Alternatives and similar repositories for spark:
Users that are interested in spark are comparing it to the libraries listed below
- Apache Hadoop☆14,932Updated this week
- Apache Hive☆5,623Updated this week
- Apache Storm☆6,611Updated this week
- Apache HBase☆5,279Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,459Updated this week
- Mirror of Apache Kafka☆29,434Updated this week
- Apache Flink☆24,509Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆7,801Updated this week
- Apache Druid: a high performance real-time analytics database.☆13,609Updated this week
- REST job server for Apache Spark☆2,835Updated last month
- Upserts, Deletes And Incremental Processing on Big Data.☆5,633Updated this week
- Apache Iceberg☆6,883Updated this week
- Apache Kylin☆3,674Updated 3 weeks ago
- The official home of the Presto distributed SQL query engine for big data☆16,194Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆6,934Updated 2 months ago
- Apache Cassandra®☆9,011Updated this week
- Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3☆14,356Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆38,716Updated this week
- Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-l…☆2,546Updated 4 months ago
- PredictionIO, a machine learning server for developers and ML engineers.☆12,533Updated 4 years ago
- Apache ZooKeeper☆12,372Updated this week
- Mirror of Apache Mahout☆2,158Updated last week
- Notes talking about the design and implementation of Apache Spark☆5,297Updated 10 months ago
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,874Updated last year
- Apache Parquet Java☆2,712Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆7,988Updated this week
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,233Updated last week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆14,973Updated this week
- Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter☆3,634Updated last year
- Interactive and Reactive Data Science using Scala and Spark.☆3,151Updated last year