Apache Spark - A unified analytics engine for large-scale data processing
☆42,898Updated this week
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below
Sorting:
- Apache Hadoop☆15,487Updated this week
- Apache Flink☆25,825Updated this week
- Mirror of Apache Kafka☆32,065Updated this week
- Apache Hive☆6,002Updated this week
- Apache HBase☆5,588Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆44,430Updated this week
- Apache Storm☆6,671Feb 4, 2026Updated 3 weeks ago
- The official home of the Presto distributed SQL query engine for big data☆16,662Updated this week
- Free and Open Source, Distributed, RESTful Search Engine☆76,165Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,602Updated this week
- A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.☆13,261Updated this week
- An Open Source Machine Learning Framework for Everyone☆193,905Updated this week
- Apache ZooKeeper☆12,731Feb 19, 2026Updated last week
- Production-Grade Container Scheduling and Management☆120,774Updated this week
- Apache Iceberg☆8,572Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,605Updated this week
- Apache Druid: a high performance real-time analytics database.☆13,942Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,492Updated this week
- Apache Cassandra®☆9,644Updated this week
- scikit-learn: machine learning in Python☆65,208Updated this week
- Apache Superset is a Data Visualization and Data Exploration Platform☆70,661Updated this week
- ClickHouse® is a real-time analytics database management system☆46,035Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,529Updated this week
- Notes talking about the design and implementation of Apache Spark☆5,360Apr 2, 2024Updated last year
- For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data s…☆73,186Updated this week
- A library that provides an embeddable, persistent key-value store for fast storage.☆31,566Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆6,098Updated this week
- TiDB - the open-source, cloud-native, distributed SQL database designed for modern applications.☆39,857Updated this week
- Deep Learning for humans☆63,866Updated this week
- Google core libraries for Java☆51,479Updated this week
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…☆28,035Updated this week
- Apache Pulsar - distributed pub-sub messaging system☆15,127Updated this week
- Apache Doris is an easy-to-use, high performance and unified analytics database.☆15,036Updated this week
- Tensors and Dynamic neural networks in Python with strong GPU acceleration☆97,688Updated this week
- Distributed reliable key-value store for the most critical data of a distributed system☆51,629Updated this week
- Apache Kylin☆3,766Dec 29, 2025Updated last month
- The Prometheus monitoring system and time series database.☆62,945Updated this week
- Netty project - an event-driven asynchronous network application framework☆34,811Updated this week
- The Moby Project - a collaborative project for the container ecosystem to assemble container-based systems☆71,483Updated this week