Apache Spark - A unified analytics engine for large-scale data processing
☆43,800Aug 6, 2026Updated this week
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Hadoop☆15,627Updated this week
- Apache Flink☆26,248Updated this week
- Apache Kafka - A distributed event streaming platform☆33,478Updated this week
- Apache Hive☆6,006Updated this week
- Apache HBase☆5,557Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3☆14,566Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆46,400Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,927Updated this week
- Free and Open Source, Distributed, RESTful Search Engine☆77,790Updated this week
- Apache Storm☆6,696Updated this week
- A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.☆13,277Updated this week
- The official home of the Presto distributed SQL query engine for big data☆16,717Updated this week
- An Open Source Machine Learning Framework for Everyone☆196,892Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,649Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Apache Iceberg☆9,115Updated this week
- Notes talking about the design and implementation of Apache Spark☆5,363Apr 2, 2024Updated 2 years ago
- scikit-learn: machine learning in Python☆66,920Updated this week
- Production-Grade Container Scheduling and Management☆124,325Updated this week
- Apache ZooKeeper☆12,786Jul 17, 2026Updated 2 weeks ago
- Apache Druid: a high performance real-time analytics database.☆14,041Updated this week
- Open source transactional distributed database. Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructu…☆10,058Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,639Updated this week
- ClickHouse® is a real-time analytics database management system☆49,097Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Upserts, Deletes And Incremental Processing on Big Data.☆6,206Updated this week
- Apache Doris is a real-time analytics and hybrid search database for AI agents.☆15,735Updated this week
- Apache Superset is a Data Visualization and Data Exploration Platform☆74,167Updated this week
- For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data s…☆75,911Updated this week
- 酷玩 Spark: Spark 源代码解析、Spark 类库等☆3,474May 18, 2022Updated 4 years ago
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,990Updated this week
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single…☆28,633Updated this week
- Google core libraries for Java☆51,630Updated this week
- Apache Kylin☆3,769Jul 16, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆13,108Updated this week
- TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vec…☆40,396Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,224Apr 29, 2025Updated last year
- Example code from Learning Spark book☆3,893Jun 30, 2026Updated last month
- A library that provides an embeddable, persistent key-value store for fast storage.☆31,942Updated this week
- The Moby Project - a collaborative project for the container ecosystem to assemble container-based systems☆72,013Updated this week
- Deep Learning for humans☆64,224Updated this week