Apache Spark - A unified analytics engine for large-scale data processing
☆43,170Apr 23, 2026Updated this week
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Hadoop☆15,529Updated this week
- Apache Flink☆25,943Updated this week
- Apache Kafka - A distributed event streaming platform☆32,426Updated this week
- Apache Hive☆5,975Updated this week
- Apache HBase☆5,545Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3☆14,451Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆45,144Updated this week
- Apache Storm☆6,684Apr 20, 2026Updated last week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,759Updated this week
- The official home of the Presto distributed SQL query engine for big data☆16,699Updated this week
- A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.☆13,275Updated this week
- Free and Open Source, Distributed, RESTful Search Engine☆76,569Updated this week
- Apache Iceberg☆8,765Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,617Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An Open Source Machine Learning Framework for Everyone☆194,909Updated this week
- Apache ZooKeeper☆12,756Updated this week
- Notes talking about the design and implementation of Apache Spark☆5,368Apr 2, 2024Updated 2 years ago
- Apache Druid: a high performance real-time analytics database.☆13,980Updated this week
- Open source transactional distributed database. Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructu…☆9,711Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,553Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆6,148Updated this week
- Production-Grade Container Scheduling and Management☆121,821Apr 21, 2026Updated last week
- scikit-learn: machine learning in Python☆65,917Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 酷玩 Spark: Spark 源代码解析、Spark 类库等☆3,479May 18, 2022Updated 3 years ago
- Apache Superset is a Data Visualization and Data Exploration Platform☆72,590Updated this week
- ClickHouse® is a real-time analytics database management system☆47,080Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,687Updated this week
- Apache Kylin☆3,766Updated this week
- Apache Doris is an easy-to-use, high performance and unified analytics database.☆15,266Updated this week
- For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data s…☆73,959Updated this week
- Google core libraries for Java☆51,497Apr 20, 2026Updated last week
- TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vec…☆39,998Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A library that provides an embeddable, persistent key-value store for fast storage.☆31,657Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,186Apr 29, 2025Updated 11 months ago
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…☆28,324Updated this week
- Apache Pulsar - distributed pub-sub messaging system☆15,214Updated this week
- Deep Learning for humans☆64,046Updated this week
- Netty project - an event-driven asynchronous network application framework☆34,928Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆12,744Updated this week