Notes talking about the design and implementation of Apache Spark
☆5,364Apr 2, 2024Updated last year
Alternatives and similar repositories for SparkInternals
Users that are interested in SparkInternals are comparing it to the libraries listed below
Sorting:
- 酷玩 Spark: Spark 源代码解析、Spark 类库等☆3,483May 18, 2022Updated 3 years ago
- 挖坑与填坑☆687Aug 18, 2016Updated 9 years ago
- Apache Spark - A unified analytics engine for large-scale data processing☆43,001Updated this week
- The Internals of Apache Spark☆1,542Jul 5, 2025Updated 8 months ago
- REST job server for Apache Spark☆2,845Mar 3, 2026Updated 2 weeks ago
- Learning to write Spark examples☆161Aug 20, 2014Updated 11 years ago
- Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.☆1,843May 29, 2024Updated last year
- spark ml 算法原理剖析以及具体的源码实现分析☆1,960Mar 25, 2019Updated 6 years ago
- scala、spark使用过程中，各种测试用例以及相关资料整理☆1,085Feb 9, 2019Updated 7 years ago
- Apache Flink☆25,875Updated this week
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,369Aug 22, 2023Updated 2 years ago
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,635Mar 13, 2026Updated last week
- Deep Dive into Apache Spark 深入研读Spark源码☆260Jan 5, 2017Updated 9 years ago
- A curated list of awesome Apache Spark packages and resources.☆1,866Feb 27, 2026Updated 3 weeks ago
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,167Apr 29, 2025Updated 10 months ago
- Flink 中文视频课程（持续更新...）☆4,626Jun 18, 2020Updated 5 years ago
- ☆131Jan 10, 2019Updated 7 years ago
- ☆134Jul 6, 2021Updated 4 years ago
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,858Jul 10, 2023Updated 2 years ago
- Streaming System 相关的论文读物☆736Feb 12, 2022Updated 4 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,784Oct 13, 2025Updated 5 months ago
- Base classes to use when writing tests with Spark☆1,549Dec 22, 2025Updated 3 months ago
- A RPC framework leveraging Spark RPC module☆209Mar 13, 2019Updated 7 years ago
- spark源码学习☆299Jan 21, 2016Updated 10 years ago
- ☆179Sep 3, 2017Updated 8 years ago
- Interactive and Reactive Data Science using Scala and Spark.☆3,150May 16, 2023Updated 2 years ago
- High performance data store solution☆1,446Mar 11, 2026Updated last week
- Examples for High Performance Spark☆527Mar 3, 2026Updated 2 weeks ago
- Apache Kylin☆3,770Mar 13, 2026Updated last week
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,007Oct 5, 2022Updated 3 years ago
- The Internals of Spark SQL☆488Jan 25, 2026Updated last month
- The Internals of Spark Structured Streaming☆422Mar 3, 2026Updated 2 weeks ago
- flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Ta…☆15,058Mar 9, 2026Updated last week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,607Updated this week
- Apache Calcite☆5,099Updated this week
- Apache Iceberg☆8,636Updated this week
- Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang☆15,081Jul 4, 2024Updated last year
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,310Mar 14, 2026Updated last week
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,260Updated this week