Notes talking about the design and implementation of Apache Spark
☆5,369Apr 2, 2024Updated 2 years ago
Alternatives and similar repositories for SparkInternals
Users that are interested in SparkInternals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 酷玩 Spark: Spark 源代码解析、Spark 类库等☆3,476May 18, 2022Updated 4 years ago
- 挖坑与填坑☆685Aug 18, 2016Updated 9 years ago
- Apache Spark - A unified analytics engine for large-scale data processing☆43,311Updated this week
- The Internals of Apache Spark☆1,547Apr 12, 2026Updated last month
- REST job server for Apache Spark☆2,843Mar 3, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Learning to write Spark examples☆160Aug 20, 2014Updated 11 years ago
- Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.☆1,839May 29, 2024Updated last year
- spark ml 算法原理剖析以及具体的源码实现分析☆1,958Mar 25, 2019Updated 7 years ago
- scala、spark使用过程中，各种测试用例以及相关资料整理☆1,086Feb 9, 2019Updated 7 years ago
- Apache Flink☆26,032Updated this week
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,369Aug 22, 2023Updated 2 years ago
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,820Updated this week
- Deep Dive into Apache Spark 深入研读Spark源码☆259Jan 5, 2017Updated 9 years ago
- A curated list of awesome Apache Spark packages and resources.☆1,879Feb 27, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,195Apr 29, 2025Updated last year
- Flink 中文视频课程（持续更新...）☆4,621Jun 18, 2020Updated 5 years ago
- ☆131Jan 10, 2019Updated 7 years ago
- ☆135Jul 6, 2021Updated 4 years ago
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,852Jul 10, 2023Updated 2 years ago
- Streaming System 相关的论文读物☆736Feb 12, 2022Updated 4 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,789May 8, 2026Updated 2 weeks ago
- Base classes to use when writing tests with Spark☆1,554Apr 20, 2026Updated last month
- A RPC framework leveraging Spark RPC module☆207Mar 13, 2019Updated 7 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- spark源码学习☆299Jan 21, 2016Updated 10 years ago
- ☆179Sep 3, 2017Updated 8 years ago
- Interactive and Reactive Data Science using Scala and Spark.☆3,150May 16, 2023Updated 3 years ago
- High performance data store solution☆1,446May 15, 2026Updated last week
- Apache Kylin☆3,767May 15, 2026Updated last week
- Examples for High Performance Spark☆532May 3, 2026Updated 3 weeks ago
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,008Oct 5, 2022Updated 3 years ago
- The Internals of Spark SQL☆487Jan 25, 2026Updated 4 months ago
- The Internals of Spark Structured Streaming☆422Mar 3, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Ta…☆15,057May 6, 2026Updated 2 weeks ago
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,621Updated this week
- Apache Calcite☆5,127Updated this week
- Apache Iceberg☆8,877May 20, 2026Updated last week
- Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang☆15,120Mar 30, 2026Updated last month
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆823May 19, 2026Updated last week
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,263May 19, 2026Updated last week