Notes talking about the design and implementation of Apache Spark
☆5,367Apr 2, 2024Updated 2 years ago
Alternatives and similar repositories for SparkInternals
Users that are interested in SparkInternals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 酷玩 Spark: Spark 源代码解析、Spark 类库等☆3,482May 18, 2022Updated 3 years ago
- 挖坑与填坑☆686Aug 18, 2016Updated 9 years ago
- Apache Spark - A unified analytics engine for large-scale data processing☆43,144Updated this week
- The Internals of Apache Spark☆1,548Updated this week
- REST job server for Apache Spark☆2,845Mar 3, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Learning to write Spark examples☆160Aug 20, 2014Updated 11 years ago
- Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.☆1,840May 29, 2024Updated last year
- spark ml 算法原理剖析以及具体的源码实现分析☆1,959Mar 25, 2019Updated 7 years ago
- scala、spark使用过程中，各种测试用例以及相关资料整理☆1,086Feb 9, 2019Updated 7 years ago
- Apache Flink☆25,943Updated this week
- Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark☆1,369Aug 22, 2023Updated 2 years ago
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,746Updated this week
- Deep Dive into Apache Spark 深入研读Spark源码☆260Jan 5, 2017Updated 9 years ago
- A curated list of awesome Apache Spark packages and resources.☆1,869Feb 27, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,182Apr 29, 2025Updated 11 months ago
- Flink 中文视频课程（持续更新...）☆4,622Jun 18, 2020Updated 5 years ago
- ☆131Jan 10, 2019Updated 7 years ago
- ☆134Jul 6, 2021Updated 4 years ago
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,860Jul 10, 2023Updated 2 years ago
- Streaming System 相关的论文读物☆736Feb 12, 2022Updated 4 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,790Oct 13, 2025Updated 6 months ago
- Base classes to use when writing tests with Spark☆1,551Apr 10, 2026Updated last week
- A RPC framework leveraging Spark RPC module☆208Mar 13, 2019Updated 7 years ago
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- spark源码学习☆299Jan 21, 2016Updated 10 years ago
- ☆179Sep 3, 2017Updated 8 years ago
- Interactive and Reactive Data Science using Scala and Spark.☆3,150May 16, 2023Updated 2 years ago
- High performance data store solution☆1,446Mar 17, 2026Updated 3 weeks ago
- Examples for High Performance Spark☆528Mar 30, 2026Updated 2 weeks ago
- Apache Kylin☆3,765Mar 13, 2026Updated last month
- Livy is an open source REST interface for interacting with Apache Spark from anywhere☆1,009Oct 5, 2022Updated 3 years ago
- The Internals of Spark SQL☆488Jan 25, 2026Updated 2 months ago
- The Internals of Spark Structured Streaming☆423Mar 3, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Ta…☆15,051Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,615Updated this week
- Apache Calcite☆5,108Updated this week
- Apache Iceberg☆8,740Updated this week
- Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang☆15,090Mar 30, 2026Updated 2 weeks ago
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆820Apr 1, 2026Updated 2 weeks ago
- A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, orga…☆2,263Apr 9, 2026Updated last week