A curated list of awesome Apache Spark packages and resources.
☆1,893Feb 27, 2026Updated 6 months ago
Alternatives and similar repositories for awesome-spark
Users that are interested in awesome-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks☆358Jun 6, 2017Updated 9 years ago
- A curated list of amazingly awesome Hadoop and Hadoop ecosystem resources☆1,117May 7, 2024Updated 2 years ago
- Real-world Spark pipelines examples☆82Feb 27, 2018Updated 8 years ago
- a curated list of awesome streaming frameworks, applications, etc☆3,013Updated this week
- A curated list of awesome big data frameworks, ressources and other awesomeness.☆14,623Jul 31, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A curated list of data engineering tools for software developers☆9,033Updated this week
- The Internals of Apache Spark☆1,550Jul 18, 2026Updated last month
- Notes talking about the design and implementation of Apache Spark☆5,362Apr 2, 2024Updated 2 years ago
- A community driven list of useful Scala libraries, frameworks and software.☆9,241Sep 20, 2024Updated last year
- Essential Spark extensions and helper methods ✨😲☆767Jun 22, 2026Updated 2 months ago
- REST job server for Apache Spark☆2,836Mar 3, 2026Updated 6 months ago
- Curated list of resources about Apache Airflow☆3,925Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,990Updated this week
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,643Aug 31, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks☆1,660Mar 16, 2024Updated 2 years ago
- Apache Spark - A unified analytics engine for large-scale data processing☆43,967Updated this week
- Qubole Sparklens tool for performance tuning Apache Spark☆593Jun 26, 2024Updated 2 years ago
- Interactive and Reactive Data Science using Scala and Spark.☆3,140May 16, 2023Updated 3 years ago
- Databricks Scala Coding Style Guide☆2,808Apr 5, 2024Updated 2 years ago
- Spark: The Definitive Guide's Code Repository☆3,152Aug 26, 2020Updated 6 years ago
- The Internals of Spark SQL☆490Jan 25, 2026Updated 7 months ago
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆457Apr 2, 2026Updated 5 months ago
- Spark style guide☆272Sep 30, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Base classes to use when writing tests with Spark☆1,555Aug 31, 2026Updated last week
- A curated list of awesome HBase projects and resources.☆180May 18, 2026Updated 3 months ago
- 😎 A curated list of amazingly awesome Flink and Flink ecosystem resources☆777Jun 8, 2023Updated 3 years ago
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆827May 19, 2026Updated 3 months ago
- Implementing best practices for PySpark ETL jobs and applications.☆2,118Jan 1, 2023Updated 3 years ago
- Deep Learning Pipelines for Apache Spark☆1,987Mar 30, 2023Updated 3 years ago
- Jupyter magics and kernels for working with remote Spark clusters☆1,366Sep 9, 2025Updated last year
- Apache Spark Awesome List☆14Apr 17, 2016Updated 10 years ago
- State of the Art Natural Language Processing☆4,158Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Koalas: pandas API on Apache Spark☆3,374Mar 20, 2024Updated 2 years ago
- Examples for High Performance Spark☆535May 3, 2026Updated 4 months ago
- A free tutorial for Apache Spark.☆988Jan 5, 2026Updated 8 months ago
- [DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark☆743Jul 30, 2024Updated 2 years ago
- Serverless proxy for Spark cluster☆326Apr 13, 2026Updated 4 months ago
- Example code from Learning Spark book☆3,894Jun 30, 2026Updated 2 months ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆344May 31, 2024Updated 2 years ago