DIYBigData / pyspark-benchmark

Related projects ⓘ

Alternatives and complementary repositories for pyspark-benchmark

• yennanliu / spark-etl-pipeline
  Various data stream/batch process demo with Apache Scala Spark 🚀
  ☆11Updated 4 years ago
• DIYBigData / spark-data-analysis-projects
  A collection of data analysis projects done using PySpark via Jupyter notebooks.
  ☆10Updated 2 years ago
• NeerajBhadani / spark-streaming
  This repository contains code for Spark Streaming
  ☆21Updated 3 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• stream-processing-with-spark / notebooks
  Interactive Notebooks that support the book
  ☆38Updated 4 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆53Updated last year
• NVIDIA / spark-xgboost-examples
  XGBoost GPU accelerated on Spark example applications
  ☆52Updated 2 years ago
• oap-project / oap-tools
  Tools for building, packaging, and OAP public cloud integrations such as AWS EMR, Google Dataproc and K8S.
  ☆16Updated 7 months ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆35Updated last year
• drabastomek / PySparkCookbook
  A repository for a PySpark Cookbook by Tomasz Drabas and Denny Lee
  ☆60Updated 6 years ago
• jaceklaskowski / spark-delta-lake-workshop
  Spark and Delta Lake Workshop
  ☆22Updated 2 years ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 2 years ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆101Updated last month
• mahmoudparsian / data-algorithms-with-spark
  O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
  ☆209Updated last year
• rapidsai / spark-examples
  [ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples
  ☆70Updated 4 years ago
• LucaCanali / Miscellaneous
  Includes notes on using Apache Spark in general, notes on using Spark for Physics, how to run TPCDS on PySpark, how to create histograms …
  ☆424Updated 2 months ago
• NVIDIA / spark-rapids-examples
  A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.
  ☆127Updated this week
• monte-carlo-data / data-observability-in-practice
  Source code for the MC technical blog post "Data Observability in Practice Using SQL"
  ☆36Updated 4 months ago
• developer-advocacy-dremio / definitive-guide-to-apache-iceberg
  ☆49Updated 8 months ago
• rberenguel / pyspark-arrow-pandas
  Presentation about Pyspark and how Arrow makes it faster
  ☆22Updated 4 years ago
• prestodb / f8-2019-demo
  A tutorial on how to get started with Presto.
  ☆56Updated 2 years ago
• JoseRFJuniorLLMs / PySpark-ETL
  PySpark-ETL
  ☆23Updated 4 years ago
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆29Updated 4 years ago
• vivek-bombatkar / MyLearningNotes
  Because its never late to start taking notes and 'public' it...
  ☆60Updated this week
• akashmehta10 / cdc_pyspark_hive
  ☆22Updated 2 years ago
• IBM / spark-tpc-ds-performance-test
  Use the TPC-DS benchmark to test Spark SQL performance
  ☆175Updated 4 years ago
• japila-books / pyspark-internals
  The Internals of PySpark
  ☆25Updated 2 months ago