n-surkov/PySparkPipeline external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

n-surkov/PySparkPipeline

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/n-surkov/PySparkPipeline)

Close

n-surkov / PySparkPipelineView on GitHubMore

• External links
• Readme badge

Module for pipelines concept in PySpark

☆16Mar 27, 2024Updated last year

Alternatives and similar repositories for PySparkPipeline

Users that are interested in PySparkPipeline are comparing it to the libraries listed below

• art591 / lsml-2024

  View on GitHub
  ☆13Mar 22, 2024Updated last year
• PastorGL / datacooker-etl

  View on GitHub
  ETL processing toolset with SQL-like language and GIS capabilities, built on core Spark. Extensible and modular. REPL included
  ☆16Jan 26, 2026Updated last month
• Raiffeisen-DGTL / zaychik-trino-proxy

  View on GitHub
  ☆22Dec 18, 2024Updated last year
• skoonData / docker-compose

  View on GitHub
  ☆12Jul 27, 2021Updated 4 years ago
• Balun-courses / system_design

  View on GitHub
  Repository for course by System Design
  ☆37May 16, 2023Updated 2 years ago
• antonvedaet / stock-market-price-forecast

  View on GitHub
  ☆10Jun 29, 2021Updated 4 years ago
• goyder / autoreporting

  View on GitHub
  ☆10Dec 29, 2018Updated 7 years ago
• Sapunov / yandex-backend-school-arch-lecture

  View on GitHub
  ☆36Sep 3, 2022Updated 3 years ago
• khanhnguyendata / logweight

  View on GitHub
  Analyze my weight loss journey
  ☆12Oct 27, 2019Updated 6 years ago
• ADKosm / lsml-2023-public

  View on GitHub
  Materials for LSML 2023 (HSE)
  ☆10Mar 21, 2023Updated 2 years ago
• amelinvladimir / clickhouse_course

  View on GitHub
  ☆17Jan 12, 2026Updated last month
• shadowofseaice / yabs.nvim

  View on GitHub
  ☆11Aug 14, 2022Updated 3 years ago
• datamarts / prostore

  View on GitHub
  Project is in active development and has been moved to https://repository.datamart.ru/datamarts/prostore.
  ☆17Apr 22, 2022Updated 3 years ago
• chilcano / docker-netcat

  View on GitHub
  The `netcat` container, the Swiss army knife of networking tool, Dockerized !
  ☆10Jul 4, 2018Updated 7 years ago
• polyzos / kafka-streaming-ledger

  View on GitHub
  ☆13Jan 23, 2023Updated 3 years ago
• tizuck / scala-uml

  View on GitHub
  Scala-based project to visualize Scala programs in UML class diagrams.
  ☆12Aug 30, 2023Updated 2 years ago
• obulygin / pyda_homeworks

  View on GitHub
  ☆15May 7, 2025Updated 9 months ago
• SimitTomar / webdriverio-cucumber-pom-boilerplate

  View on GitHub
  A WebdriverIO & Cucumber Boilerplate based on Page Object Model!
  ☆10Jan 26, 2023Updated 3 years ago
• ne-coding / Yandex.Wordstat-parser

  View on GitHub
  Simple class for parsing left and right column for Yandex Wordstat via Direct API
  ☆13Feb 27, 2022Updated 4 years ago
• dkandalov / tictactoe4k

  View on GitHub
  Source code and slides for the tictactoe4k talk
  ☆12May 2, 2023Updated 2 years ago
• vomikan / NiFi_Lab

  View on GitHub
  ☆17Dec 2, 2025Updated 2 months ago
• MohannedA / Arduino_Kafka_Dashboard

  View on GitHub
  Simple dashboard (follows MVC pattern) for monitoring temperature, humidity, gas, and sound Arduino sensors via using Kafka (stream-proce…
  ☆11Mar 1, 2023Updated 3 years ago
• rockthejvm / spark-cluster-docker

  View on GitHub
  ☆10Mar 12, 2021Updated 4 years ago
• python-generation / Professional

  View on GitHub
  Тесты к курсу для профессионалов
  ☆11Jan 16, 2026Updated last month
• vaniacer / DDT

  View on GitHub
  Download Dump and Test it
  ☆11Nov 15, 2024Updated last year
• gwvsol / flask-telegram-bot

  View on GitHub
  Flask Telegram Bot
  ☆11Dec 8, 2022Updated 3 years ago
• DanteLore / bdd-pyspark

  View on GitHub
  Simple demo using "behave" and "pyspark" libraries to test data transformations in a human-readable way
  ☆10Apr 5, 2019Updated 6 years ago
• treyhakanson / 2019-pyohio-luigi

  View on GitHub
  2019 PyOhio talk and code sample on spotify/luigi
  ☆11Aug 14, 2023Updated 2 years ago
• OtusTeam / data-engineer

  View on GitHub
  ☆12May 19, 2021Updated 4 years ago
• rusexpertiza-llc / yupana

  View on GitHub
  BigData analytics platform
  ☆18Feb 21, 2026Updated last week
• Palladain / Deep_Python_2024

  View on GitHub
  ☆26Dec 15, 2024Updated last year
• mmta-team / mmta_2021_fall

  View on GitHub
  Лекции и материалы по курсам "Математические методы анализа текстов" осеннего семестра 2021 года для студентов кафедры ММП, ВМК МГУ и каф…
  ☆11Jan 11, 2022Updated 4 years ago
• ongxuanhong / de02-pyspark-optimization

  View on GitHub
  ☆14Mar 11, 2023Updated 2 years ago
• ejulio / spider-feeder

  View on GitHub
  A library to make it easier to load input URLs to start scrapy processes
  ☆14Feb 21, 2021Updated 5 years ago
• romulovieira777 / Data_Engineering_Essentials_Hands_on_SQL_Python_and_Spark

  View on GitHub
  ☆13Feb 18, 2022Updated 4 years ago
• lowks / Airflow

  View on GitHub
  AirFlow is a system to programmaticaly author, schedule and monitor data pipelines.
  ☆13Jan 17, 2015Updated 11 years ago
• deordie / deordie-meetups

  View on GitHub
  DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.
  ☆58Jan 6, 2024Updated 2 years ago
• dmlogv / airflow-tutorial

  View on GitHub
  Learning resources for Airflow Tutorial article.
  ☆56Jul 22, 2020Updated 5 years ago
• derwasp / ua-it-in-nl

  View on GitHub
  ☆17Nov 7, 2024Updated last year