Various data stream/batch process demo with Apache Scala Spark π
β12Feb 28, 2020Updated 6 years ago
Alternatives and similar repositories for spark-etl-pipeline
Users that are interested in spark-etl-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multi-stage, config driven, SQL based ETL framework using PySparkβ26Sep 16, 2019Updated 6 years ago
- Our style guide for writing readable and maintainable PySpark code.β17Dec 21, 2021Updated 4 years ago
- Learning PySpark video seriesβ11Mar 5, 2018Updated 8 years ago
- A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.β33Aug 14, 2023Updated 2 years ago
- β10Jul 31, 2019Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Listing my favorite research papers π from different fields as I read them.β10Oct 17, 2019Updated 6 years ago
- Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and pβ¦β25Jun 4, 2019Updated 7 years ago
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computinβ¦β24Aug 11, 2023Updated 2 years ago
- Indie game project driven by a few enthusiasts.β15Aug 25, 2017Updated 8 years ago
- β10Feb 12, 2021Updated 5 years ago
- Code for training on Imagenet to SOTA results using PyTorchβ13Aug 14, 2023Updated 2 years ago
- Botoflow is an asynchronous framework for Amazon SWF that helps you build SWF applications using Pythonβ13Dec 26, 2022Updated 3 years ago
- Code for the blog postβ12Jan 15, 2021Updated 5 years ago
- Spark data pipeline that processes movie ratings data.β31Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Python script to swoop and decrypt passwords from Chrome's local storage.β11Dec 10, 2018Updated 7 years ago
- curated list of awesome open source repositories for data pipelining and machine learning in production.β17Dec 1, 2019Updated 6 years ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract dβ¦β24Nov 22, 2021Updated 4 years ago
- Python scripts for Agisoft Photoscanβ12Jun 18, 2015Updated 11 years ago
- Dump the saved wifi passwords for windows using regular expressions and python 3β17Dec 22, 2016Updated 9 years ago
- β13Jun 7, 2018Updated 8 years ago
- Solving Captchas using Deep Learningβ13Apr 17, 2023Updated 3 years ago
- Minimalist implementation of VQ-VAE in Pytorchβ10Sep 9, 2018Updated 7 years ago
- How to customize Tableau authentication using the AWS Athena's JDBC Credentials Provider capabilites.β14Jun 8, 2020Updated 6 years ago
- Managed Database hosting by DigitalOcean β’ AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- We store attacks and exploits that we've found useful in our researchβ13Jun 4, 2015Updated 11 years ago
- β10Dec 16, 2022Updated 3 years ago
- Repository for Google Cloud Run Deep Diveβ11Jul 8, 2020Updated 6 years ago
- Movie recommender system with Collaborative Filtering using PySparkβ28Apr 17, 2017Updated 9 years ago
- A Rust based data/CSV/Parquet file generatorβ66Mar 3, 2025Updated last year
- Daily-updated reading list for designing High Scalability , High Availability , High Stability back-end systems - Pull requests are greβ¦β15Jul 14, 2022Updated 4 years ago
- β12Aug 6, 2020Updated 5 years ago
- The purpose of this app is to enable users to log their runs and share their activity with other users on the platformβ18Feb 11, 2019Updated 7 years ago
- SolveDB: A PostgreSQL-based DBMS for optimization applicationsβ18Mar 1, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Android Custom Firebase Phone Verificationβ17Mar 11, 2026Updated 4 months ago
- Scripts for the Python API in PhotoScanβ17Sep 1, 2015Updated 10 years ago
- Subscriber Registry API and SIP Authentication Serverβ19Jul 13, 2016Updated 10 years ago
- Scala library for alpaca.marketsβ12Aug 5, 2019Updated 6 years ago
- Text books and programming problem websitesβ12Apr 22, 2026Updated 3 months ago
- β13Feb 27, 2018Updated 8 years ago
- Examples of using various APIs from (mostly) Pythonβ16Jul 24, 2022Updated 4 years ago