An ETL framework in Scala for Data Engineers
☆23Aug 30, 2022Updated 4 years ago
Alternatives and similar repositories for MyDataFramework
Users that are interested in MyDataFramework are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project describes how to write full ETL data pipeline using spark.☆15Oct 15, 2022Updated 3 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Jun 7, 2021Updated 5 years ago
- ☆21Aug 26, 2025Updated last year
- A simple Spark-powered ETL framework that just works 🍺☆186Oct 2, 2025Updated 11 months ago
- Apache Beam starter repo for Python☆22Sep 4, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Atomic Scala Book Solutions - for Beginners and first time Functional Programmers☆12Mar 10, 2020Updated 6 years ago
- Stream Processing Workshop☆24Jul 1, 2026Updated 2 months ago
- This repository has a tool and an API for Saudi CERT alerts. Its goal is to help improve the level of cybersecurity awareness in Saudi Ar…☆13Nov 16, 2023Updated 2 years ago
- This repo contains all codes of the articles that I have published on Medium☆10Feb 10, 2021Updated 5 years ago
- ☆14Jun 30, 2026Updated 3 months ago
- web crawler☆14Sep 27, 2022Updated 4 years ago
- This repository contains code for Spark Streaming☆26Mar 11, 2021Updated 5 years ago
- My terminal setup and config files☆14Oct 30, 2018Updated 7 years ago
- GitHub notifications tracker for Telegram. Pushes GitHub notifications to Telegram.☆13Jan 25, 2018Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Firefox extension that shows parquet schema when going over GCP cloud storage. Use DuckDB WASM☆11Jan 19, 2024Updated 2 years ago
- Redshift Proof of Concepts☆10Aug 27, 2015Updated 11 years ago
- 🗺️ An interactive scratch off map. Keep track of which places you have been, how much of the world you have conquered, and where to go n…☆11Mar 26, 2026Updated 6 months ago
- Another, hopefully better, implementation of ALS on Spark☆14May 20, 2015Updated 11 years ago
- Run spark calculations from Almond☆118Updated this week
- A MapReduce implementation of HashToMin for finding Connected Components in a graph.☆10May 18, 2016Updated 10 years ago
- For organization discussion and materials☆13Dec 10, 2018Updated 7 years ago
- Horizon Exchange REST API Server☆11Sep 17, 2026Updated last week
- A library for reading and writing Protobuf3 data from Spark RDDs.☆11Jun 28, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Scala wrapper for EOS RPC API☆15Jul 23, 2018Updated 8 years ago
- 大规模图数据交互式可视化分析平台☆14Apr 23, 2018Updated 8 years ago
- Active Learning framework for Natural Language Processing of pathology reports.☆12Dec 8, 2021Updated 4 years ago
- A Scala wrapper for the Spotify Web API☆14Apr 24, 2022Updated 4 years ago
- Hands-On Data Science for Marketing, published by Packt☆10Apr 4, 2019Updated 7 years ago
- Playing with different packages of the Apache Spark☆29Feb 8, 2026Updated 7 months ago
- ☆10Oct 12, 2021Updated 4 years ago
- Scheduler of events for near real-time systems☆32Aug 21, 2025Updated last year
- ☆12Jul 20, 2015Updated 11 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- crumbling large graphs into connected components☆12Jan 8, 2018Updated 8 years ago
- Capgemini UK Software Engineering Grade Ladder☆12Apr 12, 2023Updated 3 years ago
- Naqa API is a RESTful service designed to provide data on the purification process of Saudi stocks.☆15Aug 29, 2025Updated last year
- Extension that can be used to receive events from a Kafka cluster and to publish events to a Kafka cluster☆18Updated this week
- ☆66Jan 9, 2019Updated 7 years ago
- An Elder Scrolls neural name generator trained using PyTorch☆10Jan 29, 2019Updated 7 years ago
- The data pipeline services extracting & transforming data from our museum and collections.☆16Updated this week