This project describes how to write full ETL data pipeline using spark.
☆15Oct 15, 2022Updated 4 years ago
Alternatives and similar repositories for spark-data-pipeline
Users that are interested in spark-data-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Kafka Connect connector for receiving data and writing data to Splunk.☆25Nov 7, 2017Updated 8 years ago
- ☆14Jan 1, 2020Updated 6 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆14May 25, 2023Updated 3 years ago
- My documents for self-learning fundamental of Data engineering skills☆14Aug 5, 2023Updated 3 years ago
- ☆64Nov 8, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆21Jan 13, 2024Updated 2 years ago
- Simulation of job offers and CVs with real-time processing, classification, and analytics using Kafka, Ray, Spark, and Databricks. Includ…☆14Dec 25, 2024Updated last year
- Blogpost☆10Mar 2, 2018Updated 8 years ago
- Create Kafka-Connect clusters with docker . You put the Kafka, we put the Connect.☆25Mar 27, 2019Updated 7 years ago
- An Apache Spark app for making data movement between Apache Hive and Apache Phoenix/HBase☆14Mar 23, 2016Updated 10 years ago
- ☆10May 25, 2017Updated 9 years ago
- A database with automatic dynamic imputation of missing values.☆11Nov 2, 2017Updated 9 years ago
- Cloudformation to create and update an ECS cluster that runs jenkins☆11May 30, 2023Updated 3 years ago
- https://github.com/uavorg/uavstack☆10Sep 11, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆15Jan 3, 2015Updated 11 years ago
- My HackerRank Solutions : https://www.hackerrank.com/RohanKhude☆12Jul 13, 2016Updated 10 years ago
- Real-time motion planner and autonomous vehicle simulator in the browser, built with WebGL and Three.js.☆13Jun 25, 2026Updated 4 months ago
- Kafka Connect connector for CDC data from postgres☆11Aug 27, 2017Updated 9 years ago
- Code for my talk "Stateful & Reactive Streaming Applications Without a Database" at WeAreDevelopers 2018☆11May 20, 2018Updated 8 years ago
- ☆11Jul 13, 2020Updated 6 years ago
- A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.☆12Apr 1, 2017Updated 9 years ago
- Event ticketing system with Next.js and Appwrite☆10Jun 22, 2023Updated 3 years ago
- Algorithms and Data Structures implemented in Java☆12Jul 28, 2019Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A MapReduce implementation of HashToMin for finding Connected Components in a graph.☆10May 18, 2016Updated 10 years ago
- For organization discussion and materials☆13Dec 10, 2018Updated 7 years ago
- NICTA Named Entity Recogniser is a rule based Named Entity Recogniser which extracts named entities from text such as Organisation, Locat…☆16Apr 15, 2023Updated 3 years ago
- KBQA☆14Mar 13, 2017Updated 9 years ago
- Right whale recognition☆55Dec 16, 2015Updated 10 years ago
- Stepper allows you to write AWS Step Functions using a higher level programmatic language.☆16Jul 27, 2019Updated 7 years ago
- ☆13Mar 9, 2017Updated 9 years ago
- free bike for everyone☆15Aug 20, 2019Updated 7 years ago
- Code for Tutorial on designing clickstream analytics application using Hadoop☆55May 20, 2015Updated 11 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Data Quality Monitoring Tool☆15Dec 5, 2017Updated 8 years ago
- Reading list of the topic about utilizing vehicle generated GPS data to update road networks☆14Jul 18, 2018Updated 8 years ago
- ☆15Jan 17, 2022Updated 4 years ago
- ArangoDB Connector for Apache Spark, using the Spark DataSource API☆13Sep 28, 2026Updated last month
- Spark stream from kafka(json) to s3(parquet)☆15Nov 8, 2018Updated 7 years ago
- [UNMAINTAINED] Control your Parrot AR Drone with your keyboard☆17Aug 10, 2013Updated 13 years ago
- 🎁 Shows recommended files in Nextcloud☆16Updated this week