Data pipeline project
☆57Feb 11, 2025Updated last year
Alternatives and similar repositories for Data-pipeline-project
Users that are interested in Data-pipeline-project are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆23Feb 8, 2023Updated 3 years ago
- Apache Spark using SQL☆14Aug 18, 2021Updated 5 years ago
- ☆18Aug 15, 2022Updated 4 years ago
- Apache Spark Guide☆38Feb 1, 2022Updated 4 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆50Dec 2, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆26Jan 31, 2023Updated 3 years ago
- ETL (Extract, Transform and Load) with the Spark Python API (PySpark) and Hadoop Distributed File System (HDFS)☆17Dec 18, 2018Updated 7 years ago
- Hands-On DevOps with Ansible [Video], Published By Packt☆14Jan 15, 2021Updated 5 years ago
- Comprehensive study materials covering core data engineering concepts, tools, and practices.☆18Jan 20, 2026Updated 7 months ago
- Bencode encoding and decoding in Go.☆11Mar 8, 2024Updated 2 years ago
- This workshop is meant to give customers a hands-on experience with mentioned AWS services. Serverless Data Lake workshop helps customer…☆38Feb 9, 2021Updated 5 years ago
- Data cleaning, pre-processing, and Analytics on a Health care data using Spark and Python.☆50Jul 19, 2023Updated 3 years ago
- Multi-class hallucination detection for LLM safety using contextual NLP classification. Supports experiment tracking with MLflow and mode…☆15Mar 10, 2026Updated 5 months ago
- Engineered an advanced deep learning model to automate the classification of financial documents, including Balance Sheets, Cash Flow and…☆11Jul 19, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A simple GraphQL API demonstration application for managing a movie information☆12Jun 1, 2020Updated 6 years ago
- ☆57Aug 14, 2024Updated 2 years ago
- Toy Hadoop cluster combining various SQL-on-Hadoop variants☆13Nov 16, 2017Updated 8 years ago
- Code for NeurIPS 2024 paper "A SARS-CoV-2 Interaction Dataset and VHH Sequence Corpus for Antibody Language Models"☆17Oct 17, 2024Updated last year
- The goal of this project is to analyse the impact of Covid-19 on the Aviation industry through data engineering processes using technolog…☆13Jun 26, 2022Updated 4 years ago
- Đồ án tốt nghiệp | Data Lakehouse☆48Feb 9, 2026Updated 6 months ago
- BED-AIO team code for AIChallenge2023☆44Jul 30, 2024Updated 2 years ago
- ☆69Feb 25, 2024Updated 2 years ago
- Big Data project using Hadoop (MapReduce, spark, Hive)☆32Dec 10, 2019Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- My Portfolio of all the projects I did for both my Udacity Data Engineer and Data Streaming Nanodegrees☆21Jul 16, 2020Updated 6 years ago
- Dockerized analytics pipeline where Airflow moves mock-API data into Postgres, runs dbt transformations, and serves clean tables for Powe…☆84Oct 18, 2025Updated 10 months ago
- An example CI/CD pipeline using GitHub Actions for doing continuous deployment of AWS Glue jobs built on PySpark and Jupyter Notebooks.☆13Oct 15, 2020Updated 5 years ago
- ☆13Feb 18, 2021Updated 5 years ago
- ☆13Apr 14, 2023Updated 3 years ago
- Build and run Spark Structured Streaming pipelines in Hadoop - project using PySpark.☆13Jun 6, 2019Updated 7 years ago
- Awesome content all about Azure Databricks☆20Dec 21, 2021Updated 4 years ago
- ☆30May 16, 2023Updated 3 years ago
- Create an advanced data engineering pipeline that processes and analyzes sales data from an e-commerce website using Apache Airflow for w…☆12Aug 28, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Run dynamic SQL in SQL. This package allows queries with an unknown number of select-list items and can solve challenging problems like d…☆12Oct 5, 2024Updated last year
- Extract, transform, and load data for analytic processing using AWS Glue☆17May 2, 2021Updated 5 years ago
- Jordan Cheah's Data Science & Data Engineering Portfolio☆27May 23, 2016Updated 10 years ago
- ☆13Feb 18, 2022Updated 4 years ago
- Public GitHub repo for SciPy 2022 tutorial (Introduction to Numerical Computing With NumPy)☆13Aug 24, 2022Updated 4 years ago
- A Genetic Algorithms framework for Hadoop MapReduce.☆10May 30, 2018Updated 8 years ago
- An online shopping cart using Clean Architecture and based on Mini-Web-Server☆12Jan 24, 2024Updated 2 years ago