The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a complete data pipeline with all components seamlessly set up and ready to use
☆18Dec 26, 2023Updated 2 years ago
Alternatives and similar repositories for bigdata-ETL-pipeline
Users that are interested in bigdata-ETL-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆43Dec 15, 2025Updated 8 months ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated last year
- Files for the Docker and Kubernetes on Google Cloud Hands-On labs☆11Mar 14, 2023Updated 3 years ago
- Short Range Ultrasonic Radar - A simple radar using the ultrasonic sensor, this radar works by measuring a range from 3cm to 40 cm as non…☆19Nov 11, 2024Updated last year
- Hands-on workshop with Apache Iceberg☆15Mar 13, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆82Sep 2, 2023Updated 2 years ago
- End-to-End deployment of E-commerce customers segmentation using Clustering Machine learning algorithms in Google Cloud Platform and MLOp…☆22Jun 5, 2024Updated 2 years ago
- Template for projects in PyTorch powered with PyTorch Lightning, Telegrad and MLflow. Get updates on mobile and streamline PyTorch code f…☆10May 1, 2023Updated 3 years ago
- Solr benchmarking and load testing harness☆16Jan 7, 2025Updated last year
- A simple Perceptron in Python☆10Feb 11, 2022Updated 4 years ago
- Crawling the data from lazada, websosanh, compare.vn, cdiscount and cungmua with flexible configs☆30Jul 7, 2016Updated 10 years ago
- Some exercises to learn Spark. Solved in Python.☆21Oct 15, 2024Updated last year
- Spark and Hive docker containers sharing a common MySQL metastore☆26Apr 17, 2020Updated 6 years ago
- ☆14Jan 14, 2017Updated 9 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Completion of three Deep Q-Networks : Deep Q-Network (DQN), Double Deep Q-Network (DDQN), Double Dueling Deep Q-Network (D3QN)☆12Jun 26, 2021Updated 5 years ago
- Skribify is a powerful transcription and summarization tool that leverages the power of OpenAI's GPT-4 and WhisperAI to generate concise …☆12Aug 6, 2026Updated 3 weeks ago
- A Retail store management system - DBMS project (Sep 2015) written in Django (Python)☆11Aug 11, 2020Updated 6 years ago
- Doing sql in notebooks.☆15Aug 14, 2023Updated 3 years ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆34Feb 9, 2024Updated 2 years ago
- ☆10Jan 31, 2021Updated 5 years ago
- Ansible collection to deploy the components of TDP☆23Aug 14, 2026Updated 2 weeks ago
- ⚡ FutureGPT - Application development framework that connects GPT-4 with external data, the internet, other applications and language mod…☆13May 14, 2023Updated 3 years ago
- ☆13Jun 21, 2021Updated 5 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Kafka and Spark Integration. Alll code in maven project.☆14Jun 30, 2026Updated 2 months ago
- MCP Client and Server apps to demo integration of Azure OpenAI-based AI agent with a Data Warehouse, exposed through GraphQL in Microsoft…☆11Jul 6, 2025Updated last year
- The definitive end-to-end machine learning (ML lifecycle) guide and tutorial for data engineers.☆24Nov 14, 2024Updated last year
- This repository serves as a comprehensive guide to effective data modeling and robust data quality assurance using popular open-source to…☆44Sep 20, 2023Updated 2 years ago
- Minimal Implementation of Deep RL Algorithms in PyTorch☆26May 10, 2020Updated 6 years ago
- ☆51Jul 24, 2026Updated last month
- Building an API with the FastAPI framework to serve a scikit-learn model.☆18Jan 13, 2019Updated 7 years ago
- PyTorch Artificial Intelligence Fundamentals, published by Packt☆28Dec 15, 2025Updated 8 months ago
- An investment portfolio simulator☆12Oct 15, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Introductory interactive Jupyter tutorial providing details about ORMs in order to assist in the teaching of their use to computing scien…☆14Oct 21, 2025Updated 10 months ago
- This repo contains DAGs demonstrating a variety of ELT patterns using Airflow along with dbt.☆12Jan 12, 2023Updated 3 years ago
- A GitHub Action that analyses a Pull Request and adds unit tests if necessary / possible☆13Apr 29, 2023Updated 3 years ago
- Easily create an interactive motion chart from a Pandas dataframe in Python. Publish the chart as a standalone webpage, show it in Jupyte…☆19Jun 22, 2016Updated 10 years ago
- Revomatico Internship☆16Oct 19, 2017Updated 8 years ago
- Tests of how we can gather the most out of AutoGPT. Huge thanks to @Torantulino for this☆13Apr 16, 2023Updated 3 years ago
- Arm System Architecture: Architecture Compliance Suite☆20Updated this week