Production-grade distributed data engineering labs focused on Spark internals, large-scale performance tuning, skew handling, streaming state management, and FAANG-level system design.
☆18Mar 17, 2026Updated 5 months ago
Alternatives and similar repositories for Data_engineering_labs
Users that are interested in Data_engineering_labs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 170+ curated resources every Databricks Data Engineer should bookmark - tools, courses, creators, labs, and communities☆49Jul 13, 2026Updated 2 months ago
- This repository contains NiFi processors for interacting with Snowflake Cloud Data Platform.☆13Jul 10, 2026Updated 2 months ago
- Starter Repository for the Complete dbt Bootcamp Zero to Hero Course☆23Sep 5, 2026Updated last week
- Teaching materials (lectures and code examples) for 3rd year DSBA students at IT KMITL☆23Mar 12, 2026Updated 6 months ago
- Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction …☆12Jul 5, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆14May 29, 2025Updated last year
- This demo shows how to capture data changes from relational databases (Oracle and PostgreSQL) and stream them to Confluent Cloud, use ksq…☆17Jan 10, 2025Updated last year
- Repositorio dedicado a la aplicación práctica de métodos estadísticos en Ciencia de Datos, incluyendo análisis exploratorio, pruebas de h…☆22Jun 14, 2026Updated 3 months ago
- An Open Source Machine Learning Framework for Everyone☆10May 28, 2020Updated 6 years ago
- 06026241 MACHINE LEARNING OPERATIONS☆36Mar 4, 2026Updated 6 months ago
- ☆10Jun 29, 2021Updated 5 years ago
- ☆16Oct 8, 2025Updated 11 months ago
- Discussion forum for LearnAlgorithm's “7-Days of Data Structure and Algorithm Fundamentals” course☆16Nov 21, 2024Updated last year
- ☆14Sep 1, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆24May 1, 2024Updated 2 years ago
- An event streaming pipeline built using Kafka, KSQL, Faust, and Spark Structured Streaming☆12Sep 12, 2020Updated 6 years ago
- A collection of pipelines for Scrapy☆16Sep 3, 2026Updated last week
- Code, notebooks and examples that accompany papers and presentations from SAS Global Forum 2021☆10Jun 4, 2021Updated 5 years ago
- Script and pipeline for BRAINcode project☆17Aug 28, 2026Updated 2 weeks ago
- Research prototype for new register_template_loaders LLM plugin hook☆20Apr 7, 2025Updated last year
- Self-hosted PaaS for private infrastructure. Deploy 200+ services on any server in one click. GPU monitoring, AI model management, VRA…☆41Sep 3, 2026Updated last week
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago
- list of papers, code, and other resources☆10Feb 6, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 5 years ago
- ☆17Jan 5, 2023Updated 3 years ago
- Python wrapper for Goodreads API☆30Feb 20, 2020Updated 6 years ago
- Contains almost all important question with solution☆15Jul 3, 2026Updated 2 months ago
- basic Open WebUI + Ollama stack for Local ChatGPT☆37Jan 28, 2026Updated 7 months ago
- kaggle competition: https://www.kaggle.com/c/web-traffic-time-series-forecasting☆16Sep 12, 2017Updated 9 years ago
- This is a collecton of CDK projects to show how to load data from streaming services into Amazon Redshift.☆13Sep 10, 2024Updated 2 years ago
- ☆19May 26, 2019Updated 7 years ago
- Course project☆15Apr 20, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Deploying a Machine Learning model streaming application with Apache Kafka☆11Aug 21, 2022Updated 4 years ago
- Public repository for sharing talk materials☆13Aug 15, 2024Updated 2 years ago
- ☆19Jun 25, 2026Updated 2 months ago
- Scalable OLAP system for credit card transaction analysis, leveraging AWS S3, Databricks, and dbt. Features end-to-end batch processing p…☆26Oct 24, 2024Updated last year
- Jupyter notebook tutorials for various machine learning applications☆10Apr 6, 2026Updated 5 months ago
- Core Java live course 2025☆19Aug 1, 2025Updated last year
- Data Streaming Nanodegree (from Udacity) exercises, projects and their solutions☆17Aug 14, 2023Updated 3 years ago