My Setup Development Environment as Data Engineer
☆38Aug 5, 2025Updated 9 months ago
Alternatives and similar repositories for dotfile
Users that are interested in dotfile are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A demo instance of mage for pulling sample data from a public Google pub/sub topic and transforming with dbt.☆12Jan 5, 2024Updated 2 years ago
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆23Nov 19, 2024Updated last year
- A quickstart repo for Mage using Docker compose.☆19Feb 1, 2024Updated 2 years ago
- A simple demo showing how to use Ably and fastAPI to route messages into Kafka for stream processing☆16Oct 12, 2021Updated 4 years ago
- Data Guy Story commandline☆11Dec 2, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10May 26, 2023Updated 3 years ago
- Deployed an kafka instance in AWS EC2 Instance to streamline the data into Databricks☆10Aug 15, 2023Updated 2 years ago
- Source code for 'Pro Power BI Desktop' by Adam Aspin☆13Mar 28, 2017Updated 9 years ago
- This provider contains operators, decorators and triggers to send a ray job from an airflow task☆25Oct 27, 2025Updated 6 months ago
- ELT Data Pipeline implementation in Data Warehousing environment☆30May 2, 2025Updated last year
- ☆13Sep 5, 2025Updated 8 months ago
- Zalo AI Challenge 2020: News Summarization - Runner-up solution☆20Dec 4, 2020Updated 5 years ago
- Source code for 'Pro Power BI Desktop' by Adam Aspin☆22Dec 4, 2017Updated 8 years ago
- ☆13May 11, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Source code for 'Power Query for Power BI and Excel' by Christopher Webb and Crossjoin Consulting Limited☆19Aug 18, 2017Updated 8 years ago
- End to end data engineering project☆59Oct 27, 2022Updated 3 years ago
- This is a PDI plugin that allows execution of Python code.☆35Nov 19, 2020Updated 5 years ago
- 🚗 Downloads a Google Drive folder that you can query with gatsby-source-filesystem.☆12Mar 2, 2023Updated 3 years ago
- Data Engineering with AWS Cookbook, published by Packt☆26Apr 13, 2026Updated last month
- SIEM, Visibility, and Event-Driven Architecture Curated Solutions. Build a cost-effective threat detection and log management system.☆20Jan 17, 2024Updated 2 years ago
- ICONIP2021 - A Vietnamese Medical Dataset for IC and NER☆25Aug 8, 2023Updated 2 years ago
- Data engineering with dbt, published by Packt☆103Sep 2, 2025Updated 8 months ago
- Gatsby transformer plugin for jupyter notebooks☆10Jan 7, 2019Updated 7 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- PyTorch library for breast cancer metastasis detection in whole-slide images of sentinel lymph node tissue from the Camelyon dataset☆15Nov 25, 2019Updated 6 years ago
- Fullstack machine learning inference template☆31Nov 24, 2023Updated 2 years ago
- Data Engineering with Python, published by Packt☆795Jan 30, 2023Updated 3 years ago
- Template for a DuckDB-based, Codespace-oriented sandbox project that is also dbt Cloud compatible, and includes code-first BI tooling via…☆17Apr 7, 2023Updated 3 years ago
- This is the "Modern" theme I currently use on nick.groenen.me. It is a fork of the Hello Friend theme by panr.☆10Mar 22, 2023Updated 3 years ago
- docker images for class☆10Jul 27, 2021Updated 4 years ago
- Increase the inference speed of the model☆19Jun 7, 2022Updated 3 years ago
- Repo for Introduction to Iceberg Video☆22Jun 3, 2024Updated last year
- Local single kafka instance + schema registry + zookeeper to be used as local development.☆22Mar 3, 2022Updated 4 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Landing Page for Pycon ID 2020☆12Aug 29, 2021Updated 4 years ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆25Aug 30, 2022Updated 3 years ago
- ☆34Nov 25, 2023Updated 2 years ago
- A tutorial for the Great Expectations library.☆71Feb 11, 2021Updated 5 years ago
- This project involves an ETL (Extract, Transform, Load) process to analyze sleep data exported from Apple Health☆29Apr 29, 2023Updated 3 years ago
- A postman collection for use with Xero's API and OAuth 2.0☆28Aug 10, 2023Updated 2 years ago
- ☆173May 20, 2022Updated 4 years ago