Spark, Airflow, Kafka
☆24Apr 30, 2023Updated 2 years ago
Alternatives and similar repositories for data-engineering
Users that are interested in data-engineering are comparing it to the libraries listed below
Sorting:
- This repository shows my personal notes taken while doing the Udacity Data engineering Nanodegree☆13May 28, 2020Updated 5 years ago
- Building Real Time Data Pipeline using Apache Kafka, Apache Spark, Hadoop, PostgreSQL, Django and Flexomonster on Docker to track status …☆23Dec 29, 2020Updated 5 years ago
- This is a recipe for docker container based architecture based on airflow, kafka,spark,docker☆20Oct 15, 2024Updated last year
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Jul 9, 2019Updated 6 years ago
- GRASS GIS module for wildfire simulation wrapping r.ros and r.spread modules☆11Dec 13, 2021Updated 4 years ago
- Node-RED Flow (and web page example) for the LLaMA AI model☆11Jul 27, 2023Updated 2 years ago
- Just a boilerplate for PySpark and Flask☆36Aug 2, 2018Updated 7 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆89Apr 29, 2019Updated 6 years ago
- Pytorch implementation of Nueral Style transfer☆10Jun 22, 2021Updated 4 years ago
- Scalable genomic analysis pipelines, written in WDL☆11Updated this week
- Online voter registration (OVR) application-as-a-service for 3rd party registrar organizations.☆11Updated this week
- Azure-Sentinel-BYOML☆12Nov 8, 2019Updated 6 years ago
- Hanya dokumentasi bagaimana menggunakan opencv pada python.☆12Updated this week
- Docker powered container for using Nginx as reverse-proxy in combination with an OpenVPN Client.☆11Jan 1, 2020Updated 6 years ago
- Vector extraction of data from scientific publications☆10Apr 26, 2023Updated 2 years ago
- An open platform for capturing, integrating, storing, and sharing biological knowledge in and across organizations.☆24Jan 28, 2017Updated 9 years ago
- A parameter-efficient compression model architecture for a variety of NLP tasks at BERT level performance at a fraction of the computatio…☆10Jan 25, 2026Updated last month
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10May 26, 2023Updated 2 years ago
- A ready to use template for the CRISP-DM data science workflow☆13Nov 14, 2025Updated 3 months ago
- Jetbot Voice to Action Tools is a set of ROS2 nodes that utilize the Jetson Automatic Speech Recognition (ASR) deep learning interface li…☆13Feb 6, 2026Updated 3 weeks ago
- Real-time Credit card Fraud detection using Spark Streaming, Spark ML, Spark SQL, Kafka, Cassandra and Airflow☆11Jul 1, 2022Updated 3 years ago
- Some functions to plot OpenFOAM data with Matplotlib☆11Apr 15, 2021Updated 4 years ago
- OpenNCC Frame☆12Oct 21, 2022Updated 3 years ago
- Collections of Slides for FOSS4G 2014☆10Sep 29, 2014Updated 11 years ago
- ☆11Mar 22, 2024Updated last year
- Yeoman generator for scaffolding Azure Service Fabric C# projects☆17Jul 12, 2023Updated 2 years ago
- Batch sentiment analysis with benthos and Knative☆10May 27, 2022Updated 3 years ago
- A library for calculating clinical quality measures☆28Jul 22, 2022Updated 3 years ago
- Champion at Brainhack TIL 2023: Team 10000SGDMRT☆18May 29, 2024Updated last year
- ☆10May 24, 2021Updated 4 years ago
- ☆17Feb 5, 2021Updated 5 years ago
- Project for "Data pipeline design patterns" blog.☆50Aug 6, 2024Updated last year
- A podcast transcription service built on Azure that transcribes any new episode of your podcast and displays synchronized transcripts alo…☆10Dec 10, 2022Updated 3 years ago
- Source Code for 'Beginning Apache Spark 3' by Hien Luu☆13Oct 14, 2021Updated 4 years ago
- My professional portfolio with some of my best data science projects.☆11Jun 22, 2017Updated 8 years ago
- ☆10Jul 20, 2020Updated 5 years ago
- [DEPRECATED] Landing page for cloud.gov. New repo: https://github.com/18F/cg-site☆12Nov 22, 2016Updated 9 years ago
- Code snippets for ComputerVisionStreams youtube channel☆20Sep 5, 2025Updated 5 months ago
- A collection of preset video configurations for MiSTer.☆13Mar 8, 2024Updated last year