End to end data pipeline
☆22Apr 13, 2025Updated 11 months ago
Alternatives and similar repositories for datasystem
Users that are interested in datasystem are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Building a modern data warehouse with SQL server, including ETL processes, data modeling, and analytics.☆27May 3, 2025Updated 10 months ago
- An intelligent agent utilizing Large Language Models (LLMs) for automated financial news retrieval and stock price prediction.☆21Sep 9, 2024Updated last year
- Don't Panic. This guide will help you when it feels like the end of the world.☆30Feb 7, 2026Updated last month
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated last year
- A Python package to manipulate EPA SWMM5 like a data scientist.☆13Jun 19, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Covid19 and Iowa Liquor Sales analysis at BigQuery using dbt, Airflow, Marquez, Google Cloud and other modern data stack tools☆14Jun 18, 2022Updated 3 years ago
- This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenario…☆27Mar 17, 2026Updated last week
- ☆22May 20, 2024Updated last year
- One CAPTCHA solving client on Android☆22Jul 18, 2022Updated 3 years ago
- Yosegi - Pyramid (Geo)Parquet Generator☆33Jan 23, 2026Updated 2 months ago
- ☆13Feb 19, 2025Updated last year
- Generate and Compare Debezium CDC (Chance Data Capture) Avro Schema, directly from your Database.☆24Mar 19, 2026Updated last week
- A partially implemented ODBC driver for the Trino distributed SQL engine☆18Feb 2, 2026Updated last month
- Road corrections and measurements from ALS data☆23Nov 15, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated last year
- Code to create your own RAG Chatbot in Databricks☆28Aug 14, 2025Updated 7 months ago
- Custom kube-scheduler for binpacking targeting Spark on EKS and other jobs workloads☆26Feb 24, 2026Updated last month
- ☆22Apr 2, 2025Updated 11 months ago
- ☆22Feb 7, 2024Updated 2 years ago
- Repositório para criação do lakehouse da iniciativa [Trampar de Casa](https://www.trampardecasa.com.br/)☆25Sep 17, 2024Updated last year
- ☆17Apr 2, 2024Updated last year
- Build a Full stack Q&A Chatbot with Langchain, and LLM Models on Amazon Sagemaker☆12Nov 10, 2023Updated 2 years ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆32Jan 30, 2026Updated last month
- This repository will consist of advanced RAG applications.☆35Jul 31, 2024Updated last year
- This Power BI project provides insights into customer orders and product tracking using interactive dashboards. It visualizes order statu…☆10Aug 15, 2025Updated 7 months ago
- This project demonstrates real-time data streaming and processing architecture using Kafka, Spark Streaming, and Debezium for capturing C…☆13Oct 24, 2024Updated last year
- The project XOS or Experimental Operating System is a platform to help in developing a toy operating system.☆66Apr 11, 2018Updated 7 years ago
- An Email Spam Classifier project, helps you detect your spam email from correct email. Try it out here!☆12Jun 16, 2023Updated 2 years ago
- Performing, evaluating and tracking advanced Retrieval Augmented Generation methods ft. AzureML & LlamaIndex☆35Jan 13, 2025Updated last year
- ☆14Oct 10, 2025Updated 5 months ago
- An exercise running Kafka, Kafka Connect, PostgreSQL, Superset and AWS S3☆21Apr 29, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Pyspark boilerplate for running prod ready data pipeline☆29Mar 17, 2021Updated 5 years ago
- Command-Line Interface (CLI) application for efficient and scalable generation of large-scale 3D building models.☆39Mar 9, 2025Updated last year
- DOES NOT WORK WITH VERSIONS > 0.10.0 - A simple library to help you build node-based identity providers that work with Hydra.☆19Oct 5, 2017Updated 8 years ago
- The Cloud Squad is a web application that helps users assess their AWS certification exam readiness through a 30-minute test with real-ti…☆14Mar 24, 2025Updated last year
- Personal notes for the Azure Data Science exam DP-100☆19Mar 20, 2020Updated 6 years ago
- This repository is a collection of configuration files and settings that will be used to customize and set up the Neovim text editor☆17Aug 27, 2025Updated 6 months ago
- ☆35Dec 3, 2025Updated 3 months ago