Scheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag
☆23Sep 19, 2022Updated 3 years ago
Alternatives and similar repositories for pyDag
Users that are interested in pyDag are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A parallel implementation of the bzip2 data compressor in python, this data compression pipeline is using algorithms like Burrows–Wheeler…☆14Jun 29, 2022Updated 4 years ago
- Challenge Data Engineer☆25Jun 13, 2022Updated 4 years ago
- Build a Content-Based Movie Recommender System (TF-IDF, BM25, BERT)☆15Jun 13, 2022Updated 4 years ago
- The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …☆125Jun 29, 2022Updated 4 years ago
- Dockerizing a Python Script for Web Scraping and consume the scraped data using FastApi (www.metroscubicos.com)☆15Dec 16, 2021Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Dockerizing an Apache Spark Standalone Cluster☆42Jun 29, 2022Updated 4 years ago
- Sample Project to Learn Data Engineering☆10Aug 1, 2021Updated 4 years ago
- Simple, lightweight, extensible DAG framework for Python with a Kubeflow-like API☆87Feb 24, 2024Updated 2 years ago
- The ZetaSQL Toolkit is a library that helps users use ZetaSQL Java API to perform SQL analysis for multiple query engines, including BigQ…☆43Oct 28, 2025Updated 9 months ago
- ☆22Mar 11, 2026Updated 4 months ago
- RubyLLM with additions from the community☆21Jan 3, 2026Updated 6 months ago
- This extension makes vscode seamlessly work with dbt and bigquery☆15Sep 27, 2022Updated 3 years ago
- Cardano mainchain data on BigQuery☆11Aug 3, 2023Updated 2 years ago
- Script archive of scripts from the late JJMack☆23Oct 26, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Create tables in Google BigQuery, auto-generate their schemas, and retrieve said schemas.☆10Updated this week
- A tool to automatically infer columns data types in .csv files☆36Jan 28, 2023Updated 3 years ago
- BigQuery Skills - Claude Code plugin that makes Claude a BigQuery expert. 5 skills covering query optimization, SQL generation, schema de…☆15Apr 13, 2026Updated 3 months ago
- Business and performance KPIs drawn from game analytics using a large dataset☆11Mar 2, 2019Updated 7 years ago
- CLI for running Airbyte sources & destinations locally without Airbyte server☆34Jul 17, 2026Updated last week
- ☆12Dec 15, 2023Updated 2 years ago
- dagster scikit-learn pipeline example.☆46Mar 18, 2023Updated 3 years ago
- MM-Diff: High-Fidelity Image Personalization via Multi-Modal Condition Integration☆28May 30, 2024Updated 2 years ago
- The moderate bots for re-crawling from social medias.☆10Apr 11, 2020Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Repositorio utilizado para el Curso de Apache Spark en Platzi☆20Feb 20, 2021Updated 5 years ago
- Códigos sobre a matéria estrutura de dados.☆23Nov 8, 2018Updated 7 years ago
- A CLI tool to perform migrations on BigQuery tables☆11Feb 12, 2022Updated 4 years ago
- ䷗ Hard-Wrapping Rstudio Add-In ䷗☆12Oct 5, 2018Updated 7 years ago
- Example of a Hangouts Chat Bot on Google Cloud Functions☆16Jan 16, 2019Updated 7 years ago
- Create graphed invoice for Google Cloud Platform. You can see billing amount per GCP project.☆10Feb 28, 2022Updated 4 years ago
- All important Python tools a Data Engineer needs☆28Jun 4, 2024Updated 2 years ago
- Elixir BigQuery API client - *DEPRECATED*☆14May 29, 2020Updated 6 years ago
- Stream your CSV files to an HTTP API☆12Apr 9, 2018Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆32Mar 1, 2023Updated 3 years ago
- ☆10Jul 16, 2026Updated last week
- Load your SEO Data from Google Search Console into your Big Query Datawarehouse.☆12Jul 6, 2022Updated 4 years ago
- Google Cloud Functions examples for Google Cloud Dataprep☆11Feb 12, 2021Updated 5 years ago
- Learning Google BigQuery, published by Packt☆15Jan 30, 2023Updated 3 years ago
- Convert an html layout to an equivalent dash layout☆10Dec 6, 2024Updated last year
- Organize & Run Build Scripts Comfortably☆15Apr 21, 2024Updated 2 years ago