DataPipeline for humans.
☆250Jul 21, 2022Updated 4 years ago
Alternatives and similar repositories for dataduct
Users that are interested in dataduct are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…☆39Jan 22, 2016Updated 10 years ago
- ☆42Aug 17, 2022Updated 3 years ago
- Amazon Redshift Database Loader implemented in AWS Lambda☆595Jul 16, 2024Updated 2 years ago
- Automate copying data from S3 into Amazon Redshift☆116Dec 8, 2021Updated 4 years ago
- Scheduled task execution on top of AWS Data Pipeline☆43Mar 9, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository hosts sample pipelines☆472May 8, 2020Updated 6 years ago
- Spark Streaming with Kafka and Wikipedia Edits☆12Feb 3, 2017Updated 9 years ago
- Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment☆2,810Sep 3, 2025Updated 11 months ago
- Compare 2 basketball players by reading/comparing NBA stats in an Excel sheet.☆11Aug 19, 2018Updated 7 years ago
- Redshift data source for Apache Spark☆608Aug 10, 2023Updated 3 years ago
- Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.☆117Dec 26, 2022Updated 3 years ago
- ☆893Jul 15, 2022Updated 4 years ago
- Redshift Ops Console☆92Oct 26, 2015Updated 10 years ago
- UNRELEASED. An opinionated framework for analytics-on-write on event streams using key-value storage☆14Sep 10, 2015Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A tool for moving tables from Redshift to BigQuery☆65Jan 20, 2019Updated 7 years ago
- SQL for many helpful Redshift UDFs, and the scripts for generating and testing those UDFs☆124Oct 2, 2018Updated 7 years ago
- A collection of example UDFs for Amazon Redshift.☆244Updated this week
- Visualize pipeline definitions for AWS Data Pipeline☆23Feb 3, 2026Updated 6 months ago
- Micro-services to provide various conveniences in managing AWS services☆31Feb 11, 2019Updated 7 years ago
- Functional, Typesafe, Declarative Data Pipelines☆140Jan 29, 2018Updated 8 years ago
- The missing dashboard builder for Snowplow Analytics.☆29Jun 30, 2014Updated 12 years ago
- Python 3 compatible library for DynamoDB☆13Dec 4, 2021Updated 4 years ago
- Amazon Athena to Redash Proxy app☆15Aug 8, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LRU Cache☆15Oct 26, 2013Updated 12 years ago
- Briefly - A Python Meta-programming Library for Job Flow Control☆108Sep 10, 2018Updated 7 years ago
- awscli in a docker container☆18Apr 20, 2019Updated 7 years ago
- DonorsChoose.org Data Science Team Opensource Code☆78Dec 8, 2022Updated 3 years ago
- Algebird's HyperLogLog for Presto DB.☆11Jan 31, 2017Updated 9 years ago
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81May 16, 2025Updated last year
- mito ETL tool☆163Jun 1, 2021Updated 5 years ago
- Simple and scalable versioned data storage☆30Sep 25, 2018Updated 7 years ago
- Snowplow Request Validator☆10Apr 26, 2017Updated 9 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆16Dec 1, 2021Updated 4 years ago
- Lambda script that enriches snowplow event data and puts it back to S3☆18Sep 15, 2020Updated 5 years ago
- Dear StrongBad, this is a simple utility library for working with HBase in the REPL.☆23Jul 14, 2010Updated 16 years ago
- Secor is a service implementing Kafka log persistence☆1,857Mar 10, 2026Updated 5 months ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,762Jul 18, 2026Updated 3 weeks ago
- TPC-DS benchmarks including data generation with Spark and queries with Spark☆15May 8, 2017Updated 9 years ago
- Looker Access is a command line tool to control Looker roles, groups, permission sets and model sets.☆10Apr 20, 2019Updated 7 years ago