This repository hosts sample pipelines
☆471May 8, 2020Updated 5 years ago
Alternatives and similar repositories for data-pipeline-samples
Users that are interested in data-pipeline-samples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The open source version of the AWS Data Pipeline documentation. To provide feedback & requests for changes, submit issues in this reposit…☆15Jun 15, 2023Updated 2 years ago
- Amazon Redshift Database Loader implemented in AWS Lambda☆595Jul 16, 2024Updated last year
- Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment☆2,810Sep 3, 2025Updated 7 months ago
- This repository hold the Amazon Elastic MapReduce sample bootstrap actions☆614Jun 5, 2023Updated 2 years ago
- DataPipeline for humans.☆250Jul 21, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Amazon Redshift Advanced Monitoring☆270Oct 28, 2025Updated 5 months ago
- ☆894Jul 15, 2022Updated 3 years ago
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆344Mar 29, 2024Updated 2 years ago
- AWS Glue code samples☆1,534Nov 5, 2025Updated 5 months ago
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆698Jan 13, 2026Updated 2 months ago
- An Akka actor that writes JSON data into Amazon Kinesis Firehose.☆14Jan 14, 2026Updated 2 months ago
- As customers move from building data lakes and analytics on AWS to building machine learning solutions, one of their biggest challenges i…☆63Nov 28, 2018Updated 7 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Oct 30, 2018Updated 7 years ago
- An AWS Lambda module and node.js library to facilitate Amazon Kinesis archival and replay☆31Apr 2, 2026Updated last week
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This code example illustrates a programmatic way to search through CloudWatch Metrics for Lambda concurrency spikes.☆22Sep 20, 2018Updated 7 years ago
- Amazon Kinesis Streams fan-out via Kinesis Analytics (powered by the Serverless Framework)☆104Dec 11, 2019Updated 6 years ago
- Code to build a simple analytics data pipeline with Python☆102Mar 11, 2017Updated 9 years ago
- A collection of example UDFs for Amazon Redshift.☆244Oct 25, 2024Updated last year
- AWS Lambda function to forward Stream data to Kinesis Firehose☆279Aug 16, 2023Updated 2 years ago
- CloudFormation resource for AWS Certificate Manager cert requests☆45Jun 21, 2017Updated 8 years ago
- Plugin to create fake visits, websites, users and goals to populate Matomo reports☆22Updated this week
- Sends metrics to Datadog for items that don't have agent integrations.☆12Aug 3, 2018Updated 7 years ago
- This repo is full CI/CD Serverless example which was used in the What's New with AWS Lambda presentation at Re:Invent 2016.☆283Jan 9, 2020Updated 6 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Python Scripts for data pre- and post-processing (parsing, cleaning and analysis)☆13Jun 9, 2011Updated 14 years ago
- ARCHIVED☆71Feb 1, 2018Updated 8 years ago
- ☆14Jun 27, 2017Updated 8 years ago
- A sample AWS Lambda function that accepts messages from an Amazon Kinesis Stream and transfers the messages to another data transport.☆289Oct 18, 2022Updated 3 years ago
- Code samples showing the different ways to run AWS X-Ray in serverless applications☆23May 16, 2019Updated 6 years ago
- Amazon API Gateway sample using Amazon Cognito credentials through AWS Lambda☆307Apr 26, 2021Updated 4 years ago
- An integrated shell for working with the AWS CLI.☆7,348Dec 16, 2024Updated last year
- Bash script that reports custom metric data about PostgreSQL(RDS) performance to Amazon CloudWatch☆21Jan 28, 2021Updated 5 years ago
- Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.☆373Mar 2, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The AWS Serverless Application Model (AWS SAM) transform is a AWS CloudFormation macro that transforms SAM templates into CloudFormation …☆9,549Updated this week
- AWS Lambda API server for docker-lambda☆24Dec 1, 2016Updated 9 years ago
- Tools to deal with AWS detailed billing reports☆31Oct 14, 2014Updated 11 years ago
- SAM app that reads and logs DynamoDB events☆11Feb 25, 2026Updated last month
- ☆12Dec 7, 2025Updated 4 months ago
- UNRELEASED. An opinionated framework for analytics-on-write on event streams using key-value storage☆14Sep 10, 2015Updated 10 years ago
- Simple CQRS example using AWS Lambda and the Serverless framework.☆21Apr 16, 2018Updated 7 years ago