This repository hosts sample pipelines
☆470May 8, 2020Updated 6 years ago
Alternatives and similar repositories for data-pipeline-samples
Users that are interested in data-pipeline-samples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The open source version of the AWS Data Pipeline documentation. To provide feedback & requests for changes, submit issues in this reposit…☆15Jun 15, 2023Updated 3 years ago
- Amazon Redshift Database Loader implemented in AWS Lambda☆595Jul 16, 2024Updated 2 years ago
- Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment☆2,802Sep 3, 2025Updated last year
- This repository hold the Amazon Elastic MapReduce sample bootstrap actions☆613Jun 5, 2023Updated 3 years ago
- DataPipeline for humans.☆251Jul 21, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.☆346Mar 29, 2024Updated 2 years ago
- ☆891Jul 15, 2022Updated 4 years ago
- Amazon Redshift Advanced Monitoring☆267Oct 28, 2025Updated 11 months ago
- AWS Glue code samples☆1,540Aug 18, 2026Updated last month
- AWS Glue Libraries are additions and enhancements to Spark for ETL operations.☆701Updated this week
- Lambda functions and CloudFormation templates required for performing the step-by-step actions in the blog post☆13Apr 29, 2021Updated 5 years ago
- An Akka actor that writes JSON data into Amazon Kinesis Firehose.☆14Jan 14, 2026Updated 8 months ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆77Oct 30, 2018Updated 7 years ago
- An AWS Lambda module and node.js library to facilitate Amazon Kinesis archival and replay☆31Apr 2, 2026Updated 6 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- As customers move from building data lakes and analytics on AWS to building machine learning solutions, one of their biggest challenges i…☆62Nov 28, 2018Updated 7 years ago
- AWS Technical Trainers Demos☆128Apr 9, 2019Updated 7 years ago
- This code example illustrates a programmatic way to search through CloudWatch Metrics for Lambda concurrency spikes.☆22Sep 20, 2018Updated 8 years ago
- Amazon Kinesis Streams fan-out via Kinesis Analytics (powered by the Serverless Framework)☆104Dec 11, 2019Updated 6 years ago
- Code to build a simple analytics data pipeline with Python☆103Mar 11, 2017Updated 9 years ago
- AWS Lambda function to forward Stream data to Kinesis Firehose☆278Aug 16, 2023Updated 3 years ago
- A collection of example UDFs for Amazon Redshift.☆244Updated this week
- CloudFormation resource for AWS Certificate Manager cert requests☆45Jun 21, 2017Updated 9 years ago
- Python Scripts for data pre- and post-processing (parsing, cleaning and analysis)☆13Jun 9, 2011Updated 15 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Sends metrics to Datadog for items that don't have agent integrations.☆12Aug 3, 2018Updated 8 years ago
- This repo is full CI/CD Serverless example which was used in the What's New with AWS Lambda presentation at Re:Invent 2016.☆283Jan 9, 2020Updated 6 years ago
- ☆14Jun 27, 2017Updated 9 years ago
- Implementation of Web Log Analysis in Scala and Apache Spark☆10Feb 8, 2015Updated 11 years ago
- A sample AWS Lambda function that accepts messages from an Amazon Kinesis Stream and transfers the messages to another data transport.☆289Oct 18, 2022Updated 3 years ago
- Code samples showing the different ways to run AWS X-Ray in serverless applications☆23May 16, 2019Updated 7 years ago
- Automate AWS lambda functions migration across account using CloudFormation☆11Apr 24, 2020Updated 6 years ago
- Bash script that reports custom metric data about PostgreSQL(RDS) performance to Amazon CloudWatch☆21Jan 28, 2021Updated 5 years ago
- Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.☆373Jul 7, 2026Updated 3 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Amazon API Gateway sample using Amazon Cognito credentials through AWS Lambda☆307Apr 26, 2021Updated 5 years ago
- An integrated shell for working with the AWS CLI.☆7,332Dec 16, 2024Updated last year
- The AWS Serverless Application Model (AWS SAM) transform is a AWS CloudFormation macro that transforms SAM templates into CloudFormation …☆9,575Updated this week
- AWS OpsWorks Elasticsearch sample cookbook☆35Jan 25, 2018Updated 8 years ago
- AWS Lambda API server for docker-lambda☆24Dec 1, 2016Updated 9 years ago
- Tools to deal with AWS detailed billing reports☆31Oct 14, 2014Updated 11 years ago
- SAM app that reads and logs DynamoDB events☆12Feb 25, 2026Updated 7 months ago