Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs. Out of the box it will load files from a source, transform them and then output them (output might be writing to a file or loading them into a data analysis tool). It is designed to be modular and support var…
☆87Feb 11, 2014Updated 12 years ago
Alternatives and similar repositories for Data-Pipeline
Users that are interested in Data-Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Example that shows use of the Prediction API☆10Apr 12, 2018Updated 8 years ago
- Cloud Pub/Sub sample applications with Python☆72Jul 13, 2016Updated 10 years ago
- makeViewerUrl☆92May 20, 2024Updated 2 years ago
- Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.☆163May 31, 2017Updated 9 years ago
- Small python logging handlers that directly send the logs to Cloud Pub/Sub☆23Jul 24, 2020Updated 6 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Automated building and packaging of Tensorflow models in the cloud, and running them on devices☆15Dec 28, 2018Updated 7 years ago
- Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub☆131Oct 20, 2020Updated 5 years ago
- ☆152Oct 4, 2018Updated 7 years ago
- Demonstrates how to extract and transform data from the Datastore into a format suitable for ingestion by Google BigQuery, via the App En…☆16Sep 23, 2015Updated 11 years ago
- ☆17Sep 14, 2022Updated 4 years ago
- An example that shows how to periodically launch a Dataflow analytics pipeline from GAE Flex, that reads from Datastore.☆42Oct 24, 2017Updated 8 years ago
- This sample app will get up and running quickly with Hive and/or Pig on a Hadoop cluster on Google Compute Engine. For more information …☆19Jan 9, 2018Updated 8 years ago
- Go/App Engine sample for service account☆41Sep 23, 2015Updated 11 years ago
- Titan for App Engine☆45Oct 3, 2015Updated 10 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The Automated File Loader to BigQuery solution demonstrates the use of Object Change Notification service on Google Cloud Storage. It sho…☆22Jan 9, 2018Updated 8 years ago
- ☆63Nov 21, 2018Updated 7 years ago
- ☆22Jun 23, 2015Updated 11 years ago
- ☆64Aug 10, 2021Updated 5 years ago
- ☆144Sep 28, 2020Updated 5 years ago
- Uploads and downloads files between Google Cloud Storage and the local filesystem using the Google Python Client Library.☆99Mar 1, 2017Updated 9 years ago
- Auth plugin allowing use the use of OAuth 2.0 credentials for Google Cloud Storage in the Boto library.☆22Jun 24, 2025Updated last year
- Reference server implementation for OAuth2 that runs on App Engine☆43May 12, 2015Updated 11 years ago
- Apache Beam example project☆13Oct 16, 2019Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A small sample showing how to build an internationalized app with App Engine☆28Sep 28, 2015Updated 10 years ago
- ☆11Apr 10, 2019Updated 7 years ago
- Setting goals using Prophet forecast models in R☆10Jan 3, 2019Updated 7 years ago
- A minimal example of building and deploying a blogdown-based website via Travis CI☆14Nov 14, 2019Updated 6 years ago
- ☆28May 3, 2024Updated 2 years ago
- An R package to interact with the Google Tag Manager API☆16Jan 13, 2021Updated 5 years ago
- A skeleton for creating App Engine applications using the Django framework.☆132Nov 8, 2018Updated 7 years ago
- *luigi-gcloud* is an luigi extension that enables full support for the Google Cloud Platform. Making it possible to do complex orchestrat…☆43May 13, 2016Updated 10 years ago
- Analysis of Chicago Motor Vehicle Theft Data☆11Aug 20, 2015Updated 11 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆36Dec 5, 2018Updated 7 years ago
- A tool for moving tables from Redshift to BigQuery☆65Jan 20, 2019Updated 7 years ago
- Some cloud functions helpful to Google Analytics☆13Nov 30, 2018Updated 7 years ago
- Third-party vendoring helper for Google App Engine and other sandboxed python environments.☆11Jun 1, 2015Updated 11 years ago
- Writer Identification of Handwritten Documents☆13Oct 18, 2017Updated 8 years ago
- A Shiny app to visualise BigQuery data in R. Open sourced so you can deploy on your own Shiny server.☆48Dec 3, 2015Updated 10 years ago
- Client library for use with Google Cloud Datastore from within the Google App Engine Python runtime.☆114Oct 20, 2022Updated 3 years ago