Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs. Out of the box it will load files from a source, transform them and then output them (output might be writing to a file or loading them into a data analysis tool). It is designed to be modular and support var…
☆87Feb 11, 2014Updated 12 years ago
Alternatives and similar repositories for Data-Pipeline
Users that are interested in Data-Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Example that shows use of the Prediction API☆10Apr 12, 2018Updated 8 years ago
- makeViewerUrl☆92May 20, 2024Updated 2 years ago
- Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.☆163May 31, 2017Updated 9 years ago
- Small python logging handlers that directly send the logs to Cloud Pub/Sub☆23Jul 24, 2020Updated 6 years ago
- ☆25Sep 23, 2015Updated 10 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Automated building and packaging of Tensorflow models in the cloud, and running them on devices☆15Dec 28, 2018Updated 7 years ago
- Trivial Python 2.7 App Engine app based on https://github.com/angular/angular-seed☆31Sep 23, 2015Updated 10 years ago
- Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub☆131Oct 20, 2020Updated 5 years ago
- ☆152Oct 4, 2018Updated 7 years ago
- Demonstrates how to extract and transform data from the Datastore into a format suitable for ingestion by Google BigQuery, via the App En…☆16Sep 23, 2015Updated 10 years ago
- An example that shows how to periodically launch a Dataflow analytics pipeline from GAE Flex, that reads from Datastore.☆42Oct 24, 2017Updated 8 years ago
- Custom Text Classifier☆17Jan 8, 2018Updated 8 years ago
- Go/App Engine sample for service account☆41Sep 23, 2015Updated 10 years ago
- Titan for App Engine☆45Oct 3, 2015Updated 10 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The Automated File Loader to BigQuery solution demonstrates the use of Object Change Notification service on Google Cloud Storage. It sho…☆22Jan 9, 2018Updated 8 years ago
- "Last Across the Finish Line" is an example application that uses the Task Queue API to showcase a pattern for tracking asynchronous batc…☆16Dec 11, 2013Updated 12 years ago
- A library for running MapReduce jobs on App Engine☆235May 4, 2024Updated 2 years ago
- ☆22Jun 23, 2015Updated 11 years ago
- ☆144Sep 28, 2020Updated 5 years ago
- Uploads and downloads files between Google Cloud Storage and the local filesystem using the Google Python Client Library.☆100Mar 1, 2017Updated 9 years ago
- Auth plugin allowing use the use of OAuth 2.0 credentials for Google Cloud Storage in the Boto library.☆22Jun 24, 2025Updated last year
- Apache Beam example project☆13Oct 16, 2019Updated 6 years ago
- Setting goals using Prophet forecast models in R☆10Jan 3, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A minimal example of building and deploying a blogdown-based website via Travis CI☆14Nov 14, 2019Updated 6 years ago
- ☆28May 3, 2024Updated 2 years ago
- ☆36Jun 25, 2014Updated 12 years ago
- An R package to interact with the Google Tag Manager API☆16Jan 13, 2021Updated 5 years ago
- A skeleton for creating App Engine applications using the Django framework.☆132Nov 8, 2018Updated 7 years ago
- *luigi-gcloud* is an luigi extension that enables full support for the Google Cloud Platform. Making it possible to do complex orchestrat…☆43May 13, 2016Updated 10 years ago
- Business Data Analysis by HiPIC of CalStateLA☆21Oct 26, 2018Updated 7 years ago
- ☆36Dec 5, 2018Updated 7 years ago
- A tool for moving tables from Redshift to BigQuery☆65Jan 20, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Some cloud functions helpful to Google Analytics☆13Nov 30, 2018Updated 7 years ago
- Third-party vendoring helper for Google App Engine and other sandboxed python environments.☆11Jun 1, 2015Updated 11 years ago
- Writer Identification of Handwritten Documents☆13Oct 18, 2017Updated 8 years ago
- An AngularDart application -- Tic-Tac-Toe! Two-player only.☆13Dec 6, 2017Updated 8 years ago
- A Shiny app to visualise BigQuery data in R. Open sourced so you can deploy on your own Shiny server.☆48Dec 3, 2015Updated 10 years ago
- mrlin is 'MapReduce processing of Linked Data' … because it's magic☆16Nov 1, 2012Updated 13 years ago
- Client library for use with Google Cloud Datastore from within the Google App Engine Python runtime.☆113Oct 20, 2022Updated 3 years ago