Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs. Out of the box it will load files from a source, transform them and then output them (output might be writing to a file or loading them into a data analysis tool). It is designed to be modular and support var…
☆87Feb 11, 2014Updated 12 years ago
Alternatives and similar repositories for Data-Pipeline
Users that are interested in Data-Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Example that shows use of the Prediction API☆10Apr 12, 2018Updated 8 years ago
- makeViewerUrl☆92May 20, 2024Updated 2 years ago
- Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.☆163May 31, 2017Updated 9 years ago
- Small python logging handlers that directly send the logs to Cloud Pub/Sub☆23Jul 24, 2020Updated 6 years ago
- ☆25Sep 23, 2015Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Automated building and packaging of Tensorflow models in the cloud, and running them on devices☆15Dec 28, 2018Updated 7 years ago
- Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub☆131Oct 20, 2020Updated 5 years ago
- ☆152Oct 4, 2018Updated 7 years ago
- Accompanying repository for FIS/SunGard's whitepaper on using the Dataflow SDK to transform options market data☆23Sep 11, 2016Updated 9 years ago
- Demonstrates how to extract and transform data from the Datastore into a format suitable for ingestion by Google BigQuery, via the App En…☆16Sep 23, 2015Updated 10 years ago
- An example that shows how to periodically launch a Dataflow analytics pipeline from GAE Flex, that reads from Datastore.☆42Oct 24, 2017Updated 8 years ago
- Custom Text Classifier☆17Jan 8, 2018Updated 8 years ago
- App Engine cloudstorage examples using SDK and GAE production. This code shows how to read and write blobs (because of the deprecated blo…☆27Mar 6, 2019Updated 7 years ago
- ☆63Nov 21, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- "Last Across the Finish Line" is an example application that uses the Task Queue API to showcase a pattern for tracking asynchronous batc…☆16Dec 11, 2013Updated 12 years ago
- A library for running MapReduce jobs on App Engine☆235May 4, 2024Updated 2 years ago
- ☆22Jun 23, 2015Updated 11 years ago
- ☆65Aug 10, 2021Updated 4 years ago
- ☆144Sep 28, 2020Updated 5 years ago
- Auth plugin allowing use the use of OAuth 2.0 credentials for Google Cloud Storage in the Boto library.☆22Jun 24, 2025Updated last year
- Reference server implementation for OAuth2 that runs on App Engine☆43May 12, 2015Updated 11 years ago
- Apache Beam example project☆13Oct 16, 2019Updated 6 years ago
- A small sample showing how to build an internationalized app with App Engine☆28Sep 28, 2015Updated 10 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Apr 10, 2019Updated 7 years ago
- A minimal example of building and deploying a blogdown-based website via Travis CI☆14Nov 14, 2019Updated 6 years ago
- ☆28May 3, 2024Updated 2 years ago
- ☆15Nov 7, 2014Updated 11 years ago
- Integrating FusionCharts with AngularJS☆23Mar 2, 2014Updated 12 years ago
- A skeleton for creating App Engine applications using the Django framework.☆133Nov 8, 2018Updated 7 years ago
- *luigi-gcloud* is an luigi extension that enables full support for the Google Cloud Platform. Making it possible to do complex orchestrat…☆43May 13, 2016Updated 10 years ago
- Business Data Analysis by HiPIC of CalStateLA☆21Oct 26, 2018Updated 7 years ago
- Analysis of Chicago Motor Vehicle Theft Data☆11Aug 20, 2015Updated 10 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆36Dec 5, 2018Updated 7 years ago
- A tool for moving tables from Redshift to BigQuery☆65Jan 20, 2019Updated 7 years ago
- A library for connecting from Google Apps Scripts to Google APIs using OAuth2 and a Service Account☆15May 21, 2015Updated 11 years ago
- Some cloud functions helpful to Google Analytics☆13Nov 30, 2018Updated 7 years ago
- Third-party vendoring helper for Google App Engine and other sandboxed python environments.☆11Jun 1, 2015Updated 11 years ago
- Writer Identification of Handwritten Documents☆13Oct 18, 2017Updated 8 years ago
- An AngularDart application -- Tic-Tac-Toe! Two-player only.☆13Dec 6, 2017Updated 8 years ago