Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs. Out of the box it will load files from a source, transform them and then output them (output might be writing to a file or loading them into a data analysis tool). It is designed to be modular and support var…
☆87Feb 11, 2014Updated 12 years ago
Alternatives and similar repositories for Data-Pipeline
Users that are interested in Data-Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Example that shows use of the Prediction API☆10Apr 12, 2018Updated 8 years ago
- Cloud Pub/Sub sample applications with Python☆72Jul 13, 2016Updated 10 years ago
- makeViewerUrl☆92May 20, 2024Updated 2 years ago
- Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.☆163May 31, 2017Updated 9 years ago
- Small python logging handlers that directly send the logs to Cloud Pub/Sub☆23Jul 24, 2020Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Trivial Python 2.7 App Engine app based on https://github.com/angular/angular-seed☆31Sep 23, 2015Updated 10 years ago
- Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub☆131Oct 20, 2020Updated 5 years ago
- ☆152Oct 4, 2018Updated 7 years ago
- Accompanying repository for FIS/SunGard's whitepaper on using the Dataflow SDK to transform options market data☆23Sep 11, 2016Updated 9 years ago
- Demonstrates how to extract and transform data from the Datastore into a format suitable for ingestion by Google BigQuery, via the App En…☆16Sep 23, 2015Updated 10 years ago
- ☆17Sep 14, 2022Updated 3 years ago
- An example that shows how to periodically launch a Dataflow analytics pipeline from GAE Flex, that reads from Datastore.☆42Oct 24, 2017Updated 8 years ago
- This sample app will get up and running quickly with Hive and/or Pig on a Hadoop cluster on Google Compute Engine. For more information …☆19Jan 9, 2018Updated 8 years ago
- Go/App Engine sample for service account☆41Sep 23, 2015Updated 10 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Titan for App Engine☆45Oct 3, 2015Updated 10 years ago
- ☆63Nov 21, 2018Updated 7 years ago
- ☆22Jun 23, 2015Updated 11 years ago
- ☆65Aug 10, 2021Updated 5 years ago
- ☆144Sep 28, 2020Updated 5 years ago
- Experiment deploying Rstudio to Google AppEngine☆11Sep 3, 2017Updated 8 years ago
- Uploads and downloads files between Google Cloud Storage and the local filesystem using the Google Python Client Library.☆100Mar 1, 2017Updated 9 years ago
- Auth plugin allowing use the use of OAuth 2.0 credentials for Google Cloud Storage in the Boto library.☆22Jun 24, 2025Updated last year
- Reference server implementation for OAuth2 that runs on App Engine☆43May 12, 2015Updated 11 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Apache Beam example project☆13Oct 16, 2019Updated 6 years ago
- A small sample showing how to build an internationalized app with App Engine☆28Sep 28, 2015Updated 10 years ago
- Setting goals using Prophet forecast models in R☆10Jan 3, 2019Updated 7 years ago
- A minimal example of building and deploying a blogdown-based website via Travis CI☆14Nov 14, 2019Updated 6 years ago
- ☆28May 3, 2024Updated 2 years ago
- An R package to interact with the Google Tag Manager API☆16Jan 13, 2021Updated 5 years ago
- *luigi-gcloud* is an luigi extension that enables full support for the Google Cloud Platform. Making it possible to do complex orchestrat…☆43May 13, 2016Updated 10 years ago
- Business Data Analysis by HiPIC of CalStateLA☆21Oct 26, 2018Updated 7 years ago
- Analysis of Chicago Motor Vehicle Theft Data☆11Aug 20, 2015Updated 10 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆36Dec 5, 2018Updated 7 years ago
- A tool for moving tables from Redshift to BigQuery☆65Jan 20, 2019Updated 7 years ago
- Documentation and tools to help host a sprint on Python core development☆18May 9, 2016Updated 10 years ago
- Writer Identification of Handwritten Documents☆13Oct 18, 2017Updated 8 years ago
- A Shiny app to visualise BigQuery data in R. Open sourced so you can deploy on your own Shiny server.☆48Dec 3, 2015Updated 10 years ago
- Client library for use with Google Cloud Datastore from within the Google App Engine Python runtime.☆113Oct 20, 2022Updated 3 years ago
- Python TimeZone for Appengine☆30Dec 6, 2016Updated 9 years ago