Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs. Out of the box it will load files from a source, transform them and then output them (output might be writing to a file or loading them into a data analysis tool). It is designed to be modular and support var…
☆87Feb 11, 2014Updated 12 years ago
Alternatives and similar repositories for Data-Pipeline
Users that are interested in Data-Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cloud Pub/Sub sample applications with Python☆72Jul 13, 2016Updated 9 years ago
- Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.☆164May 31, 2017Updated 8 years ago
- makeViewerUrl☆91May 20, 2024Updated last year
- Accompanying repository for FIS/SunGard's whitepaper on using the Dataflow SDK to transform options market data☆23Sep 11, 2016Updated 9 years ago
- ☆17Sep 14, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- An example that shows how to periodically launch a Dataflow analytics pipeline from GAE Flex, that reads from Datastore.☆42Oct 24, 2017Updated 8 years ago
- Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub☆131Oct 20, 2020Updated 5 years ago
- A tutorial on streaming data from a Flask REST API and streaming the response into PostgreSQL☆39Oct 28, 2019Updated 6 years ago
- ☆65Aug 10, 2021Updated 4 years ago
- Experiment deploying Rstudio to Google AppEngine☆11Sep 3, 2017Updated 8 years ago
- ☆144Sep 28, 2020Updated 5 years ago
- This is a simple web-based example of calling the Google Cloud Storage API in JavaScript.☆83Feb 11, 2016Updated 10 years ago
- Uploads and downloads files between Google Cloud Storage and the local filesystem using the Google Python Client Library.☆100Mar 1, 2017Updated 9 years ago
- ☆63Nov 21, 2018Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆25Sep 23, 2015Updated 10 years ago
- ☆11Apr 10, 2019Updated 7 years ago
- Setting goals using Prophet forecast models in R☆11Jan 3, 2019Updated 7 years ago
- A minimal example of building and deploying a blogdown-based website via Travis CI☆14Nov 14, 2019Updated 6 years ago
- Third-party vendoring helper for Google App Engine and other sandboxed python environments.☆11Jun 1, 2015Updated 10 years ago
- An R package to interact with the Google Tag Manager API☆16Jan 13, 2021Updated 5 years ago
- The Automated File Loader to BigQuery solution demonstrates the use of Object Change Notification service on Google Cloud Storage. It sho…☆22Jan 9, 2018Updated 8 years ago
- Small python logging handlers that directly send the logs to Cloud Pub/Sub☆23Jul 24, 2020Updated 5 years ago
- Business Data Analysis by HiPIC of CalStateLA☆21Oct 26, 2018Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Writer Identification of Handwritten Documents☆13Oct 18, 2017Updated 8 years ago
- Documentation and tools to help host a sprint on Python core development☆18May 9, 2016Updated 9 years ago
- Some cloud functions helpful to Google Analytics☆13Nov 30, 2018Updated 7 years ago
- A Shiny app to visualise BigQuery data in R. Open sourced so you can deploy on your own Shiny server.☆48Dec 3, 2015Updated 10 years ago
- OpenBlock is a web application and RESTful service that allows users to browse and search their local area for "hyper-local news☆60Jun 10, 2021Updated 4 years ago
- ROP is a simple and extensible framework to display a set of art demos on an LED array (such as FadeCandy) or in ASCII Art on a terminal,…☆19Jun 21, 2022Updated 3 years ago
- Market time series database☆32Jan 14, 2015Updated 11 years ago
- This sample app will get up and running quickly with Hive and/or Pig on a Hadoop cluster on Google Compute Engine. For more information …☆19Jan 9, 2018Updated 8 years ago
- SigOpt's public R client☆13Aug 22, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Generate BigQuery tables, load and extract data, based on JSON Table Schema descriptors.☆18Jun 1, 2021Updated 4 years ago
- A library for running MapReduce jobs on App Engine☆235May 4, 2024Updated 2 years ago
- Decentralized music streaming service made with IPFS and ethereum☆11Feb 19, 2019Updated 7 years ago
- This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-notebooks☆20Jun 6, 2023Updated 2 years ago
- Looking at deploying Shiny apps on Google App Engine with flexible containers☆16Jun 17, 2017Updated 8 years ago
- Load vector tiles from a tilelive source and decorate them with properties from redis.☆10Feb 5, 2024Updated 2 years ago
- Replicates data between Google Cloud BigQuery projects☆22Jul 13, 2016Updated 9 years ago