Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs. Out of the box it will load files from a source, transform them and then output them (output might be writing to a file or loading them into a data analysis tool). It is designed to be modular and support var…
☆87Feb 11, 2014Updated 12 years ago
Alternatives and similar repositories for Data-Pipeline
Users that are interested in Data-Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cloud Pub/Sub sample applications with Python☆72Jul 13, 2016Updated 10 years ago
- makeViewerUrl☆92May 20, 2024Updated 2 years ago
- Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.☆163May 31, 2017Updated 9 years ago
- Small python logging handlers that directly send the logs to Cloud Pub/Sub☆23Jul 24, 2020Updated 6 years ago
- ☆25Sep 23, 2015Updated 11 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Automated building and packaging of Tensorflow models in the cloud, and running them on devices☆15Dec 28, 2018Updated 7 years ago
- An example that shows how to periodically launch a Dataflow analytics pipeline from GAE Flex, that reads from Datastore.☆42Oct 24, 2017Updated 8 years ago
- Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub☆131Oct 20, 2020Updated 5 years ago
- Demonstrates how to extract and transform data from the Datastore into a format suitable for ingestion by Google BigQuery, via the App En…☆16Sep 23, 2015Updated 11 years ago
- ☆17Sep 14, 2022Updated 4 years ago
- This sample app will get up and running quickly with Hive and/or Pig on a Hadoop cluster on Google Compute Engine. For more information …☆19Jan 9, 2018Updated 8 years ago
- Go/App Engine sample for service account☆41Sep 23, 2015Updated 11 years ago
- Titan for App Engine☆45Oct 3, 2015Updated 11 years ago
- ☆35Nov 28, 2013Updated 12 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- "Last Across the Finish Line" is an example application that uses the Task Queue API to showcase a pattern for tracking asynchronous batc…☆16Dec 11, 2013Updated 12 years ago
- ☆22Jun 23, 2015Updated 11 years ago
- A library for running MapReduce jobs on App Engine☆235May 4, 2024Updated 2 years ago
- Experiment deploying Rstudio to Google AppEngine☆11Sep 3, 2017Updated 9 years ago
- Activity Streams website☆11Sep 30, 2020Updated 6 years ago
- ☆144Sep 28, 2020Updated 6 years ago
- Python Client for Instagram API☆11Sep 29, 2017Updated 9 years ago
- Uploads and downloads files between Google Cloud Storage and the local filesystem using the Google Python Client Library.☆99Mar 1, 2017Updated 9 years ago
- Auth plugin allowing use the use of OAuth 2.0 credentials for Google Cloud Storage in the Boto library.☆22Jun 24, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A ubiquitous mini-profiler for Google App Engine, inspired by mvc-mini-profiler☆269Apr 23, 2019Updated 7 years ago
- Apache Beam example project☆13Oct 16, 2019Updated 7 years ago
- A small sample showing how to build an internationalized app with App Engine☆28Sep 28, 2015Updated 11 years ago
- ☆10Oct 25, 2013Updated 12 years ago
- ☆11Apr 10, 2019Updated 7 years ago
- *luigi-gcloud* is an luigi extension that enables full support for the Google Cloud Platform. Making it possible to do complex orchestrat…☆43May 13, 2016Updated 10 years ago
- Documentation and tools to help host a sprint on Python core development☆19May 9, 2016Updated 10 years ago
- Third-party vendoring helper for Google App Engine and other sandboxed python environments.☆11Jun 1, 2015Updated 11 years ago
- A Shiny app to visualise BigQuery data in R. Open sourced so you can deploy on your own Shiny server.☆48Dec 3, 2015Updated 10 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Writer Identification of Handwritten Documents☆13Oct 18, 2017Updated 9 years ago
- Client library for use with Google Cloud Datastore from within the Google App Engine Python runtime.☆114Oct 20, 2022Updated 3 years ago
- An AngularDart application -- Tic-Tac-Toe! Two-player only.☆13Dec 6, 2017Updated 8 years ago
- ☆15Sep 2, 2013Updated 13 years ago
- mrlin is 'MapReduce processing of Linked Data' … because it's magic☆16Nov 1, 2012Updated 13 years ago
- Examples of Using R with Google Cloud AI☆12Apr 8, 2019Updated 7 years ago
- CloudFormation template used in the tutorial for creating VPC Endpoints for SQS. This template creates and configures the AWS resources n…☆13Sep 5, 2021Updated 5 years ago