Stream/batch system with Hadoop, Spark on NYC taxi data | #DE
☆26Apr 10, 2026Updated 7 months ago
Alternatives and similar repositories for NYC_Taxi_Pipeline
Users that are interested in NYC_Taxi_Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Collect/process data via various data sources : website / js website / API. Run scrapping pipeline via Celery, and Travis cron task. Du…☆15Jul 24, 2024Updated 2 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆25May 14, 2022Updated 4 years ago
- Jupyter Notebook showing how to process Telecom datasets using PySpark (SparkSQL and DataFrames) and plotting the results using Matplotli…☆17Dec 3, 2018Updated 7 years ago
- This is a simple Linear Regression implementation machine learning model and deployment of the same using flask. Data-set of Vadodara Hou…☆10Jan 8, 2020Updated 6 years ago
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Data Engineering & Analysis Project- San Francisco Eviction Data ETL Pipeline An end-to-end batch data pipeline for performing ETL on San…☆10Oct 2, 2025Updated last year
- Data Engineering Project at Insight☆15Nov 17, 2015Updated 11 years ago
- Repository for Code shared in Blogs☆11Jul 28, 2022Updated 4 years ago
- Big data projects implemented by Maniram yadav☆51May 5, 2018Updated 8 years ago
- Data pipeline that scrapes Rust cheater Steam profiles☆53Feb 13, 2022Updated 4 years ago
- Data Engineer-Full time prep guide☆12Apr 1, 2025Updated last year
- Code for 'Contrastive Multi-Document Question Generation'☆11Oct 16, 2022Updated 4 years ago
- Optimizing supply chain management for transparency and auditability☆21Oct 13, 2018Updated 8 years ago
- Nayco(内湖) is all in one micro DataLake for IoT☆11Jan 6, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Core RESTful API interface to CouchDb Documents☆11Mar 8, 2017Updated 9 years ago
- ☆19May 27, 2023Updated 3 years ago
- Liquid glass / acrylic theme mod for Cursor, built on Vibrancy Continued.☆12Apr 23, 2026Updated 6 months ago
- This repository is a directory of all the projects done in the 30-day AI Internship of Pantech Solutions.☆10Nov 3, 2020Updated 6 years ago
- Demo project for creating REST API using AKKA-HTTP backed with Redis☆10Jan 10, 2017Updated 9 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆30May 2, 2023Updated 3 years ago
- Realtime IoT data streaming from Smartphone sensors☆11Aug 26, 2020Updated 6 years ago
- Celebrating 60k followers on Twitter using Flutter and Flare!☆13Sep 17, 2019Updated 7 years ago
- Firebase Firestore on Web, Mobile and Desktop☆12Sep 27, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🍕🍔🍟 Delimenú es una aplicación web para que los restaurantes puedan digitalizar sus menús y de esta manera sus usuarios puedan sentirs…☆10Nov 19, 2024Updated 2 years ago
- ☆12May 12, 2016Updated 10 years ago
- Simple beginner friendly boilerplate for kick-starting your next REST Api☆10Feb 2, 2023Updated 3 years ago
- Create a chatbot that provides responses in Vietnamese, focusing on the products offered by a flower shop☆11Nov 14, 2024Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- ☆11Dec 11, 2022Updated 3 years ago
- ☆13Jun 20, 2023Updated 3 years ago
- A reactive map that handle real time location updates for multiple devices for Flutter☆12Mar 28, 2020Updated 6 years ago
- First attempt at using Flare from 2Dimensions☆16Dec 29, 2018Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple quiz game implemented in Flutter☆10Mar 1, 2018Updated 8 years ago
- A simple boilerplate for a universal progressive web application including some default components built using React + Redux☆13May 2, 2018Updated 8 years ago
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆24Aug 11, 2023Updated 3 years ago
- A DSAuthority for up to 256 roles☆16Jul 29, 2021Updated 5 years ago
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Jan 22, 2024Updated 2 years ago
- GeoFirestore for Flutter to do location based queries with Firestore☆11Jun 6, 2019Updated 7 years ago
- Examples of integrating WireMock (http://wiremock.org) with Scala testing frameworks☆17Nov 9, 2013Updated 13 years ago
Are these results useful?