Stream/batch system with Hadoop, Spark on NYC taxi data | #DE
☆26Apr 10, 2026Updated 5 months ago
Alternatives and similar repositories for NYC_Taxi_Pipeline
Users that are interested in NYC_Taxi_Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- I implemented various ETL processes like loading the data using sqoop from mysql to hdfs, transform the data using Spark and Scala, perfo…☆10Oct 20, 2017Updated 8 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆25May 14, 2022Updated 4 years ago
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- This is a simple Linear Regression implementation machine learning model and deployment of the same using flask. Data-set of Vadodara Hou…☆10Jan 8, 2020Updated 6 years ago
- Data Generators -> Kafka -> Spark Streaming -> PostgreSQL -> Grafana☆12Jan 31, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The sample maven configuration to build spring boot and angular 5 project together as a war file.☆21Jun 21, 2022Updated 4 years ago
- Big Data Docker Data Science Spark Spark4 Hadoop HDFS Scala Python Artificial Intelligence Machine Learning Jupyter Lab Notebook☆19Sep 6, 2026Updated 2 weeks ago
- Big data projects implemented by Maniram yadav☆51May 5, 2018Updated 8 years ago
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆22Feb 3, 2026Updated 7 months ago
- ☆16May 29, 2023Updated 3 years ago
- Data pipeline that scrapes Rust cheater Steam profiles☆53Feb 13, 2022Updated 4 years ago
- Real-time streaming data pipeline for Twitter Tweets☆10Jan 31, 2022Updated 4 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- A Project where one can fetch and read tweets and show the analysis like who is most influential☆29Oct 27, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- My solutions to the algorithm questions on leetcode.☆14May 9, 2019Updated 7 years ago
- A project to design a fact and dimension star schema for optimizing queries on a flight booking database using PostgreSQL, a relational d…☆12Aug 15, 2021Updated 5 years ago
- Optimizing supply chain management for transparency and auditability☆21Oct 13, 2018Updated 7 years ago
- a phishing page☆14Aug 7, 2017Updated 9 years ago
- ☆19May 27, 2023Updated 3 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆28Nov 8, 2022Updated 3 years ago
- An example project for Kafka and Spark Streaming integration☆11Apr 21, 2023Updated 3 years ago
- Round 1 of 100 days of code in order to learn "Python with Django Framework"☆11Oct 18, 2021Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This project involves an ETL (Extract, Transform, Load) process to analyze sleep data exported from Apple Health☆29Apr 29, 2023Updated 3 years ago
- This repository is a directory of all the projects done in the 30-day AI Internship of Pantech Solutions.☆10Nov 3, 2020Updated 5 years ago
- This project contains a sample Progressive Web App (PWA) that connects to Aras Innovator via RESTful API and OAuth authentication.☆10Oct 23, 2020Updated 5 years ago
- Devery Protocol Smart Contracts☆12Dec 22, 2018Updated 7 years ago
- Crawls emails from web pages☆10Jun 16, 2024Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- A simple boilerplate for a universal progressive web application including some default components built using React + Redux☆13May 2, 2018Updated 8 years ago
- Yahoo! Finance next gen python 3 / pandas market data downloader☆11Feb 22, 2026Updated 6 months ago
- A reactive map that handle real time location updates for multiple devices for Flutter☆12Mar 28, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Create a chatbot that provides responses in Vietnamese, focusing on the products offered by a flower shop☆11Nov 14, 2024Updated last year
- Celebrating 60k followers on Twitter using Flutter and Flare!☆13Sep 17, 2019Updated 7 years ago
- Firebase Firestore on Web, Mobile and Desktop☆12Sep 27, 2021Updated 4 years ago
- The GitHub repository for the Copenhagen Dependency Treebanks exported from Google Code. The repository is still in the process of being …☆11Jul 4, 2020Updated 6 years ago
- 🍕🍔🍟 Delimenú es una aplicación web para que los restaurantes puedan digitalizar sus menús y de esta manera sus usuarios puedan sentirs…☆10Nov 19, 2024Updated last year
- First attempt at using Flare from 2Dimensions☆16Dec 29, 2018Updated 7 years ago
- ☆13Nov 11, 2022Updated 3 years ago