Stream/batch system with Hadoop, Spark on NYC taxi data | #DE
☆26Apr 10, 2026Updated 6 months ago
Alternatives and similar repositories for NYC_Taxi_Pipeline
Users that are interested in NYC_Taxi_Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simplify Big Data Analytics with Amazon EMR, published by Packt☆13Jan 18, 2023Updated 3 years ago
- I implemented various ETL processes like loading the data using sqoop from mysql to hdfs, transform the data using Spark and Scala, perfo…☆10Oct 20, 2017Updated 9 years ago
- Jupyter Notebook showing how to process Telecom datasets using PySpark (SparkSQL and DataFrames) and plotting the results using Matplotli…☆17Dec 3, 2018Updated 7 years ago
- Collect/process data via various data sources : website / js website / API. Run scrapping pipeline via Celery, and Travis cron task. Du…☆15Jul 24, 2024Updated 2 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆25May 14, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ETL (Extract, Transform and Load) with the Spark Python API (PySpark) and Hadoop Distributed File System (HDFS)☆17Dec 18, 2018Updated 7 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- This project aims to build a streaming application to perform real-time analytics of Covid-19 related tweets and deploy an ML model for r…☆14Jul 15, 2021Updated 5 years ago
- Real-time streaming data pipeline for Twitter Tweets☆10Jan 31, 2022Updated 4 years ago
- a phishing page☆14Aug 7, 2017Updated 9 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- A Project where one can fetch and read tweets and show the analysis like who is most influential☆29Oct 27, 2023Updated 3 years ago
- ☆19May 27, 2023Updated 3 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Nayco(内湖) is all in one micro DataLake for IoT☆11Jan 6, 2023Updated 3 years ago
- Core RESTful API interface to CouchDb Documents☆11Mar 8, 2017Updated 9 years ago
- This repository is a directory of all the projects done in the 30-day AI Internship of Pantech Solutions.☆10Nov 3, 2020Updated 5 years ago
- This project contains a sample Progressive Web App (PWA) that connects to Aras Innovator via RESTful API and OAuth authentication.☆10Oct 23, 2020Updated 6 years ago
- ☆14Jul 13, 2023Updated 3 years ago
- Devery Protocol Smart Contracts☆12Dec 22, 2018Updated 7 years ago
- An example project for Kafka and Spark Streaming integration☆11Apr 21, 2023Updated 3 years ago
- Realtime IoT data streaming from Smartphone sensors☆11Aug 26, 2020Updated 6 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The GitHub repository for the Copenhagen Dependency Treebanks exported from Google Code. The repository is still in the process of being …☆11Jul 4, 2020Updated 6 years ago
- Firebase Firestore on Web, Mobile and Desktop☆12Sep 27, 2021Updated 5 years ago
- Simple beginner friendly boilerplate for kick-starting your next REST Api☆10Feb 2, 2023Updated 3 years ago
- A reactive map that handle real time location updates for multiple devices for Flutter☆12Mar 28, 2020Updated 6 years ago
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆24Aug 11, 2023Updated 3 years ago
- a simple but useful tool to do Exploratory Data Analysis☆12Oct 23, 2019Updated 7 years ago
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Jan 22, 2024Updated 2 years ago
- A DSAuthority for up to 256 roles☆16Jul 29, 2021Updated 5 years ago
- Collection of docker images, helm charts and other tools needed to build DataLake on Kubernetes.☆13Oct 19, 2018Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Python API for Science Parse☆13Mar 27, 2021Updated 5 years ago
- An Efficient Supply Chain Management System using Blockchain & Machine Learning.☆10Nov 27, 2019Updated 6 years ago
- An easy to configure sidebar widget for your flutter mobile/web apps☆15Mar 24, 2021Updated 5 years ago
- a Java port of C# PasswordDeriveBytes class☆13Jun 20, 2017Updated 9 years ago
- This is a responsive single page application built with React Js and hosted on Firebase. Used Node Js for backend and payment system with…☆12Nov 19, 2024Updated last year
- Stream processing guidelines and examples using Apache Flink and Apache Spark☆47Apr 21, 2023Updated 3 years ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆104Dec 3, 2020Updated 5 years ago