Playground for pyspark (RDDs, DStreams) and Apache Airflow. Based on the example of parsing (including incorrectly formated strings) web server log data
☆18Feb 21, 2022Updated 4 years ago
Alternatives and similar repositories for Web-Server-Log-Analysis-PySpark
Users that are interested in Web-Server-Log-Analysis-PySpark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A complete search engine experience built on top of 75 GB Wikipedia corpus with subsecond latency for searches. Results contain wiki page…☆19Oct 16, 2019Updated 6 years ago
- Multiple coding projects completed in Python☆11Jun 10, 2014Updated 12 years ago
- Simple wrapper over SOLR to emulate Azure Search (for development only)☆12Jul 8, 2017Updated 9 years ago
- This is a guided certification project, as a part of Data Science for Social Good initiative☆18Mar 9, 2020Updated 6 years ago
- Data Engineering Project at Insight☆15Nov 17, 2015Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Analysis and Prediction of the Customer Churn Using Machine Learning Models (Highest Accuracy) and Plotly Library☆14Jan 5, 2023Updated 3 years ago
- Deep learning model of depression detection from activity sensor data☆14Dec 17, 2021Updated 4 years ago
- Python script for comparing two files and finding differences.☆11Jun 22, 2023Updated 3 years ago
- This is the LinkedIn Learning repository for Level Up: Python Data Acquisitions, Prep, & EDA.☆16Mar 4, 2025Updated last year
- Case Studies and Projects in Machine Learning/EDA/DL☆24Jun 18, 2024Updated 2 years ago
- This repository applies Deep Learning techniques for depression detection in text, using LSTM, GRU, BiLSTM, BERT models, and a baseline F…☆19Jul 14, 2023Updated 3 years ago
- Content-based Movie Recommender☆16Aug 17, 2018Updated 7 years ago
- An end-to-end ETL pipeline that extracts weather data, transforms it, and loads it into a PostgreSQL database.☆15Sep 6, 2024Updated last year
- Demand Forecasting Machine Learning System☆17Jul 4, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Jun 19, 2018Updated 8 years ago
- ☆19Feb 7, 2017Updated 9 years ago
- The code for the paper "AnomalyLLM: Few-shot Anomaly Edge Detection for Dynamic Graphs using Large Language Models"☆24Aug 28, 2024Updated last year
- Accident detection system for traffic footage. Using computer vision and ML to detect and analyze accidents in a CCTV footage in real-tim…☆23Jul 14, 2023Updated 3 years ago
- Here's how to get DataQuest's Data Engineering Track missions' content to work on your localhost. Using data from my Valenbisi ARIMA mode…☆17Jul 17, 2018Updated 8 years ago
- Follow the Lumiata Tech Blog on Medium!☆20May 8, 2023Updated 3 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆12Jul 16, 2019Updated 7 years ago
- Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.☆21Jan 30, 2019Updated 7 years ago
- ( These solutions tested on 4 node Hortonwork cluster on my laptop. Do not test on your production environment until you test... :)☆20Apr 18, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A UI state management library to build js apps against Azure Search☆23Oct 30, 2018Updated 7 years ago
- Raspberry Pi streaming demo with Standalone Kafka☆22Jan 22, 2020Updated 6 years ago
- Simple way to send ether.☆22Nov 23, 2020Updated 5 years ago
- ☆25Oct 13, 2019Updated 6 years ago
- End-to-end data engineering pipeline with various technologies to ingest real time data.☆28Nov 3, 2023Updated 2 years ago
- A simple spark standalone cluster for your testing environment purposses☆23Jul 25, 2020Updated 5 years ago
- A python script that uses the Tweepy library to pull Tweets from Twitter's Streaming API, and then stores the important fields in a Mongo…☆23Aug 19, 2014Updated 11 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Jun 7, 2021Updated 5 years ago
- ☆32Oct 14, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Ethereum Smart Contract to keep ether locked for a period of time so you don't trade your gains into oblivion☆27Mar 13, 2017Updated 9 years ago
- High-fidelity Google Cloud Platform (GCP) emulator for local development. Built with Go.☆42May 4, 2026Updated 2 months ago
- A kickass Quiz app designed to be run inside an organization - users can register and take a quiz everyday. Also features a full-fledged …☆30Dec 17, 2014Updated 11 years ago
- A simple Spark TDD example☆26Sep 19, 2017Updated 8 years ago
- Scrapy as a Web Crawler for Azure Search Samples☆21Aug 16, 2017Updated 8 years ago
- Project analyzing Airbnb Rental data☆33Dec 13, 2018Updated 7 years ago
- This repo is for linkedin learning course: Complete Guide to SQL for Data Engineering: from Beginner to Advanced☆48Mar 20, 2025Updated last year