Awesome list for datapipeline
☆37Feb 6, 2023Updated 3 years ago
Alternatives and similar repositories for awesome-data-pipeline
Users that are interested in awesome-data-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Nov 14, 2024Updated last year
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 2 years ago
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated last year
- The Christmas Project is a festive-themed data engineering initiative designed to integrate and analyze diverse datasets, creating a comp…☆20Jan 11, 2025Updated last year
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆14Aug 1, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A collection of sieve filters for my Proton account.☆16Dec 18, 2022Updated 3 years ago
- Rack middleware that to add cat facts in headers of HTTP responses.☆12Apr 17, 2018Updated 8 years ago
- ☆25Apr 18, 2026Updated 4 months ago
- A module and command line utility for working with the Ikea Tradfri Gateway☆13Jun 29, 2023Updated 3 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆28Nov 8, 2022Updated 3 years ago
- This repository will allow users to create API requests from postman collections at scale.☆15Jun 11, 2026Updated 2 months ago
- Curated List for 2025 Full Time Job Openings by DataDrooler☆25Aug 25, 2025Updated last year
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆25Nov 19, 2024Updated last year
- Displays a button in editor to surround selected text with snippets for convenient codehighlight in the wiki☆16Jan 15, 2020Updated 6 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- automated insights for tabular data☆10Feb 10, 2025Updated last year
- Scrape South African news☆13May 22, 2023Updated 3 years ago
- Keyword extraction using Scake, KeyBERT, Fine-tuning Transformer BERT-like models and ChatGPT.☆12May 22, 2023Updated 3 years ago
- Pure-Python HTML generation☆15Apr 12, 2021Updated 5 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated last year
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated 2 years ago
- Using Siamese LSTM to classify repeated quora questions. Attempted pretrained bert embeddings, Word2Vec and training own embeddings toget…☆10Aug 28, 2020Updated 6 years ago
- Codebase, data and models for the Headline Grouping paper at NAACL2021☆12Oct 2, 2022Updated 3 years ago
- Simulation of delta hedging☆18Jul 15, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Reading comprehension based question-answering model for news articles.☆11Jun 22, 2022Updated 4 years ago
- Atviri savivaldybės biudžeto duomenys☆13Apr 7, 2024Updated 2 years ago
- 3D Mesh Generation from 2D Images in Python☆13Feb 12, 2024Updated 2 years ago
- Triton backend for https://github.com/OpenNMT/CTranslate2☆11Aug 20, 2024Updated 2 years ago
- Skooldio: Data Pipelines with Airflow☆23May 24, 2025Updated last year
- end-to-end information extraction pipeline built by LayoutLMV2, pretrained model from HuggingFace☆11Aug 15, 2023Updated 3 years ago
- A self-contained, ready to run Airflow and Kafka project. Can be run locally or within codespaces.☆16Jul 15, 2023Updated 3 years ago
- Terraform module which creates Redis ElastiCache resources on AWS.☆12Dec 9, 2022Updated 3 years ago
- MapReduce performance testing using teragen and terasort☆19Aug 26, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Private Wiki plugin for Redmine☆17Aug 14, 2013Updated 13 years ago
- ☆43Jan 25, 2026Updated 7 months ago
- Set up 📂-structure for data science projects☆16Nov 15, 2022Updated 3 years ago
- PrintCSS Examples created over the time. Mostly HTML some Markdown.☆15Apr 15, 2022Updated 4 years ago
- This plugin allows creating holiday calendars and assigning them to the users.☆22May 17, 2012Updated 14 years ago
- The code repo for Youtube tutorial series about using Python asyncio with OpenCV to grab frames from video cameras concurrently☆16Oct 3, 2021Updated 4 years ago
- detecting the meotions using by analysing the sound of the person unsing python☆11Oct 7, 2019Updated 6 years ago